-- Logs begin at Mon 2022-10-03 13:49:57 UTC, end at Mon 2022-10-03 16:19:42 UTC. -- Oct 03 14:22:04.794467 n-d-781139-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 14:22:04.803902 n-d-781139-2 devstack@n-api.service[106398]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 14:22:04 2022] *** Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: nodename: n-d-781139-2 Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: machine: x86_64 Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: clock source: unix Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: pcre jit disabled Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: detected number of CPU cores: 4 Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: current working directory: / Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: detected binary path: /usr/bin/uwsgi-core Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: your processes number limit is 47680 Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: your memory page size is 4096 bytes Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: detected max file descriptor number: 2048 Oct 03 14:22:04.805948 n-d-781139-2 devstack@n-api.service[106398]: lock engine: pthread robust mutexes Oct 03 14:22:04.806796 n-d-781139-2 devstack@n-api.service[106398]: thunder lock: enabled Oct 03 14:22:04.806796 n-d-781139-2 devstack@n-api.service[106398]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 14:22:04.806796 n-d-781139-2 devstack@n-api.service[106398]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 14:22:04.845010 n-d-781139-2 devstack@n-api.service[106398]: Python main interpreter initialized at 0x556ce02a09c0 Oct 03 14:22:04.845010 n-d-781139-2 devstack@n-api.service[106398]: python threads support enabled Oct 03 14:22:04.845010 n-d-781139-2 devstack@n-api.service[106398]: your server socket listen backlog is limited to 100 connections Oct 03 14:22:04.845010 n-d-781139-2 devstack@n-api.service[106398]: your mercy for graceful operations on workers is 90 seconds Oct 03 14:22:04.845370 n-d-781139-2 devstack@n-api.service[106398]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 14:22:04.845370 n-d-781139-2 devstack@n-api.service[106398]: *** Operational MODE: preforking *** Oct 03 14:22:04.845665 n-d-781139-2 devstack@n-api.service[106398]: *** uWSGI is running in multiple interpreter mode *** Oct 03 14:22:04.845665 n-d-781139-2 devstack@n-api.service[106398]: spawned uWSGI master process (pid: 106398) Oct 03 14:22:04.845856 n-d-781139-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 03 14:22:04.847118 n-d-781139-2 devstack@n-api.service[106398]: spawned uWSGI worker 1 (pid: 106399, cores: 1) Oct 03 14:22:04.847118 n-d-781139-2 devstack@n-api.service[106398]: spawned uWSGI worker 2 (pid: 106400, cores: 1) Oct 03 14:22:04.847118 n-d-781139-2 devstack@n-api.service[106398]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 14:22:05.498177 n-d-781139-2 devstack@n-api.service[106400]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:22:05.507872 n-d-781139-2 devstack@n-api.service[106399]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:22:06.568515 n-d-781139-2 devstack@n-api.service[106400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:22:06.568515 n-d-781139-2 devstack@n-api.service[106400]: from cryptography.utils import int_from_bytes Oct 03 14:22:06.569154 n-d-781139-2 devstack@n-api.service[106400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:22:06.569154 n-d-781139-2 devstack@n-api.service[106400]: from cryptography.utils import int_from_bytes Oct 03 14:22:06.571123 n-d-781139-2 devstack@n-api.service[106399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:22:06.571123 n-d-781139-2 devstack@n-api.service[106399]: from cryptography.utils import int_from_bytes Oct 03 14:22:06.571574 n-d-781139-2 devstack@n-api.service[106399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:22:06.571574 n-d-781139-2 devstack@n-api.service[106399]: from cryptography.utils import int_from_bytes Oct 03 14:22:09.037056 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:22:09.037589 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:22:09.037833 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:22:09.038195 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:22:09.038421 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:22:09.038820 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.039136 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.039452 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.039764 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.040085 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.040391 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.040712 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.041041 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.041349 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.041605 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.041914 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.042232 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-781139-2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.042556 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.042668 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:22:09.043032 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.043123 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:22:09.043264 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.043430 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.043574 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:22:09.043733 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.043825 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:22:09.044026 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:22:09.044116 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.044342 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.044457 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.044715 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.044874 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.045038 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046033 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046185 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046304 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046406 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046489 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046577 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046672 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046754 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046839 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.046929 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047017 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047097 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047236 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047322 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047409 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047490 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047636 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047775 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-781139-2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.047937 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.048030 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.048304 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.048394 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-781139-2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.048607 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.048757 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.048890 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.049011 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.049240 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.049342 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.049559 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.049657 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.049862 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.050103 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.050309 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.050624 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.050724 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.050942 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.051036 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.051242 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.051347 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.051554 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.051645 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.051860 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.051966 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.052174 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.052274 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.052479 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.052629 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.052777 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.052883 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.053103 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.053209 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.053403 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.053495 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.053717 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.053828 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054015 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054121 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-781139-2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054308 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054469 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054556 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054678 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054823 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.054988 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.055135 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.055400 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.055489 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.055708 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.055796 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.055982 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.056082 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.056225 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.056315 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.056535 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.056630 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.056847 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.056981 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.057182 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.057271 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.057482 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.057578 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.057781 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.057869 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.058077 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.058183 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.058381 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.058468 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.058676 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.058764 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.058973 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.059067 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.059272 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.059360 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.059580 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.059669 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.059888 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.059974 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.060135 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.060239 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.060442 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.060529 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.060759 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.060852 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.061099 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.061200 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.061402 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.061490 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.061652 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.061739 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.061900 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.062017 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.062216 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.062310 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.062533 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.062620 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.062838 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.062993 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.063140 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.063227 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.063441 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.063529 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.063742 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.063830 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.064042 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.064143 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.064344 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.064431 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.064646 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.064751 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.064955 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.065045 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.065203 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.065307 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.065498 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.065586 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.065896 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.065984 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.066202 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.066303 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.066517 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.066610 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.066864 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.066949 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.067161 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.067256 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.067453 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.067539 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.067752 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.067839 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.068051 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.068148 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.068347 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.068443 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.068644 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.068744 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.068974 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.069067 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.069256 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.069355 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.069552 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.069640 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.069848 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.069936 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.070147 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.070235 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.070441 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.070528 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.070750 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.070851 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.070993 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.071080 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.071291 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.071404 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.071590 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.071689 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.071900 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.072051 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.072303 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.072422 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.072543 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.072657 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.072777 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.072914 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.073093 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.073180 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.073391 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.073480 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.073687 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.073774 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.073982 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.074080 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.074280 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.074368 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.074572 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.074700 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.074867 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.075034 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.075164 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.075291 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.075452 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.075538 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.075749 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.075844 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.076047 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.076134 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.076340 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.076430 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.076636 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.076742 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.076968 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.077060 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.077246 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.077342 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.077539 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.077636 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.077832 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.077921 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.078124 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.078210 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.078417 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.078522 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.078707 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.078794 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079012 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079143 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079310 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079406 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079605 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079691 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079898 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.079985 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.080192 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.080287 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.080490 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.080576 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.080803 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.080890 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.081134 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.081296 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.081490 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.081661 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.081969 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.082061 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.082276 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.082364 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.082578 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.082672 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.082876 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.083007 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.083174 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.083263 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.083474 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.083575 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.083774 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.083871 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.084070 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.084168 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.084370 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.084457 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.084663 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.084800 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.084999 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.085110 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.085310 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.085409 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.085612 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.085708 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.085913 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.086000 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.086214 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.086301 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.086522 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.086616 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:22:09.086826 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.086914 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.087139 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.087228 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.087460 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.087557 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.087772 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.087866 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.088077 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.088173 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.088409 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.088549 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.088720 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.088807 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.089062 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.089154 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.089375 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.089467 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.089686 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.089775 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.089991 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.090078 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.090291 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.090379 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.090596 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.090692 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.090906 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.091002 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.091220 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.091308 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.091522 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.091618 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.091830 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.091925 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.092143 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.092243 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.092456 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.092542 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.092763 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.092858 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.093091 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.093183 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.093396 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.093483 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.093699 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.093797 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.094001 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.094098 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.094328 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.094415 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.094634 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.094731 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.094949 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.095040 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.095260 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.095348 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.095565 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.095670 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.095872 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.095965 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.096171 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.096265 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.096474 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.096572 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.096777 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.096886 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.097123 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.097214 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.097423 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.097513 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.097720 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.097816 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.098021 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.098108 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.098319 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.098407 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.098629 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.098723 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.098947 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.099036 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.099249 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.099373 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.099555 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.099652 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.099858 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.099959 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.100163 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.100251 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.100467 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.100555 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.100771 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.100871 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.101094 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.101184 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.101400 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.101487 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.101703 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.101800 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.102003 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.102091 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.102320 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.102407 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.102627 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.102724 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.102925 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.103018 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.103229 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.103328 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.103526 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.103622 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.103827 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.103914 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.104130 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.104227 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.104431 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.104518 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.104735 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.104822 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.105068 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.105179 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.105374 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.105463 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.105688 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.105824 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.105990 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.106126 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.106295 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.106445 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.106607 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.106743 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.106912 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.107055 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.107222 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.107364 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.107530 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.107704 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.107856 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.108001 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.108143 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.108277 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.108436 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.108570 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.108734 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.108884 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.109079 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.109173 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.109391 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.109526 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.109697 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.109799 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110003 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110091 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110302 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110389 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110601 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110698 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110898 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.110994 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.111198 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.111285 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.111496 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.111584 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.111808 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.111895 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.112107 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.112195 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.112412 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.112552 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.112759 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.112905 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.113089 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.113375 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.113524 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.113670 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.113804 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.113985 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.114117 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.114302 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.114391 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.114608 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.114695 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.114917 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.115003 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.115222 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.115311 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.115523 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.115610 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.115825 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.115959 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.116130 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.116266 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.116431 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.116567 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.116732 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.116867 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.117055 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.117191 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.117333 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.117466 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.117632 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.117769 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.117946 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.118088 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.118250 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.118398 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.118545 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.118685 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.118832 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.118965 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.119128 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.119262 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.119431 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.119593 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.119758 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.119899 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.120080 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.120214 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.120389 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.120541 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.120705 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.120841 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.121034 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.121169 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.121344 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.121490 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.121649 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.121784 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.121952 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.122086 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.122253 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.122398 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.122559 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.122694 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.122869 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.123003 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.123172 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.123316 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.123480 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.123597 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.123777 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.123876 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.124093 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.124232 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.124383 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.124523 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.124686 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.124822 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.125055 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.125190 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.125324 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.125456 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.125609 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.125729 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.125934 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.126082 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.126228 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.126362 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.126528 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.126673 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.126843 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.126978 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.127150 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.127284 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.127453 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.127602 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.127758 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.127892 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.128054 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.128276 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.128433 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.128577 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.128711 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.128847 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129001 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129132 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129267 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129411 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129566 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129702 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129867 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.129966 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.130176 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.130265 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.130480 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.130569 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.130777 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.130864 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.131075 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.131164 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.131380 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.131481 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.131695 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.131791 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.131999 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.132088 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.132319 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.132415 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.132634 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.132722 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133003 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133097 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133252 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133339 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133567 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133668 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133870 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.133959 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.134171 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.134257 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.134467 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.134563 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.134765 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.134859 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.135077 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.135164 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.135389 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.135485 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.135685 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.135780 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.135987 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.136076 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.136300 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.136398 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.136601 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.136688 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.136901 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.137006 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.137228 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.137317 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.137528 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.137622 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.137844 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.137929 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.138149 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.138236 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.138454 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.138542 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.138761 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.138862 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.139066 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.139203 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.139367 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.139510 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.139671 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.139819 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.139977 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.140075 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.140278 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.140365 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.140577 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.140672 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.140876 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.140981 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.141197 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.141286 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.141500 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.141620 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.141811 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.141907 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.142141 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.142382 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.142470 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.142710 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.142811 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.143021 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.143109 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.143334 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.143421 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.143639 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.143763 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.144021 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.144180 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.144353 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.144443 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.144641 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.144739 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.144986 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.145090 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.145271 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.145360 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.145576 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.145679 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.145879 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.146013 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.146180 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.146269 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.146487 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.146584 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.146786 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.146875 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.147085 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.147183 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.147384 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.147827 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.148046 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.148132 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.148344 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.148440 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.148644 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.148908 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.149010 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.149247 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.149349 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.149558 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.149664 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.149858 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.149947 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.150163 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.150251 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.150464 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.150563 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.150780 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.150942 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.151083 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.151183 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.151380 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.151483 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.151678 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.151766 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.151974 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.152070 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.152306 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.152402 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.152607 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.152694 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.152918 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.153097 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.153246 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.153343 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.153550 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.153643 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.153855 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.153955 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.154165 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.154262 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.154474 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.154619 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.154766 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.154901 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.155046 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.155183 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.155318 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.155454 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.155626 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.155762 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.155930 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.156022 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.156231 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.156365 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.156535 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.156667 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.156837 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.156998 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.157164 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.157300 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.157462 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.157607 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.157749 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.157884 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.158028 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.158169 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.158323 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.158467 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.158631 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.158774 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.158934 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.159078 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.159239 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.159368 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.159563 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.159712 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.159887 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.160023 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.160171 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.160313 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.160466 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.160640 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.160768 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.160970 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.161132 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.161282 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.161419 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.161560 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.161695 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.161865 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.162024 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.162168 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.162302 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.162461 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.162603 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.162768 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.162917 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.163076 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.163207 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.163387 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.163525 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.163688 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.163832 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.163976 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.164110 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.164272 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.164406 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.164568 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.164713 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.164856 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.165035 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.165175 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.165310 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.165453 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.165588 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.165767 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.165903 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.166072 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.166222 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.166364 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.166499 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.166642 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.166785 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.166942 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.167086 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.167227 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.167365 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.167524 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.167666 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.167826 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.167968 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.168111 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.168246 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.168404 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.168539 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.168701 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.168846 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.169005 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.169136 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.169303 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.169435 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.169617 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.169763 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.169919 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.170132 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.170271 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.170404 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.170539 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.170686 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.170822 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.170955 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.171087 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.171225 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.171360 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.171517 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.171653 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.171786 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.171964 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.172101 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.172281 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.172419 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.172585 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.172721 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.172895 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.173091 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.173238 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.173369 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.173514 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.173654 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.173787 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.173922 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.174090 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.174233 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.174391 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.174538 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.174678 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.174820 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.174984 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.175146 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.175315 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.175508 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.175649 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.175799 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.175935 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.176079 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.176216 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.176348 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.176513 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.176725 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.176868 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.177026 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.177162 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.177312 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.177448 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.177601 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.177736 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.177872 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.178007 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.178141 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.178301 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.178451 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.178594 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.178729 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.178893 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.179028 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.179199 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.179345 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.179487 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.179582 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.179793 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.179882 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.180097 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.180245 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.180401 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.180489 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.180699 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.180787 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.181026 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.181130 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.181330 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.181418 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.181629 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.181727 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.181943 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.182047 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.182249 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.182337 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.182544 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.182630 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.182846 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.182935 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.183142 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.183239 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.183445 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.183546 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.183743 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.183840 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.184055 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.184188 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.184367 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.184478 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.184676 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.184774 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.185010 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.185120 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.185321 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.185432 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.185630 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.185726 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.185936 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.186030 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.186239 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.186361 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.186536 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.186634 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.186845 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.186932 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.187148 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.187237 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.187456 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.187544 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.187762 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.187849 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.188067 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.188155 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.188380 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.188473 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.188686 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.188772 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.189012 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.189104 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.189319 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.189409 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.189615 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.189713 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.189915 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.190003 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.190212 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.190333 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.190513 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.190658 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.190853 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.191015 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.191256 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.191346 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.191559 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.191660 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.191859 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.191947 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.192164 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.192278 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.192476 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.192577 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.192791 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.192887 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.193123 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.193224 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.193498 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.193639 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.193816 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.193904 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.194115 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.194202 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.194421 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.194508 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.194719 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.194811 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.195018 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.195105 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.195327 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.195415 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.195625 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.195720 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.195933 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.196021 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.196232 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.196329 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.196540 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.196665 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.196851 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.196958 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.197183 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.197273 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.197498 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.197587 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.197903 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.197992 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.198208 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.198295 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.198509 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.198597 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.198822 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.198909 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.199143 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.199240 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.199447 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.199536 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.199745 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.199836 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.200050 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.200148 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.200349 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.200445 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.200649 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.200736 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.200983 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.201092 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.201288 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.201377 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.201594 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.201690 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.201899 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.201997 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.202224 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.202357 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.202509 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.202599 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.202806 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.202894 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.203119 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.203213 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.203417 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.203505 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.203732 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.203821 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.204043 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.204130 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.204364 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.204504 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.204677 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.204849 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.205048 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.205188 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.205331 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.205477 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.205621 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.205758 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.205899 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.206035 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.206170 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.206356 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.206540 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.206688 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.206822 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.206984 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.207104 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.207290 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.207420 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.207613 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.207747 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.207918 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.208068 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.208230 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.208455 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.208545 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.208790 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.208886 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.209135 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.209238 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.209435 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.209531 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.209740 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.209827 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.210042 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.210138 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.210357 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.210444 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.210659 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.210749 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.210957 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.211046 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.211259 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.211348 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.211559 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.211647 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.211859 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.211949 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.212162 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.212258 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.212462 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.212549 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.212758 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.212846 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.213081 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.213182 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.213380 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.213478 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.213695 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.213821 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.213995 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.214084 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.214311 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.214413 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.214613 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.214710 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.214911 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.215007 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.215207 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.215340 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.215503 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.215592 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.215838 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.215933 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.216135 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.216225 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.216453 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.216540 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.216756 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.216879 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.217092 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.217182 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.217396 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.217484 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.217703 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.217789 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.218005 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.218094 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.218309 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.218397 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.218612 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.218706 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.218919 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.219008 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.219222 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.219309 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.219550 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.219662 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.219818 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.219906 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.220122 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.220210 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.220426 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.220522 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.220748 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.220981 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.221087 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.221277 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.221366 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.221589 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.221679 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.221924 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.222024 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.222307 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.222395 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.222610 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.222700 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.222937 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.223024 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.223247 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.223344 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.223552 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.223639 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.223859 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.223956 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.224166 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.224268 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.224476 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.224564 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.224789 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.224876 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.225130 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.225231 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.225443 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.225531 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.225755 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.225842 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.226059 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.226155 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.226367 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.226455 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.226675 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.226763 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.226987 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.227074 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.227318 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.227499 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.227624 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.227826 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.227922 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.228140 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.228228 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.228453 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.228548 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.228765 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.228861 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.229104 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.229193 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.229418 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.229518 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.229723 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.229813 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.230030 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.230169 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.230339 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.230496 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.230647 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.230782 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.230939 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.231076 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.231257 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.231402 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.231581 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.231717 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.231892 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.232028 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.232205 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.232360 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.232515 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.232651 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.232824 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.232975 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.233159 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.233355 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.233514 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.233654 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.233831 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.233967 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.234137 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.234290 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.234449 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.234601 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.234762 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.234895 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.235077 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.235209 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.235386 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.235522 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.235693 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.235830 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.236008 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.236152 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.236303 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.236444 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.236610 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.236755 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.236892 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.237002 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.237240 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.237373 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.237600 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.237778 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.237913 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.238057 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.238227 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.238386 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.238545 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.238690 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.238837 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.239138 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.239274 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.239453 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.239590 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.239777 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.239970 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.240106 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.240286 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.240406 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.240626 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.240716 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.240959 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.241064 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.241293 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.241382 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.241606 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.241712 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.241921 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.242011 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.242238 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.242340 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.242541 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.242637 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.242839 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.242926 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.243140 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.243257 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.243449 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.243542 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.243749 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.243836 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.244049 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.244147 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.244353 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.244442 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.244652 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.244741 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.244990 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.245136 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.245294 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.245382 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.245596 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.245817 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.245906 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.246157 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.246254 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.246471 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.246566 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.246770 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.246869 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.247069 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.247199 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.247368 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.247456 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.247673 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.247770 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.247972 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.248070 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.248276 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.248374 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.248575 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.248672 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.248900 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.249013 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.249212 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.249311 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.249516 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.249616 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.249821 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.249910 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.250131 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.250219 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.250428 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.250517 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.250728 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.250823 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.251031 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.251117 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.251332 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.251419 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.251647 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.251735 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.251948 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.252035 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.252252 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.252349 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.252554 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.252642 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.252863 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.253008 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.253243 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.253464 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.253555 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.253793 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.253882 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.254114 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.254248 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.254420 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.254516 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.254722 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.254810 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.255030 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.255119 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.255329 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.255417 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.255629 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.255725 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.255947 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.256037 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.256255 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.256342 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.256554 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.256641 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.256902 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.257057 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.257183 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.257273 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.257487 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.257589 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.257793 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.257890 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.258097 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.258197 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.258395 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.258563 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.258696 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.258785 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.258997 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.259087 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.259298 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.259396 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.259602 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.259699 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.259903 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.260150 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.260283 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.260481 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.260577 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.260800 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.260896 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.261140 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.261242 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.261452 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.261541 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.261760 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.261847 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.262064 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.262171 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.262367 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.262457 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.262668 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.262754 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.262973 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.263071 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.263275 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.263363 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.263579 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.263666 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.263887 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.263976 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.264196 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.264320 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.264494 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.264583 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.264799 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.265132 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.265219 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.265441 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.265531 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.265748 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.265846 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.266057 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.266145 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.266359 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.266445 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.266663 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.266752 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.266971 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.267059 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.267276 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.267374 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.267590 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.267679 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.267896 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.267992 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.268206 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.268294 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.268520 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.268617 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.268860 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.269016 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.269197 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.269304 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.269496 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.269584 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.269795 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.269885 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.270093 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.270191 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.270397 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.270494 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.270710 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.270798 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.271017 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.271121 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.271317 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.271413 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.271615 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.271916 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.272003 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.272222 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.272319 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.272875 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.272988 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.273198 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.273300 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.273498 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.273587 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.273802 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.273890 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.274098 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.274195 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.274397 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.274492 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.274694 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.274783 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.274991 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.275093 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.275289 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.275377 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.275588 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.275676 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.275889 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.275978 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.276188 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.276299 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.276486 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.276606 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.276782 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.276912 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.277103 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.277238 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.277401 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.277547 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.277725 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.277863 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.278050 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.278171 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.278361 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.278478 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.278676 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.278786 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.278980 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.279105 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.279293 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.279390 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.279593 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.279682 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.279908 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.280000 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.280222 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.280319 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.280527 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.280624 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.280823 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.280919 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.281158 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.281260 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.281459 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.281546 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.281759 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.281847 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.282061 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.282162 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.282360 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.282448 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.282661 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.282748 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.282959 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.283047 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.283261 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.283349 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.283563 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.283651 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.283861 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.283948 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.284158 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.284250 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.284558 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.284650 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.284887 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.284995 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.285220 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.285308 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.285528 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.285631 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.285849 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.285938 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.286155 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.286245 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.286464 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.286561 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.286774 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.286862 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.287082 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.287170 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.287386 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.287549 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.287690 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.287785 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.287998 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.288086 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.288301 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.288397 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.288608 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.288695 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.288910 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.289068 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.289246 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.289364 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.289552 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.289660 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.289853 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.289952 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.290170 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.290269 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.290493 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.290594 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.290799 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.290888 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.291115 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.291215 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.291427 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.291522 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.291743 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.291841 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.292049 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.292144 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.292356 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.292452 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.292653 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.292748 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.292891 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:22:09.293000 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.293295 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.293601 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.293908 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.294215 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.294527 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.294836 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.295141 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.295459 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.295771 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.296092 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.296416 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.296724 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.297072 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.297398 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.297740 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.298048 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.298390 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.298717 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.299029 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.299341 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.299642 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:22:09.299880 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:22:09.448889 n-d-781139-2 devstack@n-api.service[106400]: INFO dbcounter [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Registered counter for database nova_api Oct 03 14:22:09.462343 n-d-781139-2 devstack@n-api.service[106399]: INFO dbcounter [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Registered counter for database nova_api Oct 03 14:22:09.469953 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_db.sqlalchemy.engines [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.477016 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writer thread running {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:09.482882 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_db.sqlalchemy.engines [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.489951 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writer thread running {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:09.532772 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.context [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=106400) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:22:09.536689 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:22:09.537204 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:22:09.538815 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:22:09.539539 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:22:09.539969 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:22:09.541996 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:22:09.544012 n-d-781139-2 devstack@n-api.service[106400]: INFO dbcounter [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Registered counter for database nova_cell0 Oct 03 14:22:09.546360 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.context [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=106399) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:22:09.548113 n-d-781139-2 devstack@n-api.service[106400]: INFO dbcounter [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Registered counter for database nova_cell1 Oct 03 14:22:09.550368 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_concurrency.lockutils [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:22:09.551043 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_concurrency.lockutils [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:22:09.552610 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_concurrency.lockutils [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:22:09.553392 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_concurrency.lockutils [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:22:09.553835 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_concurrency.lockutils [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:22:09.555558 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_db.sqlalchemy.engines [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.555845 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_concurrency.lockutils [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:22:09.556913 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_db.sqlalchemy.engines [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.557981 n-d-781139-2 devstack@n-api.service[106399]: INFO dbcounter [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Registered counter for database nova_cell0 Oct 03 14:22:09.562054 n-d-781139-2 devstack@n-api.service[106399]: INFO dbcounter [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Registered counter for database nova_cell1 Oct 03 14:22:09.563614 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writer thread running {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:09.565230 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writer thread running {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:09.571410 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_db.sqlalchemy.engines [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.572659 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_db.sqlalchemy.engines [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.579273 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writer thread running {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:09.581674 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writer thread running {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:09.706735 n-d-781139-2 devstack@n-api.service[106400]: INFO dbcounter [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Registered counter for database nova_cell0 Oct 03 14:22:09.714133 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_db.sqlalchemy.engines [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.719910 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writer thread running {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:09.726009 n-d-781139-2 devstack@n-api.service[106399]: INFO dbcounter [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Registered counter for database nova_cell0 Oct 03 14:22:09.735542 n-d-781139-2 devstack@n-api.service[106399]: DEBUG oslo_db.sqlalchemy.engines [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:22:09.740949 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writer thread running {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:22:10.058795 n-d-781139-2 devstack@n-api.service[106400]: WARNING keystonemiddleware.auth_token [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:22:10.063159 n-d-781139-2 devstack@n-api.service[106399]: WARNING keystonemiddleware.auth_token [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:22:10.066330 n-d-781139-2 devstack@n-api.service[106400]: WARNING keystonemiddleware.auth_token [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:22:10.070804 n-d-781139-2 devstack@n-api.service[106399]: WARNING keystonemiddleware.auth_token [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:22:10.406535 n-d-781139-2 devstack@n-api.service[106400]: WARNING keystonemiddleware.auth_token [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:22:10.412551 n-d-781139-2 devstack@n-api.service[106400]: WARNING keystonemiddleware.auth_token [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:22:10.417830 n-d-781139-2 devstack@n-api.service[106400]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556ce02a09c0 pid: 106400 (default app) Oct 03 14:22:10.418300 n-d-781139-2 devstack@n-api.service[106399]: WARNING keystonemiddleware.auth_token [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:22:10.419907 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:22:10.421201 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001816 Oct 03 14:22:10.421593 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Oct 3 14:22:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:22:10.425123 n-d-781139-2 devstack@n-api.service[106399]: WARNING keystonemiddleware.auth_token [None req-dc74842c-146e-415f-b44e-622c53257f6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:22:10.430442 n-d-781139-2 devstack@n-api.service[106399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556ce02a09c0 pid: 106399 (default app) Oct 03 14:23:32.427097 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:32.428715 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002190 Oct 03 14:23:32.431272 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:32.445396 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_api:SELECT=3 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:32.447824 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_cell0:SELECT=3 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:32.448724 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_cell1:SELECT=3 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:32.449630 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_cell0:SELECT=3 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:33.324411 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-8ef5d2a5-eac8-4e82-942e-96b6404b41bd admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:33.357265 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-8ef5d2a5-eac8-4e82-942e-96b6404b41bd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.921064 Oct 03 14:23:33.358163 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:23:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:23:35.966645 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:35.967660 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-6ab1ab70-a851-498d-b5a3-c8548bb76dda None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 03 14:23:35.973285 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:35 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:36.411302 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-c304bc70-b090-40e9-baae-c6528225e514 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:36.460457 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-c304bc70-b090-40e9-baae-c6528225e514 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486022 Oct 03 14:23:36.461046 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:23:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:23:36.475094 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writing DB stats nova_api:SELECT=3 {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:36.475965 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writing DB stats nova_cell1:SELECT=3 {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:36.478468 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writing DB stats nova_cell0:SELECT=3 {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:36.478741 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:23:36.690840 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-5dedc8d5-900c-40e2-bf44-bbaa066bc897 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:36.760107 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-5dedc8d5-900c-40e2-bf44-bbaa066bc897 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290182 Oct 03 14:23:36.761397 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 3 14:23:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:23:39.392775 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-c304bc70-b090-40e9-baae-c6528225e514 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:39.393999 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-c304bc70-b090-40e9-baae-c6528225e514 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Oct 03 14:23:39.394570 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:40.228287 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-58d6de97-7905-429a-a04c-1653e731f699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:40.289565 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-58d6de97-7905-429a-a04c-1653e731f699 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.887065 Oct 03 14:23:40.297800 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:23:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:23:40.308698 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-4a8c13aa-5157-4ecf-b12b-48dcc753185e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:40.371407 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-4a8c13aa-5157-4ecf-b12b-48dcc753185e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071373 Oct 03 14:23:40.380973 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 3 14:23:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:23:43.147705 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-58d6de97-7905-429a-a04c-1653e731f699 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:43.148739 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-58d6de97-7905-429a-a04c-1653e731f699 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 03 14:23:43.149431 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:43.699321 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-9ed72893-5609-4f3f-92aa-6c687fe2345b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2"}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:43.740989 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-9ed72893-5609-4f3f-92aa-6c687fe2345b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.582262 Oct 03 14:23:43.743765 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:23:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:23:43.758417 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-7032fe16-edc8-4b54-bbf8-4980f95de145 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:43.799459 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-7032fe16-edc8-4b54-bbf8-4980f95de145 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044880 Oct 03 14:23:43.800255 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 3 14:23:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:23:46.400179 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-9ed72893-5609-4f3f-92aa-6c687fe2345b admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:46.401158 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-9ed72893-5609-4f3f-92aa-6c687fe2345b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 03 14:23:46.401869 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:46.854190 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-01decf7a-934b-40de-8071-616d9f57d442 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:46.878826 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-01decf7a-934b-40de-8071-616d9f57d442 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470100 Oct 03 14:23:46.879607 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:23:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:23:46.892491 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-fe64f314-f1c8-45c0-a19b-f8e2ba6a2be8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:46.923509 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-fe64f314-f1c8-45c0-a19b-f8e2ba6a2be8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035405 Oct 03 14:23:46.924101 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 3 14:23:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:23:49.583605 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-01decf7a-934b-40de-8071-616d9f57d442 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:49.585227 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-01decf7a-934b-40de-8071-616d9f57d442 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Oct 03 14:23:49.596214 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:50.016972 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-94871bef-5d07-4686-8085-a52a1f0efdc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:50.040419 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-94871bef-5d07-4686-8085-a52a1f0efdc0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448284 Oct 03 14:23:50.041300 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:23:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:23:50.054487 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-8c608e5b-7910-43b7-ab9a-253a62bc981b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:50.089491 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-8c608e5b-7910-43b7-ab9a-253a62bc981b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038602 Oct 03 14:23:50.098094 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 3 14:23:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:23:52.748133 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-94871bef-5d07-4686-8085-a52a1f0efdc0 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:52.749306 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-94871bef-5d07-4686-8085-a52a1f0efdc0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Oct 03 14:23:52.749766 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:53.196695 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-e7e62633-dba0-49b4-8931-28a097e487f1 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:53.223711 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-e7e62633-dba0-49b4-8931-28a097e487f1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.467263 Oct 03 14:23:53.224302 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:23:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:23:56.289846 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-94871bef-5d07-4686-8085-a52a1f0efdc0 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:56.291499 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-94871bef-5d07-4686-8085-a52a1f0efdc0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002331 Oct 03 14:23:56.292394 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:56.772121 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-ab2a42b4-ab97-42b6-8ad0-91e63e0ee199 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:56.798385 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-ab2a42b4-ab97-42b6-8ad0-91e63e0ee199 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.498467 Oct 03 14:23:56.798385 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:23:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:23:56.811621 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-c4e4173f-4399-4daf-bc47-600653dcca81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:56.845529 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-c4e4173f-4399-4daf-bc47-600653dcca81 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037908 Oct 03 14:23:56.846381 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 3 14:23:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:23:59.488454 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-ab2a42b4-ab97-42b6-8ad0-91e63e0ee199 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:23:59.489705 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-ab2a42b4-ab97-42b6-8ad0-91e63e0ee199 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001749 Oct 03 14:23:59.490180 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:23:59.920161 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-66ca8865-ac3d-4f1b-804d-09a01baffb77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:59.940048 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-66ca8865-ac3d-4f1b-804d-09a01baffb77 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.443591 Oct 03 14:23:59.940608 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:23:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:23:59.952863 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-bf345810-f7ba-42d7-87db-a59fe9f21a92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:23:59.977178 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-bf345810-f7ba-42d7-87db-a59fe9f21a92 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028024 Oct 03 14:23:59.977949 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 3 14:23:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:24:02.579511 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-66ca8865-ac3d-4f1b-804d-09a01baffb77 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:02.580548 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-66ca8865-ac3d-4f1b-804d-09a01baffb77 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 03 14:24:02.580945 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:02.992220 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-aa401c41-60ba-4410-a47a-f9fb2c728add admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "swap": 0}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:03.019256 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-aa401c41-60ba-4410-a47a-f9fb2c728add admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.432084 Oct 03 14:24:03.019869 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:24:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:24:03.033070 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-e4bd0149-1e0b-4022-b52f-26ece83dfb18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:03.038560 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:24:03.062629 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-e4bd0149-1e0b-4022-b52f-26ece83dfb18 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033655 Oct 03 14:24:03.063231 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 3 14:24:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:24:05.687541 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-aa401c41-60ba-4410-a47a-f9fb2c728add admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:05.688447 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-aa401c41-60ba-4410-a47a-f9fb2c728add admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Oct 03 14:24:05.689051 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:06.137388 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-af183de7-d8d4-493d-bc03-967c3fa81e4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:06.169508 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-af183de7-d8d4-493d-bc03-967c3fa81e4f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473967 Oct 03 14:24:06.170325 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:24:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:24:06.182480 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-4fa22e89-ca23-40b5-a97b-4a4218c42544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:06.209200 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-4fa22e89-ca23-40b5-a97b-4a4218c42544 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030246 Oct 03 14:24:06.213075 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 3 14:24:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:24:08.799014 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-af183de7-d8d4-493d-bc03-967c3fa81e4f admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:08.800031 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-af183de7-d8d4-493d-bc03-967c3fa81e4f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 03 14:24:08.800431 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:09.226258 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-29f847fc-56fa-4290-96f2-6122d606d348 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "swap": 0, "ram": 16384, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:09.235064 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:24:09.256887 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-29f847fc-56fa-4290-96f2-6122d606d348 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450197 Oct 03 14:24:09.257776 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 3 14:24:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:24:09.269873 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-04717cf7-d6bf-4b12-93f9-6ac89cc76c47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:09.302468 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-04717cf7-d6bf-4b12-93f9-6ac89cc76c47 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036215 Oct 03 14:24:09.303177 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 3 14:24:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:24:29.897046 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-29f847fc-56fa-4290-96f2-6122d606d348 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:29.898062 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-29f847fc-56fa-4290-96f2-6122d606d348 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Oct 03 14:24:29.898472 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:29.913151 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:24:30.347285 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-61abc183-47ff-4070-b330-c2a06d793a82 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:30.365569 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-61abc183-47ff-4070-b330-c2a06d793a82 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.460385 Oct 03 14:24:30.366115 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:24:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:24:31.673074 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-29f847fc-56fa-4290-96f2-6122d606d348 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:31.674117 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-29f847fc-56fa-4290-96f2-6122d606d348 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 03 14:24:31.677254 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:32.270122 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-42e574b1-f11c-400b-bc83-ba7afe59a7de admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:32.275961 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.wsgi [None req-42e574b1-f11c-400b-bc83-ba7afe59a7de admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-42e574b1-f11c-400b-bc83-ba7afe59a7de admin admin] Request method failure captured: Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: Accept: application/json Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: Accept-Encoding: gzip, deflate Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: Connection: keep-alive Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: Content-Length: 0 Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: Host: 10.222.0.20 Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: Openstack-Api-Version: compute 2.92 Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: Openstack-System-Scope: None Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: User-Agent: python-novaclient Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Auth-Token: gAAAAABjOvCf6pQBkAYRUJwRP2cQ94TdDvWSEkvcLgqLaXqNMv7V1PGJt6I5C0LKoLPO9S22uW1WfaFybxdHgYGSwhvJma6Npx_IPNUO8YRdhApmcS1y_t2zUUB_vionOM2jG2cpdhdu4_krstd0kji6rYVeNVzsyh_tC7hmAzWuA40d-TnAgsM Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Domain-Id: None Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Domain-Name: None Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Identity-Status: Confirmed Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Is-Admin-Project: True Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Domain-Id: default Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Domain-Name: Default Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Name: admin Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Role: admin,member,reader Oct 03 14:24:32.279322 n-d-781139-2 devstack@n-api.service[106399]: X-Roles: admin,member,reader Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d6c77d9711847d4a8d3db9eea2ff1b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant: admin Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant-Name: admin Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-User: admin Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-User-Domain-Id: default Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-User-Domain-Name: Default Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-User-Id: 237102254e2a498bb061a020c8f24aae Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: X-User-Name: admin Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: method: > Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: exception: Flavor 42 could not be found. Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: action_args: {'id': '42'} Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:24:32.280975 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:32.282121 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.283501 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-42e574b1-f11c-400b-bc83-ba7afe59a7de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:24:32.284849 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-42e574b1-f11c-400b-bc83-ba7afe59a7de admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.434671 Oct 03 14:24:32.284849 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 3 14:24:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:24:32.291148 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-e63751d6-80f2-475c-8b37-365baf5277c5 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:32.316248 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-e63751d6-80f2-475c-8b37-365baf5277c5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028724 Oct 03 14:24:32.316857 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 3 14:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:24:32.348145 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-a5239486-bb91-46c5-8428-5bdf5ba1e726 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:32.370858 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-a5239486-bb91-46c5-8428-5bdf5ba1e726 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027412 Oct 03 14:24:32.371362 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 3 14:24:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:24:32.383483 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-d2809de8-4e15-4c80-9228-d8bab82448ac admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:32.391422 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.wsgi [None req-d2809de8-4e15-4c80-9228-d8bab82448ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-d2809de8-4e15-4c80-9228-d8bab82448ac admin admin] Request method failure captured: Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: Accept: application/json Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: Accept-Encoding: gzip, deflate Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: Connection: keep-alive Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: Content-Length: 0 Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: Host: 10.222.0.20 Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: Openstack-Api-Version: compute 2.92 Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: Openstack-System-Scope: None Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: User-Agent: python-novaclient Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Auth-Token: gAAAAABjOvCf6pQBkAYRUJwRP2cQ94TdDvWSEkvcLgqLaXqNMv7V1PGJt6I5C0LKoLPO9S22uW1WfaFybxdHgYGSwhvJma6Npx_IPNUO8YRdhApmcS1y_t2zUUB_vionOM2jG2cpdhdu4_krstd0kji6rYVeNVzsyh_tC7hmAzWuA40d-TnAgsM Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Domain-Id: None Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Domain-Name: None Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Identity-Status: Confirmed Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Is-Admin-Project: True Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Domain-Id: default Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Domain-Name: Default Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Name: admin Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Role: admin,member,reader Oct 03 14:24:32.394705 n-d-781139-2 devstack@n-api.service[106400]: X-Roles: admin,member,reader Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d6c77d9711847d4a8d3db9eea2ff1b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant: admin Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant-Name: admin Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-User: admin Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-User-Domain-Id: default Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-User-Domain-Name: Default Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-User-Id: 237102254e2a498bb061a020c8f24aae Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: X-User-Name: admin Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: method: > Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: exception: Flavor 42 could not be found. Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: action_args: {'id': '42'} Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:24:32.396423 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:32.397289 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:32.398362 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-d2809de8-4e15-4c80-9228-d8bab82448ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:24:32.399368 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-d2809de8-4e15-4c80-9228-d8bab82448ac admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.018375 Oct 03 14:24:32.399368 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 3 14:24:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:24:33.628221 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-a5239486-bb91-46c5-8428-5bdf5ba1e726 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:33.629283 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-a5239486-bb91-46c5-8428-5bdf5ba1e726 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 03 14:24:33.629696 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:34.185359 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-40f81d45-6bb3-4e2e-ad9e-a1208686afb0 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:34.190546 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.wsgi [None req-40f81d45-6bb3-4e2e-ad9e-a1208686afb0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-40f81d45-6bb3-4e2e-ad9e-a1208686afb0 admin admin] Request method failure captured: Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: Accept: application/json Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: Accept-Encoding: gzip, deflate Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: Connection: keep-alive Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: Content-Length: 0 Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: Host: 10.222.0.20 Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: Openstack-Api-Version: compute 2.92 Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: Openstack-System-Scope: None Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: User-Agent: python-novaclient Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Auth-Token: gAAAAABjOvChv_edirGCVdKP6R3bRG02s5CYlu-gJ_YbX_xq7NmgzkTtFIS99xYQ88aRTynkb4TED4kzmt1vv0p0z-LZZAFMDlU8gqJuyCtdcJHlenT-jYn6zVfXHKbZkeQgDasKIG5jqlUxKfKl0WMfDfSIBCob9ZXAD3FltZgnmptFAk8zA04 Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Domain-Id: None Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Domain-Name: None Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Identity-Status: Confirmed Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Is-Admin-Project: True Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Domain-Id: default Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Domain-Name: Default Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Name: admin Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Role: admin,member,reader Oct 03 14:24:34.192065 n-d-781139-2 devstack@n-api.service[106400]: X-Roles: admin,member,reader Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d6c77d9711847d4a8d3db9eea2ff1b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant: admin Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant-Name: admin Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-User: admin Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-User-Domain-Id: default Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-User-Domain-Name: Default Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-User-Id: 237102254e2a498bb061a020c8f24aae Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: X-User-Name: admin Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: method: > Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: exception: Flavor 84 could not be found. Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: action_args: {'id': '84'} Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:24:34.193678 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:34.194706 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.196165 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-40f81d45-6bb3-4e2e-ad9e-a1208686afb0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:24:34.197424 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-40f81d45-6bb3-4e2e-ad9e-a1208686afb0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.428100 Oct 03 14:24:34.197424 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 3 14:24:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:24:34.203527 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-0f150de9-85d9-4a5c-be26-f9039a5ed9b3 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:34.218938 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-0f150de9-85d9-4a5c-be26-f9039a5ed9b3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019065 Oct 03 14:24:34.219476 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 3 14:24:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:24:34.231625 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-f446d2cd-62d5-474b-8147-e30485ca23e3 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:34.253499 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-f446d2cd-62d5-474b-8147-e30485ca23e3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027742 Oct 03 14:24:34.254022 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 3 14:24:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:24:34.263239 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-bf984470-a251-44fc-a920-671e0654a14f admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:34.268354 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.wsgi [None req-bf984470-a251-44fc-a920-671e0654a14f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-bf984470-a251-44fc-a920-671e0654a14f admin admin] Request method failure captured: Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: Accept: application/json Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: Accept-Encoding: gzip, deflate Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: Connection: keep-alive Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: Content-Length: 0 Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: Host: 10.222.0.20 Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: Openstack-Api-Version: compute 2.92 Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: Openstack-System-Scope: None Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: User-Agent: python-novaclient Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Auth-Token: gAAAAABjOvChv_edirGCVdKP6R3bRG02s5CYlu-gJ_YbX_xq7NmgzkTtFIS99xYQ88aRTynkb4TED4kzmt1vv0p0z-LZZAFMDlU8gqJuyCtdcJHlenT-jYn6zVfXHKbZkeQgDasKIG5jqlUxKfKl0WMfDfSIBCob9ZXAD3FltZgnmptFAk8zA04 Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Domain-Id: None Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Domain-Name: None Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Identity-Status: Confirmed Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Is-Admin-Project: True Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Domain-Id: default Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Domain-Name: Default Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Name: admin Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Role: admin,member,reader Oct 03 14:24:34.269985 n-d-781139-2 devstack@n-api.service[106399]: X-Roles: admin,member,reader Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d6c77d9711847d4a8d3db9eea2ff1b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant: admin Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant-Name: admin Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-User: admin Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-User-Domain-Id: default Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-User-Domain-Name: Default Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-User-Id: 237102254e2a498bb061a020c8f24aae Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: X-User-Name: admin Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: method: > Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: exception: Flavor 84 could not be found. Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: action_args: {'id': '84'} Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:24:34.271868 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:34.272855 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:34.274193 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-bf984470-a251-44fc-a920-671e0654a14f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:24:34.275413 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-bf984470-a251-44fc-a920-671e0654a14f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012082 Oct 03 14:24:34.275413 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 3 14:24:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:24:35.491802 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-f446d2cd-62d5-474b-8147-e30485ca23e3 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:35.493267 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-f446d2cd-62d5-474b-8147-e30485ca23e3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Oct 03 14:24:35.493854 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:36.041209 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-4f85af74-fb67-44d2-9ed1-6998319a704b admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:36.047073 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.wsgi [None req-4f85af74-fb67-44d2-9ed1-6998319a704b admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-4f85af74-fb67-44d2-9ed1-6998319a704b admin admin] Request method failure captured: Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: Accept: application/json Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: Accept-Encoding: gzip, deflate Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: Connection: keep-alive Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: Content-Length: 0 Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: Host: 10.222.0.20 Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: Openstack-Api-Version: compute 2.92 Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: Openstack-System-Scope: None Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: User-Agent: python-novaclient Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Auth-Token: gAAAAABjOvCjbQcLU1DjT5Zh09teopNcMChNaDDHOQlp4IrRO-vW0eLCSx_uNWgGu2FbslM3qPE3NrdmO2vkxLnv4a2U7yXef6C3k6rIhhWaILhq0thD5vKbFu9-wFH9YvQ2Jsdx0cpn4akoXZp9QmbkeAC7vggPUEyfI2LpzVy5RSoimb4r7oY Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Domain-Id: None Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Domain-Name: None Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Identity-Status: Confirmed Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Is-Admin-Project: True Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Domain-Id: default Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Domain-Name: Default Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Project-Name: admin Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Role: admin,member,reader Oct 03 14:24:36.048684 n-d-781139-2 devstack@n-api.service[106399]: X-Roles: admin,member,reader Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d6c77d9711847d4a8d3db9eea2ff1b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant: admin Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-Tenant-Name: admin Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-User: admin Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-User-Domain-Id: default Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-User-Domain-Name: Default Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-User-Id: 237102254e2a498bb061a020c8f24aae Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: X-User-Name: admin Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: method: > Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: exception: Flavor 451 could not be found. Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: action_args: {'id': '451'} Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:24:36.050118 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:36.050959 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.052314 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-4f85af74-fb67-44d2-9ed1-6998319a704b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:24:36.053587 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-4f85af74-fb67-44d2-9ed1-6998319a704b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.422726 Oct 03 14:24:36.053587 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 3 14:24:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:24:36.060148 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-4b550aef-3b9c-4ec6-a431-fb3424181de8 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:36.075092 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-4b550aef-3b9c-4ec6-a431-fb3424181de8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018583 Oct 03 14:24:36.075610 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 3 14:24:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:24:36.085320 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:36.100769 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019063 Oct 03 14:24:36.101303 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 3 14:24:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:24:36.111108 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-f7d62d1d-948d-4476-a405-3f5704021ab0 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:36.116812 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.wsgi [None req-f7d62d1d-948d-4476-a405-3f5704021ab0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-f7d62d1d-948d-4476-a405-3f5704021ab0 admin admin] Request method failure captured: Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: Accept: application/json Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: Accept-Encoding: gzip, deflate Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: Connection: keep-alive Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: Content-Length: 0 Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: Host: 10.222.0.20 Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: Openstack-Api-Version: compute 2.92 Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: Openstack-System-Scope: None Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: User-Agent: python-novaclient Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Auth-Token: gAAAAABjOvCjbQcLU1DjT5Zh09teopNcMChNaDDHOQlp4IrRO-vW0eLCSx_uNWgGu2FbslM3qPE3NrdmO2vkxLnv4a2U7yXef6C3k6rIhhWaILhq0thD5vKbFu9-wFH9YvQ2Jsdx0cpn4akoXZp9QmbkeAC7vggPUEyfI2LpzVy5RSoimb4r7oY Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Domain-Id: None Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Domain-Name: None Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Identity-Status: Confirmed Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Is-Admin-Project: True Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Domain-Id: default Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Domain-Name: Default Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Project-Name: admin Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Role: admin,member,reader Oct 03 14:24:36.118362 n-d-781139-2 devstack@n-api.service[106400]: X-Roles: admin,member,reader Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d6c77d9711847d4a8d3db9eea2ff1b8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d6c77d9711847d4a8d3db9eea2ff1b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant: admin Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant-Id: 5d6c77d9711847d4a8d3db9eea2ff1b8 Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-Tenant-Name: admin Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-User: admin Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-User-Domain-Id: default Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-User-Domain-Name: Default Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-User-Id: 237102254e2a498bb061a020c8f24aae Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: X-User-Name: admin Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: method: > Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: exception: Flavor 451 could not be found. Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: action_args: {'id': '451'} Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:24:36.119837 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:36.120757 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: ERROR nova.api.openstack.wsgi Oct 03 14:24:36.121966 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-f7d62d1d-948d-4476-a405-3f5704021ab0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:24:36.123159 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-f7d62d1d-948d-4476-a405-3f5704021ab0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012274 Oct 03 14:24:36.123159 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 3 14:24:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:24:37.346225 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:37.347228 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 03 14:24:37.347633 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:37.908900 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-baeb7e95-7ab8-4dc5-b00d-ccc788b6dc15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:37.931794 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-baeb7e95-7ab8-4dc5-b00d-ccc788b6dc15 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.444741 Oct 03 14:24:37.932330 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 3 14:24:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:24:39.187084 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:39.188088 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 03 14:24:39.188483 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:39.761927 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-8d77da8f-48cf-4e1b-ad9d-5b10f3209b46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:39.785361 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-8d77da8f-48cf-4e1b-ad9d-5b10f3209b46 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.461850 Oct 03 14:24:39.785891 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 3 14:24:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:24:41.000882 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:41.002771 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002312 Oct 03 14:24:41.003285 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:41.555579 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-d123fd07-6f9c-4795-b797-622ba6ec4601 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:41.579468 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-d123fd07-6f9c-4795-b797-622ba6ec4601 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.438596 Oct 03 14:24:41.579978 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 3 14:24:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:24:42.822837 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:42.823951 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Oct 03 14:24:42.824346 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:43.401566 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-be20dd55-2be3-4ea6-8d7d-bd93258ddfbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:24:43.426851 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-be20dd55-2be3-4ea6-8d7d-bd93258ddfbf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.467293 Oct 03 14:24:43.427411 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 3 14:24:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:24:44.656356 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:44.657378 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 03 14:24:44.657770 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:24:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:24:45.261872 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-63888cc5-6789-4a34-b9b4-547bec6006b4 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:24:45.283039 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-63888cc5-6789-4a34-b9b4-547bec6006b4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.490282 Oct 03 14:24:45.283583 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Oct 3 14:24:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:25:43.399207 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:25:43.400891 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-b327b178-0b51-414d-b854-846a62b7a608 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002271 Oct 03 14:25:43.401612 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 3 14:25:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:25:43.415793 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:25:43.966169 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-0b4e284f-c30e-47bb-b34a-0432ff3949c7 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:25:43.987248 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-0b4e284f-c30e-47bb-b34a-0432ff3949c7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.579087 Oct 03 14:25:43.987789 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:25:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:25:44.009606 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_api:SELECT=14 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:25:44.012502 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-28fddcf7-ef7f-467e-a30a-48759c103f0b admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:25:44.020480 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-28fddcf7-ef7f-467e-a30a-48759c103f0b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013106 Oct 03 14:25:44.021410 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Oct 3 14:25:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:25:44.033554 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-f4a49fbb-a6e5-4717-ba4b-8a5e82df683d admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:25:44.041023 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-f4a49fbb-a6e5-4717-ba4b-8a5e82df683d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011123 Oct 03 14:25:44.041530 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Oct 3 14:25:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:25:44.053466 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-e2c38ab6-d491-4426-9970-05fc414854d9 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:25:44.061050 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-e2c38ab6-d491-4426-9970-05fc414854d9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011134 Oct 03 14:25:44.061632 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Oct 3 14:25:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:25:44.073955 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-d152896b-a988-43ac-952e-aa68a1991c06 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:25:44.081474 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-d152896b-a988-43ac-952e-aa68a1991c06 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011215 Oct 03 14:25:44.081977 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Oct 3 14:25:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:31:07.107295 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-e2c38ab6-d491-4426-9970-05fc414854d9 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:31:07.108313 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-e2c38ab6-d491-4426-9970-05fc414854d9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 03 14:31:07.108701 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:31:07.247316 n-d-781139-2 devstack@n-api.service[106400]: DEBUG dbcounter [-] [106400] Writing DB stats nova_api:SELECT=6 {{(pid=106400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:31:07.402980 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:31:07.408019 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:31:07.408477 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:31:07.408898 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:31:07.409598 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:31:07.410062 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:31:07.410467 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:31:07.448256 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-9d78d1b6-6de0-4bcb-824d-62a8730c1add admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.203238 Oct 03 14:31:07.448801 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 3 14:31:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:31:08.560668 n-d-781139-2 devstack@n-api.service[106399]: DEBUG nova.api.openstack.wsgi [None req-e2c38ab6-d491-4426-9970-05fc414854d9 admin admin] Calling method '>' {{(pid=106399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:31:08.561715 n-d-781139-2 devstack@n-api.service[106399]: INFO nova.api.openstack.requestlog [None req-e2c38ab6-d491-4426-9970-05fc414854d9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 03 14:31:08.562381 n-d-781139-2 devstack@n-api.service[106399]: [pid: 106399|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 3 14:31:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:31:08.765956 n-d-781139-2 devstack@n-api.service[106400]: DEBUG nova.api.openstack.wsgi [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] Calling method '>' {{(pid=106400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:31:08.769781 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:31:08.770272 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:31:08.770726 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:31:08.771428 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:31:08.771869 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:31:08.772276 n-d-781139-2 devstack@n-api.service[106400]: DEBUG oslo_concurrency.lockutils [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:31:08.795545 n-d-781139-2 devstack@n-api.service[106400]: INFO nova.api.openstack.requestlog [None req-24f41ea1-4670-408c-9e94-1a09f343f879 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.094427 Oct 03 14:31:08.796109 n-d-781139-2 devstack@n-api.service[106400]: [pid: 106400|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 3 14:31:08 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:31:56.769511 n-d-781139-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 03 14:31:56.770286 n-d-781139-2 devstack@n-api.service[106398]: Mon Oct 3 14:31:56 2022 - graceful shutdown triggered... Oct 03 14:31:56.770789 n-d-781139-2 devstack@n-api.service[106400]: Gracefully killing worker 2 (pid: 106400)... Oct 03 14:31:56.771251 n-d-781139-2 devstack@n-api.service[106399]: Gracefully killing worker 1 (pid: 106399)... Oct 03 14:31:56.901684 n-d-781139-2 devstack@n-api.service[106399]: DEBUG dbcounter [-] [106399] Writing DB stats nova_api:SELECT=4 {{(pid=106399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:31:57.771591 n-d-781139-2 devstack@n-api.service[106398]: worker 1 buried after 1 seconds Oct 03 14:31:57.771591 n-d-781139-2 devstack@n-api.service[106398]: worker 2 buried after 1 seconds Oct 03 14:31:57.771591 n-d-781139-2 devstack@n-api.service[106398]: goodbye to uWSGI. Oct 03 14:31:57.774417 n-d-781139-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 03 14:31:57.775343 n-d-781139-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 03 14:31:57.779732 n-d-781139-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 14:31:57.800356 n-d-781139-2 devstack@n-api.service[128858]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 14:31:57 2022] *** Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: nodename: n-d-781139-2 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: machine: x86_64 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: clock source: unix Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: pcre jit disabled Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: detected number of CPU cores: 4 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: current working directory: / Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: detected binary path: /usr/bin/uwsgi-core Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: your processes number limit is 47680 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: your memory page size is 4096 bytes Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: detected max file descriptor number: 2048 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: lock engine: pthread robust mutexes Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: thunder lock: enabled Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 14:31:57.820716 n-d-781139-2 devstack@n-api.service[128858]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 14:31:57.864390 n-d-781139-2 devstack@n-api.service[128858]: Python main interpreter initialized at 0x55ec15d2f9c0 Oct 03 14:31:57.864390 n-d-781139-2 devstack@n-api.service[128858]: python threads support enabled Oct 03 14:31:57.864390 n-d-781139-2 devstack@n-api.service[128858]: your server socket listen backlog is limited to 100 connections Oct 03 14:31:57.864390 n-d-781139-2 devstack@n-api.service[128858]: your mercy for graceful operations on workers is 90 seconds Oct 03 14:31:57.864856 n-d-781139-2 devstack@n-api.service[128858]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 14:31:57.864856 n-d-781139-2 devstack@n-api.service[128858]: *** Operational MODE: preforking *** Oct 03 14:31:57.865051 n-d-781139-2 devstack@n-api.service[128858]: *** uWSGI is running in multiple interpreter mode *** Oct 03 14:31:57.865051 n-d-781139-2 devstack@n-api.service[128858]: spawned uWSGI master process (pid: 128858) Oct 03 14:31:57.865290 n-d-781139-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 03 14:31:57.866914 n-d-781139-2 devstack@n-api.service[128858]: spawned uWSGI worker 1 (pid: 128868, cores: 1) Oct 03 14:31:57.866914 n-d-781139-2 devstack@n-api.service[128858]: spawned uWSGI worker 2 (pid: 128869, cores: 1) Oct 03 14:31:57.866914 n-d-781139-2 devstack@n-api.service[128858]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 14:31:58.527782 n-d-781139-2 devstack@n-api.service[128868]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:31:58.543109 n-d-781139-2 devstack@n-api.service[128869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 14:31:59.673045 n-d-781139-2 devstack@n-api.service[128868]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:31:59.673045 n-d-781139-2 devstack@n-api.service[128868]: from cryptography.utils import int_from_bytes Oct 03 14:31:59.673715 n-d-781139-2 devstack@n-api.service[128868]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:31:59.673715 n-d-781139-2 devstack@n-api.service[128868]: from cryptography.utils import int_from_bytes Oct 03 14:31:59.690101 n-d-781139-2 devstack@n-api.service[128869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:31:59.690101 n-d-781139-2 devstack@n-api.service[128869]: from cryptography.utils import int_from_bytes Oct 03 14:31:59.690687 n-d-781139-2 devstack@n-api.service[128869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:31:59.690687 n-d-781139-2 devstack@n-api.service[128869]: from cryptography.utils import int_from_bytes Oct 03 14:32:02.111512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:32:02.112180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:32:02.112478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:32:02.112849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:32:02.113137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:32:02.113528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.113859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.114235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.114502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.114864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.115177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.115491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.115779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.116139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.116359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.116707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.117262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-781139-2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.117587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.117898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.118195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.118509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.119231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.119491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.119746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.120370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.120538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:32:02.122905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:32:02.123138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.123138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.123560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:32:02.123791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.124013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:32:02.124248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.124464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:32:02.124678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.124900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.125174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.125393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.125610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.125824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.126048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.126270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.126495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.126715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.126937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.127164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.127164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.127584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-781139-2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.127768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.127957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.128144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.128303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.128463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.128662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.128813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.129004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.129165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-781139-2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.129364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.129517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.129667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.129810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.129964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.130126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.130296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.130454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.130637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.130794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.130946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.131102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.131259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.131422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.131574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.131574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.132706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.132881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.133110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.133294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.133448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.133604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.133767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.133952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.134131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.134286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.134429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.134579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.134729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.134886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.135030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.135183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.135336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.135487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.135637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.135796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.135963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.136120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.136279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-781139-2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.136436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.136436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.136736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.136897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.137108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.137264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.137424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.137570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.137713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.137879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.137879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.138175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.138348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.138348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.138676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.138831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.138981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.139138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.139283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.139435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.139587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.139738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.139893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.140046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.140198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.140349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.140503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.140660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.140804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.140985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.141142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.141293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.141436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.141589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.141754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.142299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.142471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.143228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.143382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.143382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.143680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.143833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.143989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.144143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.144295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.144462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.144676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.144895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.145074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.145228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.145376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.145526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.145686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.145839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.145984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.146139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.146284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.146444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.146608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.146764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.146925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.147070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.147220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.147376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.147520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.147664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.147816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.147960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.148110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.148267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.148411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.148565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.148719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.148862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.149047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.149192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.149344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.149488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.149645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.150435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.150682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.150841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.150988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.151139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.151304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.151448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.151601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.151745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.151897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.152389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.152542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.152695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.152855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.153055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.153241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.153416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.153654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.153830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.153984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.154128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.154365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.154521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.154677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.154836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.154981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.155125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.155284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.155429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.155584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.155735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.155901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.156057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.156214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.156361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.156511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.156654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.156809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.156977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.157143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.157296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.157451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.157605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.157766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.157916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.158069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.158213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.158213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.158495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.158650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.158808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.158954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.159104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.159248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.159391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.159541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.159711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.159856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.160000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.160142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.160292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.160447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.160605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.160761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.160905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.161122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.161276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.161431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.161590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.161751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.161904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.161904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.162525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.162525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.162834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.162986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.163138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.163339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.163488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.163657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.163897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.164054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.164223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.164368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.164512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.164657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.164800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.164968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.165130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.165275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.165418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.165571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.165724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.165901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.165901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.166204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.166358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.166502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.166657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.166814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.167065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.167215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.167366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.167517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.167671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.167829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.167975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.168136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.168280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.168431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.168575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.168733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.168919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.169117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.169272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.169272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.169543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.169699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.169843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.169994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.170156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.170322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.170482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.170626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.170780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.170966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.171118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.171261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.171422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.171574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.171728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.171886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.172041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.172211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:32:02.172684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.172836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.173010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.173160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.173160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.173509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.173654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.173812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.173964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.174206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.174365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.174529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.174684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.174838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.174983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.175128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.175271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.175414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.175567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.175720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.175865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.176008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.176161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.176306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.176475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.176627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.176771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.176963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.177124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.177271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.177503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.177649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.177793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.177946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.178100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.178253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.178421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.178574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.178730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.178882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.179036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.179190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.179344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.179495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.179639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.179791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.179934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.180087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.180237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.180403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.180556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.180709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.180861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.181040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.181194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.181349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.181588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.181781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.181928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.182088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.182234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.182377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.182853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.183005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.183149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.183307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.183505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.183662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.183818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.183971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.184128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.184379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.184528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.184683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.184839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.185059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.185220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.185381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.185527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.185671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.185822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.185966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.186166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.186322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.186466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.186618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.186771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.186943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.187101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.187257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.187409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.187554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.187706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.187864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.188009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.188163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.188306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.188450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.188592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.188746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.188910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.189087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.189232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.189385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.189537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.189691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.189845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.189989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.190148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.190293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.190435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.190586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.190737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.190892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.191036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.191188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.191349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.191502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.191646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.191805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.191957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.192101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.192259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.192414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.192558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.193054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.193232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.193379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.193581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.193731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.193883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.194038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.194183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.194325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.194573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.194732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.194877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.195030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.195187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.195354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.195508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.195653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.195806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.195958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.196113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.196270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.196422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.196567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.196723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.196875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.197074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.197250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.197395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.197547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.197693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.197837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.197988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.198153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.198299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.198450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.198593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.198736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.198895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.199040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.199198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.199353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.199497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.199649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.199801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.199953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.200104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.200247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.200390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.200547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.200704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.200704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.201020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.201186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.201332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.201487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.201647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.201799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.201943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.202094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.202246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.202404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.202556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.202708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.203169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.203327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.203492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.203687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.203888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.204035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.204188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.204344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.204491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.204670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.204815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.204997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.205147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.205302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.205464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.205618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.205781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.205933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.206086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.206230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.206381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.206534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.206680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.206823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.206976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.207126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.207347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.207512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.207666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.207809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.207953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.208103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.208262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.208407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.208552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.208696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.208840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.209019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.209183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.209334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.209498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.209641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.209785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.209927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.210084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.210235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.210379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.210521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.210664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.210820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.210971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.211114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.211257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.211416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.211560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.211717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.211872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.212023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.212167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.212318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.212470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.212798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.213298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.213475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.213624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.213811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.213979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.214133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.214277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.214431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.214583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.214736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.214894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.215039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.215201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.215352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.215501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.215649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.215821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.215971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.216132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.216283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.216440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.216599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.216759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.216978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.217138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.217296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.217446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.217596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.217769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.217939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.218097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.218249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.218399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.218558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.218718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.218868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.219026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.219178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.219335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.219500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.219651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.219799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.219959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.220116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.220267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.220426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.220595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.220746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.220896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.221074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.221225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.221388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.221547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.221699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.221848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.222014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.222165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.222325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.222483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.222634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.222802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.222952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.223328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.223501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.223660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.223854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.223854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.224147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.224321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.224472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.224622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.224779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.224972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.225127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.225286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.225447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.225604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.225840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.226007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.226166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.226340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.226499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.226657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.226814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.226973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.227133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.227291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.227449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.227600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.227764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.227924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.228085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.228244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.228469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.228742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.228987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.229151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.229316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.229476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.229636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.229795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.229954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.230104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.230274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.230426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.230426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.230726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.230876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.231036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.231186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.231345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.231503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.231655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.231812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.231972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.232132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.232295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.232454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.232625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.232776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.232776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.233096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.233478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.233656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.233808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.234004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.234167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.234335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.234509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.234724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.234887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.235056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.235214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.235373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.235536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.235701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.235859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.236799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.237453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.237604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.237762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.237913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.238064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.238223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.238385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.238535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.238693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.238851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.239016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.239178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.239327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.239327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.239630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.239630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.240020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.240020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.240315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.240464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.240623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.240783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.240783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.241233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.241387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.241387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.241689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.241855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.242013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.242013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.242316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.242476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.242628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.242787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.242944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.243102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.243274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.243637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.243805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.244061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.244221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.244221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.244587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.244782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.244965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.245136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.245287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.245449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.245609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.245775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.245941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.246093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.246242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.246400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.246561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.246712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.246880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.247041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.247200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.247350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.247500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.247728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.247899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.248050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.248208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.248367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.248527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.248686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.248845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.249052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.249209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.249360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.249520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.249687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.249856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.250007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.250204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.250359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.250518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.250670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.250830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.250980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.251131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.251288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.251288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.251592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.251762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.252534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.252697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.252849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.253938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.254946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.255978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.256887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.257985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.258962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.259999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.260993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.261929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.262931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.263982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.264074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.264167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.264672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.264769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.264864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.264967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.265956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.266969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.267054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.267138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.267230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.267325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.267420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.267506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.267590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.268989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.269973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.270982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.271996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.272913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.273948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.274068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.274195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.274299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.274632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.274736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.274824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.275087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.275325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.275451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.275550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.275637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.275788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.275899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.276217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.276310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.276536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.276628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.276848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.276971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.277198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.277303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.277528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.277620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.277837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.277931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.278211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.278322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.278456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.278547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.278765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.278858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.279074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.279170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.279401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.279542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.279708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.279827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.280022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.280139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.280334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.280460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.280643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.280745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.280969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.281112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.281278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.281394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.281604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.281705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.281909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.282024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.282231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.282337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.282547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.282650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.282872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.283027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.283194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.283361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.283499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.283682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.283822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.284023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.284140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.284342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.284435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.285422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.285521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.285614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.285710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.285805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.285901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.285987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.286896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.287114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.287208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.287433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.287532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.287745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.287852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.288056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.288148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.288390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.288483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.288707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.288799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.289049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.289145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.289354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.289456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.289665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.289767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.289969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.290061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.290272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.290362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.290574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.290720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.290901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.291022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.291198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.291304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.291506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.291641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.291808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.292003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.292106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.292358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.292470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.292673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.292783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.293026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.293141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.293333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.293434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.293636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.293747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.293941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.294069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.294281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.294421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.294587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.294695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.294919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.295037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.295224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.295330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.295585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.295682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.295855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.295958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.296174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.296268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.296489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.296587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.296792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.296893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.297132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.297233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.297442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.297533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.297753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.297853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.298056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.298147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.298363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.298461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.298672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.298764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.299000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.299092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.299311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.299535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.299641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.299867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.299960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.300183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.300274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.300495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.300596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.300808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.300909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.301152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.301275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.301501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.301603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.301813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.301906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.302149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.302240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.302466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.302566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.302773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.302873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.303101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.303201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.303420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.303557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.303742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.303860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.304792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.305028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.305164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.305278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.305389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.305525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.305803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.305922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.306042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.306153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.306276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.306467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.306599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.306712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.306829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.307011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.307011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.307011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.307425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.307670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.307910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.308907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.309014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.309100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.309184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.309287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.342562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.343124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.343468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.343655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.343816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.343989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.344199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.344337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.344474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.344628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.344877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.345111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.345603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.346083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.347378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.347702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.347702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.348486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.348612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.348771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.348977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.349188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.349330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.349471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.349608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.349803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.350114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.350257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.350387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.350569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.350746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.350943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.351103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.351241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.351374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.351531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.351712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.351892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.352037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.352193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.352337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.352516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.352708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.352880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.353093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.353567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.353920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.354130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.354356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.354489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.354649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.354773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.354958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.354958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.355987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.356214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.356321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.356462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.356581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.356738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.356848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.356970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.357106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.357200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.357321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.357458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.357571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.358258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.358375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.358375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.358595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.358726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.358846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.358846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.359890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.360998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.361897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.362981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.363964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.364943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.365950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.366061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.366170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.366279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.369500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.370945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.370945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.371952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.372071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.372182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.372293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.372402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.372512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.373825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.373956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.374989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.375945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.376054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.376439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.376624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.377909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.379947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.380904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.382420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.382660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.382784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.382896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.382896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.383846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.385641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.385641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.385887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.386916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.387459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.387459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.387459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.387895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.388142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.388275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.388464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.388873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.389011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.389123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.389249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.389249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.389458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.389786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.389904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.390897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.391896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.392014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.392125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.392236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.392346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.392455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.392569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.393966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.394968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.395944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.396999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.397893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.398981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.399989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.400151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.400280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.400391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.400519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.400636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.400755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.400867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.401066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.401178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.401413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.401537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.401679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.401802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.401802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.402927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.403725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.404527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.405837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.406731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.407542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.408348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.409164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.409164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:32:02.409164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:32:02.436934 n-d-781139-2 devstack@n-api.service[128868]: INFO dbcounter [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Registered counter for database nova_api Oct 03 14:32:02.455762 n-d-781139-2 devstack@n-api.service[128869]: INFO dbcounter [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Registered counter for database nova_api Oct 03 14:32:02.457366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.464628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writer thread running {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:02.476352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.483658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:02.520609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.context [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=128868) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:32:02.524570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:02.525150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:02.526790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:02.527484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:02.527930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:02.529958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:02.532050 n-d-781139-2 devstack@n-api.service[128868]: INFO dbcounter [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Registered counter for database nova_cell0 Oct 03 14:32:02.536251 n-d-781139-2 devstack@n-api.service[128868]: INFO dbcounter [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Registered counter for database nova_cell1 Oct 03 14:32:02.543887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.context [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=128869) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 14:32:02.545996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.547157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.548041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:02.548521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:02.550171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:02.550926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:02.551380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:02.553433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:02.554151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writer thread running {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:02.555480 n-d-781139-2 devstack@n-api.service[128869]: INFO dbcounter [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Registered counter for database nova_cell0 Oct 03 14:32:02.555573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writer thread running {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:02.559753 n-d-781139-2 devstack@n-api.service[128869]: INFO dbcounter [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Registered counter for database nova_cell1 Oct 03 14:32:02.567034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.571211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.574847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:02.708919 n-d-781139-2 devstack@n-api.service[128868]: INFO dbcounter [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Registered counter for database nova_cell0 Oct 03 14:32:02.714380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:02.716549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_db.sqlalchemy.engines [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.721341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writer thread running {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:02.723940 n-d-781139-2 devstack@n-api.service[128869]: INFO dbcounter [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Registered counter for database nova_cell0 Oct 03 14:32:02.731174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_db.sqlalchemy.engines [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:32:02.735853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writer thread running {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:32:03.052165 n-d-781139-2 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:32:03.056902 n-d-781139-2 devstack@n-api.service[128868]: WARNING keystonemiddleware.auth_token [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:32:03.059546 n-d-781139-2 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:32:03.064216 n-d-781139-2 devstack@n-api.service[128868]: WARNING keystonemiddleware.auth_token [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:32:03.402101 n-d-781139-2 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:32:03.408100 n-d-781139-2 devstack@n-api.service[128869]: WARNING keystonemiddleware.auth_token [None req-c7a5d6c9-cc76-439b-b154-0ae27723b3ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:32:03.408787 n-d-781139-2 devstack@n-api.service[128868]: WARNING keystonemiddleware.auth_token [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 14:32:03.413393 n-d-781139-2 devstack@n-api.service[128869]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ec15d2f9c0 pid: 128869 (default app) Oct 03 14:32:03.414817 n-d-781139-2 devstack@n-api.service[128868]: WARNING keystonemiddleware.auth_token [None req-7d0d6efa-9f68-4f09-98ee-81c020436e40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 14:32:03.420288 n-d-781139-2 devstack@n-api.service[128868]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ec15d2f9c0 pid: 128868 (default app) Oct 03 14:32:43.442174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:43.443028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:43.444241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:43.445524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:44.350688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:44.351765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:44.352706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:44.353589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:44.686097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a169fa8-fd6c-418d-a38f-bcc6672d3c21 tempest-AZAdminNegativeTestJSON-253836137 tempest-AZAdminNegativeTestJSON-253836137-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:44.687758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a169fa8-fd6c-418d-a38f-bcc6672d3c21 tempest-AZAdminNegativeTestJSON-253836137 tempest-AZAdminNegativeTestJSON-253836137-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'ec0aef2b73f34aa1ab3f573c8298aff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8434620e204e4a79bdec3762adabda2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a169fa8-fd6c-418d-a38f-bcc6672d3c21 tempest-AZAdminNegativeTestJSON-253836137 tempest-AZAdminNegativeTestJSON-253836137-project] Request method failure captured: Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKJPptqCzrnvUQsXXfGK7hsMqstKuC7rzeiqLm7b0Ju6sqYAKMNTt7u8n6Kzc01S9Cclme9YYi72fnC7a1n6sqHI0oXuC2PN_75a6iixW2FxJdY0aO4tMBiaebaWZE8y1WZPRKdZWwl-mPaF6RtM3_NDIhAqzgtyqHcmN9sjAmh_d0 Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8434620e204e4a79bdec3762adabda2a Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AZAdminNegativeTestJSON-253836137 Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:44.690962 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8434620e204e4a79bdec3762adabda2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8434620e204e4a79bdec3762adabda2a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8434620e204e4a79bdec3762adabda2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8434620e204e4a79bdec3762adabda2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AZAdminNegativeTestJSON-253836137 Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8434620e204e4a79bdec3762adabda2a Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-253836137 Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AZAdminNegativeTestJSON-253836137-project Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ec0aef2b73f34aa1ab3f573c8298aff9 Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AZAdminNegativeTestJSON-253836137-project Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 03 14:32:44.692345 n-d-781139-2 devstack@n-api.service[128869]: action_args: {} Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:44.693101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:44.694036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a169fa8-fd6c-418d-a38f-bcc6672d3c21 tempest-AZAdminNegativeTestJSON-253836137 tempest-AZAdminNegativeTestJSON-253836137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:44.694852 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a169fa8-fd6c-418d-a38f-bcc6672d3c21 tempest-AZAdminNegativeTestJSON-253836137 tempest-AZAdminNegativeTestJSON-253836137-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.263050 Oct 03 14:32:44.696792 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 3 14:32:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:45.227946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:45.233150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.233632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.234063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.234779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.235228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.235642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.277904 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68755e10-721e-47e4-944c-9279e36a74a5 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.570550 Oct 03 14:32:45.278480 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:32:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:45.406414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Calling method '.version_select at 0x7fb2323b6820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:45.410886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.412775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.413397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.414455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.415382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.416708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.447479 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53ee6b40-c68f-476a-86f0-f7b664fa0d69 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.167693 Oct 03 14:32:45.448683 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3/3] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 3 14:32:45 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:45.500059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4df98c9c-87e3-4abc-947b-05119e754ebc tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1956535672", "id": 1610481416, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:45.557751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4df98c9c-87e3-4abc-947b-05119e754ebc tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 1.218988 Oct 03 14:32:45.558464 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1/4] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:32:44 2022] POST /compute/v2.1/flavors => generated 468 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:32:45.584503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:45.590178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.590662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.591091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.591812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.592277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.592655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.624315 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e730ca8-89c8-4bc6-8d9e-63e8fc306283 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.174355 Oct 03 14:32:45.625145 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4/5] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 3 14:32:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:32:45.692631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c0ca773-3f85-4d5a-8850-becf628c069f tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1807506665", "id": 1376220010, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:45.715056 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c0ca773-3f85-4d5a-8850-becf628c069f tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.155075 Oct 03 14:32:45.726078 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2/6] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:32:45 2022] POST /compute/v2.1/flavors => generated 471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:32:45.766105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8448ebb-49b9-42d4-833d-95250b785aa1 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-813321385", "ram": 512, "vcpus": 1, "disk": 10, "id": 16266367, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:45.804008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '.version_select at 0x7fb232282ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:45.813828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=128868) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 03 14:32:45.815464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.815954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.816364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.829659 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8448ebb-49b9-42d4-833d-95250b785aa1 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.203302 Oct 03 14:32:45.830758 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 5/7] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:45.836110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07e460c9-541a-40dd-9683-da908b1d3e22 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1933184031"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:45.840754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-07e460c9-541a-40dd-9683-da908b1d3e22 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid 46c0332b-4f60-42e1-aa73-8a63c97fd2e4 for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:45.848283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.848486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.848910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.869369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:45.870482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:45.870914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:45.877347 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-166de70a-8c30-4452-89a4-eebd8ae48f5d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.149988 Oct 03 14:32:45.877913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3/8] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 3 14:32:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:45.911935 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07e460c9-541a-40dd-9683-da908b1d3e22 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079285 Oct 03 14:32:45.913244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 6/9] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:46.075856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc6251a6-9a64-4505-bf22-57cb81d0e914 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Calling method '.version_select at 0x7fb23222c820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.079508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc6251a6-9a64-4505-bf22-57cb81d0e914 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'e9f3496823ba4e1f877e113a61534197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99076b1be73742fab50a490ea5e03aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc6251a6-9a64-4505-bf22-57cb81d0e914 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Request method failure captured: Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKKWHAw7kyBvveiq8xi7XlYZz0Ovq4938jPSRwbW9HymRC8ppSo8mqWJai1_lx_y0HW6-hEHz1uzNRHU2RKruEjptGkPSciRatTfJIRpKmhedIhIuBmP0qFKnWqEoZTL-3sF1lPMAkDT4hxFC1neP3iTtH3gnfBbnnod-i72cZoCQM Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:32:46.085191 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99076b1be73742fab50a490ea5e03aac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e9f3496823ba4e1f877e113a61534197 Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:32:46.086335 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.087019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 03 14:32:46.087969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.090376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc6251a6-9a64-4505-bf22-57cb81d0e914 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.091193 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc6251a6-9a64-4505-bf22-57cb81d0e914 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.212207 Oct 03 14:32:46.091752 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 4/10] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 3 14:32:45 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 213 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:46.099689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.102031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:46.102538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:46.103006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:46.103739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:46.104296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:46.104912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:46.150707 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-624a832f-beab-4b34-b577-e06867855541 tempest-AZAdminV2TestJSON-1728359584 tempest-AZAdminV2TestJSON-1728359584-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.057870 Oct 03 14:32:46.151880 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:46.156615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-845c472c-e869-4880-b6e9-90dbe52b748c tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:46.262453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53f7b0d5-3ed2-4825-8027-444afdf77f1b tempest-FlavorsV261TestJSON-139853957 tempest-FlavorsV261TestJSON-139853957-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.284708 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53f7b0d5-3ed2-4825-8027-444afdf77f1b tempest-FlavorsV261TestJSON-139853957 tempest-FlavorsV261TestJSON-139853957-project] 10.222.0.20 "GET /compute/v2.1/flavors/1610481416" status: 200 len: 468 microversion: 2.61 time: 0.370032 Oct 03 14:32:46.294902 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 7/12] 10.222.0.20 () {60 vars in 1199 bytes} [Mon Oct 3 14:32:45 2022] GET /compute/v2.1/flavors/1610481416 => generated 468 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:32:46.375559 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-845c472c-e869-4880-b6e9-90dbe52b748c tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1376220010/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.222365 Oct 03 14:32:46.377232 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 6/13] 10.222.0.20 () {62 vars in 1265 bytes} [Mon Oct 3 14:32:46 2022] POST /compute/v2.1/flavors/1376220010/os-extra_specs => generated 62 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:46.384755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5ade0c2-fc02-4d05-bff0-970de2fd264f tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:46.418197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5ade0c2-fc02-4d05-bff0-970de2fd264f tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:46.418634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5ade0c2-fc02-4d05-bff0-970de2fd264f tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:46.419234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5ade0c2-fc02-4d05-bff0-970de2fd264f tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:46.451835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab1d088f-72e9-4824-a2d6-32875e0203f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.466754 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ab1d088f-72e9-4824-a2d6-32875e0203f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] HTTP exception thrown: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab1d088f-72e9-4824-a2d6-32875e0203f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Request method failure captured: Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/flavors/16266367/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKrNTTij9enTg5HyKv808_bQelUdBdUpctqEahtQ_iH4weDRuQUohzcE0w02EMGK0dc0fKf-9hW-_lvcYPQAWtphzU9buTf5tjztw0DVjMguMw3YzH327wPPFHWFFsiNGQ0h3HPxPCv-rRiYfNYsxWKLxHqXQc4mwr8m68n9BJR3o Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:46.471078 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d6a24ea524463690d72525814873af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d6a24ea524463690d72525814873af", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9a09be7a06da4107abbf857a491a6d01 Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:46.472159 n-d-781139-2 devstack@n-api.service[128869]: exception: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'flavor_id': '16266367', 'id': 'hw:cpu_thread_policy'} Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.472719 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab1d088f-72e9-4824-a2d6-32875e0203f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Returning 404 to user: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab1d088f-72e9-4824-a2d6-32875e0203f4 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] 10.222.0.20 "GET /compute/v2.1/flavors/16266367/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.176561 Oct 03 14:32:46.473990 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/flavors/16266367/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:46.481008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6764fe04-787b-454e-bfa3-b40a9f12d9dc tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Calling method '.version_select at 0x7fb232248a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.483436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6764fe04-787b-454e-bfa3-b40a9f12d9dc tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'e9f3496823ba4e1f877e113a61534197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99076b1be73742fab50a490ea5e03aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6764fe04-787b-454e-bfa3-b40a9f12d9dc tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Request method failure captured: Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-781139-2/reboot HTTP/1.1 Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKWHAw7kyBvveiq8xi7XlYZz0Ovq4938jPSRwbW9HymRC8ppSo8mqWJai1_lx_y0HW6-hEHz1uzNRHU2RKruEjptGkPSciRatTfJIRpKmhedIhIuBmP0qFKnWqEoZTL-3sF1lPMAkDT4hxFC1neP3iTtH3gnfBbnnod-i72cZoCQM Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:46.485399 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99076b1be73742fab50a490ea5e03aac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e9f3496823ba4e1f877e113a61534197 Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'n-d-781139-2'} Oct 03 14:32:46.486525 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.487157 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 03 14:32:46.488042 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.488854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6764fe04-787b-454e-bfa3-b40a9f12d9dc tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.488854 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6764fe04-787b-454e-bfa3-b40a9f12d9dc tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-781139-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.011468 Oct 03 14:32:46.492871 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 9/15] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/os-hosts/n-d-781139-2/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:46.498142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6bf86fe-c49e-469a-90a9-30982748685d tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] Action: 'update', calling method: .version_select at 0x7fb23276fb80>, body: {"flavor": {"description": "new"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:46.553014 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6bf86fe-c49e-469a-90a9-30982748685d tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1610481416" status: 200 len: 469 microversion: 2.61 time: 0.058903 Oct 03 14:32:46.554225 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 10/16] 10.222.0.20 () {62 vars in 1219 bytes} [Mon Oct 3 14:32:46 2022] PUT /compute/v2.1/flavors/1610481416 => generated 469 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:32:46.559622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6e1a86af-e65f-4e19-a086-9d2a12fd4069 tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.590600 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6e1a86af-e65f-4e19-a086-9d2a12fd4069 tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1376220010" status: 202 len: 0 microversion: 2.86 time: 0.035112 Oct 03 14:32:46.591181 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 11/17] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Oct 3 14:32:46 2022] DELETE /compute/v2.1/flavors/1376220010 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:32:46.596324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2d244d0-0a80-421f-b14f-4ff6550e8bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:46.600242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2d244d0-0a80-421f-b14f-4ff6550e8bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '9a09be7a06da4107abbf857a491a6d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d6a24ea524463690d72525814873af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2d244d0-0a80-421f-b14f-4ff6550e8bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Request method failure captured: Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/flavors/16266367/os-extra_specs HTTP/1.1 Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 66 Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKrNTTij9enTg5HyKv808_bQelUdBdUpctqEahtQ_iH4weDRuQUohzcE0w02EMGK0dc0fKf-9hW-_lvcYPQAWtphzU9buTf5tjztw0DVjMguMw3YzH327wPPFHWFFsiNGQ0h3HPxPCv-rRiYfNYsxWKLxHqXQc4mwr8m68n9BJR3o Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:46.602717 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d6a24ea524463690d72525814873af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d6a24ea524463690d72525814873af", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9a09be7a06da4107abbf857a491a6d01 Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 03 14:32:46.604090 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'flavor_id': '16266367', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:46.604837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 03 14:32:46.606343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.607558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2d244d0-0a80-421f-b14f-4ff6550e8bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.607558 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2d244d0-0a80-421f-b14f-4ff6550e8bb0 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] 10.222.0.20 "POST /compute/v2.1/flavors/16266367/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.012024 Oct 03 14:32:46.609678 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 12/18] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 3 14:32:46 2022] POST /compute/v2.1/flavors/16266367/os-extra_specs => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:46.614759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d9af3a7-d60a-4f18-8ce4-567b3b3d5e72 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Calling method '.version_select at 0x7fb23195b0d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.641458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8d9af3a7-d60a-4f18-8ce4-567b3b3d5e72 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d9af3a7-d60a-4f18-8ce4-567b3b3d5e72 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:46.647642 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'nonexistent_hostname'} Oct 03 14:32:46.648950 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:46.649615 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 03 14:32:46.650632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d9af3a7-d60a-4f18-8ce4-567b3b3d5e72 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.651604 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d9af3a7-d60a-4f18-8ce4-567b3b3d5e72 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.039028 Oct 03 14:32:46.655565 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 13/19] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:32:46.660748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0a45940-5022-4535-ba7f-892dc5e70cd2 tempest-FlavorsV261TestJSON-139853957 tempest-FlavorsV261TestJSON-139853957-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.699812 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0a45940-5022-4535-ba7f-892dc5e70cd2 tempest-FlavorsV261TestJSON-139853957 tempest-FlavorsV261TestJSON-139853957-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6689 microversion: 2.61 time: 0.042964 Oct 03 14:32:46.712949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 14/20] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/flavors/detail => generated 6689 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:32:46.712949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c552c03-9028-4895-b390-eb535dfe6122 tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.742939 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c552c03-9028-4895-b390-eb535dfe6122 tempest-FlavorMetadataValidation-195501170 tempest-FlavorMetadataValidation-195501170-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6674 microversion: 2.86 time: 0.041013 Oct 03 14:32:46.743666 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 15/21] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/flavors/detail => generated 6674 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:32:46.748138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2230ccac-d2a2-47bc-8138-8244d1dc81cf tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:46.790967 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2230ccac-d2a2-47bc-8138-8244d1dc81cf tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/16266367/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046232 Oct 03 14:32:46.791664 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 16/22] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 3 14:32:46 2022] POST /compute/v2.1/flavors/16266367/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:32:46.796419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d48bfe6-4646-44ff-95e1-8244fad2c9bd tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Calling method '.version_select at 0x7fb231837e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.798721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d48bfe6-4646-44ff-95e1-8244fad2c9bd tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'e9f3496823ba4e1f877e113a61534197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99076b1be73742fab50a490ea5e03aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d48bfe6-4646-44ff-95e1-8244fad2c9bd tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Request method failure captured: Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-781139-2 HTTP/1.1 Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKWHAw7kyBvveiq8xi7XlYZz0Ovq4938jPSRwbW9HymRC8ppSo8mqWJai1_lx_y0HW6-hEHz1uzNRHU2RKruEjptGkPSciRatTfJIRpKmhedIhIuBmP0qFKnWqEoZTL-3sF1lPMAkDT4hxFC1neP3iTtH3gnfBbnnod-i72cZoCQM Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:46.800264 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99076b1be73742fab50a490ea5e03aac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e9f3496823ba4e1f877e113a61534197 Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'n-d-781139-2'} Oct 03 14:32:46.802188 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.803038 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 03 14:32:46.804028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.806691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d48bfe6-4646-44ff-95e1-8244fad2c9bd tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.806691 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d48bfe6-4646-44ff-95e1-8244fad2c9bd tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-781139-2" status: 403 len: 109 microversion: 2.1 time: 0.009089 Oct 03 14:32:46.806691 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 17/23] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/os-hosts/n-d-781139-2 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:46.807437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6a5d6f5-0e29-4996-876a-c80b271b82f4 tempest-FlavorsV261TestJSON-139853957 tempest-FlavorsV261TestJSON-139853957-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.829219 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6a5d6f5-0e29-4996-876a-c80b271b82f4 tempest-FlavorsV261TestJSON-139853957 tempest-FlavorsV261TestJSON-139853957-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3403 microversion: 2.61 time: 0.025942 Oct 03 14:32:46.829947 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 18/24] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/flavors => generated 3403 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:32:46.834590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8aa66f1-296d-425d-9edc-f7db56f66049 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.836080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8aa66f1-296d-425d-9edc-f7db56f66049 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '9a09be7a06da4107abbf857a491a6d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d6a24ea524463690d72525814873af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8aa66f1-296d-425d-9edc-f7db56f66049 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Request method failure captured: Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKrNTTij9enTg5HyKv808_bQelUdBdUpctqEahtQ_iH4weDRuQUohzcE0w02EMGK0dc0fKf-9hW-_lvcYPQAWtphzU9buTf5tjztw0DVjMguMw3YzH327wPPFHWFFsiNGQ0h3HPxPCv-rRiYfNYsxWKLxHqXQc4mwr8m68n9BJR3o Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:46.837611 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d6a24ea524463690d72525814873af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d6a24ea524463690d72525814873af", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9a09be7a06da4107abbf857a491a6d01 Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:46.838778 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'flavor_id': '16266367', 'id': 'hw:numa_nodes'} Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.839329 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.840278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8aa66f1-296d-425d-9edc-f7db56f66049 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.841612 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8aa66f1-296d-425d-9edc-f7db56f66049 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007953 Oct 03 14:32:46.841612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 19/25] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:32:46 2022] DELETE /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:46.847627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0e4b039-869f-4031-8d21-a4e0b6d31b05 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Calling method '.version_select at 0x7fb2318809d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.854469 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a0e4b039-869f-4031-8d21-a4e0b6d31b05 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0e4b039-869f-4031-8d21-a4e0b6d31b05 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:46.856024 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'nonexistent_hostname'} Oct 03 14:32:46.857188 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.857986 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:46.859104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.860150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0e4b039-869f-4031-8d21-a4e0b6d31b05 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.860150 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0e4b039-869f-4031-8d21-a4e0b6d31b05 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017148 Oct 03 14:32:46.860150 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 20/26] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:32:46.865501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7199a1ed-38a0-4424-a772-67039fa1f246 tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.883648 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7199a1ed-38a0-4424-a772-67039fa1f246 tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1610481416" status: 202 len: 0 microversion: 2.61 time: 0.022321 Oct 03 14:32:46.884330 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 21/27] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Oct 3 14:32:46 2022] DELETE /compute/v2.1/flavors/1610481416 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:32:46.898324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-701769f4-2735-499b-81f3-14936d16eeaa tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:46.926280 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-701769f4-2735-499b-81f3-14936d16eeaa tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/16266367/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040887 Oct 03 14:32:46.927421 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 22/28] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 3 14:32:46 2022] POST /compute/v2.1/flavors/16266367/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:32:46.936597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fac12a58-aca9-4f52-8623-9b30813a1691 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Calling method '.version_select at 0x7fb2317e0310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.938813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fac12a58-aca9-4f52-8623-9b30813a1691 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'e9f3496823ba4e1f877e113a61534197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99076b1be73742fab50a490ea5e03aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fac12a58-aca9-4f52-8623-9b30813a1691 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Request method failure captured: Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-781139-2/shutdown HTTP/1.1 Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKWHAw7kyBvveiq8xi7XlYZz0Ovq4938jPSRwbW9HymRC8ppSo8mqWJai1_lx_y0HW6-hEHz1uzNRHU2RKruEjptGkPSciRatTfJIRpKmhedIhIuBmP0qFKnWqEoZTL-3sF1lPMAkDT4hxFC1neP3iTtH3gnfBbnnod-i72cZoCQM Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:46.940741 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99076b1be73742fab50a490ea5e03aac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e9f3496823ba4e1f877e113a61534197 Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'n-d-781139-2'} Oct 03 14:32:46.941837 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.942485 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 03 14:32:46.943507 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.946078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fac12a58-aca9-4f52-8623-9b30813a1691 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:46.947020 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fac12a58-aca9-4f52-8623-9b30813a1691 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-781139-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017241 Oct 03 14:32:46.947659 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 23/29] 10.222.0.20 () {58 vars in 1194 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/os-hosts/n-d-781139-2/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:46.952780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-baffefcb-20e9-46ff-ad24-b5e5cb7919fb tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:46.981801 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-baffefcb-20e9-46ff-ad24-b5e5cb7919fb tempest-FlavorsV261TestJSON-1416496040 tempest-FlavorsV261TestJSON-1416496040-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6277 microversion: 2.61 time: 0.032455 Oct 03 14:32:46.983357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 24/30] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:46 2022] GET /compute/v2.1/flavors/detail => generated 6277 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:32:46.988823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a21e4d42-078f-4068-b6e6-e90d1ccce9c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:46.992863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a21e4d42-078f-4068-b6e6-e90d1ccce9c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '9a09be7a06da4107abbf857a491a6d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d6a24ea524463690d72525814873af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a21e4d42-078f-4068-b6e6-e90d1ccce9c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Request method failure captured: Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 22 Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKrNTTij9enTg5HyKv808_bQelUdBdUpctqEahtQ_iH4weDRuQUohzcE0w02EMGK0dc0fKf-9hW-_lvcYPQAWtphzU9buTf5tjztw0DVjMguMw3YzH327wPPFHWFFsiNGQ0h3HPxPCv-rRiYfNYsxWKLxHqXQc4mwr8m68n9BJR3o Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:46.997097 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d6a24ea524463690d72525814873af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d6a24ea524463690d72525814873af", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d6a24ea524463690d72525814873af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 48d6a24ea524463690d72525814873af Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9a09be7a06da4107abbf857a491a6d01 Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: {"hw:numa_nodes": "1"} Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:46.998199 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'flavor_id': '16266367', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:46.998839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 03 14:32:46.999739 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.002361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a21e4d42-078f-4068-b6e6-e90d1ccce9c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.003410 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a21e4d42-078f-4068-b6e6-e90d1ccce9c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657 tempest-FlavorsExtraSpecsNegativeTestJSON-1733650657-project] 10.222.0.20 "PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018887 Oct 03 14:32:47.004114 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 25/31] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 3 14:32:46 2022] PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:47.013181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-398a15b6-ee0b-4385-8c77-89a919ead4c5 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Calling method '.version_select at 0x7fb2317f44c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:47.026782 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-398a15b6-ee0b-4385-8c77-89a919ead4c5 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-398a15b6-ee0b-4385-8c77-89a919ead4c5 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:47.029828 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'nonexistent_hostname'} Oct 03 14:32:47.031054 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:47.031703 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 03 14:32:47.032607 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.033578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.036295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-398a15b6-ee0b-4385-8c77-89a919ead4c5 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.037752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-398a15b6-ee0b-4385-8c77-89a919ead4c5 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.032382 Oct 03 14:32:47.039071 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 26/32] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 14:32:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:32:47.046439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a828adc0-125c-46af-8d83-0775f10124bb tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:47.056282 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a828adc0-125c-46af-8d83-0775f10124bb tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] HTTP exception thrown: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a828adc0-125c-46af-8d83-0775f10124bb tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Request method failure captured: Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/flavors/16266367/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMR2FA0WjKnJpz5eXGU4utsabd9uZElk2z7B6BhuwY-Sfj0Bna_ricZOrbCXyAk_T07jqxrUrxMuPxKiDevAKStu4_jcoRUQZdpaUmWC9aUXlvO5JEoJ_as1wlyyISu1FiEPDeRylGnwk7CPtYtn-1_nF4bDUFiXGunHfZG3pvRMM Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f7ddf8670f5b44e18f1351efee36a731 Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:47.059808 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7ddf8670f5b44e18f1351efee36a731", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f7ddf8670f5b44e18f1351efee36a731 Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 37cb02204bc543dc911d79d7cbc17e30 Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:47.060914 n-d-781139-2 devstack@n-api.service[128869]: exception: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'flavor_id': '16266367', 'id': 'hw:cpu_thread_policy'} Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.061551 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.062628 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.062628 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.062628 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.062628 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:47.062628 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:47.062628 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. Oct 03 14:32:47.062628 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.064506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a828adc0-125c-46af-8d83-0775f10124bb tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Returning 404 to user: Flavor 16266367 has no extra specs with key hw:cpu_thread_policy. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.065568 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a828adc0-125c-46af-8d83-0775f10124bb tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/16266367/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.025367 Oct 03 14:32:47.067023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 27/33] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:32:47 2022] DELETE /compute/v2.1/flavors/16266367/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:47.073716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f166485-2732-42ff-8550-95fb76d3bbf6 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Calling method '.version_select at 0x7fb231880af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:47.083087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f166485-2732-42ff-8550-95fb76d3bbf6 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'e9f3496823ba4e1f877e113a61534197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99076b1be73742fab50a490ea5e03aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f166485-2732-42ff-8550-95fb76d3bbf6 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Request method failure captured: Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hosts/n-d-781139-2/startup HTTP/1.1 Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKWHAw7kyBvveiq8xi7XlYZz0Ovq4938jPSRwbW9HymRC8ppSo8mqWJai1_lx_y0HW6-hEHz1uzNRHU2RKruEjptGkPSciRatTfJIRpKmhedIhIuBmP0qFKnWqEoZTL-3sF1lPMAkDT4hxFC1neP3iTtH3gnfBbnnod-i72cZoCQM Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:47.085135 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99076b1be73742fab50a490ea5e03aac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e9f3496823ba4e1f877e113a61534197 Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'n-d-781139-2'} Oct 03 14:32:47.086358 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:47.086992 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 03 14:32:47.087905 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.088889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f166485-2732-42ff-8550-95fb76d3bbf6 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.088889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f166485-2732-42ff-8550-95fb76d3bbf6 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-781139-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.018198 Oct 03 14:32:47.089776 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 28/34] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 3 14:32:47 2022] GET /compute/v2.1/os-hosts/n-d-781139-2/startup => generated 110 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:47.101934 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5ade0c2-fc02-4d05-bff0-970de2fd264f tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.723540 Oct 03 14:32:47.102723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94dcc7cc-90f6-4e7e-8298-f5025ef8bfff tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.103684 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 7/35] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:32:46 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:47.110662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b62875f-bf91-44a5-997e-d5d088cbf8f3 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Calling method '.version_select at 0x7fb2321105e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:47.116589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-94dcc7cc-90f6-4e7e-8298-f5025ef8bfff tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94dcc7cc-90f6-4e7e-8298-f5025ef8bfff tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Request method failure captured: Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 27 Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMR2FA0WjKnJpz5eXGU4utsabd9uZElk2z7B6BhuwY-Sfj0Bna_ricZOrbCXyAk_T07jqxrUrxMuPxKiDevAKStu4_jcoRUQZdpaUmWC9aUXlvO5JEoJ_as1wlyyISu1FiEPDeRylGnwk7CPtYtn-1_nF4bDUFiXGunHfZG3pvRMM Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f7ddf8670f5b44e18f1351efee36a731 Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:47.117970 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7ddf8670f5b44e18f1351efee36a731", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f7ddf8670f5b44e18f1351efee36a731 Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 37cb02204bc543dc911d79d7cbc17e30 Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: {"hw:cpu_policy": "shared"} Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:47.119072 n-d-781139-2 devstack@n-api.service[128869]: exception: Request body and URI mismatch Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'flavor_id': '16266367', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.120606 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.122413 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:47.122413 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:47.122413 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 03 14:32:47.122413 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.122413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94dcc7cc-90f6-4e7e-8298-f5025ef8bfff tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.122413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94dcc7cc-90f6-4e7e-8298-f5025ef8bfff tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.029710 Oct 03 14:32:47.124418 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 29/36] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 3 14:32:47 2022] PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:32:47.135399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.148315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:47.148806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:47.149270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:47.150045 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-8b62875f-bf91-44a5-997e-d5d088cbf8f3 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b62875f-bf91-44a5-997e-d5d088cbf8f3 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:47.162610 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'nonexistent_hostname'} Oct 03 14:32:47.163858 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:47.164565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 03 14:32:47.165657 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b62875f-bf91-44a5-997e-d5d088cbf8f3 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.167749 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b62875f-bf91-44a5-997e-d5d088cbf8f3 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.059022 Oct 03 14:32:47.170995 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 8/37] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Oct 3 14:32:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:32:47.185960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b01ff07f-f509-410e-a5bf-fb5320891cee tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b01ff07f-f509-410e-a5bf-fb5320891cee tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Request method failure captured: Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 49 Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMR2FA0WjKnJpz5eXGU4utsabd9uZElk2z7B6BhuwY-Sfj0Bna_ricZOrbCXyAk_T07jqxrUrxMuPxKiDevAKStu4_jcoRUQZdpaUmWC9aUXlvO5JEoJ_as1wlyyISu1FiEPDeRylGnwk7CPtYtn-1_nF4bDUFiXGunHfZG3pvRMM Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f7ddf8670f5b44e18f1351efee36a731 Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:47.192028 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7ddf8670f5b44e18f1351efee36a731", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7ddf8670f5b44e18f1351efee36a731"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f7ddf8670f5b44e18f1351efee36a731 Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 37cb02204bc543dc911d79d7cbc17e30 Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 03 14:32:47.193369 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'flavor_id': '16266367', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance: Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 03 14:32:47.193997 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.195130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b01ff07f-f509-410e-a5bf-fb5320891cee tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.196830 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b01ff07f-f509-410e-a5bf-fb5320891cee tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019521 Oct 03 14:32:47.199300 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 9/38] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 3 14:32:47 2022] PUT /compute/v2.1/flavors/16266367/os-extra_specs/hw:numa_nodes => generated 117 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:32:47.200720 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-781139-2. Oct 03 14:32:47.207853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8201ac3-7f2a-4d2d-94c2-ef3afa77cb5f tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Action: 'update', calling method: .version_select at 0x7fb23180f160>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8201ac3-7f2a-4d2d-94c2-ef3afa77cb5f tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/os-hosts/n-d-781139-2 HTTP/1.1 Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 51 Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:47.212966 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: {"status": "enable", "maintenance_mode": "invalid"} Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:32:47.214855 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'n-d-781139-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'disable', Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'Enable', Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'Disable', Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance: Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.215529 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.216754 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.218897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.218897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:32:47.218897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:32:47.218897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.218897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.218897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8201ac3-7f2a-4d2d-94c2-ef3afa77cb5f tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.218897 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d8201ac3-7f2a-4d2d-94c2-ef3afa77cb5f tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-781139-2" status: 400 len: 199 microversion: 2.1 time: 0.014066 Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 39 Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:47.219673 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: {"add_host": {"host": "n-h2-781139-2"}} Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:47.221967 n-d-781139-2 devstack@n-api.service[128869]: exception: Aggregate 1 already has host n-h2-781139-2. Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-781139-2'}}} Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:32:47.223658 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-781139-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi session.flush() Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 14:32:47.225871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 14:32:47.227983 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:32:47.231365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-781139-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 3, 14, 32, 47, 187600), 'updated_at': None, 'host': 'n-h2-781139-2', 'aggregate_id': 1}] Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.233820 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-781139-2. Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.236461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-781139-2. Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:47.239416 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:47.242024 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-781139-2. Oct 03 14:32:47.242024 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.242024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-781139-2. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.242024 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1d9bbcf-0d8e-4f6a-b63d-5d898e4360e7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.091666 Oct 03 14:32:47.242555 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 10/39] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:47 2022] PUT /compute/v2.1/os-hosts/n-d-781139-2 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:32:47.242704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 30/40] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:32:47 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 03 14:32:47.242704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13dabe54-0543-4b08-8841-48e55e418f20 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Action: 'update', calling method: .version_select at 0x7fb2316553a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.242977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6624bccf-b666-497f-969d-5a51b60e5fa7 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13dabe54-0543-4b08-8841-48e55e418f20 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/os-hosts/n-d-781139-2 HTTP/1.1 Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 51 Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:47.243120 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: {"status": "invalid", "maintenance_mode": "enable"} Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:32:47.247393 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'n-d-781139-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'disable', Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'Enable', Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'Disable', Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance: Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.248844 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.251475 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13dabe54-0543-4b08-8841-48e55e418f20 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13dabe54-0543-4b08-8841-48e55e418f20 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-781139-2" status: 400 len: 189 microversion: 2.1 time: 0.011062 Oct 03 14:32:47.254268 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 31/41] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:47 2022] PUT /compute/v2.1/os-hosts/n-d-781139-2 => generated 189 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:32:47.255958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-add6670d-2a66-4b42-b759-75573a712fd6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.259044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add6670d-2a66-4b42-b759-75573a712fd6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:47.259270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add6670d-2a66-4b42-b759-75573a712fd6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:47.259872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-add6670d-2a66-4b42-b759-75573a712fd6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:47.266770 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6624bccf-b666-497f-969d-5a51b60e5fa7 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/16266367" status: 202 len: 0 microversion: 2.1 time: 0.044722 Oct 03 14:32:47.268559 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 11/42] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:32:47 2022] DELETE /compute/v2.1/flavors/16266367 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:32:47.274233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e2dca3c-5a9c-4b04-90a5-74ef10807435 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Action: 'update', calling method: .version_select at 0x7fb232110700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.278635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0e2dca3c-5a9c-4b04-90a5-74ef10807435 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'e9f3496823ba4e1f877e113a61534197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99076b1be73742fab50a490ea5e03aac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e2dca3c-5a9c-4b04-90a5-74ef10807435 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Request method failure captured: Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/os-hosts/n-d-781139-2 HTTP/1.1 Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 50 Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKKWHAw7kyBvveiq8xi7XlYZz0Ovq4938jPSRwbW9HymRC8ppSo8mqWJai1_lx_y0HW6-hEHz1uzNRHU2RKruEjptGkPSciRatTfJIRpKmhedIhIuBmP0qFKnWqEoZTL-3sF1lPMAkDT4hxFC1neP3iTtH3gnfBbnnod-i72cZoCQM Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:32:47.280275 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99076b1be73742fab50a490ea5e03aac", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99076b1be73742fab50a490ea5e03aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 99076b1be73742fab50a490ea5e03aac Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2123063688 Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e9f3496823ba4e1f877e113a61534197 Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2123063688-project Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: {"status": "enable", "maintenance_mode": "enable"} Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 03 14:32:47.281431 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'n-d-781139-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:47.282162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 03 14:32:47.283175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.286396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e2dca3c-5a9c-4b04-90a5-74ef10807435 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.286396 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e2dca3c-5a9c-4b04-90a5-74ef10807435 tempest-HostsAdminNegativeTestJSON-2123063688 tempest-HostsAdminNegativeTestJSON-2123063688-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-781139-2" status: 403 len: 111 microversion: 2.1 time: 0.011967 Oct 03 14:32:47.286396 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 12/43] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:47 2022] PUT /compute/v2.1/os-hosts/n-d-781139-2 => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:47.288829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f19bed3e-07dd-4d7b-b963-406342a164b5 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:47.330403 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f19bed3e-07dd-4d7b-b963-406342a164b5 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050 tempest-FlavorsExtraSpecsNegativeTestJSON-389721050-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046422 Oct 03 14:32:47.331362 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 13/44] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:47.335937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-164a3771-3048-4274-88b8-d3842b7dbde6 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Action: 'update', calling method: .version_select at 0x7fb23181b8b0>, body: {"status": null, "maintenance_mode": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-164a3771-3048-4274-88b8-d3842b7dbde6 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/os-hosts/n-d-781139-2 HTTP/1.1 Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 42 Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:47.342090 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: {"status": null, "maintenance_mode": null} Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 03 14:32:47.343520 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'n-d-781139-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'disable', Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'Enable', Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'Disable', Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance: Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi None Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.344352 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.345918 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.347054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:32:47.347054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:32:47.347054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 03 14:32:47.347054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.349145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-164a3771-3048-4274-88b8-d3842b7dbde6 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.350134 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-164a3771-3048-4274-88b8-d3842b7dbde6 tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-781139-2" status: 400 len: 127 microversion: 2.1 time: 0.017834 Oct 03 14:32:47.351133 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 14/45] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:47 2022] PUT /compute/v2.1/os-hosts/n-d-781139-2 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:32:47.361400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6549fc43-afec-4425-8b40-879ce3a2451d tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Action: 'update', calling method: .version_select at 0x7fb2317bc040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:47.365231 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.hosts [None req-6549fc43-afec-4425-8b40-879ce3a2451d tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Enabling host nonexistent_hostname. Oct 03 14:32:47.377866 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6549fc43-afec-4425-8b40-879ce3a2451d tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6549fc43-afec-4425-8b40-879ce3a2451d tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Request method failure captured: Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 50 Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMPPUP7vZak-bQyfPkmfbYkgoDxUSnceE0a6W6ndso7GK02UXF-GryA60q9RxiNC76fZFlH-wmAtvcEbUaxS-X7mOLzWbvmttwcePdqP0ZgqFvEAhmP4wjhfI9DBwt0vz4gVDVIGn2FHPKs6YEo8iXrkdg8qlUyGfMzKOJRqL1clA Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:47.380740 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8f320d9862074b089a28526563cf2323"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8f320d9862074b089a28526563cf2323", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8f320d9862074b089a28526563cf2323"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 8f320d9862074b089a28526563cf2323 Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1294027514 Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: fe3285180b7e423cb52499f52c671fce Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1294027514-project-admin Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: {"status": "enable", "maintenance_mode": "enable"} Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.382116 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 14:32:47.382962 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:47.384056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 03 14:32:47.385245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:47.387191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6549fc43-afec-4425-8b40-879ce3a2451d tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:47.387382 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6549fc43-afec-4425-8b40-879ce3a2451d tempest-HostsAdminNegativeTestJSON-1294027514 tempest-HostsAdminNegativeTestJSON-1294027514-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031019 Oct 03 14:32:47.387983 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 15/46] 10.222.0.20 () {60 vars in 1211 bytes} [Mon Oct 3 14:32:47 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:32:48.473537 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-add6670d-2a66-4b42-b759-75573a712fd6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.236351 Oct 03 14:32:48.474668 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 32/47] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:32:47 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:48.487223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6fed3711-089c-4001-8ffd-c9199fbb9876 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:48.524474 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6fed3711-089c-4001-8ffd-c9199fbb9876 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.041708 Oct 03 14:32:48.525721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 16/48] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:48 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 14:32:48.537048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6380afff-5668-4b34-823b-3d2077003a90 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1413452849"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:48.542691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-6380afff-5668-4b34-823b-3d2077003a90 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid 747df28f-769f-4e06-8983-717e944c4466 for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:48.550774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:48.555548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb64536c-01b0-48d8-bdb7-3402c9b6c0ef tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1229282158", "name": "tempest-test_aggregate-1399650738"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:48.582234 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6380afff-5668-4b34-823b-3d2077003a90 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050613 Oct 03 14:32:48.582912 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 33/49] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:48 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:48.646163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-eb64536c-01b0-48d8-bdb7-3402c9b6c0ef tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 064a03c7-907f-46ba-9354-59720b0aa14c for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:48.696611 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb64536c-01b0-48d8-bdb7-3402c9b6c0ef tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.146511 Oct 03 14:32:48.704142 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 17/50] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 3 14:32:48 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:48.709898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98fe025a-25de-4195-8da1-76f8611fcfbc tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:48.727056 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98fe025a-25de-4195-8da1-76f8611fcfbc tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.021306 Oct 03 14:32:48.737031 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 18/51] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:32:48 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:48.742495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba8c6c23-f666-4566-94d7-6d113d2b8c1a tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:48.758536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8c6c23-f666-4566-94d7-6d113d2b8c1a tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:48.759099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8c6c23-f666-4566-94d7-6d113d2b8c1a tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:48.759619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8c6c23-f666-4566-94d7-6d113d2b8c1a tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:48.967805 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba8c6c23-f666-4566-94d7-6d113d2b8c1a tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.229115 Oct 03 14:32:48.977825 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 19/52] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:32:48 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:49.335518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e488afd3-00e5-4f63-9e49-567e5e2c9aeb tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.339806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e488afd3-00e5-4f63-9e49-567e5e2c9aeb tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '20fe3126d2b04acf996a59f8549b2001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7911cf51cb4a40a91b512e0de33cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e488afd3-00e5-4f63-9e49-567e5e2c9aeb tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Request method failure captured: Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 39 Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKKsZcqGIQ7HNow3stJFy1TBWcw6cdl_g6rE3XY1n2KC-qy58UtdYGZ6JSFjNpcaCGtF0g8e2hmUj2NRwrieEPe4c7FS0uUjQYAVwFbiRKOWVTJxmLh70Zy9G7weTY2wuPHHeo2BdomQ6fQZr766FMiKbo9kzgo_wN5kKGCe_6vu2c Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:49.342120 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f7911cf51cb4a40a91b512e0de33cb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 20fe3126d2b04acf996a59f8549b2001 Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: {"add_host": {"host": "n-h2-781139-2"}} Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:49.343237 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-781139-2'}}} Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:49.344079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 03 14:32:49.345164 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.348690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e488afd3-00e5-4f63-9e49-567e5e2c9aeb tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.349945 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e488afd3-00e5-4f63-9e49-567e5e2c9aeb tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.758384 Oct 03 14:32:49.355081 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 34/53] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:32:48 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 764 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:32:49.359996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61747941-421f-47ff-a892-48fb394ee2d8 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:49.392766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61747941-421f-47ff-a892-48fb394ee2d8 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.036143 Oct 03 14:32:49.398419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 20/54] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:49 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 14:32:49.406686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-329ec427-3d7d-422f-87fa-1cb624c78f12 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-659983332"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.407999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-329ec427-3d7d-422f-87fa-1cb624c78f12 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid 2b2587cf-df28-4c39-aac3-c788babec09e for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:49.430498 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-329ec427-3d7d-422f-87fa-1cb624c78f12 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.030428 Oct 03 14:32:49.438617 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 35/55] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:49.443535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-573712469"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.459506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:49.461057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:49.461963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:49.470101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:49.470846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:49.471697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:49.480021 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-573712469 could not be found. Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 57 Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:49.482831 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: {"add_host": {"host": "tempest-nonexist_host-573712469"}} Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:49.483959 n-d-781139-2 devstack@n-api.service[128868]: exception: Compute host tempest-nonexist_host-573712469 could not be found. Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-573712469'}}} Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-573712469' is not mapped to any cell Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.484619 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 03 14:32:49.485614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-573712469 could not be found. Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-573712469 could not be found. Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.486618 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.489884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.489884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.489884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.489884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:49.489884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:49.489884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-573712469 could not be found. Oct 03 14:32:49.489884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.491257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-573712469 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.492157 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-573e02e5-6073-43fc-8125-6912dae9f31e tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.052744 Oct 03 14:32:49.492749 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 21/56] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:32:49.501588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-829c5c0b-edb9-4b2a-b5bb-2b7e34c49913 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:49.533282 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-829c5c0b-edb9-4b2a-b5bb-2b7e34c49913 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.035020 Oct 03 14:32:49.534095 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 36/57] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:49 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:32:49.544115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-47bcf2cb-c93f-469d-912d-20db82faa103 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-47bcf2cb-c93f-469d-912d-20db82faa103 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 283 Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:49.548274 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.549684 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:32:49.550296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.550813 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.551874 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.552614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:32:49.552614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:32:49.552614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:32:49.552614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.552614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-47bcf2cb-c93f-469d-912d-20db82faa103 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.552915 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-47bcf2cb-c93f-469d-912d-20db82faa103 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009841 Oct 03 14:32:49.555549 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 22/58] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:32:49.561936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df44812e-4a0c-4892-a28c-3e7372ef7521 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df44812e-4a0c-4892-a28c-3e7372ef7521 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 27 Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:49.570783 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: {"aggregate": {"name": ""}} Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:49.572183 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '' Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.573340 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:32:49.574523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.575504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df44812e-4a0c-4892-a28c-3e7372ef7521 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.576318 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df44812e-4a0c-4892-a28c-3e7372ef7521 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.017454 Oct 03 14:32:49.582442 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 23/59] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:32:49.587865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d9ef5d3-2c7b-4df7-8203-ddae6f85ec53 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1679743130"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.592079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d9ef5d3-2c7b-4df7-8203-ddae6f85ec53 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '20fe3126d2b04acf996a59f8549b2001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7911cf51cb4a40a91b512e0de33cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d9ef5d3-2c7b-4df7-8203-ddae6f85ec53 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Request method failure captured: Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 60 Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKKsZcqGIQ7HNow3stJFy1TBWcw6cdl_g6rE3XY1n2KC-qy58UtdYGZ6JSFjNpcaCGtF0g8e2hmUj2NRwrieEPe4c7FS0uUjQYAVwFbiRKOWVTJxmLh70Zy9G7weTY2wuPHHeo2BdomQ6fQZr766FMiKbo9kzgo_wN5kKGCe_6vu2c Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:32:49.600489 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f7911cf51cb4a40a91b512e0de33cb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 20fe3126d2b04acf996a59f8549b2001 Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: {"aggregate": {"name": "tempest-test_aggregate-1679743130"}} Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:49.601787 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1679743130'}}} Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:49.602514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:49.603725 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 03 14:32:49.604960 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.604960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d9ef5d3-2c7b-4df7-8203-ddae6f85ec53 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.604960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d9ef5d3-2c7b-4df7-8203-ddae6f85ec53 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011911 Oct 03 14:32:49.604960 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 24/60] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:49.610563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c1f3d4b3-e290-4cca-9c5c-681199d23ed4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1491990930"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.614336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-c1f3d4b3-e290-4cca-9c5c-681199d23ed4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid 4d2a0243-e816-41b4-bc05-faee79370ff7 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:49.643352 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c1f3d4b3-e290-4cca-9c5c-681199d23ed4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041478 Oct 03 14:32:49.645249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 25/61] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:49.657353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6394814a-e6ab-4b85-8277-ff2531980b1d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1491990930"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.662181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-6394814a-e6ab-4b85-8277-ff2531980b1d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid 37d0697a-858c-4097-a74b-bc2cf3146aeb for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:49.672541 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6394814a-e6ab-4b85-8277-ff2531980b1d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1491990930 already exists. Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6394814a-e6ab-4b85-8277-ff2531980b1d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 60 Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:49.676212 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: {"aggregate": {"name": "tempest-test_aggregate-1491990930"}} Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:49.677397 n-d-781139-2 devstack@n-api.service[128868]: exception: Aggregate tempest-test_aggregate-1491990930 already exists. Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1491990930'}}} Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 03 14:32:49.678058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1491990930 already exists. Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:32:49.678977 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1491990930 already exists. Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1491990930 already exists. Oct 03 14:32:49.680567 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.685522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6394814a-e6ab-4b85-8277-ff2531980b1d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1491990930 already exists. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.686811 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6394814a-e6ab-4b85-8277-ff2531980b1d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.034698 Oct 03 14:32:49.688007 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 26/62] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 36 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:32:49.699670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e36d06b-e645-49f3-bfe4-4d5212052f6d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:49.732914 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e36d06b-e645-49f3-bfe4-4d5212052f6d tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.038406 Oct 03 14:32:49.739431 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 27/63] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:49 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:32:49.749120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0766ec24-cbe2-4596-96e3-66eb254b428a tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-40158875"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.758397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-0766ec24-cbe2-4596-96e3-66eb254b428a tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid acf975b9-1bef-4fe2-99d6-8d66b202a406 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:49.793408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=9 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:49.817818 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0766ec24-cbe2-4596-96e3-66eb254b428a tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.076895 Oct 03 14:32:49.826862 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 28/64] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:49.851931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e921d140-cdd8-4dd7-b8ed-d45637c36f48 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:49.857717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e921d140-cdd8-4dd7-b8ed-d45637c36f48 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '20fe3126d2b04acf996a59f8549b2001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7911cf51cb4a40a91b512e0de33cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e921d140-cdd8-4dd7-b8ed-d45637c36f48 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Request method failure captured: Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKKsZcqGIQ7HNow3stJFy1TBWcw6cdl_g6rE3XY1n2KC-qy58UtdYGZ6JSFjNpcaCGtF0g8e2hmUj2NRwrieEPe4c7FS0uUjQYAVwFbiRKOWVTJxmLh70Zy9G7weTY2wuPHHeo2BdomQ6fQZr766FMiKbo9kzgo_wN5kKGCe_6vu2c Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:32:49.862498 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f7911cf51cb4a40a91b512e0de33cb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 20fe3126d2b04acf996a59f8549b2001 Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 03 14:32:49.863794 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6'} Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:49.864614 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 03 14:32:49.866521 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.871495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e921d140-cdd8-4dd7-b8ed-d45637c36f48 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.872791 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e921d140-cdd8-4dd7-b8ed-d45637c36f48 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.038104 Oct 03 14:32:49.876558 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 29/65] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:49 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:32:49.889253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-28ee80cc-ba21-4099-b2ca-a53015740de9 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:49.928581 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-28ee80cc-ba21-4099-b2ca-a53015740de9 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.046401 Oct 03 14:32:49.930084 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 30/66] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:49 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 14:32:49.941895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b6004290-420f-486f-9855-ac399a48c7f7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:49.958200 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b6004290-420f-486f-9855-ac399a48c7f7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b6004290-420f-486f-9855-ac399a48c7f7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:49.960815 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: exception: Aggregate -1 could not be found. Oct 03 14:32:49.962240 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '-1'} Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 14:32:49.963046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.964605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b6004290-420f-486f-9855-ac399a48c7f7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b6004290-420f-486f-9855-ac399a48c7f7 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.027195 Oct 03 14:32:49.966141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 31/67] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:32:49 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:32:49.974726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f00cc2b-d7a6-49b7-9793-2e29a8695ec4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-848923481"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:49.979407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-8f00cc2b-d7a6-49b7-9793-2e29a8695ec4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid 9d9f75e0-7432-4d24-a91e-6bbb5b00d644 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:32:50.015416 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f00cc2b-d7a6-49b7-9793-2e29a8695ec4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042861 Oct 03 14:32:50.016474 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 32/68] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:50.029849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4dd1577-0895-45a4-bd31-367ae34158e6 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:50.031350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4dd1577-0895-45a4-bd31-367ae34158e6 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '20fe3126d2b04acf996a59f8549b2001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7911cf51cb4a40a91b512e0de33cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4dd1577-0895-45a4-bd31-367ae34158e6 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Request method failure captured: Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKKsZcqGIQ7HNow3stJFy1TBWcw6cdl_g6rE3XY1n2KC-qy58UtdYGZ6JSFjNpcaCGtF0g8e2hmUj2NRwrieEPe4c7FS0uUjQYAVwFbiRKOWVTJxmLh70Zy9G7weTY2wuPHHeo2BdomQ6fQZr766FMiKbo9kzgo_wN5kKGCe_6vu2c Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:32:50.032881 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f7911cf51cb4a40a91b512e0de33cb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 20fe3126d2b04acf996a59f8549b2001 Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 03 14:32:50.034229 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '7'} Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:50.035005 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.036176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4dd1577-0895-45a4-bd31-367ae34158e6 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:50.037845 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4dd1577-0895-45a4-bd31-367ae34158e6 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.010967 Oct 03 14:32:50.037845 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 33/69] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:32:50 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:50.047536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ebc22e5-8d29-42e1-842f-dba9a9e046ba tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:50.084233 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ebc22e5-8d29-42e1-842f-dba9a9e046ba tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.042846 Oct 03 14:32:50.085170 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:50 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 14:32:50.104065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1fe15260-5c29-4817-9dab-15cb75ae8fc4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:50.125216 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-1fe15260-5c29-4817-9dab-15cb75ae8fc4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1fe15260-5c29-4817-9dab-15cb75ae8fc4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:32:50.129035 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: exception: Aggregate -1 could not be found. Oct 03 14:32:50.130171 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '-1'} Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:50.130786 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 03 14:32:50.131777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.132696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1fe15260-5c29-4817-9dab-15cb75ae8fc4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:50.134303 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1fe15260-5c29-4817-9dab-15cb75ae8fc4 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043053 Oct 03 14:32:50.134869 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 35/71] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:50 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:32:50.150072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-692b7396-2860-4ee9-95bb-f7b723c695c4 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:50.152167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-692b7396-2860-4ee9-95bb-f7b723c695c4 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '20fe3126d2b04acf996a59f8549b2001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7911cf51cb4a40a91b512e0de33cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-692b7396-2860-4ee9-95bb-f7b723c695c4 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Request method failure captured: Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKKsZcqGIQ7HNow3stJFy1TBWcw6cdl_g6rE3XY1n2KC-qy58UtdYGZ6JSFjNpcaCGtF0g8e2hmUj2NRwrieEPe4c7FS0uUjQYAVwFbiRKOWVTJxmLh70Zy9G7weTY2wuPHHeo2BdomQ6fQZr766FMiKbo9kzgo_wN5kKGCe_6vu2c Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:32:50.156069 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f7911cf51cb4a40a91b512e0de33cb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 20fe3126d2b04acf996a59f8549b2001 Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 03 14:32:50.157473 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:50.158247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 03 14:32:50.159286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:32:50.163219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-692b7396-2860-4ee9-95bb-f7b723c695c4 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:50.164720 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-692b7396-2860-4ee9-95bb-f7b723c695c4 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.021699 Oct 03 14:32:50.165439 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 36/72] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:32:50 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:32:50.232167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-604465132", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "availability_zone": "tempest-test_az-1229282158"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:50.246002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:50.246475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:50.246965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:50.247764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:50.248236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:50.248660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:51.517028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:32:51.887667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:32:51.888865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:32:51.889438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:32:51.889937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:32:51.890412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:32:51.906605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:51.907625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:51.908061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:51.908777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:51.909992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:51.910771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:51.963643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Getting quotas for project 6fe6d46ecdb948d78e85c409354a9ee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:32:51.982344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Getting quotas for user 5f0e43f6723a4b2abc02450dae9e580f and project 6fe6d46ecdb948d78e85c409354a9ee5. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:32:52.010188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:32:52.019434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:32:52.101144 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6ce36e9-fd85-4d9a-9c33-3def166faa33 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.547345 Oct 03 14:32:52.101783 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 37/73] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:32:52.114509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8fd2489-1d60-47e7-9694-5a78e84087c0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:52.115267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d8fd2489-1d60-47e7-9694-5a78e84087c0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:32:53.628546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d8fd2489-1d60-47e7-9694-5a78e84087c0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:53.653063 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d8fd2489-1d60-47e7-9694-5a78e84087c0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1242 microversion: 2.1 time: 1.543497 Oct 03 14:32:53.654362 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 37/74] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:32:52 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1242 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:54.677776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:54.679194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:32:54.717227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:54.717717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:54.720324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:54.721333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:54.725133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:54.725963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:55.153167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:55.191005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1a75cbd-8cef-4552-8d05-980e73e205dd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1298 microversion: 2.1 time: 0.519014 Oct 03 14:32:55.200999 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 38/75] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:32:54 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1298 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:55.906016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-add8cdf9-fee4-4e10-83f2-a4b2d68520c9 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1775942460", "id": 613795057, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:55.943898 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-add8cdf9-fee4-4e10-83f2-a4b2d68520c9 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.913798 Oct 03 14:32:55.948041 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:55 2022] POST /compute/v2.1/flavors => generated 427 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:55.960987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-38806089-dfd7-49f1-8690-0982d772731c tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.025801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-859bc43b-59d9-47bb-9791-0f54267698bc tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.031095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-859bc43b-59d9-47bb-9791-0f54267698bc tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 03 14:32:56.032961 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-38806089-dfd7-49f1-8690-0982d772731c tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/613795057" status: 202 len: 0 microversion: 2.1 time: 0.078343 Oct 03 14:32:56.035145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:32:55 2022] DELETE /compute/v2.1/flavors/613795057 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-859bc43b-59d9-47bb-9791-0f54267698bc tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450-project-admin] Request method failure captured: Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKX8EpwvwrlRrEMgIB9G0iwO8hHD6FJcm1vM9M8UYNxNPVfVnVQnhfTQ8gHBJXDCIDmNeVfvc9sKRfdrhU72XdKSsDcFDSNvo3HvjRg8NE8eVSuAMueilDsVAgNSy-quAaQC8FhE3oUW3XhT92IUze0jzICXlkoDb85mfDp1mw01PA Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f625c288489349feb57aa23ce399af15 Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:32:56.048322 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f625c288489349feb57aa23ce399af15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f625c288489349feb57aa23ce399af15", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f625c288489349feb57aa23ce399af15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f625c288489349feb57aa23ce399af15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f625c288489349feb57aa23ce399af15 Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450-project-admin Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e8dc0a6e34854b308b44aeb2e7355429 Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450-project-admin Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:56.049493 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid timestamp for date invalid_time Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'invalid_time'} Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:56.050187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-859bc43b-59d9-47bb-9791-0f54267698bc tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:56.051187 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-859bc43b-59d9-47bb-9791-0f54267698bc tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450 tempest-InstanceUsageAuditLogNegativeTestJSON-1610611450-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.512707 Oct 03 14:32:56.052873 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 3 14:32:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 514 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 03 14:32:56.054781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-143b8ff9-91e1-4887-a6e9-6f4d58c3238d tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.093470 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-143b8ff9-91e1-4887-a6e9-6f4d58c3238d tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052511 Oct 03 14:32:56.094705 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 40/79] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:56.117982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9a59157e-fa19-4cc8-b852-a03818f3a677 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2025414563", "id": 1011349708, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:56.172585 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9a59157e-fa19-4cc8-b852-a03818f3a677 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.059428 Oct 03 14:32:56.173693 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 41/80] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:56 2022] POST /compute/v2.1/flavors => generated 417 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:56.186255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b4469df-dec8-4f95-87a9-8a4d213d8566 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.231980 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b4469df-dec8-4f95-87a9-8a4d213d8566 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.049769 Oct 03 14:32:56.235220 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 42/81] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:56 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:32:56.242151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.242910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:32:56.266199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:56.266954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:56.268342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:56.270019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:56.280048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:56.280502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:56.526138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7526579d-81f2-4c95-9401-dacf60812aa2 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.528826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7526579d-81f2-4c95-9401-dacf60812aa2 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '7bed6463b993444fbaae276c55c347e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416be7d247de4d40a7c960138c0fcecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7526579d-81f2-4c95-9401-dacf60812aa2 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Request method failure captured: Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKUMGX9GkS9FB46svkWwXKp3cFM1exP_WL2ewcoyxDFKd0SKmOjKirRtFgcl9iHPJURGvpk_Qqp0KdXAa0_h9eARTDDSNG7Hq8lLeooOuEQDPXdPFK9N5IGaBCBMmql3-WEMSLdlHlsVbaJq7PC-yRRZvIJ87CmMI5pyEhFjalX4Xs Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 416be7d247de4d40a7c960138c0fcecb Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:56.536669 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/416be7d247de4d40a7c960138c0fcecb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_416be7d247de4d40a7c960138c0fcecb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/416be7d247de4d40a7c960138c0fcecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/416be7d247de4d40a7c960138c0fcecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 416be7d247de4d40a7c960138c0fcecb Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7bed6463b993444fbaae276c55c347e7 Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project Oct 03 14:32:56.538111 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: action_args: {} Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:56.538645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 03 14:32:56.539746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.544667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7526579d-81f2-4c95-9401-dacf60812aa2 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:56.546992 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7526579d-81f2-4c95-9401-dacf60812aa2 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.489197 Oct 03 14:32:56.582941 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 40/82] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 3 14:32:56 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 520 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:32:56.606194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e92eb3e3-f3d4-4f15-8f93-f638c024bda5 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.684221 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e92eb3e3-f3d4-4f15-8f93-f638c024bda5 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1011349708" status: 202 len: 0 microversion: 2.1 time: 0.097853 Oct 03 14:32:56.685048 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 41/83] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:32:56 2022] DELETE /compute/v2.1/flavors/1011349708 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:32:56.694901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b46a23c-d830-44ea-9fd1-222ebc6f4a26 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.696690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b46a23c-d830-44ea-9fd1-222ebc6f4a26 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '7bed6463b993444fbaae276c55c347e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416be7d247de4d40a7c960138c0fcecb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b46a23c-d830-44ea-9fd1-222ebc6f4a26 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Request method failure captured: Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03%2014:32:56 HTTP/1.1 Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKUMGX9GkS9FB46svkWwXKp3cFM1exP_WL2ewcoyxDFKd0SKmOjKirRtFgcl9iHPJURGvpk_Qqp0KdXAa0_h9eARTDDSNG7Hq8lLeooOuEQDPXdPFK9N5IGaBCBMmql3-WEMSLdlHlsVbaJq7PC-yRRZvIJ87CmMI5pyEhFjalX4Xs Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 416be7d247de4d40a7c960138c0fcecb Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:32:56.698432 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/416be7d247de4d40a7c960138c0fcecb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_416be7d247de4d40a7c960138c0fcecb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/416be7d247de4d40a7c960138c0fcecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/416be7d247de4d40a7c960138c0fcecb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 416be7d247de4d40a7c960138c0fcecb Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7bed6463b993444fbaae276c55c347e7 Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project Oct 03 14:32:56.701616 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '2022-10-03 14:32:56'} Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:32:56.702459 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 03 14:32:56.704491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:32:56.705574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b46a23c-d830-44ea-9fd1-222ebc6f4a26 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:32:56.705574 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b46a23c-d830-44ea-9fd1-222ebc6f4a26 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765 tempest-InstanceUsageAuditLogNegativeTestJSON-936935765-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03 14:32:56" status: 403 len: 128 microversion: 2.1 time: 0.014052 Oct 03 14:32:56.705709 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:32:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03%2014%3A32%3A56 => generated 128 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:32:56.710292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ef1b4ca-d73d-40b4-8092-d36d572756ae tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.763025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ef1b4ca-d73d-40b4-8092-d36d572756ae tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056160 Oct 03 14:32:56.766356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:56.772790 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:56.801409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10252571-f630-409a-beec-1bda1b0fa686 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-748569194", "id": 758412429, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:56.803010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9fbb6d10-71ea-41d8-a71b-08375bcb557d tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1296 microversion: 2.1 time: 0.566402 Oct 03 14:32:56.803625 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 43/86] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:32:56 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1296 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:56.846034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10252571-f630-409a-beec-1bda1b0fa686 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.051710 Oct 03 14:32:56.846790 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 44/87] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:56 2022] POST /compute/v2.1/flavors => generated 425 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:56.859452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9eaae6d7-912c-4d50-82b7-2ccb2ff507ad tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.904623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9eaae6d7-912c-4d50-82b7-2ccb2ff507ad tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/758412429" status: 202 len: 0 microversion: 2.1 time: 0.047985 Oct 03 14:32:56.905351 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 44/88] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:32:56 2022] DELETE /compute/v2.1/flavors/758412429 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:32:56.913402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4c891b9-eb60-40e4-b0d8-e255e96ae30b tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:56.962565 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4c891b9-eb60-40e4-b0d8-e255e96ae30b tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048980 Oct 03 14:32:56.964307 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:56.991762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13b44fc5-50bc-4795-9332-9b1f3c9507a0 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-365477430", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:57.072452 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13b44fc5-50bc-4795-9332-9b1f3c9507a0 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.084997 Oct 03 14:32:57.074402 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 45/90] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:56 2022] POST /compute/v2.1/flavors => generated 506 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:57.087144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9fac0e6-c62d-4bab-9086-81872d2c6429 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:57.133386 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9fac0e6-c62d-4bab-9086-81872d2c6429 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/0ba621d8-4d5d-402e-a073-676737669301" status: 202 len: 0 microversion: 2.1 time: 0.049291 Oct 03 14:32:57.140021 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 46/91] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:32:57 2022] DELETE /compute/v2.1/flavors/0ba621d8-4d5d-402e-a073-676737669301 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:32:57.150038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cad8267b-aea5-4d01-89bc-b21738bf0e5a tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:57.196966 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cad8267b-aea5-4d01-89bc-b21738bf0e5a tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055065 Oct 03 14:32:57.214466 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 47/92] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:57.227980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29454e0b-35b6-4eca-98bd-03044221d843 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-827451518", "id": "ffdcb5a5-9783-4b3e-b439-c36252a9691c", "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:57.277897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29454e0b-35b6-4eca-98bd-03044221d843 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.057942 Oct 03 14:32:57.278483 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 48/93] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:57 2022] POST /compute/v2.1/flavors => generated 506 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:57.294494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50864109-b7e6-4750-8032-fef8f0fce815 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:57.346705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50864109-b7e6-4750-8032-fef8f0fce815 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/ffdcb5a5-9783-4b3e-b439-c36252a9691c" status: 202 len: 0 microversion: 2.1 time: 0.053691 Oct 03 14:32:57.347398 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 49/94] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:32:57 2022] DELETE /compute/v2.1/flavors/ffdcb5a5-9783-4b3e-b439-c36252a9691c => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:32:57.360660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da40e482-cd66-4051-8f05-c4ce2012d4f0 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:57.401906 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da40e482-cd66-4051-8f05-c4ce2012d4f0 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048044 Oct 03 14:32:57.402726 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 50/95] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:57.429512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-996a8897-c0ae-4d3f-acee-8756c3e04102 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1886687803", "id": 8836673, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:57.495330 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-996a8897-c0ae-4d3f-acee-8756c3e04102 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.1 time: 0.075333 Oct 03 14:32:57.507065 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 51/96] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:32:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:32:58.083798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85805585-86c9-41a8-a095-72ab87d3323b tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Calling method '.version_select at 0x7fb231687160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:58.110408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Calling method '.version_select at 0x7fb2313fd8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:58.133173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=128869) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 03 14:32:58.138720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:58.147612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:58.149065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:58.178974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:58.181255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:58.181825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:58.194885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:58.195447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:58.196080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:58.212118 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0409d7b2-dc8b-47f1-add2-fc4e2bd57792 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.703694 Oct 03 14:32:58.213138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 52/97] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:32:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:32:58.226055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0943203f-760c-425c-ab80-445b49640a99 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:58.234690 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0943203f-760c-425c-ab80-445b49640a99 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/8836673" status: 200 len: 405 microversion: 2.1 time: 0.013563 Oct 03 14:32:58.235849 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 53/98] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:32:58 2022] GET /compute/v2.1/flavors/8836673 => generated 405 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:58.258081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:58.261422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:32:58.278823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:58.283170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:58.285479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:58.287229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:58.287847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:58.289369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:58.661565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:32:58.671726 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac5b53fc-01c8-40a7-9960-b55255ed133f tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.434492 Oct 03 14:32:58.684359 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 54/99] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:32:58 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:58.693623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Calling method '.version_select at 0x7fb2313fd3a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:58.696613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:58.697916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:58.698725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:58.719139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:32:58.719621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:32:58.720274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:32:58.728791 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5192fca8-9683-427e-8ff3-210029c7c191 tempest-HypervisorAdminV228Test-165663292 tempest-HypervisorAdminV228Test-165663292-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.043103 Oct 03 14:32:58.742306 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 55/100] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 3 14:32:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:32:59.043311 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-85805585-86c9-41a8-a095-72ab87d3323b tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 371 microversion: 2.1 time: 1.912925 Oct 03 14:32:59.049079 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 46/101] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:32:57 2022] GET /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 371 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:32:59.424865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1338f59-7b27-45a6-a382-840a77db678d tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:32:59.460366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1338f59-7b27-45a6-a382-840a77db678d tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5386 microversion: 2.1 time: 0.715235 Oct 03 14:32:59.461226 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 56/102] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:32:58 2022] GET /compute/v2.1/flavors/detail => generated 5386 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:32:59.469893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:32:59.472442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Action: 'update', calling method: .version_select at 0x7fb2314088b0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:59.920999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e3a55137-6dd7-4b2a-b0e9-b366358dd4b9 tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1794880429", "id": 994168984, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:32:59.958161 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e3a55137-6dd7-4b2a-b0e9-b366358dd4b9 tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.907841 Oct 03 14:32:59.968356 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 47/103] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:32:59 2022] POST /compute/v2.1/flavors => generated 446 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:32:59.992519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9f8de63-4e18-4eb9-b307-c7f4286f4c0a tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:00.035795 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a9f8de63-4e18-4eb9-b307-c7f4286f4c0a tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/8836673" status: 202 len: 0 microversion: 2.1 time: 0.059139 Oct 03 14:33:00.042841 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 48/104] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:32:59 2022] DELETE /compute/v2.1/flavors/8836673 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:33:00.058531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:00.060721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:00.085979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:00.090791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:00.091989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:00.093476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:00.097535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:00.098275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:00.574733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:00.581270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:00.581844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:00.583486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:00.584876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:00.595354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:00.598177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:00.607291 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd89c00f-5d2b-4f72-85ce-4279fa6e74b9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.561618 Oct 03 14:33:00.609641 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 49/105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:00 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:00.761741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=80,nova_api:DELETE=11 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:00.849903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3b0152e-f7f4-4faf-b913-f82876e8fa92 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 328 microversion: 2.1 time: 1.386133 Oct 03 14:33:00.855561 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 57/106] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:32:59 2022] PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 328 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:00.878836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c17c7fdc-b29a-43c5-a3d3-26aab3679269 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:00.967569 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c17c7fdc-b29a-43c5-a3d3-26aab3679269 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.108596 Oct 03 14:33:00.973309 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 58/107] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:00 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:00.998826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f69f353-3668-4dc6-b5fa-1bfa18552424 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-491966914", "id": 718327285, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:01.059607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f68370f8-8a24-4bab-9a4a-221bddfa07ab tempest-FlavorsV255TestJSON-234724738 tempest-FlavorsV255TestJSON-234724738-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:01.087993 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f69f353-3668-4dc6-b5fa-1bfa18552424 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.079201 Oct 03 14:33:01.090975 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 59/108] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:00 2022] POST /compute/v2.1/flavors => generated 426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:01.102359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cfda148-8da8-4a0c-b45c-2dadfdffc65a tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "718327285"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:01.112347 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f68370f8-8a24-4bab-9a4a-221bddfa07ab tempest-FlavorsV255TestJSON-234724738 tempest-FlavorsV255TestJSON-234724738-project] 10.222.0.20 "GET /compute/v2.1/flavors/994168984" status: 200 len: 446 microversion: 2.55 time: 0.499467 Oct 03 14:33:01.115096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 50/109] 10.222.0.20 () {60 vars in 1196 bytes} [Mon Oct 3 14:33:00 2022] GET /compute/v2.1/flavors/994168984 => generated 446 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:01.127529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e67bf983-6f55-4d33-bf81-ce437a30b1ac tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] Action: 'update', calling method: .version_select at 0x7fb23276fb80>, body: {"flavor": {"description": "new"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:01.153019 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8cfda148-8da8-4a0c-b45c-2dadfdffc65a tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] HTTP exception thrown: Flavor 718327285 could not be found. Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cfda148-8da8-4a0c-b45c-2dadfdffc65a tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] Request method failure captured: Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 106 Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKUau3GiLA5lsWHq2h6B81XiYn6LhxFCBCQKAnmWAw1csVfc0DLjVL1ZFgF6LpqhwdzWbWcOKRzaPCkpi6yO9dOo6ppR2o27_cJ5-da7MAklOBG2dLrT-vOTyrJ6UAmGrJ5I-i2MZ82qdJWGMtfnZ8OBuzwtM43EA0FB61vpVkGMRc Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 15d56b834a1b4ffcb5874e911942a58d Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsAdminTestJSON-322012587 Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:01.156005 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/15d56b834a1b4ffcb5874e911942a58d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_15d56b834a1b4ffcb5874e911942a58d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/15d56b834a1b4ffcb5874e911942a58d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/15d56b834a1b4ffcb5874e911942a58d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsAdminTestJSON-322012587 Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 15d56b834a1b4ffcb5874e911942a58d Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-322012587 Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsAdminTestJSON-322012587-project Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: b4555421358046d8bfd4aa1a26bedfd5 Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsAdminTestJSON-322012587-project Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "test", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "718327285"}} Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:01.157408 n-d-781139-2 devstack@n-api.service[128869]: exception: Flavor 718327285 could not be found. Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '718327285'}}} Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 718327285 could not be found. Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:01.158272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 718327285 could not be found. Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:01.159536 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:01.161107 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:01.161107 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:01.161107 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:01.161107 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 718327285 could not be found. Oct 03 14:33:01.161107 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:01.161107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cfda148-8da8-4a0c-b45c-2dadfdffc65a tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] Returning 400 to user: Flavor 718327285 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:01.182293 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cfda148-8da8-4a0c-b45c-2dadfdffc65a tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.085116 Oct 03 14:33:01.184865 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 60/110] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:01 2022] POST /compute/v2.1/servers => generated 80 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 03 14:33:01.194142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49a0e842-9891-4648-b3ea-cada63eb4970 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:01.257163 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e67bf983-6f55-4d33-bf81-ce437a30b1ac tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/994168984" status: 200 len: 447 microversion: 2.55 time: 0.133366 Oct 03 14:33:01.260020 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49a0e842-9891-4648-b3ea-cada63eb4970 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/718327285" status: 202 len: 0 microversion: 2.1 time: 0.069305 Oct 03 14:33:01.261064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 61/111] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:33:01 2022] DELETE /compute/v2.1/flavors/718327285 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:33:01.273144 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 51/112] 10.222.0.20 () {62 vars in 1216 bytes} [Mon Oct 3 14:33:01 2022] PUT /compute/v2.1/flavors/994168984 => generated 447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:01.293795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b882f7e-f07f-4c02-91d4-a2989b8c5117 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:01.362276 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b882f7e-f07f-4c02-91d4-a2989b8c5117 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.086504 Oct 03 14:33:01.362865 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 52/113] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:01 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:01.375751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3c2b9922-ee71-4e36-8012-f547ef36066f tempest-FlavorsV255TestJSON-234724738 tempest-FlavorsV255TestJSON-234724738-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:01.466145 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3c2b9922-ee71-4e36-8012-f547ef36066f tempest-FlavorsV255TestJSON-234724738 tempest-FlavorsV255TestJSON-234724738-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.090795 Oct 03 14:33:01.470013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 53/114] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:33:01 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:01.480891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-16742d46-97a7-465d-89ed-4e61bd5fe7c9 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-648294663", "id": 1892732045, "os-flavor-access:is_public": "False"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:01.520032 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-16742d46-97a7-465d-89ed-4e61bd5fe7c9 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048241 Oct 03 14:33:01.523167 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 54/115] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:01.536450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc38d329-032c-44d1-b113-5df5f19e616c tempest-FlavorsV255TestJSON-234724738 tempest-FlavorsV255TestJSON-234724738-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:01.578911 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc38d329-032c-44d1-b113-5df5f19e616c tempest-FlavorsV255TestJSON-234724738 tempest-FlavorsV255TestJSON-234724738-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.054025 Oct 03 14:33:01.581459 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 55/116] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Oct 3 14:33:01 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:01.600031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7303c922-bfdd-45fe-9572-8dd85c9258d6 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-397705406", "id": 892134570, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:01.648290 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7303c922-bfdd-45fe-9572-8dd85c9258d6 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.056641 Oct 03 14:33:01.651005 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 56/117] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:01 2022] POST /compute/v2.1/flavors => generated 410 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:01.661854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9216c453-f5c4-4a94-bb85-c2f803402b24 tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:01.683523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=15,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:01.711476 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9216c453-f5c4-4a94-bb85-c2f803402b24 tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/994168984" status: 202 len: 0 microversion: 2.55 time: 0.058888 Oct 03 14:33:01.712532 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 57/118] 10.222.0.20 () {60 vars in 1199 bytes} [Mon Oct 3 14:33:01 2022] DELETE /compute/v2.1/flavors/994168984 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:33:01.726480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:01.727626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:01.744482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:01.747155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:01.748051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:01.750236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:01.751106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:01.752513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:01.908320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-842331265", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:02.026213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:02.494946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:02.515495 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e988453a-932a-40b5-b77f-20f73b6bbbec tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.801586 Oct 03 14:33:02.537450 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 58/119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:01 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:02.549286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4169ed26-3971-4c92-bb0f-ac8c18d4cd8b tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:02.627645 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4169ed26-3971-4c92-bb0f-ac8c18d4cd8b tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.088636 Oct 03 14:33:02.628992 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 59/120] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 3 14:33:02 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:02.643076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e6914cb-c9f5-4f50-aac6-ce288b67ba46 tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:02.678891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e6914cb-c9f5-4f50-aac6-ce288b67ba46 tempest-FlavorsV255TestJSON-173054687 tempest-FlavorsV255TestJSON-173054687-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5706 microversion: 2.55 time: 0.048509 Oct 03 14:33:02.699848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 60/121] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:33:02 2022] GET /compute/v2.1/flavors/detail => generated 5706 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:02.875722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-10c9cde3-ad39-4903-84ff-1e1451a24dd0 req-a47a876a-cf49-40db-aa51-b1700e1d0f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1706f473-6565-47c7-8715-b19cfb200faf", "tag": "cc90c244-dfcc-4a15-bf94-2dced2f540a9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:02.913188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10c9cde3-ad39-4903-84ff-1e1451a24dd0 req-a47a876a-cf49-40db-aa51-b1700e1d0f00 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:02.924192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10c9cde3-ad39-4903-84ff-1e1451a24dd0 req-a47a876a-cf49-40db-aa51-b1700e1d0f00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:02.924785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10c9cde3-ad39-4903-84ff-1e1451a24dd0 req-a47a876a-cf49-40db-aa51-b1700e1d0f00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:03.003434 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-10c9cde3-ad39-4903-84ff-1e1451a24dd0 req-a47a876a-cf49-40db-aa51-b1700e1d0f00 service nova] Creating event network-changed:cc90c244-dfcc-4a15-bf94-2dced2f540a9 for instance 1706f473-6565-47c7-8715-b19cfb200faf on n-h2-781139-2 Oct 03 14:33:03.004356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10c9cde3-ad39-4903-84ff-1e1451a24dd0 req-a47a876a-cf49-40db-aa51-b1700e1d0f00 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:33:03.004997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10c9cde3-ad39-4903-84ff-1e1451a24dd0 req-a47a876a-cf49-40db-aa51-b1700e1d0f00 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:33:03.006366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:03.007057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:03.012446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:03.013614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:03.021770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:03.022428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:03.049630 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.compute.rpcapi [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 14:33:03.062844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] Releasing lock "compute-rpcapi-router" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:33:03.090771 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-904ffdd5-ff77-4644-b60d-e3222552259b None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389001 Oct 03 14:33:03.091816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 61/122] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:03.099893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51573514-12d2-4652-99a0-3ca9d7658331 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.123993 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51573514-12d2-4652-99a0-3ca9d7658331 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.030699 Oct 03 14:33:03.129909 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1177 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:03.145000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14b6dcab-dc3e-47d3-8543-fa2416bff14a tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.176674 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14b6dcab-dc3e-47d3-8543-fa2416bff14a tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.037642 Oct 03 14:33:03.180328 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 63/124] 10.222.0.20 () {58 vars in 1171 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:03.195016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b3a6374b-e6da-473b-ab81-58d48c68c6a1 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.223209 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b3a6374b-e6da-473b-ab81-58d48c68c6a1 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.032238 Oct 03 14:33:03.235607 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 64/125] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:03.253981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-48f38ed5-705e-4038-8ab0-30a69a72fb28 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.311986 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-48f38ed5-705e-4038-8ab0-30a69a72fb28 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.070140 Oct 03 14:33:03.325661 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 65/126] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:03.340490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b5c2a7c-1ae7-4cd8-9364-e40c21c53b3b tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.360213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:03.361218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:03.361829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:03.362384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:03.362928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:03.389165 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b5c2a7c-1ae7-4cd8-9364-e40c21c53b3b tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.051358 Oct 03 14:33:03.401435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:03.402065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:03.404608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:03.404896 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1175 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:03.408830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:03.418754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:03.420537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:03.423357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51572745-3c16-484c-8d4a-ae25d813c5b8 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.475687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51572745-3c16-484c-8d4a-ae25d813c5b8 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.062348 Oct 03 14:33:03.495356 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 67/128] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:03.503609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bcf7ccc4-a435-4913-9414-afab026ba3dd tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.540466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Getting quotas for project fe389dc18c4c4f9ca06621236adf0625. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:03.560761 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bcf7ccc4-a435-4913-9414-afab026ba3dd tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.062982 Oct 03 14:33:03.564380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Getting quotas for user 13f81b782b3f4036ba42778d33c3bd50 and project fe389dc18c4c4f9ca06621236adf0625. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:03.573672 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 68/129] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:03.582524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.584081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:03.596113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:03.597270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:03.597968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:03.599032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:03.599760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:03.600405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:03.634110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.utils [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] cores quota exceeded for fe389dc18c4c4f9ca06621236adf0625, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128869) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 03 14:33:03.642269 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Request method failure captured: Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 144 Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKVxzSrDSDsGGu9MytLcPSaOoc5BEw9ILiQCsB-juJWa2meIOjKAiMWeO1XeKB-Uj5F6LwzzULceg8ic54ET3iUvBnB_nBblRdtcxR6h-MFq98QpLsZLTl9bYSiG7cphy79W9OhdgMHkxTU1xuvTZgyF0Kh291t05cksDOT-_96-Kc Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:03.664687 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe389dc18c4c4f9ca06621236adf0625", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 13f81b782b3f4036ba42778d33c3bd50 Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-842331265", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} Oct 03 14:33:03.666241 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-842331265', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452'}}} Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 14:33:03.666916 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:03.667875 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:03.669257 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:03.672035 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:03.672035 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:03.672035 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:03.672035 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:03.672035 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 03 14:33:03.672035 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:03.676270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:03.680114 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02c36104-9da5-4cb7-bc6e-e2d146605ce3 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.417210 Oct 03 14:33:03.683747 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 62/130] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:01 2022] POST /compute/v2.1/servers => generated 111 bytes in 2422 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:03.695783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da79f0f7-0081-4560-adf9-b42cfcd2295c tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:03.746016 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da79f0f7-0081-4560-adf9-b42cfcd2295c tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/892134570" status: 202 len: 0 microversion: 2.1 time: 0.048199 Oct 03 14:33:03.749076 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 63/131] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:33:03 2022] DELETE /compute/v2.1/flavors/892134570 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:33:03.758537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Action: 'update', calling method: .version_select at 0x7fb2313b2700>, body: {"quota_set": {"cores": 20}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:04.087576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:04.110487 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b3b9713-4b5f-4ba5-81e4-fa14bd5ae375 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.534788 Oct 03 14:33:04.133285 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 69/132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:03 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:04.149129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06736eb6-9b3c-4bc8-84b7-840ca879b030 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.187101 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06736eb6-9b3c-4bc8-84b7-840ca879b030 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052099 Oct 03 14:33:04.227628 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 70/133] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:04.236851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-909513b2-9d1e-4f43-a746-41b8e56be444 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.270685 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-909513b2-9d1e-4f43-a746-41b8e56be444 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1892732045" status: 202 len: 0 microversion: 2.1 time: 0.039527 Oct 03 14:33:04.276269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 71/134] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:33:04 2022] DELETE /compute/v2.1/flavors/1892732045 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:33:04.287181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da1d54ca-01fc-476a-9fdc-288299f14b67 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.324109 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da1d54ca-01fc-476a-9fdc-288299f14b67 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046112 Oct 03 14:33:04.349430 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 72/135] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:04.357675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b89d1507-71d6-48ff-aa0b-ab35730723c0 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1930492455", "id": 1445390157, "os-flavor-access:is_public": "False"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:04.395275 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b89d1507-71d6-48ff-aa0b-ab35730723c0 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.043365 Oct 03 14:33:04.408109 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 73/136] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:04 2022] POST /compute/v2.1/flavors => generated 415 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:04.417021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-445ee3ec-87a4-437f-be45-b9473c896f35 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.447142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-445ee3ec-87a4-437f-be45-b9473c896f35 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035635 Oct 03 14:33:04.462365 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 74/137] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:04.472548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04cd1cdc-5de1-40a5-971c-4ba25273a1b4 tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.539622 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04cd1cdc-5de1-40a5-971c-4ba25273a1b4 tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075439 Oct 03 14:33:04.543594 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 75/138] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:04.563363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cf1cc095-3a7e-4764-b2e0-d1544ee0e632 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.613305 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cf1cc095-3a7e-4764-b2e0-d1544ee0e632 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1445390157" status: 202 len: 0 microversion: 2.1 time: 0.053392 Oct 03 14:33:04.614141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 76/139] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:33:04 2022] DELETE /compute/v2.1/flavors/1445390157 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:33:04.621929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-005da145-ac13-4e95-9593-488bdcd49a45 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.643367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:04.647760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:04.648620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:04.649657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:04.650465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:04.653334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:04.685945 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-005da145-ac13-4e95-9593-488bdcd49a45 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058951 Oct 03 14:33:04.693017 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 77/140] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:04.716517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd6b375e-c475-451e-a75e-88c732b71c37 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-403663347", "id": 1125842099, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:04.765335 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd6b375e-c475-451e-a75e-88c732b71c37 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.052608 Oct 03 14:33:04.775847 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 78/141] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:04 2022] POST /compute/v2.1/flavors => generated 413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:04.789086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f534c2e-92c1-4696-b1ab-bc5ca7f148df tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.859205 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f534c2e-92c1-4696-b1ab-bc5ca7f148df tempest-FlavorsAdminTestJSON-322012587 tempest-FlavorsAdminTestJSON-322012587-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.074002 Oct 03 14:33:04.861990 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76a40cdf-c70b-4433-a22d-c8b4c2143b4d tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 329 microversion: 2.1 time: 1.111541 Oct 03 14:33:04.866690 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 64/142] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:33:03 2022] PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 329 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:04.867641 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 79/143] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:04.882786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87c551d7-5ad8-47d8-aaed-47e574009f77 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Calling method '.version_select at 0x7fb231303e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.896348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b3c137a7-a68a-4130-ab02-e685075f6ad1 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:04.945282 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b3c137a7-a68a-4130-ab02-e685075f6ad1 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1125842099" status: 202 len: 0 microversion: 2.1 time: 0.052813 Oct 03 14:33:04.950184 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 80/144] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:33:04 2022] DELETE /compute/v2.1/flavors/1125842099 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:33:04.960877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b45eb11d-37fa-4b44-9eed-2615437c6ca1 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:05.060881 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b45eb11d-37fa-4b44-9eed-2615437c6ca1 tempest-FlavorsAdminTestJSON-1212958084 tempest-FlavorsAdminTestJSON-1212958084-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108577 Oct 03 14:33:05.073824 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 81/145] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:05.137924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:05.137924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:05.148354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:05.148849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:05.149316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:05.150034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:05.150591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:05.151123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:05.798562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:05.812599 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87c551d7-5ad8-47d8-aaed-47e574009f77 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 371 microversion: 2.1 time: 0.938268 Oct 03 14:33:05.814479 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 65/146] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:33:04 2022] GET /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 371 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:05.821697 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f9037a94-6063-4bdc-bce7-3706b52fdfe9 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.689853 Oct 03 14:33:05.825812 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 82/147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:05 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:05.831902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Action: 'update', calling method: .version_select at 0x7fb2313beca0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:06.603663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:06.605530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:06.607090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:06.608115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:06.612064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:06.613759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:06.734081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c4e5d84-59ef-4111-a957-be645a253145 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 328 microversion: 2.1 time: 0.906358 Oct 03 14:33:06.736353 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 66/148] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:33:05 2022] PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 328 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:06.851911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:06.852524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:06.873794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:06.874326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:06.874763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:06.875747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:06.876526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:06.877022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:07.325065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-120899080", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:07.426201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:07.751261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:07.764865 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-397792fb-d598-431e-8db1-46cf0f0d8600 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.918520 Oct 03 14:33:07.792213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 83/149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:06 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:08.482753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:08.484749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:08.485415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:08.486005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:08.486844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:08.521545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:08.522030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:08.527970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:08.530574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:08.534233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:08.537012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:08.623089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Getting quotas for project fe389dc18c4c4f9ca06621236adf0625. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:08.631183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Getting quotas for user 13f81b782b3f4036ba42778d33c3bd50 and project fe389dc18c4c4f9ca06621236adf0625. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:08.660121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.utils [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] instances quota exceeded for fe389dc18c4c4f9ca06621236adf0625, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128869) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 03 14:33:08.661516 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Request method failure captured: Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 144 Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKVxzSrDSDsGGu9MytLcPSaOoc5BEw9ILiQCsB-juJWa2meIOjKAiMWeO1XeKB-Uj5F6LwzzULceg8ic54ET3iUvBnB_nBblRdtcxR6h-MFq98QpLsZLTl9bYSiG7cphy79W9OhdgMHkxTU1xuvTZgyF0Kh291t05cksDOT-_96-Kc Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:08.669429 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe389dc18c4c4f9ca06621236adf0625", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 13f81b782b3f4036ba42778d33c3bd50 Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-120899080", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} Oct 03 14:33:08.670925 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-120899080', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452'}}} Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 14:33:08.671897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:08.673120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:08.674386 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-053973fe-be33-4640-99cd-02ca3c4e0b7e tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.350800 Oct 03 14:33:08.675502 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 67/150] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:07 2022] POST /compute/v2.1/servers => generated 119 bytes in 1352 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:08.683731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Action: 'update', calling method: .version_select at 0x7fb231687040>, body: {"quota_set": {"instances": 10}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:08.801016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:08.801782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:08.821592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:08.822563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:08.823014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:08.823761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:08.824211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:08.824659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:09.018358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:09.296153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:09.314951 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f8a5c30-277a-4d5d-babc-ef76b91cdb7b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.517423 Oct 03 14:33:09.328959 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 68/151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:08 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:09.721200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:09.724044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:09.727150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:09.728378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:09.729227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:09.730790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:09.922307 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-abe144f2-8e26-4cbb-8c7f-051af9951518 tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 329 microversion: 2.1 time: 1.244517 Oct 03 14:33:09.936582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eaa8b976-cb51-438c-8251-77f4fc23c7ba tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Calling method '.version_select at 0x7fb231322f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:09.941806 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 84/152] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:33:08 2022] PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 329 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:10.342083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:10.343290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:10.357394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:10.359670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:10.360267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:10.362121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:10.363281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:10.367021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:10.676317 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eaa8b976-cb51-438c-8251-77f4fc23c7ba tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 371 microversion: 2.1 time: 0.743367 Oct 03 14:33:10.685995 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 69/153] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:33:09 2022] GET /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 371 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:10.710984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:10.719687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d20ad47a-355f-4a14-877c-270f138b1ce6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.383646 Oct 03 14:33:10.725520 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 85/154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:10 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:10.757646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Action: 'update', calling method: .version_select at 0x7fb23157a430>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:11.144674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-315934241", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:11.233959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:11.310906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:11.311632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:11.312225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:11.313135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:11.320827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:11.324876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:11.430605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:11.473681 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5e0b2ff-8938-4b2c-96d0-08b157d338bc tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 325 microversion: 2.1 time: 0.731489 Oct 03 14:33:11.474994 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 86/155] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:33:10 2022] PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 325 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:11.669106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1525413014", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:11.800059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:12.204164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:12.204710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:12.205035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:12.205496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:12.205915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:12.231147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:12.234072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:12.234736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:12.237245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:12.238550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:12.239846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:12.286163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Getting quotas for project 78dce6cc05804cc0b807cc6da75ec0aa. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:12.292071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Getting quotas for user b54fe4de8a9e4cc79a0e09c98d0d570e and project 78dce6cc05804cc0b807cc6da75ec0aa. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:12.297206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:12.310397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:33:12.312846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:33:12.402761 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99cd7816-48f4-4c6e-9a64-2d37113f1890 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713775 Oct 03 14:33:12.404065 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 70/156] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:33:12.411781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:12.412756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:12.425153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:12.425968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:12.426710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:12.427633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:12.428234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:12.428980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:12.762592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:12.763284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:12.763913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:12.764502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:12.765135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:12.791509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:12.792429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:12.796505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:12.797654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:12.798571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:12.799353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:12.840568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Getting quotas for project fe389dc18c4c4f9ca06621236adf0625. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:12.845988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Getting quotas for user 13f81b782b3f4036ba42778d33c3bd50 and project fe389dc18c4c4f9ca06621236adf0625. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:12.867114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.utils [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] ram quota exceeded for fe389dc18c4c4f9ca06621236adf0625, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128868) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 03 14:33:12.869014 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Request method failure captured: Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 145 Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKVxzSrDSDsGGu9MytLcPSaOoc5BEw9ILiQCsB-juJWa2meIOjKAiMWeO1XeKB-Uj5F6LwzzULceg8ic54ET3iUvBnB_nBblRdtcxR6h-MFq98QpLsZLTl9bYSiG7cphy79W9OhdgMHkxTU1xuvTZgyF0Kh291t05cksDOT-_96-Kc Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:12.890854 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe389dc18c4c4f9ca06621236adf0625", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 13f81b782b3f4036ba42778d33c3bd50 Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1525413014", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} Oct 03 14:33:12.892856 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1525413014', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452'}}} Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 14:33:12.893587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:12.895224 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:12.896399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:12.897572 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:12.897572 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:12.897572 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:12.897572 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:12.897572 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 03 14:33:12.897572 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:12.902944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:12.905594 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0c0e092-5ff3-4166-b938-4bf7a759c2cf tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.241693 Oct 03 14:33:12.911645 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 87/157] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:11 2022] POST /compute/v2.1/servers => generated 110 bytes in 1248 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:12.922991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2016321730", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:13.017581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:13.338071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:13.349708 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-942994cd-7244-4b10-ac56-30826286b634 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.944496 Oct 03 14:33:13.354486 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 71/158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:12 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:13.359151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Action: 'update', calling method: .version_select at 0x7fb231313160>, body: {"quota_set": {"ram": 51200}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:13.492802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:13.493401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:13.494464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:13.494981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:13.495775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:13.515018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:13.517575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:13.518935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:13.519914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:13.520616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:13.521282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:13.577644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Getting quotas for project 78dce6cc05804cc0b807cc6da75ec0aa. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:13.588876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Getting quotas for user b54fe4de8a9e4cc79a0e09c98d0d570e and project 78dce6cc05804cc0b807cc6da75ec0aa. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:13.622969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:33:13.630529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:33:13.796021 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875906 Oct 03 14:33:13.799376 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 88/159] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:33:13.800501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:13.801491 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4b8e97b-860a-4bfc-ae79-a162f67ea57d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001259 Oct 03 14:33:13.801828 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 89/160] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 3 14:33:13 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 03 14:33:13.826836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-95f406c2-49ca-41e0-a375-eb57c9002532 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:13.827490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-95f406c2-49ca-41e0-a375-eb57c9002532 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:13.975559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=53 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:13.988488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:13.989378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:13.989975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:13.990245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-95f406c2-49ca-41e0-a375-eb57c9002532 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:13.991654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:13.992772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:14.009137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:14.014689 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-95f406c2-49ca-41e0-a375-eb57c9002532 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1214 microversion: 2.1 time: 0.205731 Oct 03 14:33:14.021269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 90/161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:13 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:14.036681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:14.042480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=63 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:14.172953 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-449f13ca-3ecb-4a76-8855-8f41caca3e4e tempest-QuotasAdminNegativeTest-1496841036 tempest-QuotasAdminNegativeTest-1496841036-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 200 len: 329 microversion: 2.1 time: 0.817276 Oct 03 14:33:14.174510 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 72/162] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:33:13 2022] PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 329 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:14.188606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb6d44cd-7111-4560-9b29-38604ea50cc8 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Action: 'update', calling method: .version_select at 0x7fb2314f1dc0>, body: {"quota_set": {"ram": 0}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:14.194005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb6d44cd-7111-4560-9b29-38604ea50cc8 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '13f81b782b3f4036ba42778d33c3bd50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe389dc18c4c4f9ca06621236adf0625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb6d44cd-7111-4560-9b29-38604ea50cc8 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Request method failure captured: Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 HTTP/1.1 Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 25 Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKVxzSrDSDsGGu9MytLcPSaOoc5BEw9ILiQCsB-juJWa2meIOjKAiMWeO1XeKB-Uj5F6LwzzULceg8ic54ET3iUvBnB_nBblRdtcxR6h-MFq98QpLsZLTl9bYSiG7cphy79W9OhdgMHkxTU1xuvTZgyF0Kh291t05cksDOT-_96-Kc Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:14.204647 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fe389dc18c4c4f9ca06621236adf0625", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fe389dc18c4c4f9ca06621236adf0625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: fe389dc18c4c4f9ca06621236adf0625 Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1830989805 Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 13f81b782b3f4036ba42778d33c3bd50 Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-QuotasAdminNegativeTest-1830989805-project Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: {"quota_set": {"ram": 0}} Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 03 14:33:14.206199 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'fe389dc18c4c4f9ca06621236adf0625', 'body': {'quota_set': {'ram': 0}}} Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:14.207036 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:14.208055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:14.209383 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:14.209383 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:14.209383 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:14.209383 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:14.209383 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 03 14:33:14.209383 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:14.210907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb6d44cd-7111-4560-9b29-38604ea50cc8 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:14.212018 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb6d44cd-7111-4560-9b29-38604ea50cc8 tempest-QuotasAdminNegativeTest-1830989805 tempest-QuotasAdminNegativeTest-1830989805-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625" status: 403 len: 116 microversion: 2.1 time: 0.027455 Oct 03 14:33:14.213555 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 91/163] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:33:14 2022] PUT /compute/v2.1/os-quota-sets/fe389dc18c4c4f9ca06621236adf0625 => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:14.377066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:14.386922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:14.421205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:14.421744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:14.425721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:14.428060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:14.432104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:14.435893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:14.510555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=73 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:14.778373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:14.822178 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c81b420c-134c-4309-b618-addd3fe47f66 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.438563 Oct 03 14:33:14.822178 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 92/164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:14 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:15.055076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:15.055752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:15.071593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:15.075243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:15.076853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:15.079892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:15.081067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:15.082126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:15.101067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ab103a8-20bf-4367-8c82-4af3b0f697e6 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-247904388", "id": 1443649007, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:15.169998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ab103a8-20bf-4367-8c82-4af3b0f697e6 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.895099 Oct 03 14:33:15.176552 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 73/165] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:14 2022] POST /compute/v2.1/flavors => generated 430 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:15.191134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5001b52-3ae1-47d6-98cc-40f54a1a5baf tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bb75b94b81634c30af1639d5a4b806ee"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:15.342442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:15.354384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2efcbd8d-42a7-4c9b-a251-86f9cdafdde5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1218 microversion: 2.1 time: 0.314534 Oct 03 14:33:15.373157 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 93/166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:15 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1218 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:15.378229 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5001b52-3ae1-47d6-98cc-40f54a1a5baf tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1443649007/action" status: 200 len: 97 microversion: 2.1 time: 0.196523 Oct 03 14:33:15.384595 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 74/167] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 3 14:33:15 2022] POST /compute/v2.1/flavors/1443649007/action => generated 97 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:33:15.769096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9244fdc9-647f-4960-9e0b-207f7a54c5e6 tempest-FlavorsAccessTestJSON-1023654104 tempest-FlavorsAccessTestJSON-1023654104-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:15.824542 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9244fdc9-647f-4960-9e0b-207f7a54c5e6 tempest-FlavorsAccessTestJSON-1023654104 tempest-FlavorsAccessTestJSON-1023654104-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.434293 Oct 03 14:33:15.826694 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 94/168] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:15 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:15.846974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:15.847804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:15.850403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a036126c-9d52-4130-bb27-a9940ea0afc8 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bb75b94b81634c30af1639d5a4b806ee"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:15.860995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:15.861646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:15.862216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:15.863090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:15.863721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:15.864422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:15.995516 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a036126c-9d52-4130-bb27-a9940ea0afc8 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1443649007/action" status: 200 len: 21 microversion: 2.1 time: 0.148949 Oct 03 14:33:16.002004 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 95/169] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 3 14:33:15 2022] POST /compute/v2.1/flavors/1443649007/action => generated 21 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:33:16.013872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3db418e9-2633-4ac0-94f6-3fae3b4fde7b tempest-FlavorsAccessTestJSON-1023654104 tempest-FlavorsAccessTestJSON-1023654104-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.055686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3db418e9-2633-4ac0-94f6-3fae3b4fde7b tempest-FlavorsAccessTestJSON-1023654104 tempest-FlavorsAccessTestJSON-1023654104-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046575 Oct 03 14:33:16.062911 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 96/170] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:16.079059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63f66541-e19e-46d8-a119-cf9eb9b98a54 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.115336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63f66541-e19e-46d8-a119-cf9eb9b98a54 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1443649007" status: 202 len: 0 microversion: 2.1 time: 0.040232 Oct 03 14:33:16.115934 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 97/171] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:33:16 2022] DELETE /compute/v2.1/flavors/1443649007 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:33:16.132772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ee3f2f5-750e-47d8-a9de-88868ecfb0e3 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.155016 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ee3f2f5-750e-47d8-a9de-88868ecfb0e3 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034368 Oct 03 14:33:16.156119 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 98/172] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:16.175953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-edcf9df7-409e-4e01-95ed-e9dd3ca0cb05 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1759469874", "id": 1987112153, "os-flavor-access:is_public": "False"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:16.204258 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-edcf9df7-409e-4e01-95ed-e9dd3ca0cb05 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.031874 Oct 03 14:33:16.205811 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 99/173] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:16 2022] POST /compute/v2.1/flavors => generated 431 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:16.218655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-543df8cd-7ae8-4149-b000-b5b5691186e8 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.245085 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-543df8cd-7ae8-4149-b000-b5b5691186e8 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1987112153/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.030430 Oct 03 14:33:16.246096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 100/174] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Oct 3 14:33:16 2022] GET /compute/v2.1/flavors/1987112153/os-flavor-access => generated 21 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:33:16.256982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d658d44-728c-4129-9f2b-64f0ef1ed2af tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.299973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:16.316199 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b76393a8-e81c-4411-904d-86b45a293f06 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.473937 Oct 03 14:33:16.336365 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d658d44-728c-4129-9f2b-64f0ef1ed2af tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1987112153" status: 202 len: 0 microversion: 2.1 time: 0.083630 Oct 03 14:33:16.339788 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 75/175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:15 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:16.341486 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 101/176] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:33:16 2022] DELETE /compute/v2.1/flavors/1987112153 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:33:16.355885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e2fcdd0-61db-427f-b9d8-dbaf3b754a93 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.384310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.385885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:16.396689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:16.399150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:16.400046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:16.401050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:16.403714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:16.404572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:16.424952 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e2fcdd0-61db-427f-b9d8-dbaf3b754a93 tempest-FlavorsAccessTestJSON-844707577 tempest-FlavorsAccessTestJSON-844707577-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081780 Oct 03 14:33:16.438897 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 76/177] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:16.785179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:16.804203 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0fa9f6a2-1999-487a-8c63-0c040cb8730c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1266 microversion: 2.1 time: 0.420981 Oct 03 14:33:16.806513 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 102/178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:16 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1266 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:16.824543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56b060e4-a234-4ce3-8554-653d9170d0fa tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:16.840211 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56b060e4-a234-4ce3-8554-653d9170d0fa tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.247793 Oct 03 14:33:16.840817 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 77/179] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:33:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:17.248095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5cae42d2-9426-44be-ba43-fd44f70184d2 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1768145191", "id": 1107244729, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:17.313752 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5cae42d2-9426-44be-ba43-fd44f70184d2 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.462333 Oct 03 14:33:17.316875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 103/180] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:16 2022] POST /compute/v2.1/flavors => generated 425 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:17.331209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-876ac9e3-e2b2-405e-9601-85e9a05d1d05 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:17.345792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:17.346700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:17.350677 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-876ac9e3-e2b2-405e-9601-85e9a05d1d05 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021816 Oct 03 14:33:17.352380 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 78/181] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 3 14:33:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:33:17.362060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7e97631-67d3-4873-89bf-abef8fb6911c tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-54014218", "id": 219638355, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:17.375964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:17.378045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:17.379376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:17.381324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:17.382707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:17.385844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:17.435169 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7e97631-67d3-4873-89bf-abef8fb6911c tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.076783 Oct 03 14:33:17.439751 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 79/182] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:17 2022] POST /compute/v2.1/flavors => generated 420 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:17.456773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06738424-e053-491f-a30d-5e9cbb42946f tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:17.478365 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06738424-e053-491f-a30d-5e9cbb42946f tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032377 Oct 03 14:33:17.486488 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 80/183] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 3 14:33:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:33:17.502316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15019bf1-430e-4ff2-8cbb-a7d53440d63d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Action: 'create', calling method: .version_select at 0x7fb231313430>, body: {"keypair": {"name": "tempest-keypair-3290191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9b/ItraFijzUpzwxbq4hhD5jkojHfkpFKM8qCrjn/RO91/qkLEwd+LTqGmj940yYsfIBijHpaYvkoFU2DytX8gvc6sQ+4KNIwng/3pmCih8LvvIoAOk3mKMnx8Im5Qzg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:17.560813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-15019bf1-430e-4ff2-8cbb-a7d53440d63d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Getting quotas for project de6554f52fa546d5b7396f907f2f3e81. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:17.568070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-15019bf1-430e-4ff2-8cbb-a7d53440d63d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Getting quotas for user 01fed2159b9c4c97aef7978920b4c959 and project de6554f52fa546d5b7396f907f2f3e81. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:17.642841 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15019bf1-430e-4ff2-8cbb-a7d53440d63d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.150700 Oct 03 14:33:17.646708 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 81/184] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:33:17 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:17.834754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:17.835388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:17.861247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:17.861667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:17.862106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:17.862999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:17.863583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:17.864016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:17.999948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:18.033778 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e8c93b0-b59d-4e2d-8158-1e2642ba5029 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1266 microversion: 2.1 time: 0.203889 Oct 03 14:33:18.038857 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 82/185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:17 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:18.187468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:18.207936 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a30e2015-e9de-4f7a-aab4-2ac2e4fb546b tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.867367 Oct 03 14:33:18.214054 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 104/186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:17 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:19.060375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:19.061831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:19.076475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:19.085641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:19.089432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:19.090869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:19.091566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:19.092246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:19.099261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c5c1cbe6-52e4-464e-bf4e-c4a3fae2aff3 req-1b6c54d4-8e8c-40f2-a8db-41eecf00f38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1706f473-6565-47c7-8715-b19cfb200faf", "name": "network-vif-plugged", "status": "completed", "tag": "cc90c244-dfcc-4a15-bf94-2dced2f540a9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:19.140902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c5c1cbe6-52e4-464e-bf4e-c4a3fae2aff3 req-1b6c54d4-8e8c-40f2-a8db-41eecf00f38b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:19.141409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c5c1cbe6-52e4-464e-bf4e-c4a3fae2aff3 req-1b6c54d4-8e8c-40f2-a8db-41eecf00f38b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:19.142200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c5c1cbe6-52e4-464e-bf4e-c4a3fae2aff3 req-1b6c54d4-8e8c-40f2-a8db-41eecf00f38b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:19.202521 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c5c1cbe6-52e4-464e-bf4e-c4a3fae2aff3 req-1b6c54d4-8e8c-40f2-a8db-41eecf00f38b service nova] Creating event network-vif-plugged:cc90c244-dfcc-4a15-bf94-2dced2f540a9 for instance 1706f473-6565-47c7-8715-b19cfb200faf on n-h2-781139-2 Oct 03 14:33:19.203054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c5c1cbe6-52e4-464e-bf4e-c4a3fae2aff3 req-1b6c54d4-8e8c-40f2-a8db-41eecf00f38b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:33:19.203450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c5c1cbe6-52e4-464e-bf4e-c4a3fae2aff3 req-1b6c54d4-8e8c-40f2-a8db-41eecf00f38b service nova] Acquired lock "compute-rpcapi-router" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:33:19.213371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:19.225067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:19.225785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:19.226629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:19.227098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:19.227523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:19.259673 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.rpcapi [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 14:33:19.271107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] Releasing lock "compute-rpcapi-router" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:33:19.302196 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c74938f-b274-4252-818f-b5a9c234a88b None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324898 Oct 03 14:33:19.306101 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 83/187] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:19.338363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:19.341327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:19.374153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:19.375823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:19.377697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:19.379769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:19.381861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:19.382513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:19.436248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:19.449979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cba01c7a-301d-49ce-b1aa-fe71becdb6c9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1266 microversion: 2.1 time: 0.389402 Oct 03 14:33:19.452273 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 105/188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:19 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:20.171542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:20.190758 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ab0415a-3fd0-466f-aad6-c16c7e58568e tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.879673 Oct 03 14:33:20.194850 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 84/189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:19 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:20.475642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:20.476858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:20.496245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:20.501251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:20.502176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:20.505567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:20.506609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:20.507301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:21.119957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:21.135843 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d2767d0e-7876-4b34-824b-076067991ab2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1266 microversion: 2.1 time: 0.664735 Oct 03 14:33:21.144128 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 106/190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:20 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1266 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:21.219500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:21.220525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:21.245377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:21.246348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:21.248790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:21.250029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:21.251520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:21.253374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:21.699181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:21.711817 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d28f3f0-badf-4ec3-b18b-6bf08f618e6c tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.497910 Oct 03 14:33:21.725842 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 85/191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:21 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:22.169819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:22.171430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:22.177829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:22.182432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:22.183713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:22.186640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:22.188256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:22.189377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:22.309365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:22.327546 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3c95700c-e905-4434-bccb-695d799446cc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1266 microversion: 2.1 time: 0.163184 Oct 03 14:33:22.328540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 107/192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:22 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:22.744383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:22.746958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:22.753542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:22.754248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:22.754816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:22.755686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:22.756455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:22.756871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:22.784946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1120185223", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "219638355", "adminPass": "***", "networks": [{"uuid": "5d8854a5-13f1-4626-abe1-8931b1eaa8eb"}], "security_groups": [{"name": "tempest-securitygroup--1653888081"}], "key_name": "tempest-keypair-3290191", "user_data": "}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:23.079167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] validate_networks() for [('5d8854a5-13f1-4626-abe1-8931b1eaa8eb', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:23.165538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:23.176669 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a485961-5046-495f-ab9c-f3e8ad5152b1 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1338 microversion: 2.1 time: 0.441210 Oct 03 14:33:23.177293 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 86/193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:22 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1338 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:23.357488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:23.358169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:23.381658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:23.382153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:23.382594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:23.383324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:23.383764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:23.384255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:23.502807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:23.511205 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-849c14e3-547b-4393-90b0-9578ce6a3235 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1266 microversion: 2.1 time: 0.163857 Oct 03 14:33:23.511798 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 87/194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:23 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:23.553300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:23.996091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=30 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:24.009609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Calling method '.version_select at 0x7fb231313280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:24.021487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.022046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.022503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.094369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.095068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.101961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.232761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.233287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.233724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.270360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.271125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.272241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.307735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.310089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.310747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.319311 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7c25785-754e-4d80-a586-813bb1719417 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.801138 Oct 03 14:33:24.332972 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 88/195] 10.222.0.20 () {60 vars in 1243 bytes} [Mon Oct 3 14:33:23 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:24.338386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:24.339255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:24.346640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.347451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.348111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.349058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.349710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.350334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.649229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:24.660549 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f824edc-c4e0-4a11-a47b-a7fdc0910c47 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1488 microversion: 2.1 time: 0.325991 Oct 03 14:33:24.662459 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 89/196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:24 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1488 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:24.671680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Calling method '.version_select at 0x7fb2312c8820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:24.681096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.685645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.686344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.720310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.720812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.721289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.764364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.764863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.765320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.797095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.797590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.798027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.838197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.838685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.839117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.860743 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-089bf108-60bd-440a-b34c-99f0f8afccb0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.194603 Oct 03 14:33:24.860743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 90/197] 10.222.0.20 () {60 vars in 1222 bytes} [Mon Oct 3 14:33:24 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:24.872810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:24.873486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:24.887284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.887776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.888362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:24.889094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:24.889549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:24.889999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:25.015915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:25.016528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:25.018391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:25.018910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:25.019358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:25.037190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:25.042688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:25.043555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:25.044002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:25.044982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:25.046317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:25.048019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:25.053430 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f327d5b-ed43-49e9-945c-f75c5c793020 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1272 microversion: 2.1 time: 0.179851 Oct 03 14:33:25.062426 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 91/198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:24 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:25.077026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:25.077586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:25.078180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Getting quotas for project de6554f52fa546d5b7396f907f2f3e81. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:25.083459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Getting quotas for user 01fed2159b9c4c97aef7978920b4c959 and project de6554f52fa546d5b7396f907f2f3e81. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:25.089022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=87,nova_api:DELETE=7 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:25.099921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:33:25.103009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:25.103290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:33:25.103529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:25.104617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:25.108148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:25.109035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:25.111279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:25.168833 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8d1bbac6-123f-4ab1-a61a-b53b1ff1a28a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.392169 Oct 03 14:33:25.170581 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 108/199] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:33:25.177889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Calling method '.version_select at 0x7fb231508700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:25.183491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:25.184355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:25.185063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:25.211289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:25.212526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:25.213390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:25.222494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0a75641-1969-4dc1-a9b3-2965b7c4d5f0 tempest-HypervisorAdminV253TestBase-1363204978 tempest-HypervisorAdminV253TestBase-1363204978-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/8ac25c0b-ae26-4264-8a8a-205beb907094" status: 200 len: 792 microversion: 2.53 time: 0.050403 Oct 03 14:33:25.223735 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 109/200] 10.222.0.20 () {60 vars in 1298 bytes} [Mon Oct 3 14:33:25 2022] GET /compute/v2.1/os-hypervisors/8ac25c0b-ae26-4264-8a8a-205beb907094 => generated 792 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:25.230382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-360107c7-aa11-4e59-a8fc-ae0679751ac9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:25.231545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-360107c7-aa11-4e59-a8fc-ae0679751ac9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:25.637770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-360107c7-aa11-4e59-a8fc-ae0679751ac9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:25.655322 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-360107c7-aa11-4e59-a8fc-ae0679751ac9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1260 microversion: 2.1 time: 0.429970 Oct 03 14:33:25.656315 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 110/201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:25 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1260 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:26.084133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Calling method '.version_select at 0x7fb2314f1940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:26.089150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.090337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.090930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.106811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.107544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.108152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.122287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.122982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.123574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.131632 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-558c6f95-85a4-41f6-8b6f-e499fd1dde6a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.474026 Oct 03 14:33:26.132469 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 111/202] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:26.138310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:26.139399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:26.147229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.147923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.148496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.150252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.151670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.152369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.337491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:26.354566 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42b70323-68ff-4132-b240-c03500f0f03a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1272 microversion: 2.1 time: 0.220773 Oct 03 14:33:26.355214 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 112/203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:26 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:26.370219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Calling method '.version_select at 0x7fb2313f5430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:26.371685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.372351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.373943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.411870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.413245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.414073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.459402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.460252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.461073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.469997 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b92396b2-ce8f-4153-8682-4f45ad6c47d2 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-781139-2/servers" status: 200 len: 196 microversion: 2.1 time: 0.113708 Oct 03 14:33:26.471385 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 113/204] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 3 14:33:26 2022] GET /compute/v2.1/os-hypervisors/n-h2-781139-2/servers => generated 196 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:26.486751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Calling method '.version_select at 0x7fb231485430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:26.489038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.492778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.495161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.540534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.541312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.541962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.552417 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0cfe966c-32e9-44af-ae03-1398eae384c9 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1639 microversion: 2.1 time: 1.487748 Oct 03 14:33:26.556702 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 92/205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:25 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1639 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:26.578721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.579888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.580071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:26.581028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.589592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:26.590195 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-39bbeef4-a883-4da5-9ca3-18bd88123414 tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.110460 Oct 03 14:33:26.591103 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 114/206] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:26.607059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Calling method '.version_select at 0x7fb2313f58b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:26.611791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.612768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.614093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.614356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.615153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.615813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.616686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.621274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.621812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.645593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.646837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.654793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.662287 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6352a02c-3bad-4386-868f-acba0274800a tempest-HypervisorAdminUnderV252Test-1311320311 tempest-HypervisorAdminUnderV252Test-1311320311-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-781139-2/search" status: 200 len: 104 microversion: 2.1 time: 0.060577 Oct 03 14:33:26.662887 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 115/207] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Oct 3 14:33:26 2022] GET /compute/v2.1/os-hypervisors/n-h2-781139-2/search => generated 104 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:26.680179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:26.681118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:26.688679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:33:26.694636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.695707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.698645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.700015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.702681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.703341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:26.827837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:26.924627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:26.959022 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf2e6cab-9697-4d1a-928b-ae3f5e096684 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 204 len: 0 microversion: 2.1 time: 0.374058 Oct 03 14:33:26.960078 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 93/208] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:33:26 2022] DELETE /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:33:26.966845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a6c43100-694f-4dd4-a8f1-299f26e6d776 req-be6f69d8-98ba-427b-9330-fe3e32649018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc3a975-8b74-4921-9106-0160c9bcc3bf", "tag": "3114f95d-0543-4f63-a146-ecadff0a8ba9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:26.994961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6c43100-694f-4dd4-a8f1-299f26e6d776 req-be6f69d8-98ba-427b-9330-fe3e32649018 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:26.996369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6c43100-694f-4dd4-a8f1-299f26e6d776 req-be6f69d8-98ba-427b-9330-fe3e32649018 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:26.997041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a6c43100-694f-4dd4-a8f1-299f26e6d776 req-be6f69d8-98ba-427b-9330-fe3e32649018 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:27.026892 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a6c43100-694f-4dd4-a8f1-299f26e6d776 req-be6f69d8-98ba-427b-9330-fe3e32649018 service nova] Creating event network-changed:3114f95d-0543-4f63-a146-ecadff0a8ba9 for instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf on n-h1-781139-2 Oct 03 14:33:27.039546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a6c43100-694f-4dd4-a8f1-299f26e6d776 req-be6f69d8-98ba-427b-9330-fe3e32649018 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077875 Oct 03 14:33:27.044260 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 94/209] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:27.049764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:27.060482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:27.076664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:27.077529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:27.078154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:27.079761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:27.080410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:27.081056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:27.099949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:27.109523 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34e1e934-b256-4610-8a73-6cc51a77dfc7 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1334 microversion: 2.1 time: 0.433872 Oct 03 14:33:27.122012 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 116/210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:26 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1334 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:27.378082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:27.378982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:27.394503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:27.399353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:27.400143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:27.402465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:27.404822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:27.407219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:27.434816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:27.447771 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82648196-1ac4-4fd6-8057-28e9271a49a6 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1494 microversion: 2.1 time: 0.401847 Oct 03 14:33:27.453023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 95/211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:27 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1494 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:28.072807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:28.083788 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4d059156-4e60-4d2a-bdf3-fb62bfb747b4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.709740 Oct 03 14:33:28.117797 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 117/212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:27 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:28.135926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:28.136606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:28.138919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=11 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:28.158902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:28.159716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:28.160480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:28.161396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:28.161994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:28.162621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:28.384245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:28.408419 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d17700b-b34a-4ce9-97d8-56b9e66c75e0 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1342 microversion: 2.1 time: 0.277730 Oct 03 14:33:28.414711 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 96/213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:28 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1342 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:28.481454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:28.485703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:28.502843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:28.504314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:28.507692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:28.508766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:28.509491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:28.510809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:29.122377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:29.123977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:29.144180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:29.145661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:29.148388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:29.151040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:29.152886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:29.153608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:29.251008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:29.929685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:29.966008 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e0730c0-6f8b-44a8-b40c-28e84fe62f9a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1494 microversion: 2.1 time: 1.475071 Oct 03 14:33:29.968132 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 118/214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:28 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1494 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:29.973318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:29.974240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:29.981218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:29.982069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:29.982718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:29.983669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:29.984328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:29.984991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:30.180246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:30.195500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:30.214916 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7a0696c-bb33-4c3f-928b-18a2f348951f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1340 microversion: 2.1 time: 0.245360 Oct 03 14:33:30.237937 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 119/215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:29 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:30.440876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:30.453777 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ca47c2b-0c52-4b65-b708-b035abace338 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 1.346374 Oct 03 14:33:30.479192 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 97/216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:29 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:30.997705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:30.998502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:31.005755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:31.006815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:31.007519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:31.008518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:31.009525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:31.010205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:31.246582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:31.247210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:31.257519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:31.258016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:31.258453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:31.259213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:31.259661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:31.260079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:31.771299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0e43f6723a4b2abc02450dae9e580f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe6d46ecdb948d78e85c409354a9ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:31.787792 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d366091e-f5b0-4cbe-a629-6fef543ff4bd tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 200 len: 1452 microversion: 2.1 time: 0.794838 Oct 03 14:33:31.794065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 120/217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:30 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 1452 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:31.812543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:31.820079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:31.853136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:31.853952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:31.854556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:31.855483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:31.860205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:31.860952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:32.883929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:32.892164 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43331282-23e1-4aaf-b31c-8f28aebe0fe3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 1.095017 Oct 03 14:33:32.906647 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 121/218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:31 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:33.375017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-49433683-977a-45ff-9dc2-97aea44d522d req-f3c13497-4616-45d7-9456-d782c0c102ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1706f473-6565-47c7-8715-b19cfb200faf", "name": "network-vif-deleted", "tag": "cc90c244-dfcc-4a15-bf94-2dced2f540a9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:33.411010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-49433683-977a-45ff-9dc2-97aea44d522d req-f3c13497-4616-45d7-9456-d782c0c102ab service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:33.411769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-49433683-977a-45ff-9dc2-97aea44d522d req-f3c13497-4616-45d7-9456-d782c0c102ab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:33.412208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-49433683-977a-45ff-9dc2-97aea44d522d req-f3c13497-4616-45d7-9456-d782c0c102ab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:33.727533 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-49433683-977a-45ff-9dc2-97aea44d522d req-f3c13497-4616-45d7-9456-d782c0c102ab service nova] Creating event network-vif-deleted:cc90c244-dfcc-4a15-bf94-2dced2f540a9 for instance 1706f473-6565-47c7-8715-b19cfb200faf on n-h2-781139-2 Oct 03 14:33:33.746913 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-49433683-977a-45ff-9dc2-97aea44d522d req-f3c13497-4616-45d7-9456-d782c0c102ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.838968 Oct 03 14:33:33.747538 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 122/219] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:33.752618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:33.753341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:33.760379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:33.760875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:33.761329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:33.762211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:33.762810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:33.763380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:33.778157 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] HTTP exception thrown: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Request method failure captured: Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf HTTP/1.1 Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKK2BfgOFGd46tPH5pjYQgVMhiED_QJeUlBlAXPzwTdRrr3bf7V38VSozK_tz_E5Lhhw-7O9lzefwCguJl76ojXWnQV7hiyzL0ZkEvtAi-T0yK2yQX_fTq8yInd2Yrj--oVTmCGWviWgocvqbo3knfv7oDT50XQhlIiJWY6SZjjM7M Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6fe6d46ecdb948d78e85c409354a9ee5 Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:33.780414 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fe6d46ecdb948d78e85c409354a9ee5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6fe6d46ecdb948d78e85c409354a9ee5 Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminTestJSON-1654502565-project Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 5f0e43f6723a4b2abc02450dae9e580f Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminTestJSON-1654502565-project Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:33.782050 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1706f473-6565-47c7-8715-b19cfb200faf'} Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:33.782850 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:33.784294 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:33.786435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Returning 404 to user: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:33.787479 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ab072551-7ca9-41e5-abb3-37446a65f732 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 404 len: 111 microversion: 2.1 time: 0.038860 Oct 03 14:33:33.788196 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 123/220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:33 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:34.033100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Calling method '.version_select at 0x7fb2313709d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:34.034755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.035416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.035849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.046766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:34.074829 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-898a0ea2-1df0-4c10-a26b-ff746d705927 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1408 microversion: 2.1 time: 2.828087 Oct 03 14:33:34.076339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.077051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.077446 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 98/221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:31 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1408 bytes in 2837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:34.077706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.087067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f379be4-d4d0-4ee2-97a0-714a58ba9cfc tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:34.096308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.109928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.110603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.118108 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-718bfb73-0740-4d7f-9570-42408492a234 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.324963 Oct 03 14:33:34.119210 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 124/222] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:34.130732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:34.131593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:34.133241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f379be4-d4d0-4ee2-97a0-714a58ba9cfc tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.134019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f379be4-d4d0-4ee2-97a0-714a58ba9cfc tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.134756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f379be4-d4d0-4ee2-97a0-714a58ba9cfc tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.148163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.148574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.149207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.150356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.150975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.151540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.367997 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f379be4-d4d0-4ee2-97a0-714a58ba9cfc tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.288637 Oct 03 14:33:34.370748 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 99/223] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:33:34 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:34.658340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:34.679706 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-881dd715-69c4-4693-b1c2-ccaa6cd5cf4d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.549929 Oct 03 14:33:34.681209 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 125/224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:34 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:34.701650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-10119a00-c3b2-42d4-a022-eb818647fa25 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:34.764968 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-10119a00-c3b2-42d4-a022-eb818647fa25 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.082545 Oct 03 14:33:34.765921 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 126/225] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:34 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:34.790113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-091786aa-8523-40d1-b147-7bc80584067c tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1178937492"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:34.796723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58bc7afb-7380-4b1d-9c63-eddae235e57d tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Calling method '.version_select at 0x7fb23122bf70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:34.800094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58bc7afb-7380-4b1d-9c63-eddae235e57d tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '591867af4da945c3a5955502ddaf5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd4af77e3744d69800f875c253e9d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:34.803381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-091786aa-8523-40d1-b147-7bc80584067c tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 7f981481-1140-4cb3-b6fd-af9dd128cb73 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58bc7afb-7380-4b1d-9c63-eddae235e57d tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Request method failure captured: Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/n-h2-781139-2/search HTTP/1.1 Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvK8fkm6G3SyOm1jOA-bNWUdbSFVBdYZZ_WK3TtufZcWGbnnLgfYCJfZS87g_a7JLFV5vrqEI8YOPZDpPYfdYefCNhwYKDUojXLb03JGgfVGgxDCXufEAEWj5BWWmqdmZmBKJvs9OnPwuEbACg3Fm_Ze6ky1s_mDVFS3IlObylIyAoY Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: dfd4af77e3744d69800f875c253e9d14 Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-163982073 Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:34.810356 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfd4af77e3744d69800f875c253e9d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfd4af77e3744d69800f875c253e9d14", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfd4af77e3744d69800f875c253e9d14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfd4af77e3744d69800f875c253e9d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-163982073 Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: dfd4af77e3744d69800f875c253e9d14 Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-163982073 Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-163982073-project Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 591867af4da945c3a5955502ddaf5fdb Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-163982073-project Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 03 14:33:34.811718 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'n-h2-781139-2'} Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:34.812395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 03 14:33:34.813478 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:34.816135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58bc7afb-7380-4b1d-9c63-eddae235e57d tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:34.820336 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58bc7afb-7380-4b1d-9c63-eddae235e57d tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h2-781139-2/search" status: 403 len: 117 microversion: 2.1 time: 0.447405 Oct 03 14:33:34.825801 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 100/226] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Oct 3 14:33:34 2022] GET /compute/v2.1/os-hypervisors/n-h2-781139-2/search => generated 117 bytes in 454 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:34.844225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Calling method '.version_select at 0x7fb2315b93a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:34.846269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.849900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.850586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.890471 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-091786aa-8523-40d1-b147-7bc80584067c tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.108422 Oct 03 14:33:34.894162 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 127/227] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:34.896910 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 14:33:34.903624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f997b6a-f499-4f88-b557-f1e27d3e3c3e tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Request method failure captured: Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvK9tdb9mS87Y9vkTXGYDxjIG7FfUxvoOIpa2mhzoS3pbSyaCyL-Miq0Yog2a5fhaDNgli2AxEN7o4thwBl0YAadeuyWD4xqA9jfx0Jfa6dT2Hw7hPAsQz9o9F11mc-U3ucdXXIX-hhV8QjlZXktOporVRmIjNMiMl_ZYGwzwkkoCAk Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3d176e420c05458caf84e6b9517c1210 Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-834050480 Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:33:34.904409 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d176e420c05458caf84e6b9517c1210"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d176e420c05458caf84e6b9517c1210", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d176e420c05458caf84e6b9517c1210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d176e420c05458caf84e6b9517c1210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-834050480 Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3d176e420c05458caf84e6b9517c1210 Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-834050480 Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7e95720b5a1e4471a34e97468c19a71e Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 14:33:34.905856 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:34.906676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:34.907889 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:34.907889 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:34.907889 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:34.907889 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 03 14:33:34.907889 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:34.909437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:34.912003 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34a28427-e0b0-4d87-b43d-9c4de14f4ac3 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.080582 Oct 03 14:33:34.918939 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 101/228] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:33:34 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:34.925889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Calling method '.version_select at 0x7fb2311363a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:34.933701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.934467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.936431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f997b6a-f499-4f88-b557-f1e27d3e3c3e tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.936937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f997b6a-f499-4f88-b557-f1e27d3e3c3e tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.937595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.941789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f997b6a-f499-4f88-b557-f1e27d3e3c3e tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:34.987100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:34.990551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:34.990830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:35.028995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:35.031791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:35.032534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:35.060342 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a501cbe6-02ec-485d-bcfd-5d8b08aa764e tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.138296 Oct 03 14:33:35.067257 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 102/229] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:35.072910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:35.082368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1e67274-f800-4db7-a435-958c3ebabb1f tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Calling method '.version_select at 0x7fb231127af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:35.086180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1e67274-f800-4db7-a435-958c3ebabb1f tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '591867af4da945c3a5955502ddaf5fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfd4af77e3744d69800f875c253e9d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1e67274-f800-4db7-a435-958c3ebabb1f tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Request method failure captured: Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvK8fkm6G3SyOm1jOA-bNWUdbSFVBdYZZ_WK3TtufZcWGbnnLgfYCJfZS87g_a7JLFV5vrqEI8YOPZDpPYfdYefCNhwYKDUojXLb03JGgfVGgxDCXufEAEWj5BWWmqdmZmBKJvs9OnPwuEbACg3Fm_Ze6ky1s_mDVFS3IlObylIyAoY Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: dfd4af77e3744d69800f875c253e9d14 Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-163982073 Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:35.092135 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dfd4af77e3744d69800f875c253e9d14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dfd4af77e3744d69800f875c253e9d14", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfd4af77e3744d69800f875c253e9d14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dfd4af77e3744d69800f875c253e9d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-163982073 Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: dfd4af77e3744d69800f875c253e9d14 Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-163982073 Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-163982073-project Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 591867af4da945c3a5955502ddaf5fdb Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-163982073-project Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 03 14:33:35.093938 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1'} Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:35.094612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 03 14:33:35.095612 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:35.102024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1e67274-f800-4db7-a435-958c3ebabb1f tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:35.106546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1e67274-f800-4db7-a435-958c3ebabb1f tempest-HypervisorAdminNegativeUnderV252Test-163982073 tempest-HypervisorAdminNegativeUnderV252Test-163982073-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.033193 Oct 03 14:33:35.107799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 103/230] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:33:35 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:35.125779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:35.128198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:35.147228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:35.148124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:35.149953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:35.151065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:35.153484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:35.154171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:35.220575 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f997b6a-f499-4f88-b557-f1e27d3e3c3e tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.320897 Oct 03 14:33:35.221701 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 128/231] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:33:34 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:35.231618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Calling method '.version_select at 0x7fb2314e6b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:35.237031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:35.238718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:35.239402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:35.258388 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] HTTP exception thrown: No hypervisor matching '5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06' could be found. Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Request method failure captured: Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors/5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06/servers HTTP/1.1 Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvK9tdb9mS87Y9vkTXGYDxjIG7FfUxvoOIpa2mhzoS3pbSyaCyL-Miq0Yog2a5fhaDNgli2AxEN7o4thwBl0YAadeuyWD4xqA9jfx0Jfa6dT2Hw7hPAsQz9o9F11mc-U3ucdXXIX-hhV8QjlZXktOporVRmIjNMiMl_ZYGwzwkkoCAk Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3d176e420c05458caf84e6b9517c1210 Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-834050480 Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:33:35.260888 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3d176e420c05458caf84e6b9517c1210"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3d176e420c05458caf84e6b9517c1210", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d176e420c05458caf84e6b9517c1210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3d176e420c05458caf84e6b9517c1210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-834050480 Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3d176e420c05458caf84e6b9517c1210 Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-834050480 Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 7e95720b5a1e4471a34e97468c19a71e Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: exception: No hypervisor matching '5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06' could be found. Oct 03 14:33:35.262109 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06'} Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06' could be found. Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:35.262765 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06' could be found. Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] Returning 404 to user: No hypervisor matching '5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06' could be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5a1ae39-bab6-4b41-810c-0e31b374ce41 tempest-HypervisorAdminNegativeUnderV252Test-834050480 tempest-HypervisorAdminNegativeUnderV252Test-834050480-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06/servers" status: 404 len: 123 microversion: 2.1 time: 0.039507 Oct 03 14:33:35.268058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 129/232] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 3 14:33:35 2022] GET /compute/v2.1/os-hypervisors/5ee88a3d-4bbd-4efb-be15-ba3b1c1d5c06/servers => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:35.290915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7d6f46d-a50b-49d2-92bb-902d9d8e5981 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:35.314673 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7d6f46d-a50b-49d2-92bb-902d9d8e5981 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.048336 Oct 03 14:33:35.315254 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 130/233] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:33:35 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:35.337924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2070b78a-1be1-48b9-bb3b-595df35aaf12 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:35.363821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2070b78a-1be1-48b9-bb3b-595df35aaf12 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:35.371454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2070b78a-1be1-48b9-bb3b-595df35aaf12 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:35.373111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2070b78a-1be1-48b9-bb3b-595df35aaf12 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:35.639155 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2070b78a-1be1-48b9-bb3b-595df35aaf12 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.312233 Oct 03 14:33:35.645803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 131/234] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:33:35 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:35.666568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-caf73bff-1549-43b9-b965-aa98fb18ce68 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:35.685041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:35.737813 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-caf73bff-1549-43b9-b965-aa98fb18ce68 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.084142 Oct 03 14:33:35.739329 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 132/235] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:35 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:35.766933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:35.776182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:35.804648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:35.815593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:35.821624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:35.823360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:35.826880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:35.828057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:36.117508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:36.128552 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ae04bb5-fc73-48e7-80a4-7f321a18bbfb tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1386 microversion: 2.1 time: 1.019394 Oct 03 14:33:36.136470 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 104/236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:35 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1386 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:36.150889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f95ef59-6b18-48c9-bd67-5048cc38fc53 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-432743059"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:36.162958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-3f95ef59-6b18-48c9-bd67-5048cc38fc53 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 7f90b13b-9220-455e-acb9-ab9ba1e1ad3e for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:36.212306 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f95ef59-6b18-48c9-bd67-5048cc38fc53 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068855 Oct 03 14:33:36.216553 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 105/237] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:36.239366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6fa8065e-6651-489d-85c9-c59c8081707c req-9916cf23-ca39-456c-9a3a-dff27515946d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512b8784-a0b5-45a8-95d9-85d2faaf4e5f", "tag": "3e232d83-b71c-4671-92c6-7ea1aeafc99f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:36.276017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6fa8065e-6651-489d-85c9-c59c8081707c req-9916cf23-ca39-456c-9a3a-dff27515946d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:36.281960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6fa8065e-6651-489d-85c9-c59c8081707c req-9916cf23-ca39-456c-9a3a-dff27515946d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:36.282517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6fa8065e-6651-489d-85c9-c59c8081707c req-9916cf23-ca39-456c-9a3a-dff27515946d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:36.317627 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6fa8065e-6651-489d-85c9-c59c8081707c req-9916cf23-ca39-456c-9a3a-dff27515946d service nova] Creating event network-changed:3e232d83-b71c-4671-92c6-7ea1aeafc99f for instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f on n-h2-781139-2 Oct 03 14:33:36.337406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6fa8065e-6651-489d-85c9-c59c8081707c req-9916cf23-ca39-456c-9a3a-dff27515946d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119029 Oct 03 14:33:36.361864 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 106/238] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:36.387257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffb5d820-ace1-4fa5-848c-647529d4afa2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:36.416345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffb5d820-ace1-4fa5-848c-647529d4afa2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:36.417308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffb5d820-ace1-4fa5-848c-647529d4afa2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:36.417907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffb5d820-ace1-4fa5-848c-647529d4afa2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:36.626839 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ffb5d820-ace1-4fa5-848c-647529d4afa2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.263285 Oct 03 14:33:36.627760 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 107/239] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:33:36 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:36.639041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-95f66135-869a-499b-aec5-1989e07f50fc req-7b58abaf-fd85-48c7-846c-6e1c3ab7d3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbec214f-3bd5-4963-9bf7-28bb6b7403e5", "tag": "cb72ef60-69de-435d-a9e3-5f8d864fc731"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:36.656137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-95f66135-869a-499b-aec5-1989e07f50fc req-7b58abaf-fd85-48c7-846c-6e1c3ab7d3a3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:36.656556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-95f66135-869a-499b-aec5-1989e07f50fc req-7b58abaf-fd85-48c7-846c-6e1c3ab7d3a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:36.657884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:36.658517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-95f66135-869a-499b-aec5-1989e07f50fc req-7b58abaf-fd85-48c7-846c-6e1c3ab7d3a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:36.673571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59b8b492-fa24-4094-913f-b29cdd3addb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.932443 Oct 03 14:33:36.675434 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 133/240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:35 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:36.681237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-67f6504e-ead7-4524-a243-47aa2458e8e1 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:36.695983 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-95f66135-869a-499b-aec5-1989e07f50fc req-7b58abaf-fd85-48c7-846c-6e1c3ab7d3a3 service nova] Creating event network-changed:cb72ef60-69de-435d-a9e3-5f8d864fc731 for instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 on n-h1-781139-2 Oct 03 14:33:36.707665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-67f6504e-ead7-4524-a243-47aa2458e8e1 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.030965 Oct 03 14:33:36.708265 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 134/241] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:33:36 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:36.710005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-95f66135-869a-499b-aec5-1989e07f50fc req-7b58abaf-fd85-48c7-846c-6e1c3ab7d3a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080788 Oct 03 14:33:36.710946 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 108/242] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:36.736476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6f2ced7-54cd-49d9-a456-fe9c070ba431 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:36.764186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6f2ced7-54cd-49d9-a456-fe9c070ba431 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:36.767115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6f2ced7-54cd-49d9-a456-fe9c070ba431 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:36.770109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6f2ced7-54cd-49d9-a456-fe9c070ba431 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:37.020139 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6f2ced7-54cd-49d9-a456-fe9c070ba431 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.296166 Oct 03 14:33:37.026284 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 135/243] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 3 14:33:36 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:37.038731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7517913-6dd5-46fb-b8c6-20b9f9c68742 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:37.098419 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7517913-6dd5-46fb-b8c6-20b9f9c68742 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.063878 Oct 03 14:33:37.099703 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 109/244] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:37 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:37.114478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37774ecf-afce-4e4f-baab-d1ebe43c3856 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032025775"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:37.134225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-37774ecf-afce-4e4f-baab-d1ebe43c3856 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 4a356cb3-d16a-4dd5-826d-5cb2334af023 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:37.161605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:37.162563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:37.174034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:37.180363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:37.181624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:37.182501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:37.183099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:37.183692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:37.203528 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37774ecf-afce-4e4f-baab-d1ebe43c3856 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.096390 Oct 03 14:33:37.210459 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 136/245] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:37.227080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59ae1420-7041-43ec-aefa-d3f9f7b74771 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:37.256193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:37.262098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59ae1420-7041-43ec-aefa-d3f9f7b74771 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:37.262692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59ae1420-7041-43ec-aefa-d3f9f7b74771 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:37.263143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59ae1420-7041-43ec-aefa-d3f9f7b74771 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:37.499488 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59ae1420-7041-43ec-aefa-d3f9f7b74771 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.286084 Oct 03 14:33:37.500086 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 137/246] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 14:33:37 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:37.514331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6edd153-3b9f-4501-8530-abc770beb8f4 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:37.526825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6edd153-3b9f-4501-8530-abc770beb8f4 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:37.527611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6edd153-3b9f-4501-8530-abc770beb8f4 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:37.528193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6edd153-3b9f-4501-8530-abc770beb8f4 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:37.755297 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6edd153-3b9f-4501-8530-abc770beb8f4 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.245345 Oct 03 14:33:37.759224 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 138/247] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 14:33:37 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:38.037391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e17e530f-18eb-4d18-addf-ab24d7d757d0 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Calling method '.version_select at 0x7fb2313f5ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.040331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e17e530f-18eb-4d18-addf-ab24d7d757d0 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e5b9d8eba2bd4f53921318be11baac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be169802fc764f9ea497a752ada156c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e17e530f-18eb-4d18-addf-ab24d7d757d0 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Request method failure captured: Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLAd2nfHa9DZWuwBs9OJBDpLH3ckHTXJdIyixG6RpcSCMv8ilkIH6A_AidVU2YdzzUPkfotz7vrbr5ytr2bxJwk_hOGzXreOt6-PZIgR4V59XD_v990roOq4bkQxL5LwaFn48tSwG7O3pZlJaYLe2Q3tE4SOZgCN6LP8ZZepJ7_kP0 Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:38.042635 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be169802fc764f9ea497a752ada156c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be169802fc764f9ea497a752ada156c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e5b9d8eba2bd4f53921318be11baac9d Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:33:38.044050 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:38.044914 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 03 14:33:38.046328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.051552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e17e530f-18eb-4d18-addf-ab24d7d757d0 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.052722 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e17e530f-18eb-4d18-addf-ab24d7d757d0 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.292513 Oct 03 14:33:38.059691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 139/248] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 3 14:33:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 300 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:38.065041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.065662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:38.074603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:38.075089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:38.075808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:38.076511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:38.077060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:38.084589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:38.329341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:38.337534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9276dd92-b0c3-4f7c-a958-c6bec7d38a11 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.276431 Oct 03 14:33:38.338206 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 140/249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:38.343062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e66026b-0df8-48b6-94f2-39101b15e791 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.371631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:38.381844 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6011ddd2-d01c-4882-aec1-0c5f0abcb9ca tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1386 microversion: 2.1 time: 1.224829 Oct 03 14:33:38.382768 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 110/250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:37 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1386 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:38.412047 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e66026b-0df8-48b6-94f2-39101b15e791 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.072502 Oct 03 14:33:38.412977 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 141/251] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:38 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:38.422240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06cc49b4-7165-474e-943b-5184a0dfd0e5 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Calling method '.version_select at 0x7fb2313f5ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.429522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-06cc49b4-7165-474e-943b-5184a0dfd0e5 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e5b9d8eba2bd4f53921318be11baac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be169802fc764f9ea497a752ada156c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06cc49b4-7165-474e-943b-5184a0dfd0e5 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Request method failure captured: Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLAd2nfHa9DZWuwBs9OJBDpLH3ckHTXJdIyixG6RpcSCMv8ilkIH6A_AidVU2YdzzUPkfotz7vrbr5ytr2bxJwk_hOGzXreOt6-PZIgR4V59XD_v990roOq4bkQxL5LwaFn48tSwG7O3pZlJaYLe2Q3tE4SOZgCN6LP8ZZepJ7_kP0 Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:38.434553 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be169802fc764f9ea497a752ada156c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be169802fc764f9ea497a752ada156c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e5b9d8eba2bd4f53921318be11baac9d Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:33:38.436106 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:38.436970 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 03 14:33:38.438906 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.441158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06cc49b4-7165-474e-943b-5184a0dfd0e5 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.441158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06cc49b4-7165-474e-943b-5184a0dfd0e5 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.019931 Oct 03 14:33:38.449890 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 142/252] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:38.452555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-4ee0cb0c-f4a3-4e7a-9774-f728eaa80d3b req-8aee85ce-f70a-4bee-97b2-a9a320c837e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc3a975-8b74-4921-9106-0160c9bcc3bf", "name": "network-vif-plugged", "status": "completed", "tag": "3114f95d-0543-4f63-a146-ecadff0a8ba9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:38.468137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4ee0cb0c-f4a3-4e7a-9774-f728eaa80d3b req-8aee85ce-f70a-4bee-97b2-a9a320c837e5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:38.468603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4ee0cb0c-f4a3-4e7a-9774-f728eaa80d3b req-8aee85ce-f70a-4bee-97b2-a9a320c837e5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:38.469050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4ee0cb0c-f4a3-4e7a-9774-f728eaa80d3b req-8aee85ce-f70a-4bee-97b2-a9a320c837e5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:38.482016 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4ee0cb0c-f4a3-4e7a-9774-f728eaa80d3b req-8aee85ce-f70a-4bee-97b2-a9a320c837e5 service nova] Creating event network-vif-plugged:3114f95d-0543-4f63-a146-ecadff0a8ba9 for instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf on n-h1-781139-2 Oct 03 14:33:38.485510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37cc453c-cc5c-4294-b7a3-457cd703f8e0 tempest-FloatingIPDetailsNegativeTestJSON-1979067378 tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project] Calling method '.version_select at 0x7fb231307dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.490762 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-4ee0cb0c-f4a3-4e7a-9774-f728eaa80d3b req-8aee85ce-f70a-4bee-97b2-a9a320c837e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042842 Oct 03 14:33:38.491535 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 143/253] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:38.502280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8662e963-9c56-4263-9f88-5ac42abe0d05 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2136822540"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:38.505881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-8662e963-9c56-4263-9f88-5ac42abe0d05 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 5ec67592-ef53-4fc0-8e85-56326f9e8936 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:38.533537 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8662e963-9c56-4263-9f88-5ac42abe0d05 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039091 Oct 03 14:33:38.535135 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 144/254] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:38.542275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03672c8f-a21e-49f9-af40-09fc44d3d416 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-369399551"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:38.549127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-03672c8f-a21e-49f9-af40-09fc44d3d416 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid 9742181f-1016-4f79-9902-5711194d6cfe for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:38.577532 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03672c8f-a21e-49f9-af40-09fc44d3d416 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040454 Oct 03 14:33:38.579835 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 145/255] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:38.584900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e8ff8ec-7450-44c9-96ef-d9069e84d5f9 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Calling method '.version_select at 0x7fb2317833a0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.591697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6e8ff8ec-7450-44c9-96ef-d9069e84d5f9 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e5b9d8eba2bd4f53921318be11baac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be169802fc764f9ea497a752ada156c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e8ff8ec-7450-44c9-96ef-d9069e84d5f9 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Request method failure captured: Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLAd2nfHa9DZWuwBs9OJBDpLH3ckHTXJdIyixG6RpcSCMv8ilkIH6A_AidVU2YdzzUPkfotz7vrbr5ytr2bxJwk_hOGzXreOt6-PZIgR4V59XD_v990roOq4bkQxL5LwaFn48tSwG7O3pZlJaYLe2Q3tE4SOZgCN6LP8ZZepJ7_kP0 Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:38.592308 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be169802fc764f9ea497a752ada156c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be169802fc764f9ea497a752ada156c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e5b9d8eba2bd4f53921318be11baac9d Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:33:38.593537 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:38.594247 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 03 14:33:38.595453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.596446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e8ff8ec-7450-44c9-96ef-d9069e84d5f9 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.596446 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6e8ff8ec-7450-44c9-96ef-d9069e84d5f9 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.014172 Oct 03 14:33:38.596446 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 146/256] 10.222.0.20 () {58 vars in 1179 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:38.601746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f95b1cc-95ae-45da-8bae-86f24ce6a9b6 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.603103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-37cc453c-cc5c-4294-b7a3-457cd703f8e0 tempest-FloatingIPDetailsNegativeTestJSON-1979067378 tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 63977abf-aa61-4a4d-a22c-7840f008bbca could not be found", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:33:38.604148 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-37cc453c-cc5c-4294-b7a3-457cd703f8e0 tempest-FloatingIPDetailsNegativeTestJSON-1979067378 tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project] HTTP exception thrown: Floating IP not found for ID 63977abf-aa61-4a4d-a22c-7840f008bbca Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37cc453c-cc5c-4294-b7a3-457cd703f8e0 tempest-FloatingIPDetailsNegativeTestJSON-1979067378 tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project] Request method failure captured: Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-floating-ips/63977abf-aa61-4a4d-a22c-7840f008bbca HTTP/1.1 Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLB7pNEY-5wjpu5mowO879WCD04Wt4wjmCXr4KjfnhecMuozv-ZNJrCmAK20CtkauM-KDpczTCH5WHDxXmArP1EnI-Xm-IuptbkIBFIckSYlppCpOUuD0dv_TjOrUONf3-vJsYq_y-a-Ei6YDEtBgvwUiwvSne9G404g9qXNQ488sI Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: bb6e8bc39353449d8e36eed54f674e02 Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1979067378 Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:38.621400 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb6e8bc39353449d8e36eed54f674e02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb6e8bc39353449d8e36eed54f674e02", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb6e8bc39353449d8e36eed54f674e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb6e8bc39353449d8e36eed54f674e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1979067378 Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: bb6e8bc39353449d8e36eed54f674e02 Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1979067378 Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d7dcb93a85034a3c885824752f96ed15 Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: exception: Floating IP not found for ID 63977abf-aa61-4a4d-a22c-7840f008bbca Oct 03 14:33:38.622794 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '63977abf-aa61-4a4d-a22c-7840f008bbca'} Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:33:38.623470 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 63977abf-aa61-4a4d-a22c-7840f008bbca could not be found Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-37f97a5d-2479-4337-bfa6-c06b79d4df82'] Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 63977abf-aa61-4a4d-a22c-7840f008bbca. Oct 03 14:33:38.624488 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 63977abf-aa61-4a4d-a22c-7840f008bbca Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.626205 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:38.627402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:38.627402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 63977abf-aa61-4a4d-a22c-7840f008bbca Oct 03 14:33:38.627402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.627402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37cc453c-cc5c-4294-b7a3-457cd703f8e0 tempest-FloatingIPDetailsNegativeTestJSON-1979067378 tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project] Returning 404 to user: Floating IP not found for ID 63977abf-aa61-4a4d-a22c-7840f008bbca {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.628157 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37cc453c-cc5c-4294-b7a3-457cd703f8e0 tempest-FloatingIPDetailsNegativeTestJSON-1979067378 tempest-FloatingIPDetailsNegativeTestJSON-1979067378-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/63977abf-aa61-4a4d-a22c-7840f008bbca" status: 404 len: 111 microversion: 2.1 time: 0.243898 Oct 03 14:33:38.635674 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 111/257] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/os-floating-ips/63977abf-aa61-4a4d-a22c-7840f008bbca => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:38.650430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14c62ebc-0158-49ca-88a3-1406e5e438a2 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:38.653168 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f95b1cc-95ae-45da-8bae-86f24ce6a9b6 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.052037 Oct 03 14:33:38.654037 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 147/258] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:38 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:38.674317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c62ebc-0158-49ca-88a3-1406e5e438a2 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:38.674811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c62ebc-0158-49ca-88a3-1406e5e438a2 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:38.675241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c62ebc-0158-49ca-88a3-1406e5e438a2 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:38.828114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Calling method '.version_select at 0x7fb231442940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.832843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:38.833362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:38.833797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:38.886058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:38.886547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:38.890126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:38.906431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:38.907205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:38.907792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:38.916719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14c62ebc-0158-49ca-88a3-1406e5e438a2 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.279649 Oct 03 14:33:38.918306 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 112/259] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 14:33:38 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:38.924445 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f117682-0d5e-4b02-aa54-da195c8c4df9 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.259866 Oct 03 14:33:38.927218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cc2d7bd-c2a7-4c5f-97b0-b9ab1eb1c46b tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.931489 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 148/260] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:38.937789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ebd1541-8845-4f23-9b2a-4b99a9a6c237 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:38.941676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ebd1541-8845-4f23-9b2a-4b99a9a6c237 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '20fe3126d2b04acf996a59f8549b2001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f7911cf51cb4a40a91b512e0de33cb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ebd1541-8845-4f23-9b2a-4b99a9a6c237 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Request method failure captured: Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 42 Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKKsZcqGIQ7HNow3stJFy1TBWcw6cdl_g6rE3XY1n2KC-qy58UtdYGZ6JSFjNpcaCGtF0g8e2hmUj2NRwrieEPe4c7FS0uUjQYAVwFbiRKOWVTJxmLh70Zy9G7weTY2wuPHHeo2BdomQ6fQZr766FMiKbo9kzgo_wN5kKGCe_6vu2c Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:38.943801 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6f7911cf51cb4a40a91b512e0de33cb9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6f7911cf51cb4a40a91b512e0de33cb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6f7911cf51cb4a40a91b512e0de33cb9 Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-928806229 Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 20fe3126d2b04acf996a59f8549b2001 Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-928806229-project Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: {"remove_host": {"host": "n-h2-781139-2"}} Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:33:38.945306 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-781139-2'}}} Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:38.946194 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 03 14:33:38.947382 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.949029 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6cc2d7bd-c2a7-4c5f-97b0-b9ab1eb1c46b tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 03 14:33:38.949697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ebd1541-8845-4f23-9b2a-4b99a9a6c237 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.950908 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ebd1541-8845-4f23-9b2a-4b99a9a6c237 tempest-AggregatesAdminNegativeTestJSON-928806229 tempest-AggregatesAdminNegativeTestJSON-928806229-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.017479 Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cc2d7bd-c2a7-4c5f-97b0-b9ab1eb1c46b tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Request method failure captured: Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKNRKPvLyLIpfX1a1mXY6XNetkSg2ioOnUQWDu_k_3J3KJ9tG6ug5qDugKGIYwKTz9zwW0kMuFJxyisNlqVTWeo4yA26uGdAp6QwZf859SMN8dzDrYgBkyBpuypMa8HO5dS2HORFvXaNzbKN4fG-sbZ_Yk6B_eKbqBqvQlwOy6LwAM Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:33:38.952855 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/353a472313694467be08497cfbcc4392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_353a472313694467be08497cfbcc4392", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb85184e45ec498b89c30941cf5420d9 Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: exception: Aggregate 11 could not be found. Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '11'} Oct 03 14:33:38.954322 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.955580 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 03 14:33:38.956958 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.958166 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 149/261] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 14:33:38 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:38.959372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cc2d7bd-c2a7-4c5f-97b0-b9ab1eb1c46b tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.960024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b72f48c-a704-412a-9303-c42e3ac31aa3 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Calling method '.version_select at 0x7fb231391e50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.961929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b72f48c-a704-412a-9303-c42e3ac31aa3 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e5b9d8eba2bd4f53921318be11baac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be169802fc764f9ea497a752ada156c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:38.963220 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cc2d7bd-c2a7-4c5f-97b0-b9ab1eb1c46b tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.041957 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b72f48c-a704-412a-9303-c42e3ac31aa3 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Request method failure captured: Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLAd2nfHa9DZWuwBs9OJBDpLH3ckHTXJdIyixG6RpcSCMv8ilkIH6A_AidVU2YdzzUPkfotz7vrbr5ytr2bxJwk_hOGzXreOt6-PZIgR4V59XD_v990roOq4bkQxL5LwaFn48tSwG7O3pZlJaYLe2Q3tE4SOZgCN6LP8ZZepJ7_kP0 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:38.963709 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be169802fc764f9ea497a752ada156c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be169802fc764f9ea497a752ada156c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e5b9d8eba2bd4f53921318be11baac9d Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1'} Oct 03 14:33:38.964877 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:38.965601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 03 14:33:38.966678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.967694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b72f48c-a704-412a-9303-c42e3ac31aa3 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.967694 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b72f48c-a704-412a-9303-c42e3ac31aa3 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.008857 Oct 03 14:33:38.969939 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 113/263] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:33:38.974336 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 150/263] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:38.980207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6077ef64-6f97-4897-b35c-bbddc6fa5d80 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Calling method '.version_select at 0x7fb2314854c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:38.981821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6077ef64-6f97-4897-b35c-bbddc6fa5d80 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] HTTP exception thrown: Hypervisor with ID '16300b56-8917-4c82-8df7-5dd39dd8a53d' could not be found. Oct 03 14:33:38.985373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae0da663-2431-40a2-a1c6-cec1e193e207 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6077ef64-6f97-4897-b35c-bbddc6fa5d80 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Request method failure captured: Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors/16300b56-8917-4c82-8df7-5dd39dd8a53d/uptime HTTP/1.1 Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLBIEiP1ahmoSov4J7FbWz03OSvoBy6u4dJXSVFMWxXWyHBXlWqtYvztLcBVToYwYtXTc4U_HxPuStsyJ4YQ2VTSkkeefurMibCha2IBFb29Os_aOloWPIK7GF3Uxgb0KkityRhBXKJWJcOtYzuEDXs6_idweXPdk8WbASyJ4LvtA0 Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 06deec1691ae4d1b8e1277fd09248d57 Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1314161918 Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:33:38.992165 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06deec1691ae4d1b8e1277fd09248d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06deec1691ae4d1b8e1277fd09248d57", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06deec1691ae4d1b8e1277fd09248d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06deec1691ae4d1b8e1277fd09248d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1314161918 Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 06deec1691ae4d1b8e1277fd09248d57 Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1314161918 Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 55474082f2344499b871eb1338785a47 Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: exception: Hypervisor with ID '16300b56-8917-4c82-8df7-5dd39dd8a53d' could not be found. Oct 03 14:33:38.993742 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '16300b56-8917-4c82-8df7-5dd39dd8a53d'} Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '16300b56-8917-4c82-8df7-5dd39dd8a53d' Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 03 14:33:38.994629 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '16300b56-8917-4c82-8df7-5dd39dd8a53d' could not be found. Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:38.996223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '16300b56-8917-4c82-8df7-5dd39dd8a53d' could not be found. Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6077ef64-6f97-4897-b35c-bbddc6fa5d80 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Returning 404 to user: Hypervisor with ID '16300b56-8917-4c82-8df7-5dd39dd8a53d' could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6077ef64-6f97-4897-b35c-bbddc6fa5d80 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/16300b56-8917-4c82-8df7-5dd39dd8a53d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.018754 Oct 03 14:33:38.997723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 151/264] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 3 14:33:38 2022] GET /compute/v2.1/os-hypervisors/16300b56-8917-4c82-8df7-5dd39dd8a53d/uptime => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:39.006583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-106d0dc8-761b-4608-bc49-64663cd2c862 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.030010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-106d0dc8-761b-4608-bc49-64663cd2c862 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-106d0dc8-761b-4608-bc49-64663cd2c862 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Request method failure captured: Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKNRKPvLyLIpfX1a1mXY6XNetkSg2ioOnUQWDu_k_3J3KJ9tG6ug5qDugKGIYwKTz9zwW0kMuFJxyisNlqVTWeo4yA26uGdAp6QwZf859SMN8dzDrYgBkyBpuypMa8HO5dS2HORFvXaNzbKN4fG-sbZ_Yk6B_eKbqBqvQlwOy6LwAM Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:33:39.035775 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/353a472313694467be08497cfbcc4392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_353a472313694467be08497cfbcc4392", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: cb85184e45ec498b89c30941cf5420d9 Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: exception: Aggregate 11 could not be found. Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '11'} Oct 03 14:33:39.037257 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:33:39.038120 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.039491 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.040801 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.040801 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:39.040801 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:39.040801 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 03 14:33:39.040801 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.040801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-106d0dc8-761b-4608-bc49-64663cd2c862 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:39.040801 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-106d0dc8-761b-4608-bc49-64663cd2c862 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.037564 Oct 03 14:33:39.046428 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 152/265] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:38 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:33:39.053482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae0da663-2431-40a2-a1c6-cec1e193e207 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.054128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Calling method '.version_select at 0x7fb231370b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.056355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae0da663-2431-40a2-a1c6-cec1e193e207 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.056819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae0da663-2431-40a2-a1c6-cec1e193e207 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.062792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.063241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.063912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.097199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.099397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.099860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.121339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.122134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.122723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.132302 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b827ec0a-c2cb-465d-b484-01f6335c159b tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.084785 Oct 03 14:33:39.139770 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 153/266] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:33:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:39.145844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ee642d40-d843-4e7d-addf-5fa196282370 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1313528947", "name": "tempest-test_aggregate-1785939882"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:39.151979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-ee642d40-d843-4e7d-addf-5fa196282370 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 9fcde290-c9e5-4143-806a-7afa40e09672 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:39.200373 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ee642d40-d843-4e7d-addf-5fa196282370 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.058982 Oct 03 14:33:39.208182 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 154/267] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 3 14:33:39 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:39.214678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aef18099-731a-41a5-b92c-7789704835c7 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Calling method '.version_select at 0x7fb2314429d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.217351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aef18099-731a-41a5-b92c-7789704835c7 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e5b9d8eba2bd4f53921318be11baac9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be169802fc764f9ea497a752ada156c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aef18099-731a-41a5-b92c-7789704835c7 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Request method failure captured: Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLAd2nfHa9DZWuwBs9OJBDpLH3ckHTXJdIyixG6RpcSCMv8ilkIH6A_AidVU2YdzzUPkfotz7vrbr5ytr2bxJwk_hOGzXreOt6-PZIgR4V59XD_v990roOq4bkQxL5LwaFn48tSwG7O3pZlJaYLe2Q3tE4SOZgCN6LP8ZZepJ7_kP0 Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:39.227920 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be169802fc764f9ea497a752ada156c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be169802fc764f9ea497a752ada156c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be169802fc764f9ea497a752ada156c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be169802fc764f9ea497a752ada156c2 Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572 Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e5b9d8eba2bd4f53921318be11baac9d Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1420829572-project Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1'} Oct 03 14:33:39.229475 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:39.230338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 03 14:33:39.231596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.237302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aef18099-731a-41a5-b92c-7789704835c7 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:39.239935 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aef18099-731a-41a5-b92c-7789704835c7 tempest-HypervisorAdminNegativeTestJSON-1420829572 tempest-HypervisorAdminNegativeTestJSON-1420829572-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.029952 Oct 03 14:33:39.247712 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 155/268] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:39.258618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3bd8125a-39cc-48b7-be16-3b13518136df tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.292319 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3bd8125a-39cc-48b7-be16-3b13518136df tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.036857 Oct 03 14:33:39.293627 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 156/269] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:39 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:39.316943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91684e78-a357-4561-ac9b-3c1ca8326990 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Calling method '.version_select at 0x7fb231783160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.320421 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-91684e78-a357-4561-ac9b-3c1ca8326990 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] HTTP exception thrown: Hypervisor with ID '01910eec-ecf0-4bed-bee5-7ebe83fc0780' could not be found. Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91684e78-a357-4561-ac9b-3c1ca8326990 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Request method failure captured: Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-hypervisors/01910eec-ecf0-4bed-bee5-7ebe83fc0780 HTTP/1.1 Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLBIEiP1ahmoSov4J7FbWz03OSvoBy6u4dJXSVFMWxXWyHBXlWqtYvztLcBVToYwYtXTc4U_HxPuStsyJ4YQ2VTSkkeefurMibCha2IBFb29Os_aOloWPIK7GF3Uxgb0KkityRhBXKJWJcOtYzuEDXs6_idweXPdk8WbASyJ4LvtA0 Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 06deec1691ae4d1b8e1277fd09248d57 Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1314161918 Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:33:39.324617 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06deec1691ae4d1b8e1277fd09248d57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06deec1691ae4d1b8e1277fd09248d57", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06deec1691ae4d1b8e1277fd09248d57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06deec1691ae4d1b8e1277fd09248d57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1314161918 Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 06deec1691ae4d1b8e1277fd09248d57 Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1314161918 Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 55474082f2344499b871eb1338785a47 Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: exception: Hypervisor with ID '01910eec-ecf0-4bed-bee5-7ebe83fc0780' could not be found. Oct 03 14:33:39.325848 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '01910eec-ecf0-4bed-bee5-7ebe83fc0780'} Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '01910eec-ecf0-4bed-bee5-7ebe83fc0780' Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 03 14:33:39.326486 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:33:39.327667 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '01910eec-ecf0-4bed-bee5-7ebe83fc0780' could not be found. Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '01910eec-ecf0-4bed-bee5-7ebe83fc0780' could not be found. Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91684e78-a357-4561-ac9b-3c1ca8326990 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] Returning 404 to user: Hypervisor with ID '01910eec-ecf0-4bed-bee5-7ebe83fc0780' could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:39.328944 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-91684e78-a357-4561-ac9b-3c1ca8326990 tempest-HypervisorAdminNegativeTestJSON-1314161918 tempest-HypervisorAdminNegativeTestJSON-1314161918-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/01910eec-ecf0-4bed-bee5-7ebe83fc0780" status: 404 len: 123 microversion: 2.1 time: 0.027934 Oct 03 14:33:39.336857 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 157/270] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 14:33:39 2022] GET /compute/v2.1/os-hypervisors/01910eec-ecf0-4bed-bee5-7ebe83fc0780 => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:39.342351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09be23cf-423b-4980-91f0-c261e6160a88 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.351697 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-09be23cf-423b-4980-91f0-c261e6160a88 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09be23cf-423b-4980-91f0-c261e6160a88 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Request method failure captured: Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKNRKPvLyLIpfX1a1mXY6XNetkSg2ioOnUQWDu_k_3J3KJ9tG6ug5qDugKGIYwKTz9zwW0kMuFJxyisNlqVTWeo4yA26uGdAp6QwZf859SMN8dzDrYgBkyBpuypMa8HO5dS2HORFvXaNzbKN4fG-sbZ_Yk6B_eKbqBqvQlwOy6LwAM Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:33:39.353268 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/353a472313694467be08497cfbcc4392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_353a472313694467be08497cfbcc4392", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: cb85184e45ec498b89c30941cf5420d9 Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: exception: Aggregate 13 could not be found. Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '13'} Oct 03 14:33:39.355118 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.356804 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 03 14:33:39.358506 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.359502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09be23cf-423b-4980-91f0-c261e6160a88 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:39.359502 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-09be23cf-423b-4980-91f0-c261e6160a88 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.016851 Oct 03 14:33:39.359502 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 158/271] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:39 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:33:39.363389 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae0da663-2431-40a2-a1c6-cec1e193e207 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.390687 Oct 03 14:33:39.365401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.366693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:39.368236 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 114/272] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 14:33:38 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:39.380050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.380540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.381153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.382234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.383156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.383949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.385063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f78c17f7-de66-42b0-8c20-43d9a24a76da tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.430921 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f78c17f7-de66-42b0-8c20-43d9a24a76da tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f78c17f7-de66-42b0-8c20-43d9a24a76da tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Request method failure captured: Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKNRKPvLyLIpfX1a1mXY6XNetkSg2ioOnUQWDu_k_3J3KJ9tG6ug5qDugKGIYwKTz9zwW0kMuFJxyisNlqVTWeo4yA26uGdAp6QwZf859SMN8dzDrYgBkyBpuypMa8HO5dS2HORFvXaNzbKN4fG-sbZ_Yk6B_eKbqBqvQlwOy6LwAM Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:33:39.436811 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/353a472313694467be08497cfbcc4392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_353a472313694467be08497cfbcc4392", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/353a472313694467be08497cfbcc4392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 353a472313694467be08497cfbcc4392 Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1346865243 Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb85184e45ec498b89c30941cf5420d9 Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-1346865243-project-admin Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: exception: Aggregate 13 could not be found. Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '13'} Oct 03 14:33:39.438210 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:33:39.439150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:39.440285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:39.441861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:39.441861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:39.441861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:39.441861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 03 14:33:39.441861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:39.441861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f78c17f7-de66-42b0-8c20-43d9a24a76da tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:39.441861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f78c17f7-de66-42b0-8c20-43d9a24a76da tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.066183 Oct 03 14:33:39.450957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 115/273] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:39 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:33:39.463131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12456976-29eb-42d7-a77f-eae3f2e99933 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.521846 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12456976-29eb-42d7-a77f-eae3f2e99933 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.069584 Oct 03 14:33:39.523059 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 116/274] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:39 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:39.533067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:39.534533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:39.542893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.544075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.544828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.545724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:39.546791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:39.547360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:39.802035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:39.815809 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3f19be2-3964-4811-b3e0-cce172b99577 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.452431 Oct 03 14:33:39.817006 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 159/275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:39 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:39.836369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4faf782d-a21e-448c-8295-cf6d19915c25 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1782614486"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:39.840320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.aggregate [None req-4faf782d-a21e-448c-8295-cf6d19915c25 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 361d8351-457e-46e6-88a2-93ab5d5f3ff1 for aggregate {{(pid=128868) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:39.879748 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4faf782d-a21e-448c-8295-cf6d19915c25 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061644 Oct 03 14:33:39.881638 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 160/276] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:40.065410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:40.078725 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aec6f984-ef7c-4c8d-94a6-a4f726edfe5b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1386 microversion: 2.1 time: 0.554424 Oct 03 14:33:40.081642 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 117/277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:39 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1386 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:40.091186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74dc6b52-0ec1-4453-9397-796e34a933a6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-386934918"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:40.100388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-74dc6b52-0ec1-4453-9397-796e34a933a6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Generated uuid c38c8de5-e540-48f1-ab58-074db463f5be for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:40.207095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74dc6b52-0ec1-4453-9397-796e34a933a6 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.122610 Oct 03 14:33:40.213792 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 118/278] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:40.249891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e503066-bbb3-47ed-8722-0bef7e38deb4 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:40.255393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1398763922", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "3bec1a14-e895-4900-8f12-af133bd5e217"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:40.298243 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e503066-bbb3-47ed-8722-0bef7e38deb4 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.065200 Oct 03 14:33:40.298818 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 119/279] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:40 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:40.329944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:40.356626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] validate_networks() for [('3bec1a14-e895-4900-8f12-af133bd5e217', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:40.361771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:40.363571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:40.365501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:40.386084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:40.389524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:40.391138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:40.400902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.compute.aggregates [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 03 14:33:40.401445 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Request method failure captured: Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 42 Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKMH05rw6U67lEz9x-VXxB-11l5PDtTOn7s_FSwsFS6EJIJdmg-FVZlTzxBBqtHvRo6x2TN2iM772BNVI6t-ytr0pmcMERAhvf6gz5CFJRXnjSyKYsqXNPcsAlQoOiA-ucnXiArSduryTa_uHsNdt6bFjsoQom6GBB5P-yTfOgWaCk Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:33:40.404500 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3db1dc00a53a494d89e6d75e5e5fc4cc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3db1dc00a53a494d89e6d75e5e5fc4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3db1dc00a53a494d89e6d75e5e5fc4cc Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-343660793 Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 89ef0a7b25054cda8a3a300d42fa5aed Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: {"remove_host": {"host": "nonexist_host"}} Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:40.406031 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 03 14:33:40.410201 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 03 14:33:40.411566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.412872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79dc872b-8889-4d63-b153-2dd74e5f13ca tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.091195 Oct 03 14:33:40.414333 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 120/280] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 14:33:40 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:33:40.414963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e2777e0-5a17-4f3c-aa03-b98bedaf9ea8 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:40.465038 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e2777e0-5a17-4f3c-aa03-b98bedaf9ea8 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.046687 Oct 03 14:33:40.472120 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 121/281] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 14:33:40 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:40.472120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-860d631a-f18c-4de2-a961-8af2f1f1d202 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:40.507229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=86,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:40.541889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-860d631a-f18c-4de2-a961-8af2f1f1d202 tempest-AggregatesAdminNegativeTestJSON-343660793 tempest-AggregatesAdminNegativeTestJSON-343660793-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.065085 Oct 03 14:33:40.541889 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 122/282] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:40 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:40.541889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aad4bdb7-f051-49e6-a2b7-f8f38cd9c5b1 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:40.559000 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aad4bdb7-f051-49e6-a2b7-f8f38cd9c5b1 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.024435 Oct 03 14:33:40.559519 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 123/283] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:33:40 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:40.571892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fe93622-871c-4e97-88d7-cf05973c3957 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:40.628562 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fe93622-871c-4e97-88d7-cf05973c3957 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.061073 Oct 03 14:33:40.633487 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 124/284] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:40 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 03 14:33:40.638816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d5ecbec-d104-4abb-b803-0449d314c0e1 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1849436465", "availability_zone": "tempest-test_az-1400483564"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:40.683642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-3d5ecbec-d104-4abb-b803-0449d314c0e1 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid e9ab7a9b-8b68-41ee-8b63-9b5a050a7531 for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:40.739339 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d5ecbec-d104-4abb-b803-0449d314c0e1 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.104072 Oct 03 14:33:40.739958 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 125/285] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 3 14:33:40 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:40.752073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccf4d8b7-f050-4eb7-bf15-ab678799a4e2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1849436465_new", "availability_zone": "tempest-test_az-1400483564_new"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:40.961771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4d8b7-f050-4eb7-bf15-ab678799a4e2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:40.962245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4d8b7-f050-4eb7-bf15-ab678799a4e2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:40.962680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4d8b7-f050-4eb7-bf15-ab678799a4e2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:41.037443 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccf4d8b7-f050-4eb7-bf15-ab678799a4e2 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.289136 Oct 03 14:33:41.044333 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 126/286] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 3 14:33:40 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:41.068207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:41.071156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:41.081133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:41.081633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:41.082072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:41.084876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:41.085377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:41.085815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:41.543939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:41.554348 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b9e6148-fc22-49aa-af1f-97de0fedf850 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.507761 Oct 03 14:33:41.556337 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 127/287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:41 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:41.562684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-880a896c-de17-4ab0-a178-4f0b6e787e51 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:41.590361 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-880a896c-de17-4ab0-a178-4f0b6e787e51 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.032177 Oct 03 14:33:41.593247 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 128/288] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:33:41 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:41.608917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:41.616218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:41.646855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:41.647652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:41.650780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:41.653435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:41.654111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:41.657167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.003880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:42.012438 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcbe686e-755c-4663-a755-646ee050e071 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1386 microversion: 2.1 time: 0.417343 Oct 03 14:33:42.017230 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 129/289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:41 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1386 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:42.029140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a2b9479-96a1-4b2a-ad59-70cd7454eb6e tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:42.065659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:42.066232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:42.066567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:42.067145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:42.067713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:42.075219 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a2b9479-96a1-4b2a-ad59-70cd7454eb6e tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.056609 Oct 03 14:33:42.075874 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 130/290] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:42 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:42.085777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e6f4ac1-54da-4090-bf83-424f5ff3036d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1219721676"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:42.088091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.089573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.091965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.092987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.095714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.096336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.097370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-7e6f4ac1-54da-4090-bf83-424f5ff3036d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Generated uuid 3f030831-a4d1-4e63-ad4d-cf7af96540de for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:42.144288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:42.154414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for user 19b2b042d70a426989bb5dc6b986b7c5 and project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:42.173540 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e6f4ac1-54da-4090-bf83-424f5ff3036d tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.090646 Oct 03 14:33:42.174394 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 131/291] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 14:33:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:42.188120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6c1a5ca-3d61-4fd2-b45e-779e7f9086d6 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:42.191140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:33:42.194839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:33:42.221145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6c1a5ca-3d61-4fd2-b45e-779e7f9086d6 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.039351 Oct 03 14:33:42.222431 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 132/292] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:33:42 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:42.234555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2572cff-9ec0-4000-adb5-e2dd23497873 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:42.278193 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2572cff-9ec0-4000-adb5-e2dd23497873 tempest-AggregatesAdminTestJSON-1346865243 tempest-AggregatesAdminTestJSON-1346865243-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.047449 Oct 03 14:33:42.279398 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 133/293] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:42 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:33:42.288349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:42.290153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:42.295093 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c328d8a3-ae80-4707-8550-229a58bddb36 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.412005 Oct 03 14:33:42.298165 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 161/294] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2416 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:33:42.298907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.299633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.300298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.301246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.301908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.302535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.313948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5eeda7ba-4406-45df-9f89-81ffc2eb34ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:42.317767 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] HTTP exception thrown: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Request method failure captured: Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf HTTP/1.1 Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKK2BfgOFGd46tPH5pjYQgVMhiED_QJeUlBlAXPzwTdRrr3bf7V38VSozK_tz_E5Lhhw-7O9lzefwCguJl76ojXWnQV7hiyzL0ZkEvtAi-T0yK2yQX_fTq8yInd2Yrj--oVTmCGWviWgocvqbo3knfv7oDT50XQhlIiJWY6SZjjM7M Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6fe6d46ecdb948d78e85c409354a9ee5 Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:42.320037 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fe6d46ecdb948d78e85c409354a9ee5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6fe6d46ecdb948d78e85c409354a9ee5 Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-1654502565-project Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5f0e43f6723a4b2abc02450dae9e580f Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-1654502565-project Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.321541 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1706f473-6565-47c7-8715-b19cfb200faf'} Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:42.322421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.323508 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.325951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5eeda7ba-4406-45df-9f89-81ffc2eb34ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:42.326844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Returning 404 to user: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:42.330267 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a05fccc4-c33d-4c49-8aa5-06e4c254f31a tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 404 len: 111 microversion: 2.1 time: 0.046406 Oct 03 14:33:42.332969 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 134/295] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:33:42 2022] DELETE /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:33:42.346597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:42.347442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] [instance: 1706f473-6565-47c7-8715-b19cfb200faf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:42.377335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.380384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.382426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.383511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.389690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.402851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.442757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] HTTP exception thrown: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Request method failure captured: Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf HTTP/1.1 Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKK2BfgOFGd46tPH5pjYQgVMhiED_QJeUlBlAXPzwTdRrr3bf7V38VSozK_tz_E5Lhhw-7O9lzefwCguJl76ojXWnQV7hiyzL0ZkEvtAi-T0yK2yQX_fTq8yInd2Yrj--oVTmCGWviWgocvqbo3knfv7oDT50XQhlIiJWY6SZjjM7M Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6fe6d46ecdb948d78e85c409354a9ee5 Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:33:42.452575 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fe6d46ecdb948d78e85c409354a9ee5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fe6d46ecdb948d78e85c409354a9ee5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6fe6d46ecdb948d78e85c409354a9ee5 Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1654502565 Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AggregatesAdminTestJSON-1654502565-project Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5f0e43f6723a4b2abc02450dae9e580f Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AggregatesAdminTestJSON-1654502565-project Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.453906 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1706f473-6565-47c7-8715-b19cfb200faf'} Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:42.454597 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. Oct 03 14:33:42.456405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:33:42.458543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] Returning 404 to user: Instance 1706f473-6565-47c7-8715-b19cfb200faf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:42.458543 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05fdac29-028c-4804-9a73-705b73feb8f0 tempest-AggregatesAdminTestJSON-1654502565 tempest-AggregatesAdminTestJSON-1654502565-project] 10.222.0.20 "GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf" status: 404 len: 111 microversion: 2.1 time: 0.118793 Oct 03 14:33:42.458543 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 135/296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:42 2022] GET /compute/v2.1/servers/1706f473-6565-47c7-8715-b19cfb200faf => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:33:42.536640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5eeda7ba-4406-45df-9f89-81ffc2eb34ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:42.551884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5eeda7ba-4406-45df-9f89-81ffc2eb34ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:42.553387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5eeda7ba-4406-45df-9f89-81ffc2eb34ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:42.554596 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5eeda7ba-4406-45df-9f89-81ffc2eb34ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1262 microversion: 2.25 time: 0.247843 Oct 03 14:33:42.561631 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 162/297] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:42 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1262 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:42.579703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:42.581820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:42.611607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.613093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.616304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:42.622843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:42.624117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:42.636582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:43.040378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:43.041323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:43.053644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:43.054218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:43.054750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:43.055521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:43.056036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:43.057089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:43.111537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:43.120403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:43.128233 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2d6c467-46b6-4ebb-9205-b3524b22963a tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.551263 Oct 03 14:33:43.148064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 136/298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:42 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:43.521471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:43.534492 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bf4aeada-e968-4db5-be00-ff0935a3cc1f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1386 microversion: 2.1 time: 0.494968 Oct 03 14:33:43.535238 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 163/299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:43 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1386 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:43.585945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:43.598809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:43.628062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:43.628949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:43.629553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:43.630548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:43.631278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:43.631870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:43.935643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:43.948242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:43.957482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:43.958997 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1663fc3-d619-44ee-8e72-ae95b34a4808 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1266 microversion: 2.25 time: 0.377947 Oct 03 14:33:43.963041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 137/300] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:43 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:44.147859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ac9ebecb-d745-4d9b-a5dd-ddeb50383d72 req-bab58cee-1f02-4d46-ac4d-b279f8ad4871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec214f-3bd5-4963-9bf7-28bb6b7403e5", "name": "network-vif-plugged", "status": "completed", "tag": "cb72ef60-69de-435d-a9e3-5f8d864fc731"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:44.154128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:44.156327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:44.179087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:44.183825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:44.185756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:44.186689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:44.200741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:44.201191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ac9ebecb-d745-4d9b-a5dd-ddeb50383d72 req-bab58cee-1f02-4d46-ac4d-b279f8ad4871 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:44.201960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ac9ebecb-d745-4d9b-a5dd-ddeb50383d72 req-bab58cee-1f02-4d46-ac4d-b279f8ad4871 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:44.204834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ac9ebecb-d745-4d9b-a5dd-ddeb50383d72 req-bab58cee-1f02-4d46-ac4d-b279f8ad4871 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:44.205173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:44.258333 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ac9ebecb-d745-4d9b-a5dd-ddeb50383d72 req-bab58cee-1f02-4d46-ac4d-b279f8ad4871 service nova] Creating event network-vif-plugged:cb72ef60-69de-435d-a9e3-5f8d864fc731 for instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 on n-h1-781139-2 Oct 03 14:33:44.278666 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ac9ebecb-d745-4d9b-a5dd-ddeb50383d72 req-bab58cee-1f02-4d46-ac4d-b279f8ad4871 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133087 Oct 03 14:33:44.279649 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 164/301] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:44.559005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:44.559710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:44.574956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:44.578184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:44.579759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:44.580695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:44.582287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:44.582877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:44.782976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:44.796968 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5741c7c-397e-4bbe-a113-162bf626f3ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 0.646675 Oct 03 14:33:44.814949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 138/302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:44 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:44.989817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:44.990436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:45.007053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:45.008135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:45.010590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:45.012759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:45.013452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:45.015379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:45.245776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:45.268042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:45.275473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:45.277714 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0799fc4-3a7b-44a4-849a-a6e217778a4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1320 microversion: 2.25 time: 0.291740 Oct 03 14:33:45.283238 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 139/303] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:44 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:45.505137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:45.521409 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-367d5a42-ae6a-41b0-95f1-1f3271e7fc57 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1386 microversion: 2.1 time: 0.964618 Oct 03 14:33:45.544188 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 165/304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:44 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1386 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:45.825768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:45.827297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:45.837377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:45.840802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:45.841809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:45.844824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:45.845917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:45.846577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:46.300519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-2c963335-8be5-4d7e-9e87-ac07638bae94 req-4c9e0088-e97e-41dc-8907-e321bbfaca06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512b8784-a0b5-45a8-95d9-85d2faaf4e5f", "name": "network-vif-plugged", "status": "completed", "tag": "3e232d83-b71c-4671-92c6-7ea1aeafc99f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:46.316265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=7 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:46.328209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2c963335-8be5-4d7e-9e87-ac07638bae94 req-4c9e0088-e97e-41dc-8907-e321bbfaca06 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:46.330054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2c963335-8be5-4d7e-9e87-ac07638bae94 req-4c9e0088-e97e-41dc-8907-e321bbfaca06 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:46.333354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2c963335-8be5-4d7e-9e87-ac07638bae94 req-4c9e0088-e97e-41dc-8907-e321bbfaca06 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:46.339953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:46.350760 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-2c963335-8be5-4d7e-9e87-ac07638bae94 req-4c9e0088-e97e-41dc-8907-e321bbfaca06 service nova] Creating event network-vif-plugged:3e232d83-b71c-4671-92c6-7ea1aeafc99f for instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f on n-h2-781139-2 Oct 03 14:33:46.359094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-2c963335-8be5-4d7e-9e87-ac07638bae94 req-4c9e0088-e97e-41dc-8907-e321bbfaca06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062662 Oct 03 14:33:46.360214 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 166/305] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:46.372065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:46.373250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:46.405311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:46.406707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:46.408191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:46.411061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:46.412349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:46.413795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:46.922379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:46.933676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:46.936379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:46.937535 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b35222f0-a6e9-46b3-99ba-c6fe7b9f77b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 0.570682 Oct 03 14:33:46.940849 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 167/306] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:46 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:46.952251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:46.953186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:46.967193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:46.968101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:46.968754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:46.969991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:46.970886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:46.971603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:47.082779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:47.104466 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b34c83e-e6d4-422d-9f6d-2cedc992714c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1314 microversion: 2.1 time: 1.286094 Oct 03 14:33:47.123216 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 140/307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:45 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1314 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:47.776270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:47.798973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-120ce6a5-15b6-43c1-a109-2b0ec84efd10 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1386 microversion: 2.1 time: 0.856297 Oct 03 14:33:47.799548 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 168/308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:46 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1386 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:47.979929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:47.981190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:47.998864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:47.999783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.000456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.002369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.003898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.005859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.035191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb231127af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.040074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.040638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.041687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.042398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.043041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.043809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.088087 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63f17ec7-6935-4da2-8704-f69ecdece4ce tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.273575 Oct 03 14:33:48.106980 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 141/309] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 3 14:33:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:48.132054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb231408310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.143747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.144698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.150421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.152635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.156817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.157562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.239283 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b638570f-3829-440f-9a12-08652947e59e tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.118176 Oct 03 14:33:48.241270 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 142/310] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:48.254861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.255488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:48.272910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.274209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.276837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.278547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.280161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.281711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.386881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:48.396218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:48.407205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:48.409835 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e44e0fb3-2382-49ae-98f8-1c79446aa9cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 0.441752 Oct 03 14:33:48.410964 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 169/311] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:47 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:33:48.425368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb231370940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.438840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.440381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.440913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.443210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.444226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.444586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.500360 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc60b9b0-e147-450d-80d3-b08fc96adfa7 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.088101 Oct 03 14:33:48.508893 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 170/312] 10.222.0.20 () {58 vars in 1145 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:33:48.514471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb231783160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.519709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.520396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.521019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.521919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.523075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.523736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.549636 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54cf0c24-2553-43ad-82d8-5c556011fa6f tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.039313 Oct 03 14:33:48.550506 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 171/313] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:48.562825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb231508ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.568597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.569353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.569984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.571686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.572383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.573132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.579458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:48.595055 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c14be670-fe1a-4c75-90a1-02b4be2590f6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1463 microversion: 2.1 time: 0.350387 Oct 03 14:33:48.597149 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 143/314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1463 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:48.607943 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ea11233-33b1-4946-8453-0999ab9c2d43 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.050168 Oct 03 14:33:48.609088 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 172/315] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:48.621272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb231056550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.626538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.626795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.627228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.627668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.628417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.628865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.632905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:48.642104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.642279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.646408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.646915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.649191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.650041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.650314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.760184 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6db36611-fd2d-4860-81f7-eac621c6c9ed tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.141673 Oct 03 14:33:48.766830 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 144/316] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:48.768007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9fb000d0-f71b-47cb-902f-80d4559a6366 req-491e2036-c95f-4387-b10c-a9b18b93f5dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a85eea-3a6c-4b79-b702-6faef8ab910b", "tag": "badac6a7-8c48-4385-8ede-5a1648db8792"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:48.795378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9fb000d0-f71b-47cb-902f-80d4559a6366 req-491e2036-c95f-4387-b10c-a9b18b93f5dc service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.795906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9fb000d0-f71b-47cb-902f-80d4559a6366 req-491e2036-c95f-4387-b10c-a9b18b93f5dc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.796479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9fb000d0-f71b-47cb-902f-80d4559a6366 req-491e2036-c95f-4387-b10c-a9b18b93f5dc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.809931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9fb000d0-f71b-47cb-902f-80d4559a6366 req-491e2036-c95f-4387-b10c-a9b18b93f5dc service nova] Creating event network-changed:badac6a7-8c48-4385-8ede-5a1648db8792 for instance b0a85eea-3a6c-4b79-b702-6faef8ab910b on n-h2-781139-2 Oct 03 14:33:48.816638 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9fb000d0-f71b-47cb-902f-80d4559a6366 req-491e2036-c95f-4387-b10c-a9b18b93f5dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053496 Oct 03 14:33:48.817766 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 145/317] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:48.824178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb2312c8310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.834804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.835698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.837137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.856084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.857464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.858085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.911945 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f556f78c-770d-4022-8275-8264fb079550 tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-781139-2" status: 200 len: 598 microversion: 2.1 time: 0.092692 Oct 03 14:33:48.913810 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 146/318] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/os-hosts/n-h2-781139-2 => generated 598 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:48.933085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:48.943897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:48.965916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.966697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.967302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:48.969254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:48.969992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:48.971233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:49.149627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:49.164755 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6324df6-410e-472f-a3b7-c3491de394eb tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1462 microversion: 2.1 time: 0.540169 Oct 03 14:33:49.165704 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 173/319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1462 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:49.180682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Calling method '.version_select at 0x7fb231442700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:49.191300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:49.191792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:49.192221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:49.229058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:49.229609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:49.230112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:49.267220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3917f6b2-aa8d-417c-9835-f8911744b2db tempest-HostsAdminTestJSON-1532702583 tempest-HostsAdminTestJSON-1532702583-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-781139-2" status: 200 len: 467 microversion: 2.1 time: 0.100048 Oct 03 14:33:49.267878 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 174/320] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 3 14:33:49 2022] GET /compute/v2.1/os-hosts/n-h1-781139-2 => generated 467 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:49.333776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2034980924", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5dc3a975-8b74-4921-9106-0160c9bcc3bf"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:49.435173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:33:49.568622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:49.578919 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea30274b-ccec-4857-a2e8-535c0b678d5a tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1584 microversion: 2.1 time: 0.663958 Oct 03 14:33:49.584559 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 147/321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:48 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1584 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:49.592282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:49.600610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:49.618113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:49.620662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:49.622311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:49.625910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:49.627902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:49.629425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.258271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:50.272752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:50.279250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:50.280435 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab12bfc9-b32c-435d-ae5c-051d47271d23 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 0.694725 Oct 03 14:33:50.281026 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 148/322] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:49 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:50.290488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:50.297646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:50.308972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:50.310929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:50.311364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.312472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:50.313143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:50.313721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.502730 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81a2ee8c-bc93-4f00-9ab4-fbbf1985e103 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216599 Oct 03 14:33:50.503774 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 149/323] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:33:50 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:50.879759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:33:50.881065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:33:50.881831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:33:50.882507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:33:50.883954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:33:50.893320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Calling method '.version_select at 0x7fb231408310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:50.900044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:50.900709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:50.901352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.914217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:50.916778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:50.919018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.921250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:50.922080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:50.922201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:50.922838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.923243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:50.925002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.951755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:50.952419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:50.953358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:50.964663 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3ad560e-ee84-416c-b34f-801d644f73f8 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.305457 Oct 03 14:33:50.966353 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 150/324] 10.222.0.20 () {60 vars in 1208 bytes} [Mon Oct 3 14:33:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:33:50.983015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Getting quotas for project 78dce6cc05804cc0b807cc6da75ec0aa. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:33:50.989826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Getting quotas for user b54fe4de8a9e4cc79a0e09c98d0d570e and project 78dce6cc05804cc0b807cc6da75ec0aa. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:33:50.994751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b70db3d-6153-47f6-9a7c-5e44dbb3ba88 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1473886477"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:51.010462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-7b70db3d-6153-47f6-9a7c-5e44dbb3ba88 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Generated uuid 8a7bb3e4-0385-4c19-8820-d9cd1d88b65d for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 14:33:51.029468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:33:51.035816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:33:51.042907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:51.116441 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b70db3d-6153-47f6-9a7c-5e44dbb3ba88 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.130480 Oct 03 14:33:51.121237 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 151/325] 10.222.0.20 () {62 vars in 1205 bytes} [Mon Oct 3 14:33:50 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:51.143396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e88d503c-476e-49e7-943a-146bcc06dc70 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2021781400"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:51.205975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5c3c4f7-a8e5-42c1-bc18-9983ab7fc04d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.872536 Oct 03 14:33:51.208115 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 175/326] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:33:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:33:51.221115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86deee08-faea-45f9-a681-4a97818293ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:51.222219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-86deee08-faea-45f9-a681-4a97818293ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:51.260490 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e88d503c-476e-49e7-943a-146bcc06dc70 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.133655 Oct 03 14:33:51.271417 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 152/327] 10.222.0.20 () {62 vars in 1213 bytes} [Mon Oct 3 14:33:51 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:51.277833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d08687a-b09c-4963-861a-70be1de3b81f tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:51.297517 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d08687a-b09c-4963-861a-70be1de3b81f tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.025419 Oct 03 14:33:51.305277 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 153/328] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 3 14:33:51 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:51.309967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:51.310595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:51.319477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:51.320030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:51.321641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:51.322545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:51.323291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:51.323725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:51.737482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-86deee08-faea-45f9-a681-4a97818293ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:51.752411 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-86deee08-faea-45f9-a681-4a97818293ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1214 microversion: 2.1 time: 0.535918 Oct 03 14:33:51.753588 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 176/329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:51 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1214 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:51.759200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-044577b5-c642-4540-8d09-8d347a2485cd tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:51.788060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044577b5-c642-4540-8d09-8d347a2485cd tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:51.790424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044577b5-c642-4540-8d09-8d347a2485cd tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:51.790828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044577b5-c642-4540-8d09-8d347a2485cd tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:52.034965 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-044577b5-c642-4540-8d09-8d347a2485cd tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.279570 Oct 03 14:33:52.035842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 177/330] 10.222.0.20 () {62 vars in 1235 bytes} [Mon Oct 3 14:33:51 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:52.048174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-196d39c3-ee34-4222-824d-d603727ad921 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:52.093961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-196d39c3-ee34-4222-824d-d603727ad921 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:52.094491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-196d39c3-ee34-4222-824d-d603727ad921 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:52.094925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-196d39c3-ee34-4222-824d-d603727ad921 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:52.448494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-196d39c3-ee34-4222-824d-d603727ad921 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.403741 Oct 03 14:33:52.449854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 178/331] 10.222.0.20 () {62 vars in 1235 bytes} [Mon Oct 3 14:33:52 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:33:52.483590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6616ec79-03a9-43dc-a118-7b9cc8759818 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:52.556182 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6616ec79-03a9-43dc-a118-7b9cc8759818 tempest-AggregatesAdminTestV241-624133634 tempest-AggregatesAdminTestV241-624133634-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.096596 Oct 03 14:33:52.557543 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 179/332] 10.222.0.20 () {60 vars in 1196 bytes} [Mon Oct 3 14:33:52 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:33:52.781220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:52.782326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:52.791464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:52.792410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:52.793739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:52.795041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:52.795841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:52.797389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:52.903876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:52.923792 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a188204-00d8-4858-845f-0707930dab0d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1266 microversion: 2.1 time: 0.144668 Oct 03 14:33:52.924471 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 180/333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:52 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:52.959271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:52.972976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:52.974435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:52.975581 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f5425d4-c1e6-43e4-96ae-c74ffe3c5d1f tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 1.673602 Oct 03 14:33:52.989047 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 154/334] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:51 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:53.949205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:53.949825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:53.963219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:53.965706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:53.966352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:53.967472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:53.969298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:53.969915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:54.015411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:54.018459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:54.040017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:54.040620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:54.041165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:54.042314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:54.044531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:54.045182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:54.296943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:54.313625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d25246eb-322a-4272-bbdd-1d69127399d0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1272 microversion: 2.1 time: 0.369618 Oct 03 14:33:54.314756 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 181/335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:53 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1272 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:55.161691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d622076-af2f-4e37-b234-5281643965ac tempest-ListImageFiltersNegativeTestJSON-201194940 tempest-ListImageFiltersNegativeTestJSON-201194940-project] Calling method '.version_select at 0x7fb231370af0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:55.189527 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-7d622076-af2f-4e37-b234-5281643965ac tempest-ListImageFiltersNegativeTestJSON-201194940 tempest-ListImageFiltersNegativeTestJSON-201194940-project] HTTP exception thrown: Image not found. Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d622076-af2f-4e37-b234-5281643965ac tempest-ListImageFiltersNegativeTestJSON-201194940 tempest-ListImageFiltersNegativeTestJSON-201194940-project] Request method failure captured: Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/images/6abacda4-bd4f-46fd-8494-56f2925ea8cd HTTP/1.1 Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLSPFVrDj6_zAqnFugLp9q0Qhf1UP1-RAxfPch0udojkvHcIppi58UtAwTtjVEoR_d47CmxgM-cILiFiqxMczyZaZn1h0kvBTJMGpTU9VumOSFOA2E2k14KrVBs9xkcO6AEkbj_RAB7g9ks8wHepawP8L_LkZXHFsJJVgcqzT9xBmc Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 072c1bd3970c4dc698a27758f919938e Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-201194940 Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:33:55.209150 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/072c1bd3970c4dc698a27758f919938e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_072c1bd3970c4dc698a27758f919938e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/072c1bd3970c4dc698a27758f919938e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/072c1bd3970c4dc698a27758f919938e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-201194940 Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 072c1bd3970c4dc698a27758f919938e Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-201194940 Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListImageFiltersNegativeTestJSON-201194940-project Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 498b10e7cc114fa2a3d222b1af7f2232 Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-201194940-project Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: exception: Image not found. Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6abacda4-bd4f-46fd-8494-56f2925ea8cd'} Oct 03 14:33:55.210690 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:33:55.211806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6abacda4-bd4f-46fd-8494-56f2925ea8cd Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:33:55.213509 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6abacda4-bd4f-46fd-8494-56f2925ea8cd could not be found. Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:33:55.215064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:33:55.216890 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:33:55.220128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d622076-af2f-4e37-b234-5281643965ac tempest-ListImageFiltersNegativeTestJSON-201194940 tempest-ListImageFiltersNegativeTestJSON-201194940-project] Returning 404 to user: Image not found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:33:55.221334 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d622076-af2f-4e37-b234-5281643965ac tempest-ListImageFiltersNegativeTestJSON-201194940 tempest-ListImageFiltersNegativeTestJSON-201194940-project] 10.222.0.20 "GET /compute/v2.1/images/6abacda4-bd4f-46fd-8494-56f2925ea8cd" status: 404 len: 62 microversion: 2.1 time: 0.270011 Oct 03 14:33:55.237771 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 182/336] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:33:54 2022] GET /compute/v2.1/images/6abacda4-bd4f-46fd-8494-56f2925ea8cd => generated 62 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:33:55.339402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:55.340234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:55.358564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:55.360125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:55.362073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:55.362822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:55.365101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:55.365900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:55.428874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:55.442902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:55.444623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:55.445899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2093ed04-40b2-47ba-a5da-e66a63cbe9a9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 1.441631 Oct 03 14:33:55.469334 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 155/337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:54 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:55.571129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:55.581143 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-568e493e-fd96-427f-b763-354c970f9fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1272 microversion: 2.1 time: 0.245809 Oct 03 14:33:55.583218 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 183/338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:55 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:56.486752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:56.487359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:56.495296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:56.513764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:56.514153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:56.514896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:56.515342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:56.515758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:56.604229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:56.605391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:56.620976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:56.621730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:56.622321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:56.623225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:56.623829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:56.624403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:56.896789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:56.914097 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc5ca8c3-4458-473e-9df8-81e556d442f8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1272 microversion: 2.1 time: 0.312825 Oct 03 14:33:56.916560 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 184/339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:56 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:33:57.070437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:57.079400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:57.087916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:57.089327 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32bd46e2-037f-4ac3-b294-4cc9c6c1773c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 0.606431 Oct 03 14:33:57.108773 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 156/340] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:56 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:33:57.189333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:57.189976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:57.199417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c06350cc-4184-4bb3-9bdb-ada0aafc925b req-e2ce767a-aaf5-44f7-b2c2-283b986adf73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512b8784-a0b5-45a8-95d9-85d2faaf4e5f", "tag": "3e232d83-b71c-4671-92c6-7ea1aeafc99f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:33:57.207115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:57.207656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:57.208109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:57.209012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:57.217844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:57.218258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:57.218499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c06350cc-4184-4bb3-9bdb-ada0aafc925b req-e2ce767a-aaf5-44f7-b2c2-283b986adf73 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:57.219126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c06350cc-4184-4bb3-9bdb-ada0aafc925b req-e2ce767a-aaf5-44f7-b2c2-283b986adf73 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:57.220206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c06350cc-4184-4bb3-9bdb-ada0aafc925b req-e2ce767a-aaf5-44f7-b2c2-283b986adf73 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:57.244269 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c06350cc-4184-4bb3-9bdb-ada0aafc925b req-e2ce767a-aaf5-44f7-b2c2-283b986adf73 service nova] Creating event network-changed:3e232d83-b71c-4671-92c6-7ea1aeafc99f for instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f on n-h2-781139-2 Oct 03 14:33:57.265681 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c06350cc-4184-4bb3-9bdb-ada0aafc925b req-e2ce767a-aaf5-44f7-b2c2-283b986adf73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070451 Oct 03 14:33:57.272665 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 157/341] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:33:57.600917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:57.609127 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d454dbbf-a8d2-43ff-ad18-32233551f208 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 200 len: 1584 microversion: 2.1 time: 0.424531 Oct 03 14:33:57.614023 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 185/342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:57 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 1584 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:57.939477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:57.940241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:57.946894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:57.957386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:57.958056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:57.958892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:57.959620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:57.960215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:58.115751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:58.116365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:58.123412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:58.123898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:58.124335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:58.125073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:58.125525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:58.125947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:58.616810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:58.643619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:58.649287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:58.661884 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6d237a9c-a013-4433-a4bd-0b02ae54944d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 0.545448 Oct 03 14:33:58.671019 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 186/343] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:58 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:33:58.673213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:33:58.732567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:33:58.753106 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-091e49bf-52fe-4a04-a0dd-7d0496302afd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.815787 Oct 03 14:33:58.771186 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 158/344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:33:57 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:33:59.707245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:33:59.708660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:33:59.735547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:59.736279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:59.736914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:33:59.737843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:33:59.741248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:33:59.742610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:00.073650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a5619e25-cc6f-47d5-9841-7c3636b5e638 tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] Calling method '.version_select at 0x7fb23131ea60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:00.103276 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a5619e25-cc6f-47d5-9841-7c3636b5e638 tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.632724 Oct 03 14:34:00.109790 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 187/345] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 3 14:33:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:00.128250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7b2b15d3-5ae9-4b36-85df-cf6831ecc822 req-9755f555-9924-42a4-af5a-6a9db8e2a5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a85eea-3a6c-4b79-b702-6faef8ab910b", "name": "network-vif-plugged", "status": "completed", "tag": "badac6a7-8c48-4385-8ede-5a1648db8792"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:00.154121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7b2b15d3-5ae9-4b36-85df-cf6831ecc822 req-9755f555-9924-42a4-af5a-6a9db8e2a5ce service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:00.159827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7b2b15d3-5ae9-4b36-85df-cf6831ecc822 req-9755f555-9924-42a4-af5a-6a9db8e2a5ce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:00.160566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7b2b15d3-5ae9-4b36-85df-cf6831ecc822 req-9755f555-9924-42a4-af5a-6a9db8e2a5ce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:00.175469 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7b2b15d3-5ae9-4b36-85df-cf6831ecc822 req-9755f555-9924-42a4-af5a-6a9db8e2a5ce service nova] Creating event network-vif-plugged:badac6a7-8c48-4385-8ede-5a1648db8792 for instance b0a85eea-3a6c-4b79-b702-6faef8ab910b on n-h2-781139-2 Oct 03 14:34:00.181564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7b2b15d3-5ae9-4b36-85df-cf6831ecc822 req-9755f555-9924-42a4-af5a-6a9db8e2a5ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070116 Oct 03 14:34:00.183118 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 188/346] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:00.189173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:00.190428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:00.199163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:00.199950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:00.200696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:00.201795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:00.202524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:00.203205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:00.626616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:00.636486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:00.650956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:00.652405 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bf28087-864c-4473-a51c-bdd0f6c40398 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 0.958719 Oct 03 14:34:00.653511 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 159/347] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:33:59 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:00.662970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49ff2c3b-45b8-4f86-820c-8f0c263f4ccc tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] Action: 'update', calling method: .version_select at 0x7fb23103c9d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:00.701351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:00.709394 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35bbed77-bb94-4607-900b-8c8ed8dd8e4c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.524713 Oct 03 14:34:00.709973 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 189/348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:00 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:00.948959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:00.966000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d0704d0-ecfe-4b20-b9bd-0669cd6d04e1 tempest-ListImagesTestJSON-109035543 tempest-ListImagesTestJSON-109035543-project] Calling method '.version_select at 0x7fb2313f50d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:01.019407 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d0704d0-ecfe-4b20-b9bd-0669cd6d04e1 tempest-ListImagesTestJSON-109035543 tempest-ListImagesTestJSON-109035543-project] 10.222.0.20 "GET /compute/v2.1/images/b9a0038d-acfa-4c25-a7f1-6598cf246eca" status: 200 len: 784 microversion: 2.1 time: 0.296425 Oct 03 14:34:01.030849 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 190/349] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:34:00 2022] GET /compute/v2.1/images/b9a0038d-acfa-4c25-a7f1-6598cf246eca => generated 784 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:01.039393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eed30bb6-e45d-411f-a5ea-e7983f7c14f7 tempest-ListImagesTestJSON-109035543 tempest-ListImagesTestJSON-109035543-project] Calling method '.version_select at 0x7fb231370b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:01.168624 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eed30bb6-e45d-411f-a5ea-e7983f7c14f7 tempest-ListImagesTestJSON-109035543 tempest-ListImagesTestJSON-109035543-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.132553 Oct 03 14:34:01.170056 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 191/350] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 3 14:34:01 2022] GET /compute/v2.1/images => generated 445 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:01.190862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-128291e7-f429-4438-ac32-39de5d442a1a tempest-ListImagesTestJSON-109035543 tempest-ListImagesTestJSON-109035543-project] Calling method '.version_select at 0x7fb231370d30>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:01.337514 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-128291e7-f429-4438-ac32-39de5d442a1a tempest-ListImagesTestJSON-109035543 tempest-ListImagesTestJSON-109035543-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.158520 Oct 03 14:34:01.341546 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 192/351] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:34:01 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:01.393801 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49ff2c3b-45b8-4f86-820c-8f0c263f4ccc tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.738798 Oct 03 14:34:01.401688 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 160/352] 10.222.0.20 () {60 vars in 1206 bytes} [Mon Oct 3 14:34:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:01.407360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c3b6929-a8a0-4ee0-971f-83d6073f728f tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] Calling method '.version_select at 0x7fb231391160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:01.443017 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c3b6929-a8a0-4ee0-971f-83d6073f728f tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.040183 Oct 03 14:34:01.452201 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 193/353] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 3 14:34:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:01.467446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae024f71-6730-4792-bbb0-362f5b26c2d7 tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] Action: 'update', calling method: .version_select at 0x7fb2310563a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:01.613649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=21,nova_api:INSERT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:01.686883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:01.689486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:01.730008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:01.735012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:01.736226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:01.738818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:01.743661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:01.746593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:01.755701 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae024f71-6730-4792-bbb0-362f5b26c2d7 tempest-QuotaClassesAdminTestJSON-509962492 tempest-QuotaClassesAdminTestJSON-509962492-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.294866 Oct 03 14:34:01.765252 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 161/354] 10.222.0.20 () {60 vars in 1206 bytes} [Mon Oct 3 14:34:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:01.787006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:01.791618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:01.814008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:01.814485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:01.814925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:01.815651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:01.825471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:01.825984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:01.839082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:02.219956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:02.233079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:02.234528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:02.235654 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5c54c7d-3230-45b7-8857-963aa8f08a99 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1362 microversion: 2.25 time: 0.558143 Oct 03 14:34:02.237011 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 194/355] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:01 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:34:02.261380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e86642a0-799e-4423-b71e-6f0020643f21 req-8ed52b65-121d-451b-ab2f-bf04bcdbdaac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6f819f-fe1e-4600-91d6-0a068a24b8c6", "tag": "0b0ca6d8-8f04-4205-9759-4f348a5a7efe"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:02.278763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e86642a0-799e-4423-b71e-6f0020643f21 req-8ed52b65-121d-451b-ab2f-bf04bcdbdaac service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:02.280691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e86642a0-799e-4423-b71e-6f0020643f21 req-8ed52b65-121d-451b-ab2f-bf04bcdbdaac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:02.283363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e86642a0-799e-4423-b71e-6f0020643f21 req-8ed52b65-121d-451b-ab2f-bf04bcdbdaac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:02.311091 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e86642a0-799e-4423-b71e-6f0020643f21 req-8ed52b65-121d-451b-ab2f-bf04bcdbdaac service nova] Creating event network-changed:0b0ca6d8-8f04-4205-9759-4f348a5a7efe for instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 on n-h1-781139-2 Oct 03 14:34:02.322030 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e86642a0-799e-4423-b71e-6f0020643f21 req-8ed52b65-121d-451b-ab2f-bf04bcdbdaac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082985 Oct 03 14:34:02.323554 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 195/356] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:02.528056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:02.537138 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9f939dc-d92c-47f3-a1a9-ff2dcb06304f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.770633 Oct 03 14:34:02.543941 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 162/357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:01 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:03.269103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:03.270131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:03.285003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:03.286422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:03.286893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:03.287610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:03.288071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:03.291879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:03.338657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:03.568586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:03.569361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:03.582356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:03.582968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:03.583880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:03.585213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:03.585796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:03.586243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:03.906411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:03.920610 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ea030a3-7414-4373-b8a8-4736119e050b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.356123 Oct 03 14:34:03.923888 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 163/358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:03 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:34:03.943743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:03.956731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:03.960258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:03.963785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-434571fc-0d58-4e59-a375-6d9a180b9311 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1559 microversion: 2.25 time: 0.703084 Oct 03 14:34:03.966839 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 196/359] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:03 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1559 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:04.437386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:04.438300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:04.453627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:04.454266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:04.454879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:04.456262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:04.456792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:04.458832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:04.652531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid b0a85eea-3a6c-4b79-b702-6faef8ab910b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:04.772245 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42d9d87e-e52a-4626-9239-5e498d737128 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 2052 microversion: 2.25 time: 0.780199 Oct 03 14:34:04.772841 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 164/360] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:03 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 2052 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:04.800658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:04.801844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:04.817742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:04.818515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:04.819018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:04.820735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:04.821552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:04.822191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:04.948810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:04.949463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:04.962138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:04.962652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:04.963095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:04.963827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:04.964280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:04.964708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:05.246091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:05.255752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c8e60d0-7e69-4b3e-b765-68cce16ed78b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.311797 Oct 03 14:34:05.258018 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 165/361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:04 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:05.551683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid b0a85eea-3a6c-4b79-b702-6faef8ab910b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:05.737039 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4147b469-5b42-41d6-8ee9-2a64c078d9e2 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 2052 microversion: 2.25 time: 0.940522 Oct 03 14:34:05.742280 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 197/362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:04 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 2052 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:05.770496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:05.790600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:05.800383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:05.801868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:05.803131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:05.803896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:05.805503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:05.833475 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ec168f8-1696-413b-9bf9-d41f5590cc03 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.068564 Oct 03 14:34:05.834768 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 166/363] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 3 14:34:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:34:05.850579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-781139-2", "block_migration": "auto"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:05.855938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:05.877988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:05.878789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:05.879382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:05.883222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:05.885158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:05.885798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:06.128073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'flavor' on Instance uuid b0a85eea-3a6c-4b79-b702-6faef8ab910b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:06.268010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Going to try to live migrate instance to n-h1-781139-2 {{(pid=128868) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:34:06.810404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6be1ee3d-6d11-448e-bd75-3a378fcb1fa2 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb230fea430>, body: {"keypair": {"name": "tempest-keypair-1975562175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvlzmubLfwCfkZYoY794TQ75cQXYpHp5PkFcPSv+ohn58N61Lkz3ZF1BNAg6RtB/oFHOrh/4VcYsSUSUKU8CEJjM/D0rXAOgRL+cwBWo424oVoo4iLw4mjmuhZLASlYaw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:06.850222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6be1ee3d-6d11-448e-bd75-3a378fcb1fa2 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:06.893046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6be1ee3d-6d11-448e-bd75-3a378fcb1fa2 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:06.984208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6be1ee3d-6d11-448e-bd75-3a378fcb1fa2 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.962216 Oct 03 14:34:06.985657 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 167/364] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 3 14:34:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 964 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:34:07.010250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:07.013184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:07.036057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:07.038041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:07.042213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:07.045845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:07.046628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:07.048272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:07.899818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:07.919624 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57c0c90a-db08-4ff3-b67f-d670839a01c2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.932540 Oct 03 14:34:07.925365 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 168/365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:06 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:07.939257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43c2c46e-0a5d-4c31-8a58-8fc733eed44c tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb23103c9d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:07.988109 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43c2c46e-0a5d-4c31-8a58-8fc733eed44c tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1975562175" status: 200 len: 512 microversion: 2.2 time: 0.061060 Oct 03 14:34:08.008192 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 169/366] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 3 14:34:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1975562175 => generated 512 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:08.022519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e71c68c-0967-450d-893b-bd1ca011cbf5 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb230feaca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:08.092001 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e71c68c-0967-450d-893b-bd1ca011cbf5 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975562175" status: 204 len: 0 microversion: 2.2 time: 0.079547 Oct 03 14:34:08.109252 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 170/367] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Oct 3 14:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975562175 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:08.131296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e619c166-2070-47be-b968-3540de679c6a tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb230feaee0>, body: {"keypair": {"name": "tempest-keypair-1396494054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS19JJ8FsjYjMhwbZO3/ytkRpD4myCp9pNRwHQPVHLYYKpgdT9pGrSeI8dMmj2Uud5xI553cRsX/VlL7vbyOiF0afBDzZuVCjQiM/fJI/DuJBovmGO9QJ0igHdlA5jcjg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:08.196893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e619c166-2070-47be-b968-3540de679c6a tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:08.215309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e619c166-2070-47be-b968-3540de679c6a tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:08.290059 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e619c166-2070-47be-b968-3540de679c6a tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.177755 Oct 03 14:34:08.290843 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 171/368] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 3 14:34:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:34:08.309154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20f6db55-f6f3-49f9-8fa0-17d2d87ea621 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb230fa8d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:08.359458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20f6db55-f6f3-49f9-8fa0-17d2d87ea621 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396494054" status: 204 len: 0 microversion: 2.2 time: 0.060263 Oct 03 14:34:08.360522 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 172/369] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Oct 3 14:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396494054 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:08.373762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d09b2870-d700-4714-9757-664bcbf5ed38 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb230fc4c10>, body: {"keypair": {"name": "tempest-keypair-990466859", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:08.417929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d09b2870-d700-4714-9757-664bcbf5ed38 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:08.434800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d09b2870-d700-4714-9757-664bcbf5ed38 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:08.501237 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d09b2870-d700-4714-9757-664bcbf5ed38 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.133286 Oct 03 14:34:08.502521 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 173/370] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 3 14:34:08 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:34:08.522607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8330caa3-fa2d-4636-8182-ac69657fc91a tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb230fcb820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:08.567951 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8330caa3-fa2d-4636-8182-ac69657fc91a tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990466859" status: 204 len: 0 microversion: 2.2 time: 0.056508 Oct 03 14:34:08.569177 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 174/371] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 3 14:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990466859 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:08.583942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b6ff813-609b-4275-be3b-f30a559e9ade tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb230fc4280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1689221662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkeYuv7ckLqXpfNzYKzuXVkb4/dtSN30rOfa3ttdOpM8dS9LJfGSh63pu2ESmsOdCa8NQpvOwLRolY3QL0yNbJGzrK0gyb/rcNPj4oSMfL721WvnO6RdX8pSK1YKw1i8Q=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:08.630306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7b6ff813-609b-4275-be3b-f30a559e9ade tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:08.647020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7b6ff813-609b-4275-be3b-f30a559e9ade tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:08.768293 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b6ff813-609b-4275-be3b-f30a559e9ade tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.190261 Oct 03 14:34:08.769120 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 175/372] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 3 14:34:08 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 03 14:34:08.787933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6d0cdce-043e-4c73-a072-f494d0fd52d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb2310adee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-456860236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp5bDiBiiZZi6A4tKG/NyliCiIHiZZBnsmo2UFpSC439lGh/tZ1WZHavNbtUZyVX3vu4RL0gZfUodFW28OkxnzGVJTgXKekvCP+giHCPZM21lheOyVFPblPl7A/RYD1CQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:08.846621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d6d0cdce-043e-4c73-a072-f494d0fd52d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:08.859005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d6d0cdce-043e-4c73-a072-f494d0fd52d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:08.938282 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6d0cdce-043e-4c73-a072-f494d0fd52d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.158659 Oct 03 14:34:08.940292 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 176/373] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 3 14:34:08 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:34:08.952188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:08.953294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:08.968595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=4,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:08.989757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:08.990414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:08.990991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:08.992086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:08.992553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:08.992991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:10.276260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:10.300686 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39538870-e27d-4b0a-bc61-241f409dd70f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 1.343457 Oct 03 14:34:10.318680 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 177/374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:08 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:10.336280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e84e05ca-5b34-42a6-8a74-b0cfc38ce7e1 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb2310adf70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1033575320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU9jx/9A+SER4yOFmLPqnkQ1a/8sYbNoe/2ArsHrNUDlGJx8+rf1MWpv8HGdm3Tuhbnbgp3F7Xf3mX/U+BPuTFY3GC4/Ue4ID3kkHmCxr7v3qrTHdw3K7NDL57SRyPiAA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:10.383325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e84e05ca-5b34-42a6-8a74-b0cfc38ce7e1 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:10.398444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e84e05ca-5b34-42a6-8a74-b0cfc38ce7e1 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:10.452913 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e84e05ca-5b34-42a6-8a74-b0cfc38ce7e1 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.130988 Oct 03 14:34:10.458724 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 178/375] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 3 14:34:10 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:34:10.904522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-297f0773-e7e5-4693-996b-0e752f3a53d9 tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] Action: 'create', calling method: .version_select at 0x7fb231056790>, body: {"security_group": {"name": "tempest-securitygroup-1258008950", "description": "tempest-description-160557418"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:11.417183 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba307f15-e5e7-48d2-8ead-007e321c11e3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b/action" status: 202 len: 0 microversion: 2.25 time: 5.569800 Oct 03 14:34:11.421333 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 198/376] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:34:05 2022] POST /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b/action => generated 0 bytes in 5573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:11.425749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-28030c64-d384-4951-abcf-c2a38b3b9447 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb231190ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:11.438180 n-d-781139-2 devstack@n-api.service[128868]: WARNING oslo_db.sqlalchemy.utils [None req-28030c64-d384-4951-abcf-c2a38b3b9447 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 14:34:11.472500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=20 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:11.473863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:11.477562 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-28030c64-d384-4951-abcf-c2a38b3b9447 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.056182 Oct 03 14:34:11.484186 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 199/377] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Oct 3 14:34:11 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:11.484186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:11.484415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:11.497093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:11.497820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:11.498491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:11.499371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:11.499894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:11.500371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:11.924030 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-297f0773-e7e5-4693-996b-0e752f3a53d9 tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.469172 Oct 03 14:34:11.927408 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 179/378] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:34:10 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:11.933032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:11.933769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:11.948984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:11.950752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:11.951349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:11.951908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:11.952725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:11.955791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:11.956600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:11.965348 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e3a7ef6-ef23-4009-9733-11c387e0894e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.485329 Oct 03 14:34:11.966682 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 200/379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:11 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:11.974790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-183eecf4-38c5-424d-9542-79ebdeb42b66 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb2310dd160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:12.032171 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-183eecf4-38c5-424d-9542-79ebdeb42b66 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1033575320" status: 204 len: 0 microversion: 2.2 time: 0.064176 Oct 03 14:34:12.033093 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 201/380] 10.222.0.20 () {60 vars in 1321 bytes} [Mon Oct 3 14:34:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1033575320 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:12.250323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1474975997", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:12.339481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:12.548673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:12.571943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:12.577550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:12.581184 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a08ed008-3d7d-4177-84c5-89a670200b3d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.652619 Oct 03 14:34:12.583468 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 180/381] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:11 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:12.589311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d346d6e9-6b08-4d0a-af1c-3cd743c78377 tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] Action: 'create', calling method: .version_select at 0x7fb230feaca0>, body: {"security_group": {"name": "tempest-securitygroup-502861770", "description": "tempest-description-584328666"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:12.761686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:12.765189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:12.765927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:12.766830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:12.767397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:12.801798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:12.803936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:12.806306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:12.810879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:12.812779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:12.815604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:12.880749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Getting quotas for project 65d139c47ffe4f3c96ca156f2b63703b. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:12.896788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Getting quotas for user 5e37b3a80e494c7787b3fbb417f89ccb and project 65d139c47ffe4f3c96ca156f2b63703b. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:12.939047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:12.942559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:13.046220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8304cc85-4953-48f8-9f5f-c666b9ce3eeb tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011804 Oct 03 14:34:13.047369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 202/382] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:34:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:34:13.052630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0852df14-c898-4853-b9bc-10a833b2993b tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb2311571f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:13.085545 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0852df14-c898-4853-b9bc-10a833b2993b tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-456860236" status: 204 len: 0 microversion: 2.2 time: 0.036599 Oct 03 14:34:13.090903 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 203/383] 10.222.0.20 () {60 vars in 1318 bytes} [Mon Oct 3 14:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-456860236 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:13.175993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1778359760", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "1de92605-c737-403e-8392-200d1d88069b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:13.272225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] validate_networks() for [('1de92605-c737-403e-8392-200d1d88069b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:13.283819 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d346d6e9-6b08-4d0a-af1c-3cd743c78377 tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.698920 Oct 03 14:34:13.284390 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 181/384] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:34:12 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:13.294344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:13.294344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:13.296665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:13.297177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:13.297784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:13.298964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:13.299717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:13.300287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:13.785645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:13.806660 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c065667d-f8d5-4de4-88ff-cc407df2caa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.521038 Oct 03 14:34:13.808644 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 182/385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:13 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:13.815053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:13.816896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:13.827308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:13.829425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:13.830368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:13.831426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:13.844394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:13.845427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:14.042917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:14.044135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:14.047170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:14.047974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:14.048578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:14.075815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:14.079117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:14.082397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:14.084858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:14.085652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:14.086245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:14.112825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:14.119545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for user a91d62c6a8f04094b64c79e338b1dc49 and project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:14.135013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:14.137607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:14.222187 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e17209f0-bccd-4e73-a069-72485a3b2ed1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126343 Oct 03 14:34:14.224891 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 204/386] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:34:14.250323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1f8160d8-d6fd-45d9-be82-74dd46a6e7a6 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb231144ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:14.295617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1f8160d8-d6fd-45d9-be82-74dd46a6e7a6 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1689221662" status: 204 len: 0 microversion: 2.2 time: 0.068673 Oct 03 14:34:14.303715 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 205/387] 10.222.0.20 () {60 vars in 1321 bytes} [Mon Oct 3 14:34:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1689221662 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:14.423959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:14.439082 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccf4c799-6b56-446f-a2d3-345722589f61 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1224 microversion: 2.1 time: 0.628937 Oct 03 14:34:14.443058 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 183/388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:13 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1224 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:14.454385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c1307c83-e3ea-4516-a3af-76a7f4afa320 req-8979e974-4dfd-4093-95cd-e742af0d3648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6f819f-fe1e-4600-91d6-0a068a24b8c6", "name": "network-vif-plugged", "status": "completed", "tag": "0b0ca6d8-8f04-4205-9759-4f348a5a7efe"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:14.481947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c1307c83-e3ea-4516-a3af-76a7f4afa320 req-8979e974-4dfd-4093-95cd-e742af0d3648 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:14.482427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c1307c83-e3ea-4516-a3af-76a7f4afa320 req-8979e974-4dfd-4093-95cd-e742af0d3648 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:14.482891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c1307c83-e3ea-4516-a3af-76a7f4afa320 req-8979e974-4dfd-4093-95cd-e742af0d3648 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:14.527780 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c1307c83-e3ea-4516-a3af-76a7f4afa320 req-8979e974-4dfd-4093-95cd-e742af0d3648 service nova] Creating event network-vif-plugged:0b0ca6d8-8f04-4205-9759-4f348a5a7efe for instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 on n-h1-781139-2 Oct 03 14:34:14.530640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-78db27f3-b326-43ad-8374-4c9cebe14ddc tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] Action: 'create', calling method: .version_select at 0x7fb231508700>, body: {"security_group": {"name": "tempest-securitygroup-170459368", "description": "tempest-description-894443529"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:14.549776 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c1307c83-e3ea-4516-a3af-76a7f4afa320 req-8979e974-4dfd-4093-95cd-e742af0d3648 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103263 Oct 03 14:34:14.553743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 184/389] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:14.574143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:14.575247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:14.616125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:14.617036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:14.617748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:14.618623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:14.620008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:14.620607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:15.361544 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-78db27f3-b326-43ad-8374-4c9cebe14ddc tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.054591 Oct 03 14:34:15.362317 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 206/390] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:34:14 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:15.367272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:15.368047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:15.382140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:15.383446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:15.384081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:15.385442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:15.386033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:15.386703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:15.493078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:15.504352 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bea70002-e1b5-4cbb-9458-b424d0fb5ce3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1207 microversion: 2.1 time: 0.140706 Oct 03 14:34:15.505530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 207/391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:15 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1207 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:15.525415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66855307-04ca-4336-92bc-35faeaec3157 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb231157280>, body: {"keypair": {"name": "tempest-keypair-173473230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx8gRpIMuxuIQijakBRKQd3qEyoZgGNjnv3WJbCLfFcLPIxqk/L1qunTy+Hmu17Z1RSMegMvaHOlog5l3igjNN267wOXkbfzlwJkxOV2DDR+Ua0VHB64Z3VD1Sx54UBDg=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:15.593034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-66855307-04ca-4336-92bc-35faeaec3157 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:15.608609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-66855307-04ca-4336-92bc-35faeaec3157 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:15.672990 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66855307-04ca-4336-92bc-35faeaec3157 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.165505 Oct 03 14:34:15.675121 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 208/392] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 3 14:34:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:34:15.711728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:15.714856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:15.734179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:15.734837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:15.735413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:15.737448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:15.738267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:15.741228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:15.812953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:15.887276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:15.903093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:15.906196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:15.907609 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e486f84c-1a90-44c6-a511-c27b23946820 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 1.352121 Oct 03 14:34:15.912464 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 185/393] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:14 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:15.920472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-102ab916-331c-46d5-ba72-8b709f99d2cc tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] Action: 'create', calling method: .version_select at 0x7fb23107c5e0>, body: {"security_group": {"name": "tempest-securitygroup-750167018", "description": "tempest-description-66807520"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:15.995644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:16.012644 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e69aeacd-2a12-454b-bd39-875adbf59428 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1314 microversion: 2.1 time: 0.336086 Oct 03 14:34:16.013991 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 209/394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:15 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:16.020313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:16.028322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:16.036448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:16.036993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:16.037424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:16.038960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:16.039419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:16.039844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:16.286376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:16.304552 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-beceaaf6-3cde-41b9-8139-b5af7986353c tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1278 microversion: 2.1 time: 0.288654 Oct 03 14:34:16.307854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 210/395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:16 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1278 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:16.327999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b4d929a-d83e-4b67-a6d2-2bc0c0457cd1 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb2310f5550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:16.352549 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b4d929a-d83e-4b67-a6d2-2bc0c0457cd1 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-173473230" status: 200 len: 511 microversion: 2.2 time: 0.043347 Oct 03 14:34:16.353572 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 211/396] 10.222.0.20 () {60 vars in 1255 bytes} [Mon Oct 3 14:34:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-173473230 => generated 511 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:16.364381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-62c49d04-40af-4b7a-9bac-8d776185808a req-cd8e50ea-8458-43ac-9271-7c3ea7ab4aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a85eea-3a6c-4b79-b702-6faef8ab910b", "name": "network-vif-unplugged", "status": "completed", "tag": "badac6a7-8c48-4385-8ede-5a1648db8792"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:16.393361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-62c49d04-40af-4b7a-9bac-8d776185808a req-cd8e50ea-8458-43ac-9271-7c3ea7ab4aba service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:16.395290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-62c49d04-40af-4b7a-9bac-8d776185808a req-cd8e50ea-8458-43ac-9271-7c3ea7ab4aba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:16.395968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-62c49d04-40af-4b7a-9bac-8d776185808a req-cd8e50ea-8458-43ac-9271-7c3ea7ab4aba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:16.425509 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-62c49d04-40af-4b7a-9bac-8d776185808a req-cd8e50ea-8458-43ac-9271-7c3ea7ab4aba service nova] Creating event network-vif-unplugged:badac6a7-8c48-4385-8ede-5a1648db8792 for instance b0a85eea-3a6c-4b79-b702-6faef8ab910b on n-h2-781139-2 Oct 03 14:34:16.439290 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-62c49d04-40af-4b7a-9bac-8d776185808a req-cd8e50ea-8458-43ac-9271-7c3ea7ab4aba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082756 Oct 03 14:34:16.441311 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 212/397] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:16.459358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c1bf5f9-d88e-4a83-8941-4cd16911725d tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb2313919d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:16.469251 n-d-781139-2 devstack@n-api.service[128868]: WARNING oslo_db.sqlalchemy.utils [None req-8c1bf5f9-d88e-4a83-8941-4cd16911725d tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 14:34:16.479950 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c1bf5f9-d88e-4a83-8941-4cd16911725d tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.034696 Oct 03 14:34:16.484437 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 213/398] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Oct 3 14:34:16 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:16.500806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d45cb85e-af53-4099-b017-7811f676e820 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb231141a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:16.556078 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d45cb85e-af53-4099-b017-7811f676e820 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-173473230" status: 204 len: 0 microversion: 2.2 time: 0.068631 Oct 03 14:34:16.557436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 214/399] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 3 14:34:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-173473230 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:16.565219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:16.568433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:16.588605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:16.589404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:16.590004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:16.590874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:16.592856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:16.593935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:16.911291 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-102ab916-331c-46d5-ba72-8b709f99d2cc tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.997163 Oct 03 14:34:16.920225 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 186/400] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:34:15 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:16.926370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Action: 'create', calling method: .version_select at 0x7fb230fc6160>, body: {"keypair": {"name": "tempest-keypair-1007412319", "type": "x509"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:16.961954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:16.973596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:16.978607 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33b795c6-f7df-4592-af93-927297a02c57 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1281 microversion: 2.1 time: 0.417593 Oct 03 14:34:16.979645 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 215/401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:16 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1281 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:16.987769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b93889a2-b47b-40f3-a8f6-7083b81c8acd tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] Calling method '.version_select at 0x7fb2310f58b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:16.990075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:17.037292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpqxh3qa6t/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqxh3qa6t/temp.key -subj /CN=4a38d8d871fd48d0ad12e74e1fb91904 -extensions v3_req_client {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 03 14:34:17.791125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpqxh3qa6t/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqxh3qa6t/temp.key -subj /CN=4a38d8d871fd48d0ad12e74e1fb91904 -extensions v3_req_client" returned: 0 in 0.753s {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 03 14:34:17.795364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpqxh3qa6t/temp.key -password pass: {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 03 14:34:17.838614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.processutils [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpqxh3qa6t/temp.key -password pass:" returned: 0 in 0.043s {{(pid=128869) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 03 14:34:17.904722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:17.914492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Getting quotas for user 4a38d8d871fd48d0ad12e74e1fb91904 and project 54337b8c1d2e447b90513eda62367fcd. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:17.948237 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4057cbe6-737e-4303-a54b-ad52f97c62d3 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.026473 Oct 03 14:34:17.950686 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 187/402] 10.222.0.20 () {62 vars in 1198 bytes} [Mon Oct 3 14:34:16 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1030 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:17.968440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:17.970761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:18.005823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:18.007856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:18.008605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:18.010466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:18.013309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:18.039224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:18.581227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:18.605137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:18.607109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:18.609285 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c6abeef-8f26-46ef-8b7f-4c95d78a24cf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.656448 Oct 03 14:34:18.626596 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 188/403] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:17 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:18.643261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:18.644163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:18.654215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:18.655006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:18.658818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:18.660049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:18.660718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:18.661352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:19.661567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:19.685432 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b57f1989-d10a-45d9-94b1-4bcba6a37c69 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1464 microversion: 2.1 time: 1.056824 Oct 03 14:34:19.686382 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 189/404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:18 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1464 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:19.692516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:19.693630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:19.703916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:19.704861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:19.705831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:19.707244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:19.707861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:19.721907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.213165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:20.222071 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d094e814-1953-4f46-b049-84a16cc5ccbc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1320 microversion: 2.1 time: 0.534434 Oct 03 14:34:20.222895 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 190/405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:19 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:20.243544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96ecdd7e-e017-4fa2-8994-56ecdfbb0b12 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb2310adee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:20.262353 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96ecdd7e-e017-4fa2-8994-56ecdfbb0b12 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1007412319" status: 200 len: 1533 microversion: 2.2 time: 0.023542 Oct 03 14:34:20.263282 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 191/406] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 3 14:34:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1007412319 => generated 1533 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:20.268433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:20.269233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:20.276129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.276807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.277594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.278307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.278761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.279182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.624889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:20.637437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1590ec0-ce46-4bea-8692-b149fa06f34a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 0.372596 Oct 03 14:34:20.638360 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 192/407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:20 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:20.657685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-08faa4f4-3fd9-4b6f-90fd-d306b2367cff req-b99bae19-b885-44a1-aaa3-aa4f0163af9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a85eea-3a6c-4b79-b702-6faef8ab910b", "tag": "badac6a7-8c48-4385-8ede-5a1648db8792"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:20.670847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08faa4f4-3fd9-4b6f-90fd-d306b2367cff req-b99bae19-b885-44a1-aaa3-aa4f0163af9b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.671372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08faa4f4-3fd9-4b6f-90fd-d306b2367cff req-b99bae19-b885-44a1-aaa3-aa4f0163af9b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.671805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08faa4f4-3fd9-4b6f-90fd-d306b2367cff req-b99bae19-b885-44a1-aaa3-aa4f0163af9b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.686472 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-08faa4f4-3fd9-4b6f-90fd-d306b2367cff req-b99bae19-b885-44a1-aaa3-aa4f0163af9b service nova] Creating event network-changed:badac6a7-8c48-4385-8ede-5a1648db8792 for instance b0a85eea-3a6c-4b79-b702-6faef8ab910b on n-h2-781139-2 Oct 03 14:34:20.692619 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-08faa4f4-3fd9-4b6f-90fd-d306b2367cff req-b99bae19-b885-44a1-aaa3-aa4f0163af9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052979 Oct 03 14:34:20.693609 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 193/408] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:20.701000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-93ede2be-499a-4f75-967c-4544d84576e8 req-f1ff5041-805a-4307-aa82-dd8c0404feae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75dea759-c447-4eb0-ab8f-c7c95d850f04", "tag": "7130af64-c9fb-43c1-839e-275151e1b876"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:20.712492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93ede2be-499a-4f75-967c-4544d84576e8 req-f1ff5041-805a-4307-aa82-dd8c0404feae service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.713238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93ede2be-499a-4f75-967c-4544d84576e8 req-f1ff5041-805a-4307-aa82-dd8c0404feae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.714342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93ede2be-499a-4f75-967c-4544d84576e8 req-f1ff5041-805a-4307-aa82-dd8c0404feae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.727628 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-93ede2be-499a-4f75-967c-4544d84576e8 req-f1ff5041-805a-4307-aa82-dd8c0404feae service nova] Creating event network-changed:7130af64-c9fb-43c1-839e-275151e1b876 for instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 on n-h1-781139-2 Oct 03 14:34:20.732815 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-93ede2be-499a-4f75-967c-4544d84576e8 req-f1ff5041-805a-4307-aa82-dd8c0404feae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036043 Oct 03 14:34:20.733658 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 194/409] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:20.738870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:20.739561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:20.746562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.747050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.747482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.748209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.748652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.749114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.791391 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b93889a2-b47b-40f3-a8f6-7083b81c8acd tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11737 microversion: 2.1 time: 3.810357 Oct 03 14:34:20.792003 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 216/410] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 3 14:34:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11737 bytes in 3812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:34:20.945288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:20.951391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Searching by: {'deleted': False, 'project_id': 'caa5941ca7b14ac58033a698c0509c2e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:20.965294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.965775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.966202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:20.966937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:20.967558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:20.968142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:21.004532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:21.013715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:21.017107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:21.021520 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7dfd08e3-4b3a-44ed-be73-884803f9cd65 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.286873 Oct 03 14:34:21.022116 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 195/411] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:20 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:21.035261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e29a425f-7515-495e-9061-73f3486bb11e tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb23107c550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:21.039353 n-d-781139-2 devstack@n-api.service[128869]: WARNING oslo_db.sqlalchemy.utils [None req-e29a425f-7515-495e-9061-73f3486bb11e tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 14:34:21.058920 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e29a425f-7515-495e-9061-73f3486bb11e tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.035380 Oct 03 14:34:21.059809 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 196/412] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Oct 3 14:34:21 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:21.075029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20fffbd7-9b43-4e9b-8738-74da8217e76e tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] Calling method '.version_select at 0x7fb230fc6280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:21.138701 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1869379e-a3fa-4fa8-86a3-3146426d801c tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.345475 Oct 03 14:34:21.139328 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 217/413] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:34:20 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:34:21.153131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-303ac1b4-3062-4e19-8269-a1635ae379c0 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] Calling method '.version_select at 0x7fb231305b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:21.178349 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-303ac1b4-3062-4e19-8269-a1635ae379c0 tempest-KeyPairsV22TestJSON-765942036 tempest-KeyPairsV22TestJSON-765942036-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1007412319" status: 204 len: 0 microversion: 2.2 time: 0.037481 Oct 03 14:34:21.179456 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 218/414] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Oct 3 14:34:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1007412319 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:21.187567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:21.194388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Searching by: {'deleted': False} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:21.200203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:21.200895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:21.201520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:21.203009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:21.203648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:21.204604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:21.342259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:34:21.527337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:21.528790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:21.530106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:21.578171 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20fffbd7-9b43-4e9b-8738-74da8217e76e tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.515803 Oct 03 14:34:21.578793 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 197/415] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 3 14:34:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:21.583972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:21.584577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:21.592399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:21.592820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:21.593285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:21.594158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:21.594607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:21.595175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:21.602279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:21.941086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:21.954126 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d05f0a87-e37f-45fc-b71f-b9fc4bfbc8cd tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1320 microversion: 2.1 time: 0.373847 Oct 03 14:34:21.955757 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 198/416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:21 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:21.962220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-489a9b28-5cc7-47e0-8668-d729d07010a2 tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] Calling method '.version_select at 0x7fb231056790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:22.208623 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-489a9b28-5cc7-47e0-8668-d729d07010a2 tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ffa9e123-da76-4f9f-8792-5b463798d548" status: 202 len: 0 microversion: 2.1 time: 0.250174 Oct 03 14:34:22.209336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 199/417] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:34:21 2022] DELETE /compute/v2.1/os-security-groups/ffa9e123-da76-4f9f-8792-5b463798d548 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:22.217425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:22.218336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:22.227228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.227882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.228807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.230497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.231253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.232632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.393160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:22.407102 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8014cf5c-7256-4ac7-8a30-0ab7f11cda24 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 0.195901 Oct 03 14:34:22.408542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 200/418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:22 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:22.425598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:22.426598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:22.433598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.433978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.434716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.435499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.436007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.436582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.461471 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59694959-262b-4f1a-b6cb-5285253479cf tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11253 microversion: 2.1 time: 1.278027 Oct 03 14:34:22.475053 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 219/419] 10.222.0.20 () {58 vars in 1171 bytes} [Mon Oct 3 14:34:21 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11253 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:34:22.488963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-779ab012-e82e-4a4d-b4ac-ca6251624147 tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] Calling method '.version_select at 0x7fb2313918b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:22.618818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:22.631770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:22.633242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:22.634461 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c05dc225-f2dd-40e9-9a8a-4935aa8267b8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.224547 Oct 03 14:34:22.635033 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 201/420] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:22 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:22.671930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:22.677549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Searching by: {'deleted': False, 'project_id': 'caa5941ca7b14ac58033a698c0509c2e'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:22.685789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.686366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.687009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.687644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.688158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.688646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.810328 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ce54397-2052-43eb-80d5-2c02c374f12a tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=78dce6cc05804cc0b807cc6da75ec0aa" status: 200 len: 15 microversion: 2.1 time: 0.174035 Oct 03 14:34:22.811321 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 202/421] 10.222.0.20 () {58 vars in 1231 bytes} [Mon Oct 3 14:34:22 2022] GET /compute/v2.1/servers/detail?tenant_id=78dce6cc05804cc0b807cc6da75ec0aa => generated 15 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:34:22.817110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a354d84a-818a-46b9-a7ab-a4e0ab4f5fde req-60afcfef-5164-4fb0-8ca3-f955052dc2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bbc8f0-e427-4021-bcc7-3d530f263eb8", "tag": "78fb81bf-61f4-46aa-acb3-a9f95766502a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:22.831678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a354d84a-818a-46b9-a7ab-a4e0ab4f5fde req-60afcfef-5164-4fb0-8ca3-f955052dc2c1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.832534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a354d84a-818a-46b9-a7ab-a4e0ab4f5fde req-60afcfef-5164-4fb0-8ca3-f955052dc2c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.833063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a354d84a-818a-46b9-a7ab-a4e0ab4f5fde req-60afcfef-5164-4fb0-8ca3-f955052dc2c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.849533 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a354d84a-818a-46b9-a7ab-a4e0ab4f5fde req-60afcfef-5164-4fb0-8ca3-f955052dc2c1 service nova] Creating event network-changed:78fb81bf-61f4-46aa-acb3-a9f95766502a for instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 on n-h2-781139-2 Oct 03 14:34:22.856441 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a354d84a-818a-46b9-a7ab-a4e0ab4f5fde req-60afcfef-5164-4fb0-8ca3-f955052dc2c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043051 Oct 03 14:34:22.857700 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 203/422] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:22.863521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:22.874904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Searching by: {'tenant_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'deleted': False} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:22.882918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.883824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.884314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.885458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:22.886021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:22.886848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:22.937400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:34:23.116778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:23.120608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:23.120608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:23.364839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-779ab012-e82e-4a4d-b4ac-ca6251624147 tempest-SecurityGroupsTestAdminJSON-1150370831 tempest-SecurityGroupsTestAdminJSON-1150370831-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/57731eba-e691-4ea3-b3b9-c9bd266f494e" status: 202 len: 0 microversion: 2.1 time: 0.887958 Oct 03 14:34:23.365743 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 220/423] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:34:22 2022] DELETE /compute/v2.1/os-security-groups/57731eba-e691-4ea3-b3b9-c9bd266f494e => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:23.372465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:23.373280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:23.386030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:23.386778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:23.387367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:23.388534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:23.389164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:23.389743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:23.396786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c4d25f5-316c-4e4a-9d6c-03fcc182faab tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=78dce6cc05804cc0b807cc6da75ec0aa" status: 200 len: 4825 microversion: 2.1 time: 0.537790 Oct 03 14:34:23.397606 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 204/424] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 14:34:22 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=78dce6cc05804cc0b807cc6da75ec0aa => generated 4825 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:23.404042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95eb729d-f2f3-495e-befe-ec6131e6e31d tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] Calling method '.version_select at 0x7fb230fea790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:23.880268 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95eb729d-f2f3-495e-befe-ec6131e6e31d tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/dfca6c69-3d1d-44f5-9455-c95bd4609223" status: 202 len: 0 microversion: 2.1 time: 0.481207 Oct 03 14:34:23.881168 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 205/425] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:34:23 2022] DELETE /compute/v2.1/os-security-groups/dfca6c69-3d1d-44f5-9455-c95bd4609223 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:23.892439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:23.908234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Searching by: {'tenant_id': 'caa5941ca7b14ac58033a698c0509c2e', 'deleted': False} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:23.918352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:23.920787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:23.925864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:23.927047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:23.927685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:23.928274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:23.993580 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b192c138-dbcb-4e5d-94d5-f33dffb9ea2e tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=caa5941ca7b14ac58033a698c0509c2e" status: 200 len: 15 microversion: 2.1 time: 0.106031 Oct 03 14:34:23.994510 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 206/426] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 14:34:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=caa5941ca7b14ac58033a698c0509c2e => generated 15 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:34:24.017944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:24.019178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:24.075198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.075697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.076128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.076845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.077354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.077806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.136872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:24.155321 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a916e73-6234-4998-b551-f26b36520f99 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1320 microversion: 2.1 time: 0.788108 Oct 03 14:34:24.162387 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 221/427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:23 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1320 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:24.184348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:24.185072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:24.207880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.208702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.209884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.219132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.219705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.220230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.372878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:24.395715 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4dffd42-29af-4e31-9d59-cebd22e83a0b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 0.399809 Oct 03 14:34:24.396917 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 207/428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:23 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:24.401843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-795e11d1-1742-40a2-81ce-d08c22db567a tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] Calling method '.version_select at 0x7fb23107cdc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:24.612174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:24.625072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:24.633565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:24.634793 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3465033-976e-4a6b-854f-662334c30eea tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.470437 Oct 03 14:34:24.638350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 222/429] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:24 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:24.644340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff072c6d-7a7f-4ecf-91e5-ed8a8ba611fd tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:24.650263 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff072c6d-7a7f-4ecf-91e5-ed8a8ba611fd tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010858 Oct 03 14:34:24.664962 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 223/430] 10.222.0.20 () {58 vars in 1189 bytes} [Mon Oct 3 14:34:24 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:34:24.671513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:24.674381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:24.696152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.697250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.697849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.698785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.699618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.700672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.735808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:34:24.802378 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-795e11d1-1742-40a2-81ce-d08c22db567a tempest-SecurityGroupsTestAdminJSON-1817455850 tempest-SecurityGroupsTestAdminJSON-1817455850-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/bee2a92e-f05a-430c-a383-78b430013a0e" status: 202 len: 0 microversion: 2.1 time: 0.404051 Oct 03 14:34:24.803366 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 208/431] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:34:24 2022] DELETE /compute/v2.1/os-security-groups/bee2a92e-f05a-430c-a383-78b430013a0e => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:24.808818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:24.811097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:24.826464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.827026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.827705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.828186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:24.828640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:24.831630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:24.888719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:25.073049 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80faf5fd-c352-45a6-b923-e79b30a69720 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action" status: 202 len: 0 microversion: 2.1 time: 0.267752 Oct 03 14:34:25.074878 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 209/432] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:34:24 2022] POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:25.086476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=5,nova_api:INSERT=7 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:25.096882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:25.097175 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36bfaf18-a47a-459a-bd8e-66f2c3e0090c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 204 len: 0 microversion: 2.1 time: 0.436992 Oct 03 14:34:25.108998 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 224/433] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:34:24 2022] DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:25.109576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:25.109576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:25.123118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.123609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.124092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.124832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.125314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.125780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.191035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:25.192282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:25.217256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.218929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.219535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.222099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.224326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.225448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.234617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:34:25.321897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6454c304-828e-4762-b570-50df946aba10 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.241348 Oct 03 14:34:25.335039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 210/434] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Oct 3 14:34:25 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:25.351819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:25.361360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:25.390144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.405339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.406800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.408353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.410113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.411050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.603948 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9bc228d0-045f-4e6c-b15f-942aa56f41c3 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action" status: 202 len: 0 microversion: 2.1 time: 0.267353 Oct 03 14:34:25.605312 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 211/435] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:34:25 2022] POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:25.613766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:25.614935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:25.637227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.640072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.642309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.643867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:25.644546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:25.645482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:25.670840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:25.684811 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d75bb86e-c975-4c16-b24e-41ef45323685 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1320 microversion: 2.1 time: 0.498237 Oct 03 14:34:25.686175 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 225/436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:25 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1320 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:34:25.699450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-627023816", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "1107244729", "adminPass": "***", "networks": [{"uuid": "5d8854a5-13f1-4626-abe1-8931b1eaa8eb"}], "security_groups": [{"name": "tempest-securitygroup--1653888081"}], "key_name": "tempest-keypair-3290191", "user_data": "}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:25.946513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] validate_networks() for [('5d8854a5-13f1-4626-abe1-8931b1eaa8eb', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:26.089812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:26.106575 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41cbe783-bee0-421d-bf10-770af566d217 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 0.498609 Oct 03 14:34:26.123977 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 212/437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:25 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:26.129364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:26.130327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:26.137026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:26.137990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:26.138630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:26.139569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:26.140247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:26.141217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:26.678455 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d4622e8-62e3-414f-a802-94b7b0bdb4a6 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1613 microversion: 2.1 time: 0.549734 Oct 03 14:34:26.683894 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 213/438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:26 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1613 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:26.692995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:26.694816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:26.708675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:26.709518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:26.710279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:26.712320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:26.713021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:26.713635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:26.996752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:27.013519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:27.016301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:27.018432 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7684829-a995-4212-b451-9a4de9d16eaa tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.332201 Oct 03 14:34:27.045316 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 214/439] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:26 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:27.052289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:27.053131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:27.063747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.065346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.065959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:27.067137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.067907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.070003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:27.274011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:27.277990 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cf030e1-0475-4fd2-a845-2cbdf4c796f0 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1613 microversion: 2.1 time: 0.230719 Oct 03 14:34:27.302025 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 215/440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:27 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1613 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:27.311851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:27.313657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:27.328754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:27.330882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.331533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.343595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:27.347533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.348217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.349379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:27.626323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:27.635200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75a7842d-bd25-4e44-985a-5db896f6fea7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1320 microversion: 2.1 time: 0.330182 Oct 03 14:34:27.651867 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 216/441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:27 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:27.658132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:27.659011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:27.668191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.668878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.669562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:27.670496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.671129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.671751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:27.897718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:27.913884 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40361093-8c88-40c3-baea-ad1abc1b66a4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 0.258881 Oct 03 14:34:27.914707 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 217/442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:27 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:27.934810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:27.944095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Searching by: {'host': 'n-h1-781139-2', 'deleted': False} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:27.952239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.952880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.953390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:27.954123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:27.954700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:27.955272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.122254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:34:28.199201 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c5bd66c-5615-490d-a963-75d955f8ff41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h1-781139-2&all_tenants=1" status: 200 len: 1322 microversion: 2.1 time: 0.283145 Oct 03 14:34:28.200423 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 218/443] 10.222.0.20 () {58 vars in 1190 bytes} [Mon Oct 3 14:34:27 2022] GET /compute/v2.1/servers?host=n-h1-781139-2&all_tenants=1 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:28.205242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-917b1d44-3cda-41f7-bd3d-ac3fb9a5a39a req-3335d603-71bf-4bee-a23b-25e759bcb8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dea759-c447-4eb0-ab8f-c7c95d850f04", "name": "network-vif-plugged", "status": "completed", "tag": "7130af64-c9fb-43c1-839e-275151e1b876"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:28.219742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-917b1d44-3cda-41f7-bd3d-ac3fb9a5a39a req-3335d603-71bf-4bee-a23b-25e759bcb8e3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.221399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-917b1d44-3cda-41f7-bd3d-ac3fb9a5a39a req-3335d603-71bf-4bee-a23b-25e759bcb8e3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.221833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-917b1d44-3cda-41f7-bd3d-ac3fb9a5a39a req-3335d603-71bf-4bee-a23b-25e759bcb8e3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.243268 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-917b1d44-3cda-41f7-bd3d-ac3fb9a5a39a req-3335d603-71bf-4bee-a23b-25e759bcb8e3 service nova] Creating event network-vif-plugged:7130af64-c9fb-43c1-839e-275151e1b876 for instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 on n-h1-781139-2 Oct 03 14:34:28.249181 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-917b1d44-3cda-41f7-bd3d-ac3fb9a5a39a req-3335d603-71bf-4bee-a23b-25e759bcb8e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047303 Oct 03 14:34:28.250367 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 219/444] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:28.255793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:28.257369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:28.264898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.265692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.266658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.267530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.268246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.268981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.460364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:28.462273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:28.462914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:28.463475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:28.464186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:28.486168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.486651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.491386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.492206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.492685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.493166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.527409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Getting quotas for project de6554f52fa546d5b7396f907f2f3e81. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:28.536802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Getting quotas for user 01fed2159b9c4c97aef7978920b4c959 and project de6554f52fa546d5b7396f907f2f3e81. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:28.552782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:28.556880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:28.673580 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49eb943b-9a56-4f14-981b-1282ba0aca40 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.985344 Oct 03 14:34:28.674926 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 226/445] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:34:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:34:28.683378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:28.693172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:34:28.701427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:28.725109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.726477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.727911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.729594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.730956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.731692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.732465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:28.743053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:28.744262 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f086bdfe-3035-4338-b4a0-bc3b11204bd8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.492653 Oct 03 14:34:28.744838 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 220/446] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:28 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:28.772021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:28.772664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:28.822563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.825267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.833233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:28.835147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:28.836627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:28.840141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:29.033313 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cde46681-c5b5-47d0-8ee5-bee3fbda3a41 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.356295 Oct 03 14:34:29.042902 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 227/447] 10.222.0.20 () {58 vars in 1196 bytes} [Mon Oct 3 14:34:28 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:34:29.051545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ecabdad-6256-4268-882e-fa6464b67892 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:29.056420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ecabdad-6256-4268-882e-fa6464b67892 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:29.215472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ecabdad-6256-4268-882e-fa6464b67892 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:29.245869 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ecabdad-6256-4268-882e-fa6464b67892 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1261 microversion: 2.1 time: 0.205571 Oct 03 14:34:29.267500 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 228/448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:29 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:29.285070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:29.286078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:29.306216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:29.306714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:29.307145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:29.308022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:29.308623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:29.309432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:29.393702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:29.405916 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cce69955-d53d-4c36-b860-67c5b6ea4d43 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1320 microversion: 2.1 time: 0.637595 Oct 03 14:34:29.427241 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 221/449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:28 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1320 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:29.442248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:29.449023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:29.457914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:29.458717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:29.459666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:29.460865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:29.461657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:29.462336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:29.586701 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75fc2478-b51e-4b49-8ce5-2d1904eb5bc4 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action" status: 202 len: 0 microversion: 2.1 time: 0.156628 Oct 03 14:34:29.588060 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 222/450] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:34:29 2022] POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:29.840593 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5340cc57-d627-4a74-b9b9-b95f2e142301 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.250855 Oct 03 14:34:29.842087 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 223/451] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 3 14:34:29 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 14:34:29.852682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:29.855800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:29.864327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:29.865496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:29.866230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:29.867319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:29.867966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:29.868560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:29.988738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:29.989429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:29.990070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:29.990658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:29.991342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:30.119349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:30.132237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.133009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.133589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.136298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.136913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.139528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.207035 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0c4cbb3-860e-4e79-b4bf-ec9cdeebc053 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action" status: 202 len: 1066 microversion: 2.1 time: 0.363614 Oct 03 14:34:30.207617 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 224/452] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:34:29 2022] POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action => generated 1066 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 14:34:30.220996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:30.222006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:30.230884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:30.233785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.240592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.241349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.242522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.243129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.243870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.258575 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-204bf9ba-ec50-4338-bcc6-f67d843e6dba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 0.983875 Oct 03 14:34:30.262715 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 229/453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:29 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:30.279302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de2d07c5-7aff-4896-87cc-ae45095a93d3 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Calling method '.version_select at 0x7fb230ee0670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:30.353617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-de2d07c5-7aff-4896-87cc-ae45095a93d3 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] HTTP exception thrown: Image not found. Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de2d07c5-7aff-4896-87cc-ae45095a93d3 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Request method failure captured: Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvL0pDYht3i8bxXW9WSImfSpLG6mNmSgqyP_AkYY4VDkb8cZ5ETkNCIJqRDEa2fqIvvYvkHvtCc77lzIn0oz26kmqfsZuMzxTIyDX-qHbw2PN7n9PZk5VRygKiay1Im1sAdWeBrVP6TsBbBCjgS0agoFBliqiFOINrqnm4RekhaOFdU Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:34:30.356213 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/004ac2a63347448fa227d2eebec29899"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_004ac2a63347448fa227d2eebec29899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c8179e65039845a4ad5a4d7652dfa934 Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: exception: Image not found. Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '-1'} Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:34:30.357762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.361911 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:34:30.363231 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de2d07c5-7aff-4896-87cc-ae45095a93d3 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Returning 404 to user: Image not found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de2d07c5-7aff-4896-87cc-ae45095a93d3 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.099966 Oct 03 14:34:30.369114 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 230/454] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 3 14:34:30 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:34:30.377053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:30.378788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:30.403379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.405642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.406176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.406973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.408631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.410783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.604145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:30.619703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:30.624191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:30.627289 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28678ea1-8ec9-48c4-8f08-87d8317c4116 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1569 microversion: 2.25 time: 0.416813 Oct 03 14:34:30.629348 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 225/455] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:30 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1569 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:30.646302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:30.649410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:30.660428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.667025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.667743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.669464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.669985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.670408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.819020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:30.831881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cce2021a-e8e1-48d0-aa1d-23c384a202ce tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1313 microversion: 2.1 time: 0.199444 Oct 03 14:34:30.837563 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 226/456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:30 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:30.854720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f1d973-4126-4840-b772-c40c5ccff5b8 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Calling method '.version_select at 0x7fb230d394c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:30.916798 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-66f1d973-4126-4840-b772-c40c5ccff5b8 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] HTTP exception thrown: Image not found. Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f1d973-4126-4840-b772-c40c5ccff5b8 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Request method failure captured: Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/9390b0aa-b591-4468-9470-345a793a91bj HTTP/1.1 Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvL0pDYht3i8bxXW9WSImfSpLG6mNmSgqyP_AkYY4VDkb8cZ5ETkNCIJqRDEa2fqIvvYvkHvtCc77lzIn0oz26kmqfsZuMzxTIyDX-qHbw2PN7n9PZk5VRygKiay1Im1sAdWeBrVP6TsBbBCjgS0agoFBliqiFOINrqnm4RekhaOFdU Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:34:30.922201 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/004ac2a63347448fa227d2eebec29899"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_004ac2a63347448fa227d2eebec29899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: c8179e65039845a4ad5a4d7652dfa934 Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '9390b0aa-b591-4468-9470-345a793a91bj'} Oct 03 14:34:30.923806 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9390b0aa-b591-4468-9470-345a793a91bj to delete Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:30.924692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9390b0aa-b591-4468-9470-345a793a91bj could not be found. Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:34:30.926015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:34:30.928056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:30.930712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f1d973-4126-4840-b772-c40c5ccff5b8 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:34:30.933758 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66f1d973-4126-4840-b772-c40c5ccff5b8 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] 10.222.0.20 "DELETE /compute/v2.1/images/9390b0aa-b591-4468-9470-345a793a91bj" status: 404 len: 62 microversion: 2.1 time: 0.092720 Oct 03 14:34:30.934478 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 227/457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:30 2022] DELETE /compute/v2.1/images/9390b0aa-b591-4468-9470-345a793a91bj => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:34:30.949771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:30.952659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:30.970987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.975275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.978722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:30.979700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:30.980330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:30.982331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:31.360240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:31.375008 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a897544c-a0b8-4a6b-8e4f-e1bee4fd40c4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1470 microversion: 2.1 time: 1.008954 Oct 03 14:34:31.376368 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 231/458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:30 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1470 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:31.409010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-cebcc568-82a4-44ef-86d8-0d46562888ee req-4f2636b5-2f87-4938-8c6b-aaafc03d501f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bbc8f0-e427-4021-bcc7-3d530f263eb8", "name": "network-vif-plugged", "status": "completed", "tag": "78fb81bf-61f4-46aa-acb3-a9f95766502a"}, {"server_uuid": "512b8784-a0b5-45a8-95d9-85d2faaf4e5f", "name": "network-vif-unplugged", "status": "completed", "tag": "3e232d83-b71c-4671-92c6-7ea1aeafc99f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:31.448232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cebcc568-82a4-44ef-86d8-0d46562888ee req-4f2636b5-2f87-4938-8c6b-aaafc03d501f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:31.453280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cebcc568-82a4-44ef-86d8-0d46562888ee req-4f2636b5-2f87-4938-8c6b-aaafc03d501f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:31.455112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cebcc568-82a4-44ef-86d8-0d46562888ee req-4f2636b5-2f87-4938-8c6b-aaafc03d501f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:31.493145 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-cebcc568-82a4-44ef-86d8-0d46562888ee req-4f2636b5-2f87-4938-8c6b-aaafc03d501f service nova] Creating event network-vif-plugged:78fb81bf-61f4-46aa-acb3-a9f95766502a for instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 on n-h2-781139-2 Oct 03 14:34:31.503793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:31.513283 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1cd9c708-d08b-4fb7-8382-5803f08363d7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1469 microversion: 2.1 time: 0.576632 Oct 03 14:34:31.513878 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:30 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1469 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:31.516328 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-cebcc568-82a4-44ef-86d8-0d46562888ee req-4f2636b5-2f87-4938-8c6b-aaafc03d501f service nova] Creating event network-vif-unplugged:3e232d83-b71c-4671-92c6-7ea1aeafc99f for instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f on n-h2-781139-2 Oct 03 14:34:31.532847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d78715b-185b-4b05-86a6-a0d2b3c821dd tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Calling method '.version_select at 0x7fb230d39af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:31.543326 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-cebcc568-82a4-44ef-86d8-0d46562888ee req-4f2636b5-2f87-4938-8c6b-aaafc03d501f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.164698 Oct 03 14:34:31.546188 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 232/460] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:31.561487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:31.562191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:31.587501 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0d78715b-185b-4b05-86a6-a0d2b3c821dd tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] HTTP exception thrown: Image not found. Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d78715b-185b-4b05-86a6-a0d2b3c821dd tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Request method failure captured: Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/c0e8e4cf-5ab6-4c02-850c-5933920f259e1 HTTP/1.1 Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvL0pDYht3i8bxXW9WSImfSpLG6mNmSgqyP_AkYY4VDkb8cZ5ETkNCIJqRDEa2fqIvvYvkHvtCc77lzIn0oz26kmqfsZuMzxTIyDX-qHbw2PN7n9PZk5VRygKiay1Im1sAdWeBrVP6TsBbBCjgS0agoFBliqiFOINrqnm4RekhaOFdU Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:34:31.590204 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/004ac2a63347448fa227d2eebec29899"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_004ac2a63347448fa227d2eebec29899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: c8179e65039845a4ad5a4d7652dfa934 Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c0e8e4cf-5ab6-4c02-850c-5933920f259e1'} Oct 03 14:34:31.591676 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c0e8e4cf-5ab6-4c02-850c-5933920f259e1 to delete Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:31.592402 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0e8e4cf-5ab6-4c02-850c-5933920f259e1 could not be found. Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:34:31.594232 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d78715b-185b-4b05-86a6-a0d2b3c821dd tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:34:31.595358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d78715b-185b-4b05-86a6-a0d2b3c821dd tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] 10.222.0.20 "DELETE /compute/v2.1/images/c0e8e4cf-5ab6-4c02-850c-5933920f259e1" status: 404 len: 62 microversion: 2.1 time: 0.077026 Oct 03 14:34:31.596190 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 229/461] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:34:31 2022] DELETE /compute/v2.1/images/c0e8e4cf-5ab6-4c02-850c-5933920f259e1 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:34:31.603688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:31.604174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:31.604609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:31.617164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:31.629490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:31.629845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ffdbeab0-a2ca-4715-b009-8093dd83ce63 req-505d5039-9dba-48e3-abb0-036fc72a74d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512b8784-a0b5-45a8-95d9-85d2faaf4e5f", "name": "network-vif-deleted", "tag": "3e232d83-b71c-4671-92c6-7ea1aeafc99f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:31.635647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:31.648974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ffdbeab0-a2ca-4715-b009-8093dd83ce63 req-505d5039-9dba-48e3-abb0-036fc72a74d8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:31.649907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ffdbeab0-a2ca-4715-b009-8093dd83ce63 req-505d5039-9dba-48e3-abb0-036fc72a74d8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:31.650885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ffdbeab0-a2ca-4715-b009-8093dd83ce63 req-505d5039-9dba-48e3-abb0-036fc72a74d8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:31.667813 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ffdbeab0-a2ca-4715-b009-8093dd83ce63 req-505d5039-9dba-48e3-abb0-036fc72a74d8 service nova] Creating event network-vif-deleted:3e232d83-b71c-4671-92c6-7ea1aeafc99f for instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f on n-h2-781139-2 Oct 03 14:34:31.676830 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ffdbeab0-a2ca-4715-b009-8093dd83ce63 req-505d5039-9dba-48e3-abb0-036fc72a74d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082689 Oct 03 14:34:31.678656 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 230/462] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:31.987963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:31.989499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:32.034030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:32.034978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:32.037805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:32.045567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:32.050188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:32.052509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:32.181868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:34:32.280324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:32.416234 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7248a4a8-25c9-4214-be48-f03d8f9d5ae3 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 204 len: 0 microversion: 2.1 time: 0.735795 Oct 03 14:34:32.420637 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 231/463] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:34:31 2022] DELETE /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:32.449554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e93cfa04-bf85-4e2b-8b4e-1da81ec71762 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Calling method '.version_select at 0x7fb230de4280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:32.488626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e93cfa04-bf85-4e2b-8b4e-1da81ec71762 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] HTTP exception thrown: Image not found. Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e93cfa04-bf85-4e2b-8b4e-1da81ec71762 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Request method failure captured: Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/tempest-invalid-1301480673 HTTP/1.1 Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvL0pDYht3i8bxXW9WSImfSpLG6mNmSgqyP_AkYY4VDkb8cZ5ETkNCIJqRDEa2fqIvvYvkHvtCc77lzIn0oz26kmqfsZuMzxTIyDX-qHbw2PN7n9PZk5VRygKiay1Im1sAdWeBrVP6TsBbBCjgS0agoFBliqiFOINrqnm4RekhaOFdU Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:34:32.491062 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/004ac2a63347448fa227d2eebec29899"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_004ac2a63347448fa227d2eebec29899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: c8179e65039845a4ad5a4d7652dfa934 Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'tempest-invalid-1301480673'} Oct 03 14:34:32.492478 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1301480673 to delete Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:32.493326 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1301480673 could not be found. Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:34:32.494471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:34:32.495582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:32.499254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e93cfa04-bf85-4e2b-8b4e-1da81ec71762 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:34:32.502922 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e93cfa04-bf85-4e2b-8b4e-1da81ec71762 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-1301480673" status: 404 len: 62 microversion: 2.1 time: 0.080869 Oct 03 14:34:32.503869 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 232/464] 10.222.0.20 () {58 vars in 1206 bytes} [Mon Oct 3 14:34:32 2022] DELETE /compute/v2.1/images/tempest-invalid-1301480673 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:34:32.509330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:32.516974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:32.528887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:32.529771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:32.530308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:32.531138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:32.531686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:32.532379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:32.836663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:32.851338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-20cdc14c-d5d6-48d6-9dbf-1704b835027d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 1.299941 Oct 03 14:34:32.851943 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 233/465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:31 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:32.866061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:32.866890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:32.887126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:32.887792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:32.888408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:32.889308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:32.889904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:32.890462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.011356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:33.026369 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e386f1c-fabc-443b-9901-b73ff7e98f4b tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1331 microversion: 2.1 time: 0.163992 Oct 03 14:34:33.029681 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 234/466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:32 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:33.036672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:33.037745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:33.047348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.048114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.048739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.049937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.050971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.051629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.091101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=74,nova_cell0:UPDATE=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:33.117916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:33.127444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:33.129257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:33.130452 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-803b06a5-dd68-4bcd-b77b-ea926a50811e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1559 microversion: 2.25 time: 0.625796 Oct 03 14:34:33.131008 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 233/467] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:32 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1559 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:33.137759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:33.139573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:33.146087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.146538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.146984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.147690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.148433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.149126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.337650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:33.351745 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b67e7e21-1164-4f35-a756-4ea64268bdb4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1470 microversion: 2.1 time: 0.319124 Oct 03 14:34:33.352352 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 235/468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:33 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:33.358037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15c9e47d-9877-4f03-beab-2bcaa7e209a4 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Calling method '.version_select at 0x7fb230dfe670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:33.390498 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-15c9e47d-9877-4f03-beab-2bcaa7e209a4 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] HTTP exception thrown: Image not found. Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15c9e47d-9877-4f03-beab-2bcaa7e209a4 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Request method failure captured: Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/images/0103c660-091d-45cd-aaf3-60c2f0ee72ce HTTP/1.1 Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvL0pDYht3i8bxXW9WSImfSpLG6mNmSgqyP_AkYY4VDkb8cZ5ETkNCIJqRDEa2fqIvvYvkHvtCc77lzIn0oz26kmqfsZuMzxTIyDX-qHbw2PN7n9PZk5VRygKiay1Im1sAdWeBrVP6TsBbBCjgS0agoFBliqiFOINrqnm4RekhaOFdU Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:34:33.393862 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/004ac2a63347448fa227d2eebec29899"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_004ac2a63347448fa227d2eebec29899", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/004ac2a63347448fa227d2eebec29899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 004ac2a63347448fa227d2eebec29899 Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-16689945 Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c8179e65039845a4ad5a4d7652dfa934 Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-16689945-project Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: exception: Image not found. Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '0103c660-091d-45cd-aaf3-60c2f0ee72ce'} Oct 03 14:34:33.395346 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0103c660-091d-45cd-aaf3-60c2f0ee72ce to delete Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:33.396490 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0103c660-091d-45cd-aaf3-60c2f0ee72ce could not be found. Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:34:33.398202 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15c9e47d-9877-4f03-beab-2bcaa7e209a4 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] Returning 404 to user: Image not found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:34:33.399528 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-15c9e47d-9877-4f03-beab-2bcaa7e209a4 tempest-ImagesDeleteNegativeTestJSON-16689945 tempest-ImagesDeleteNegativeTestJSON-16689945-project] 10.222.0.20 "DELETE /compute/v2.1/images/0103c660-091d-45cd-aaf3-60c2f0ee72ce" status: 404 len: 62 microversion: 2.1 time: 0.041081 Oct 03 14:34:33.400824 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 236/469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:33 2022] DELETE /compute/v2.1/images/0103c660-091d-45cd-aaf3-60c2f0ee72ce => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:34:33.401391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e4c3c450-90a2-47ac-b109-555ba01cdcb9 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '.version_select at 0x7fb230ded160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:33.406130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c3c450-90a2-47ac-b109-555ba01cdcb9 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.406757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c3c450-90a2-47ac-b109-555ba01cdcb9 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.407196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c3c450-90a2-47ac-b109-555ba01cdcb9 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.424034 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e4c3c450-90a2-47ac-b109-555ba01cdcb9 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.027034 Oct 03 14:34:33.425329 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 237/470] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 3 14:34:33 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:34:33.440600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:33.442332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:33.464599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.465431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.466421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.467927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.470291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.470911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.600753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:33.619208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5da8808b-627d-4d31-b053-233464e0788a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1475 microversion: 2.1 time: 0.484243 Oct 03 14:34:33.620714 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 234/471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:33 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1475 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:33.812717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid b0a85eea-3a6c-4b79-b702-6faef8ab910b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:33.846495 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37d9024d-26af-4866-b080-799d80b37369 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 2052 microversion: 2.25 time: 0.410142 Oct 03 14:34:33.849327 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 238/472] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:33 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 2052 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:34:33.880292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:33.881313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:33.895050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.895706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.900106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:33.905906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:33.905906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:33.906553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:34.053720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:34.055031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:34.067023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:34.073700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:34.074252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:34.075241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:34.077507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:34.078103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:34.205120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:34.231153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d2d4b36a-4565-4c9e-8272-671c1ea6ed02 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1319 microversion: 2.1 time: 0.182264 Oct 03 14:34:34.234409 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 239/473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:34 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:34:34.243530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1905954619", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "3bec1a14-e895-4900-8f12-af133bd5e217"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:34.358439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] validate_networks() for [('3bec1a14-e895-4900-8f12-af133bd5e217', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:34.418947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:34.434670 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55f5e88b-126a-4599-8b97-1fd190dfeff9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1311 microversion: 2.1 time: 0.559980 Oct 03 14:34:34.438301 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 235/474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:33 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1311 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:34.459317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:34.460280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:34.466946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:34.467681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:34.468295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:34.469274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:34.469880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:34.470454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:34.768673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:34.778426 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14e6b51c-dfec-4cc8-a6c9-9b1d0982075c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1470 microversion: 2.1 time: 0.327603 Oct 03 14:34:34.782363 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 236/475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:34 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1470 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:34.795505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:34.796530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:34.817758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:34.818735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:34.819577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:34.822872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:34.823451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:34.823960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:35.097545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:35.107211 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1da0932-9710-47fb-8d2c-310d2fc87de7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1475 microversion: 2.1 time: 0.322910 Oct 03 14:34:35.125049 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 237/476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:34 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1475 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:35.262642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:35.263783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:35.281205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:35.282448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:35.283048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:35.284122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:35.284730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:35.285343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:35.459885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:35.471815 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e5f756d-2265-43b7-bf1e-973c114e3b3d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1319 microversion: 2.1 time: 0.218486 Oct 03 14:34:35.472411 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 238/477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:35 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:34:35.496245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:35.496767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:35.515220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:35.516374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:35.521378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:35.522423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:35.523125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:35.523733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:36.029641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:36.046152 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-465b500d-11d6-4e0c-9c7b-b3c47f13ac55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1493 microversion: 2.1 time: 0.555133 Oct 03 14:34:36.046418 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 239/478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:35 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1493 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:36.050988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:36.051582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:36.063948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:36.064442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:36.064898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:36.069305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:36.069788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:36.070225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:36.436284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:36.438255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:36.439863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:36.440819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:36.447420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:36.449350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:36.482170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3adf21aa-5fd1-492f-b201-9a5a54dc10c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1470 microversion: 2.1 time: 0.434033 Oct 03 14:34:36.485486 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 240/479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:36 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1470 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:36.489304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:36.489924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:36.490364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:36.491162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:36.491751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:36.492184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:36.524430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:36.530790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for user 19b2b042d70a426989bb5dc6b986b7c5 and project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:36.549567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:36.552179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:36.613368 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2dc06ea4-097a-46c9-b691-d3791e97e183 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.377428 Oct 03 14:34:36.614112 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 240/480] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:34:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2379 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:34:36.630822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:36.635620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:36.650392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:36.651007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:36.651429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:36.653284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:36.653730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:36.655074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:36.982087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:36.983269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:36.986616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:37.007188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.008405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.010346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:37.012678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.016800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.018541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:37.018633 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-766bfcf6-9bf6-4ca7-ab7a-fd8f02488e42 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1433 microversion: 2.1 time: 0.403339 Oct 03 14:34:37.019241 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 241/481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:36 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1433 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:37.049213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:37.052051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:37.079887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.083552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.084722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:37.087042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.091238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.092014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:37.821296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:37.830923 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-190481b4-2001-425d-a815-005650e8ecd1 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.794224 Oct 03 14:34:37.853525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 242/482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:37 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:37.861849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:37.865495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:37.882453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.884119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.884747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:37.885676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.886456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.887139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:37.907198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a663254-b76d-4f19-aaba-9855a73387b8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1644 microversion: 2.1 time: 1.420707 Oct 03 14:34:37.929789 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 241/483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:36 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1644 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:37.941601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:37.948617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:37.964224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.968683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.969413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:37.970496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:37.971107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:37.973918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.020048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:38.031569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:38.033629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:38.034196 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ca0857a-2644-423b-aa7a-a8454b692e47 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1266 microversion: 2.25 time: 0.176344 Oct 03 14:34:38.034772 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 243/484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:37 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:38.036613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:38.048823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5d304a20-5691-447c-9230-26ec8d4e1916 req-b88d2ee4-80a0-4477-b4a7-80bb2d0d6f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dea759-c447-4eb0-ab8f-c7c95d850f04", "name": "network-vif-deleted", "tag": "7130af64-c9fb-43c1-839e-275151e1b876"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:38.079402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d304a20-5691-447c-9230-26ec8d4e1916 req-b88d2ee4-80a0-4477-b4a7-80bb2d0d6f7a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.079968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d304a20-5691-447c-9230-26ec8d4e1916 req-b88d2ee4-80a0-4477-b4a7-80bb2d0d6f7a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.080432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d304a20-5691-447c-9230-26ec8d4e1916 req-b88d2ee4-80a0-4477-b4a7-80bb2d0d6f7a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.124087 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5d304a20-5691-447c-9230-26ec8d4e1916 req-b88d2ee4-80a0-4477-b4a7-80bb2d0d6f7a service nova] Creating event network-vif-deleted:7130af64-c9fb-43c1-839e-275151e1b876 for instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 on n-h1-781139-2 Oct 03 14:34:38.131192 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5d304a20-5691-447c-9230-26ec8d4e1916 req-b88d2ee4-80a0-4477-b4a7-80bb2d0d6f7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094597 Oct 03 14:34:38.137318 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 244/485] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:38.143418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:38.144127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:38.172862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.173495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.174106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.177513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.182272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.183026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.362106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:38.374550 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8a5e396-51be-457b-9dc5-127600ea54c6 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1470 microversion: 2.1 time: 0.440339 Oct 03 14:34:38.393655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 242/486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:37 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1470 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:38.408845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:38.409634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:38.421191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.421702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.422134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.423936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.429816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.430405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.499274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.499777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.500352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.500743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lazy-loading 'fault' on Instance uuid 75dea759-c447-4eb0-ab8f-c7c95d850f04 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:38.600056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:38.612266 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4486f3c7-1928-48e2-a18d-460002b679b2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 200 len: 1310 microversion: 2.1 time: 0.217019 Oct 03 14:34:38.629505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 243/487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:38 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 1310 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:38.631949 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04f73388-48b1-4816-8117-1d70fe78e369 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1644 microversion: 2.1 time: 0.492912 Oct 03 14:34:38.637281 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 245/488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:38 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1644 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:38.664258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:38.670304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.671231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.671968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.674533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.675436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.677346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.733534 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4f03d3e-2f69-41aa-a1d4-1bbecf792cfb tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073471 Oct 03 14:34:38.744802 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 244/489] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:34:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:38.749496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-781139-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:38.753138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:38.763709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.764461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.765177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.766486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.767207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.767830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.839505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lazy-loading 'flavor' on Instance uuid 92bbc8f0-e427-4021-bcc7-3d530f263eb8 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:38.858936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Going to try to live migrate instance to n-h1-781139-2 {{(pid=128868) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:34:38.865917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:38.866183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:38.868190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:38.879310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.891056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.891831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:38.893855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:38.894531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:38.895214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:39.606637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:39.621754 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03b58813-5138-436f-967a-2a4979af6c93 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.760655 Oct 03 14:34:39.622987 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 245/490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:38 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:34:39.628449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:39.629416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:39.636604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:39.637436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:39.638092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:39.639033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:39.639719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:39.640377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:39.883098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:39.896199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:39.898570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:39.899785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db5b1a40-54ef-4088-8c99-3d4f67facc3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1320 microversion: 2.25 time: 0.275848 Oct 03 14:34:39.900908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 246/491] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:39 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:39.923289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:39.924214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:39.931113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:39.931828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:39.932892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:39.933979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:39.934641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:39.935270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:40.284139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:40.297676 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c3bc178-7166-4f27-bdb7-72dc1119c858 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1470 microversion: 2.1 time: 0.379343 Oct 03 14:34:40.299093 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 247/492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:39 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1470 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:40.304101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:40.305066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:40.317885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:40.318751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:40.319535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:40.320453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:40.321293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:40.321934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:40.337634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] HTTP exception thrown: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Request method failure captured: Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 HTTP/1.1 Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLiIemr1kyaRMkCSEEHCSkWxKwEGt4r3FFj4RHcVvRg5H49FhiTHVuNQU30L65SUOMZBBQsv1fyKIzmHutD2PENvfkjPjdHtxC0V1JiBkdvSHNh9TVxXVuwRpS_dIFS4ZcOHlG-A-CqI8D3HUaCUhU0SaR8BL8-H2pdkalvdRgJSeI Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:34:40.339550 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d139c47ffe4f3c96ca156f2b63703b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5e37b3a80e494c7787b3fbb417f89ccb Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:34:40.341204 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '75dea759-c447-4eb0-ab8f-c7c95d850f04'} Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:34:40.342061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:34:40.343441 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:34:40.344733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Returning 404 to user: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:34:40.344733 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-101011ce-99bf-4367-a1e6-9c692881de3f tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 404 len: 111 microversion: 2.1 time: 0.040736 Oct 03 14:34:40.350376 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 248/493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:40 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:34:40.411942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-08570f5c-da94-4fe3-82b5-d07e2a1ce35c req-a9830a1d-82af-45a1-a9ce-4b88062caa7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc34547e-726a-48d7-a87e-ac934587ff08", "tag": "e5b2dd85-e850-4a4d-9462-b0db8c7f6164"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:40.426712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08570f5c-da94-4fe3-82b5-d07e2a1ce35c req-a9830a1d-82af-45a1-a9ce-4b88062caa7a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:40.427749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08570f5c-da94-4fe3-82b5-d07e2a1ce35c req-a9830a1d-82af-45a1-a9ce-4b88062caa7a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:40.428274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-08570f5c-da94-4fe3-82b5-d07e2a1ce35c req-a9830a1d-82af-45a1-a9ce-4b88062caa7a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:40.455586 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-08570f5c-da94-4fe3-82b5-d07e2a1ce35c req-a9830a1d-82af-45a1-a9ce-4b88062caa7a service nova] Creating event network-changed:e5b2dd85-e850-4a4d-9462-b0db8c7f6164 for instance cc34547e-726a-48d7-a87e-ac934587ff08 on n-h1-781139-2 Oct 03 14:34:40.466454 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-08570f5c-da94-4fe3-82b5-d07e2a1ce35c req-a9830a1d-82af-45a1-a9ce-4b88062caa7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057853 Oct 03 14:34:40.471660 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 249/494] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:34:40.494774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1728224960", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:40.583492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:41.240545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:41.241268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:41.241539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:41.242117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:41.242691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:41.260548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.261336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.261920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:41.265096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.266317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.266889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:41.315381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Getting quotas for project 65d139c47ffe4f3c96ca156f2b63703b. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:41.331517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Getting quotas for user 5e37b3a80e494c7787b3fbb417f89ccb and project 65d139c47ffe4f3c96ca156f2b63703b. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:41.352548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f42ec083-2204-4a4f-9a8b-7a5cf2310ee6 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8/action" status: 202 len: 0 microversion: 2.1 time: 2.607476 Oct 03 14:34:41.360321 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 246/495] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:34:38 2022] POST /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8/action => generated 0 bytes in 2616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:34:41.365807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:41.367296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:41.369300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:41.376277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:41.412287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.414809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.415433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:41.417315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.418777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.419625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:41.540948 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-744390f7-869f-4a8d-b190-6d09558c02a7 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050574 Oct 03 14:34:41.566370 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 250/496] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:34:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:34:41.580002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:41.580646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:41.599466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.600527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.601153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:41.602050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.602654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.603232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:41.619430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:41.748608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:41.762968 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c55cf411-2557-43ce-b938-3cffd4d85225 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.401129 Oct 03 14:34:41.764460 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 247/497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:41 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:41.770395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:41.771334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:41.784487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.786542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.787319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:41.790526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:41.791249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:41.793550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:42.114861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:42.124076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:42.125566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:42.131370 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51019bfe-7f39-47a3-9715-9c7b0ddb17ab tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1362 microversion: 2.25 time: 0.563494 Oct 03 14:34:42.149749 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 251/498] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:41 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1362 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:42.155204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:42.155847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:42.178766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:42.179277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:42.179713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:42.180424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:42.180876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:42.181327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:42.479826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:42.493516 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0c234bc-762e-4a9d-a54b-7de93ed7e07b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.342377 Oct 03 14:34:42.509286 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 252/499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:42 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:42.552715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:42.574498 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05503f6d-18d9-4465-908a-cec9fe6f40a0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1470 microversion: 2.1 time: 0.802316 Oct 03 14:34:42.578254 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 248/500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:41 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1470 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:42.607719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:42.608469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:42.640532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:42.645085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:42.645866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:42.646637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:42.647115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:42.647714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:42.962695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01fbc6ec-c320-4560-aa31-6e5598585e11 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Action: 'create', calling method: .version_select at 0x7fb230c503a0>, body: {"keypair": {"name": "tempest-keypair-345637909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6Ccn05h9CPno/fzEI5VjIXl8bCNCbcZlrMl8qmWNphafSKAAnft1HlwyG+ATBbstscSedCZCBlXCRKevqRQNBNAsRT7eYwiDg15TqHvaj+Ae1hT8EUnHuPuvla/ilYBw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:42.982275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-01fbc6ec-c320-4560-aa31-6e5598585e11 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Getting quotas for project ef8c0030da91477dad8a2c2354f7703d. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:42.989047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-01fbc6ec-c320-4560-aa31-6e5598585e11 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Getting quotas for user 74fbc9e372994766b6a3979dd355c881 and project ef8c0030da91477dad8a2c2354f7703d. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:42.994087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:43.071988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01fbc6ec-c320-4560-aa31-6e5598585e11 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.559949 Oct 03 14:34:43.073327 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 253/501] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:34:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:43.086276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:43.089290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:43.103547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:43.104050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:43.104492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:43.105241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:43.105698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:43.106126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:43.182128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:43.204735 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4a7dc40-7e59-40be-9fbf-f12e512d9546 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1216 microversion: 2.1 time: 0.623299 Oct 03 14:34:43.208303 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 249/502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:42 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1216 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:43.220647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:43.227734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:43.241593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:43.246743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:43.247272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:43.248027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:43.248492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:43.249561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:43.678833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:43.695785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15062d53-4478-4184-bd19-b9b097d55f19 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.619429 Oct 03 14:34:43.696403 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 254/503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:43 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:43.710380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:43.714636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:43.733106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:43.734299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:43.735826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:43.736782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:43.738271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:43.738871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:44.083905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:44.109776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:44.112882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:44.116626 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de40d283-9bf9-40d0-b231-8849b24e3383 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1362 microversion: 2.25 time: 0.904976 Oct 03 14:34:44.129294 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 250/504] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:43 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1362 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:44.152374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-765e49ba-230b-489f-9672-e8d651549f24 req-5ffedb2d-8857-4c0c-875c-c56baab9bcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "660e7ae4-72b0-4c44-8ece-82014c070066", "tag": "81a132de-4f8c-4bc6-b575-447721adc30c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:44.166326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-765e49ba-230b-489f-9672-e8d651549f24 req-5ffedb2d-8857-4c0c-875c-c56baab9bcf4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:44.167078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-765e49ba-230b-489f-9672-e8d651549f24 req-5ffedb2d-8857-4c0c-875c-c56baab9bcf4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:44.167651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-765e49ba-230b-489f-9672-e8d651549f24 req-5ffedb2d-8857-4c0c-875c-c56baab9bcf4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:44.190355 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-765e49ba-230b-489f-9672-e8d651549f24 req-5ffedb2d-8857-4c0c-875c-c56baab9bcf4 service nova] Creating event network-changed:81a132de-4f8c-4bc6-b575-447721adc30c for instance 660e7ae4-72b0-4c44-8ece-82014c070066 on n-h2-781139-2 Oct 03 14:34:44.196685 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-765e49ba-230b-489f-9672-e8d651549f24 req-5ffedb2d-8857-4c0c-875c-c56baab9bcf4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069457 Oct 03 14:34:44.197334 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 251/505] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:44.208043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:44.209584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:44.227899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:44.228408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:44.228846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:44.229601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:44.236438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:44.237074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:44.441719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:44.460185 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ad4f892-3a38-4800-914a-5b50535a0509 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.761506 Oct 03 14:34:44.460474 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 255/506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:43 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:44.483360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:44.483502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:44.495774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:44.498327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:44.499065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:44.499984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:44.501691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:44.502879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:44.560004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:44.577009 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-979078a7-f4e3-4f9e-b9d6-5d119ecfe665 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1476 microversion: 2.1 time: 0.378224 Oct 03 14:34:44.577609 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 252/507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:44 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:44.629416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:44.638572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1fe2f02-e7d9-4c5d-a924-bb79a1263021 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1278 microversion: 2.1 time: 0.176768 Oct 03 14:34:44.643143 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 256/508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:44 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:44.723829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:44.724449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:44.731217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:44.731702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:44.732128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:44.732821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:44.741282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:44.741760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:45.146311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:45.146962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:45.156940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:45.172674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:45.173553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:45.174257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:45.175162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:45.175948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:45.176534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:45.177927 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b15f3e6e-95df-4789-a169-380a319c0630 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.453692 Oct 03 14:34:45.179104 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 253/509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:44 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:45.305541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-283c6e21-e607-4bb9-86d6-67d9dad49a61 req-d3298c79-5721-4ee1-b9e0-efe53bb7cc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc3a975-8b74-4921-9106-0160c9bcc3bf", "name": "network-vif-unplugged", "status": "completed", "tag": "3114f95d-0543-4f63-a146-ecadff0a8ba9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:45.330584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-283c6e21-e607-4bb9-86d6-67d9dad49a61 req-d3298c79-5721-4ee1-b9e0-efe53bb7cc93 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:45.331182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-283c6e21-e607-4bb9-86d6-67d9dad49a61 req-d3298c79-5721-4ee1-b9e0-efe53bb7cc93 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:45.331822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-283c6e21-e607-4bb9-86d6-67d9dad49a61 req-d3298c79-5721-4ee1-b9e0-efe53bb7cc93 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:45.359596 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-283c6e21-e607-4bb9-86d6-67d9dad49a61 req-d3298c79-5721-4ee1-b9e0-efe53bb7cc93 service nova] Creating event network-vif-unplugged:3114f95d-0543-4f63-a146-ecadff0a8ba9 for instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf on n-h1-781139-2 Oct 03 14:34:45.369997 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-283c6e21-e607-4bb9-86d6-67d9dad49a61 req-d3298c79-5721-4ee1-b9e0-efe53bb7cc93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069458 Oct 03 14:34:45.373324 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 254/510] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:34:45.486465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:45.487399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:45.499146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:45.501378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:45.502627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:45.504287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:45.505577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:45.507568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:45.726838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:45.756804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:45.760618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:45.761865 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09c04b26-a3da-4043-ab9e-a7fb9861b18c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1362 microversion: 2.25 time: 0.622520 Oct 03 14:34:45.764957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 257/511] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:45 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1362 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:45.773132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:45.784980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:45.796083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:45.796613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:45.799205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:45.799959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:45.800467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:45.800897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:46.179038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:46.187212 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d3b2d6c-fcf6-43cf-b55f-c10d8196ff07 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1476 microversion: 2.1 time: 0.421167 Oct 03 14:34:46.188031 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 258/512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:45 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1476 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:46.210065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:46.211514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:46.212617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:46.219649 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5abd0522-ef98-4793-ab31-d90710a7e0d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.737518 Oct 03 14:34:46.225596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:46.226341 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 255/513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:45 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:34:46.229895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:46.230535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:46.231427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:46.233579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:46.234173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:46.248181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:46.248795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:46.255998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:46.256566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:46.257122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:46.257986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:46.258436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:46.258856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:46.517893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=14 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:46.544687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=32 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:46.586715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:46.595379 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9373298-32cb-488e-8cb2-ec03d856dcfc tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.391486 Oct 03 14:34:46.596048 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 259/514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:46 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:46.727959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:46.742028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-99544496", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:46.747158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3eb8157-5e94-41b5-bd55-02fc4c5a15be tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.504191 Oct 03 14:34:46.748607 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 256/515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:46 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:46.796139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:46.799102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:46.803876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:46.807605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:46.809342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:46.809792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:46.810876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:46.811347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:46.812636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.433815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:47.446238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:47.448058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:47.449491 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce768380-2e07-4d7e-be5a-97dcead93911 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1362 microversion: 2.25 time: 0.662776 Oct 03 14:34:47.450680 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 257/516] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:46 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:34:47.455990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:47.456601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:47.468468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.469210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.469785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.471708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.472161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.472777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.521007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:47.521559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:47.521957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:47.522529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:47.523086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:47.534178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.546812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.547680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.549801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.552673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.553161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.571135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Getting quotas for project 1bd1040ed429433ab0b563f842e05ef2. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:47.576535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Getting quotas for user 41de1ec36c284e418fca1bfcede0d595 and project 1bd1040ed429433ab0b563f842e05ef2. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:47.591166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:47.593786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:47.654590 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7d9e7d4-2028-4089-b1c4-586b3e1fa9fd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055400 Oct 03 14:34:47.655888 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 260/517] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:34:47.662807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:47.664021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:47.673049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.674862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.675484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.676457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.677126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.677963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.840884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:47.856169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d14753f4-c860-49e5-9c3e-cef9f325fc25 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1476 microversion: 2.1 time: 0.404232 Oct 03 14:34:47.872979 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 258/518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:47 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:47.880471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:47.884387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:47.916259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:47.921786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.926151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.926644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.928845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:47.934452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:47.934970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:47.976792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:47.986000 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4be13a5e-5d70-43de-9db1-d10513bf4436 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.328893 Oct 03 14:34:47.987151 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 261/519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:47 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:48.005539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3ee0ec9-d828-41c6-8409-83f36d930389 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:48.007425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3ee0ec9-d828-41c6-8409-83f36d930389 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:48.082446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3ee0ec9-d828-41c6-8409-83f36d930389 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:48.099492 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3ee0ec9-d828-41c6-8409-83f36d930389 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1217 microversion: 2.1 time: 0.110406 Oct 03 14:34:48.100955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 262/520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:47 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:48.106548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:48.118121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:48.129082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:48.129633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:48.130173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:48.131020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:48.131721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:48.132293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:48.310581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:48.328159 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fb880e7-4c19-41cc-8ae7-c5ce90ab181c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.225428 Oct 03 14:34:48.348308 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 263/521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:48 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:48.353123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:48.363063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2119365587", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6bbdc7d9-0f06-4025-a020-ba370ef2e111"}], "security_groups": [{"name": "tempest-securitygroup--231628103"}], "key_name": "tempest-keypair-345637909", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:48.366576 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-78e9031d-3136-435a-b42c-118952724666 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.492069 Oct 03 14:34:48.369986 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 259/522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:47 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:48.480011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:48.483000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:48.497626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:48.498243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:48.498758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:48.500668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:48.501204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:48.501637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:48.648752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] validate_networks() for [('6bbdc7d9-0f06-4025-a020-ba370ef2e111', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:48.709663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:48.730861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:48.735999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:48.738356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-30783d4c-e6cb-409c-80a1-8cf8e366cebf tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1362 microversion: 2.25 time: 0.262539 Oct 03 14:34:48.749444 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 260/523] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:48 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:34:48.762830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-826832db-addb-4354-8fba-589e8a4e5c50 req-5da03daf-5844-4617-8587-ea01b375e1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2153bd-a784-4eb8-98ea-65c6cbe6dca2", "tag": "a2b4ed4a-96d7-4430-9b8d-493124034929"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:48.773948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-826832db-addb-4354-8fba-589e8a4e5c50 req-5da03daf-5844-4617-8587-ea01b375e1b5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:48.775191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-826832db-addb-4354-8fba-589e8a4e5c50 req-5da03daf-5844-4617-8587-ea01b375e1b5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:48.775785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-826832db-addb-4354-8fba-589e8a4e5c50 req-5da03daf-5844-4617-8587-ea01b375e1b5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:48.790846 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-826832db-addb-4354-8fba-589e8a4e5c50 req-5da03daf-5844-4617-8587-ea01b375e1b5 service nova] Creating event network-changed:a2b4ed4a-96d7-4430-9b8d-493124034929 for instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 on n-h2-781139-2 Oct 03 14:34:48.797233 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-826832db-addb-4354-8fba-589e8a4e5c50 req-5da03daf-5844-4617-8587-ea01b375e1b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045992 Oct 03 14:34:48.798722 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 261/524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:48.882428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:48.903133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:48.914793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:48.915444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:48.915963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:48.916898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:48.917646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:48.918352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.189604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:49.202602 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74b1f406-1341-40ef-8ed0-e8a6f6d1b836 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1476 microversion: 2.1 time: 0.326389 Oct 03 14:34:49.213611 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 262/525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:48 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:49.213611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:49.213770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:49.231072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.232485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.233241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.236100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.237145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.237593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.586138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:49.590272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:49.610684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b1b0d1f1-5a31-4ed7-bbf0-6381b36bcc60 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.404279 Oct 03 14:34:49.612154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Getting quotas for project ef8c0030da91477dad8a2c2354f7703d. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:49.624473 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 263/526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:49 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:49.629855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:49.633739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Getting quotas for user 74fbc9e372994766b6a3979dd355c881 and project ef8c0030da91477dad8a2c2354f7703d. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:49.643360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:49.660158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.663642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.664374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.666495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.668236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.679134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.699060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:49.700677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:49.702556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:49.704679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:49.705315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:49.731785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.732580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.733258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.735096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.735896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.738763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.799222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Getting quotas for project ef8c0030da91477dad8a2c2354f7703d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:49.812605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Getting quotas for user 74fbc9e372994766b6a3979dd355c881 and project ef8c0030da91477dad8a2c2354f7703d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:49.849070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:49.851850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:49.927388 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c16cf14-59d7-4d44-86e2-0238812fcbd8 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.576127 Oct 03 14:34:49.939832 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 264/527] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:34:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:34:49.951323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:49.968260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:49.972317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:49.978440 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ad21d52a-5ced-49c6-8474-8844721a3ae9 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1277 microversion: 2.1 time: 0.352484 Oct 03 14:34:49.984097 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 264/528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:49 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1277 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:49.990139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.991120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.991652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:49.992460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:49.993257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:49.993783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:50.015184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:50.016303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:50.028856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:50.029535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:50.030083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:50.033699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:50.034272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:50.035202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:50.434963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:50.448113 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70b568e4-8808-4dcf-961b-b462e9d79746 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.459442 Oct 03 14:34:50.448777 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 265/529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:49 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:50.453633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-8f9b8ed8-331f-46b7-8115-98e2b7df2617 req-6ad301ca-c757-4201-99d4-48463ae72a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc34547e-726a-48d7-a87e-ac934587ff08", "name": "network-vif-plugged", "status": "completed", "tag": "e5b2dd85-e850-4a4d-9462-b0db8c7f6164"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:50.473091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f9b8ed8-331f-46b7-8115-98e2b7df2617 req-6ad301ca-c757-4201-99d4-48463ae72a32 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:50.473824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f9b8ed8-331f-46b7-8115-98e2b7df2617 req-6ad301ca-c757-4201-99d4-48463ae72a32 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:50.474967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f9b8ed8-331f-46b7-8115-98e2b7df2617 req-6ad301ca-c757-4201-99d4-48463ae72a32 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:50.492560 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-8f9b8ed8-331f-46b7-8115-98e2b7df2617 req-6ad301ca-c757-4201-99d4-48463ae72a32 service nova] Creating event network-vif-plugged:e5b2dd85-e850-4a4d-9462-b0db8c7f6164 for instance cc34547e-726a-48d7-a87e-ac934587ff08 on n-h1-781139-2 Oct 03 14:34:50.498987 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-8f9b8ed8-331f-46b7-8115-98e2b7df2617 req-6ad301ca-c757-4201-99d4-48463ae72a32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048585 Oct 03 14:34:50.499736 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 266/530] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:50.508908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:50.509978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:50.517322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:50.538932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:50.539908 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5054dfc8-bbe7-4949-8500-18cd678e92a9 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.594743 Oct 03 14:34:50.541247 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 265/531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:49 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:50.541389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:50.542245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:50.543885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:50.545745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:50.546416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:50.558407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e81048d-3def-4ad4-a7b0-d35f7e59008d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:50.559235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e81048d-3def-4ad4-a7b0-d35f7e59008d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:50.757741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e81048d-3def-4ad4-a7b0-d35f7e59008d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:50.769700 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e81048d-3def-4ad4-a7b0-d35f7e59008d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1269 microversion: 2.1 time: 0.226583 Oct 03 14:34:50.770320 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 266/532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:50 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1269 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:50.803513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:50.806187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:50.828942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:50.829755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:50.831610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:50.832551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:50.834787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:50.837170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:51.680173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:51.695484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:51.700163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:51.705245 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-235247b4-5cd6-41d1-a54a-c0d9f5f22cd3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1362 microversion: 2.25 time: 1.203334 Oct 03 14:34:51.707719 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 267/533] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:50 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1362 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:51.719951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:51.721654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:51.736994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:51.737507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:51.737960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:51.742107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:51.742650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:51.743049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:51.821475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:51.833349 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de7a2fa6-e7f9-490c-8f9f-6b4fcdbaff1e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1476 microversion: 2.1 time: 1.060663 Oct 03 14:34:51.834430 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 267/534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:50 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1476 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:51.842321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:51.843116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:51.863759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:51.864217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:51.864857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:51.866013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:51.866973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:51.867804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.086092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.099887 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20762d22-b2f5-4a82-8036-254230a5995e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1275 microversion: 2.1 time: 0.263415 Oct 03 14:34:52.100839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 268/535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:51 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:52.117625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:52.118248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:52.126849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.127344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.127792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.130808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.131565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.133038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.143453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.152804 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fca30d29-b7bb-425f-9d3d-f71979c68c3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.440008 Oct 03 14:34:52.155846 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 268/536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:51 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:52.163057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:52.166260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:52.182354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.183838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.189707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.190470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.190946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.191378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.417392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.428089 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f18d077-a129-4da4-8522-8a2186d48964 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1387 microversion: 2.1 time: 0.270564 Oct 03 14:34:52.428991 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 269/537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:52 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1387 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:52.434175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:52.434885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:52.441356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.442016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.442729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.443840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.444495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.445130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.547601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.557035 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a94c207-c133-417b-9113-359915d46790 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.454736 Oct 03 14:34:52.559944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.560706 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 269/538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:52 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:52.567971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-659bc740-480b-4c8c-9170-e604bef66173 req-6b682650-e11f-4021-b983-4d4184e6b479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660e7ae4-72b0-4c44-8ece-82014c070066", "name": "network-vif-plugged", "status": "completed", "tag": "81a132de-4f8c-4bc6-b575-447721adc30c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:52.579315 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43a2a990-7891-4a32-81b5-910c7cff3f4b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1321 microversion: 2.1 time: 0.149234 Oct 03 14:34:52.583441 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 270/539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:52 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:52.587535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-659bc740-480b-4c8c-9170-e604bef66173 req-6b682650-e11f-4021-b983-4d4184e6b479 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.588752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-659bc740-480b-4c8c-9170-e604bef66173 req-6b682650-e11f-4021-b983-4d4184e6b479 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.589425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-659bc740-480b-4c8c-9170-e604bef66173 req-6b682650-e11f-4021-b983-4d4184e6b479 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.604890 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-659bc740-480b-4c8c-9170-e604bef66173 req-6b682650-e11f-4021-b983-4d4184e6b479 service nova] Creating event network-vif-plugged:81a132de-4f8c-4bc6-b575-447721adc30c for instance 660e7ae4-72b0-4c44-8ece-82014c070066 on n-h2-781139-2 Oct 03 14:34:52.612487 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-659bc740-480b-4c8c-9170-e604bef66173 req-6b682650-e11f-4021-b983-4d4184e6b479 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050595 Oct 03 14:34:52.613214 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 270/540] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:52.737779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:52.738813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:52.747477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.748190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.748980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.750111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.750664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.751374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.865100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:52.867394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:52.881537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.883821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.885720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.887409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:52.888534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:52.889504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:52.979996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.988769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.991571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:52.992738 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43b8891e-0a05-4e78-a4aa-267b376f1d13 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1362 microversion: 2.25 time: 0.259022 Oct 03 14:34:52.993694 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 271/541] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:52 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:34:53.060796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-38fd21be-cadf-4538-80f6-959c87d06eb4 req-e1c8dbd4-36a1-448e-af02-9a46b1b6fcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bbc8f0-e427-4021-bcc7-3d530f263eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "78fb81bf-61f4-46aa-acb3-a9f95766502a"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:53.074638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-38fd21be-cadf-4538-80f6-959c87d06eb4 req-e1c8dbd4-36a1-448e-af02-9a46b1b6fcc4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.075371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-38fd21be-cadf-4538-80f6-959c87d06eb4 req-e1c8dbd4-36a1-448e-af02-9a46b1b6fcc4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.075968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-38fd21be-cadf-4538-80f6-959c87d06eb4 req-e1c8dbd4-36a1-448e-af02-9a46b1b6fcc4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.099734 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-38fd21be-cadf-4538-80f6-959c87d06eb4 req-e1c8dbd4-36a1-448e-af02-9a46b1b6fcc4 service nova] Creating event network-vif-unplugged:78fb81bf-61f4-46aa-acb3-a9f95766502a for instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 on n-h2-781139-2 Oct 03 14:34:53.113591 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-38fd21be-cadf-4538-80f6-959c87d06eb4 req-e1c8dbd4-36a1-448e-af02-9a46b1b6fcc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055732 Oct 03 14:34:53.116831 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 272/542] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:34:53.131272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:53.132335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:53.144471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.145456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.146949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.148463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.149249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.150062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.365460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:53.373486 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a6c8e3c-6415-4891-84cb-d539ec0d0397 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1462 microversion: 2.1 time: 0.518679 Oct 03 14:34:53.374079 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 271/543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:52 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1462 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:53.378945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:53.390224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:53.403015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.413805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.414260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.415020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.419746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.420196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.603277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:53.615133 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd6ae4f2-5595-46d8-8650-6815b7a32e95 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1317 microversion: 2.1 time: 0.491911 Oct 03 14:34:53.629079 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 273/544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:53 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:34:53.634431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:53.635235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:53.642362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.643426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.643965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.644773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.645372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.646079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.815160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:53.818837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:53.826192 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a62fa16-34fb-406b-b5fa-cc0a2c46c7f8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.450895 Oct 03 14:34:53.836899 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 272/545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:53 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:53.848867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:53.863589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:53.873246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.885147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.887187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.889791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.893176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.893803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.925789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:53.937307 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d22ef49a-5a3a-43c4-b733-ca32785e1b0f tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1462 microversion: 2.1 time: 0.317484 Oct 03 14:34:53.955850 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 274/546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:53 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1462 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:53.972392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:53.976408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:53.986044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.986836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.987421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:53.988355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:53.990033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:53.992138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.255074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:54.268836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e7fb758-0585-4f3b-9f04-2515edf804ae tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.311405 Oct 03 14:34:54.272986 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 275/547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:53 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:54.285191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:54.288506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:54.307014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.308916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.309851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.311946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.312597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.314118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.426324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:54.439295 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c43ea7cf-e666-43fe-bac5-bfd0e0f09f84 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1329 microversion: 2.1 time: 0.164209 Oct 03 14:34:54.441256 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 276/548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:54 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1329 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:54.449612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:54.452455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:54.473741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.474268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.475693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.479493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.479894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.480613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.556770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:54.570369 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c5ac167-3a84-4ffa-b778-8515de39716c tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1585 microversion: 2.1 time: 0.727402 Oct 03 14:34:54.576287 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 273/549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:53 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1585 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:54.581780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:54.582618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:54.590084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.590822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.591446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.592518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.593173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.593824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.618409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:54.618928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:54.620040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:54.620515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:54.621073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:54.724069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:54.734726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.736689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.737339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.738178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:54.739414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:54.739570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:54.822462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de2d86b8-8a4b-4700-a420-e484142f691d tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action" status: 202 len: 1066 microversion: 2.1 time: 0.377020 Oct 03 14:34:54.836981 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 277/550] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:34:54 2022] POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action => generated 1066 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 14:34:54.931996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1030654016", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c9d9ff27-356e-417a-acdf-f6fd563a5575"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:54.968723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:54.982411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:54.985011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:54.989354 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a81b3a9-c675-4a14-8627-10068bcde029 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1559 microversion: 2.25 time: 0.411694 Oct 03 14:34:54.992057 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 274/551] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:54 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1559 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:54.997267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:55.000463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:55.011500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:55.012372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:55.012979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:55.013835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:55.014539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:55.018684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:55.052735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] validate_networks() for [('c9d9ff27-356e-417a-acdf-f6fd563a5575', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:34:55.285407 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e768f1f-032a-44b6-8af3-aaa128ff64d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291520 Oct 03 14:34:55.286275 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 275/552] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:34:54 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:55.297109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:55.299861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:55.329384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:55.329887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:55.330308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:55.336910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:55.337530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:55.337960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:55.647942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:55.660596 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d1de02c-2dc6-431a-a921-1d28a0a4587c tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1317 microversion: 2.1 time: 0.372868 Oct 03 14:34:55.663535 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 276/553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:55 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:55.670648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-82307a59-e460-4c9a-a1f3-5a4fc7a52834 req-efbc9e21-d960-47fb-8f4b-838eefe9e530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc3a975-8b74-4921-9106-0160c9bcc3bf", "name": "network-vif-plugged", "status": "completed", "tag": "3114f95d-0543-4f63-a146-ecadff0a8ba9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:55.693042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82307a59-e460-4c9a-a1f3-5a4fc7a52834 req-efbc9e21-d960-47fb-8f4b-838eefe9e530 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:55.696467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82307a59-e460-4c9a-a1f3-5a4fc7a52834 req-efbc9e21-d960-47fb-8f4b-838eefe9e530 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:55.698434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-82307a59-e460-4c9a-a1f3-5a4fc7a52834 req-efbc9e21-d960-47fb-8f4b-838eefe9e530 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:55.727557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-82307a59-e460-4c9a-a1f3-5a4fc7a52834 req-efbc9e21-d960-47fb-8f4b-838eefe9e530 service nova] Creating event network-vif-plugged:3114f95d-0543-4f63-a146-ecadff0a8ba9 for instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf on n-h1-781139-2 Oct 03 14:34:55.738993 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-82307a59-e460-4c9a-a1f3-5a4fc7a52834 req-efbc9e21-d960-47fb-8f4b-838eefe9e530 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072098 Oct 03 14:34:55.739743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 277/554] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:55.752339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:55.755283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:55.768435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:55.769838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:55.774108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:55.775123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:55.775682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:55.776186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.057505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:56.067215 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb7dd773-94c5-45c6-8081-6a28c72fc055 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.325149 Oct 03 14:34:56.081549 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 278/555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:55 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:56.090400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:56.091163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:56.097860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.098487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.098936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.099660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.100118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.100537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.251093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:56.259788 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8496a245-ba50-45bc-a400-58c4005ff86a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.176756 Oct 03 14:34:56.260400 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 279/556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:56 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:56.264780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:56.265925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:56.269227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:56.273157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.273855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.274476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.275509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.276107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.276678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.473385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid 660e7ae4-72b0-4c44-8ece-82014c070066 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:56.494421 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a31e206-f28e-4fb9-9ce5-510b75521d1a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 2052 microversion: 2.25 time: 0.232750 Oct 03 14:34:56.495289 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 280/557] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:56 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 2052 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:56.510170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6ca46d8d-55da-44a0-9b28-70c5491298f8 req-20bfc052-640e-4cea-8e6f-f66b9dd8afea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8", "tag": "1baf58e4-20c8-4388-9943-c8b753eb469b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:56.526087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6ca46d8d-55da-44a0-9b28-70c5491298f8 req-20bfc052-640e-4cea-8e6f-f66b9dd8afea service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.526570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6ca46d8d-55da-44a0-9b28-70c5491298f8 req-20bfc052-640e-4cea-8e6f-f66b9dd8afea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.526997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6ca46d8d-55da-44a0-9b28-70c5491298f8 req-20bfc052-640e-4cea-8e6f-f66b9dd8afea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.543884 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6ca46d8d-55da-44a0-9b28-70c5491298f8 req-20bfc052-640e-4cea-8e6f-f66b9dd8afea service nova] Creating event network-changed:1baf58e4-20c8-4388-9943-c8b753eb469b for instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 on n-h2-781139-2 Oct 03 14:34:56.549659 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6ca46d8d-55da-44a0-9b28-70c5491298f8 req-20bfc052-640e-4cea-8e6f-f66b9dd8afea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052377 Oct 03 14:34:56.550982 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 281/558] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:56.559369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4108f13b-877a-42a0-bba0-240feb619fee req-eef17d03-a5c3-4fb0-ba78-fa655f4d0829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bbc8f0-e427-4021-bcc7-3d530f263eb8", "tag": "78fb81bf-61f4-46aa-acb3-a9f95766502a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:56.570758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4108f13b-877a-42a0-bba0-240feb619fee req-eef17d03-a5c3-4fb0-ba78-fa655f4d0829 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.571498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4108f13b-877a-42a0-bba0-240feb619fee req-eef17d03-a5c3-4fb0-ba78-fa655f4d0829 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.572228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4108f13b-877a-42a0-bba0-240feb619fee req-eef17d03-a5c3-4fb0-ba78-fa655f4d0829 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.588064 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4108f13b-877a-42a0-bba0-240feb619fee req-eef17d03-a5c3-4fb0-ba78-fa655f4d0829 service nova] Creating event network-changed:78fb81bf-61f4-46aa-acb3-a9f95766502a for instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 on n-h2-781139-2 Oct 03 14:34:56.593865 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4108f13b-877a-42a0-bba0-240feb619fee req-eef17d03-a5c3-4fb0-ba78-fa655f4d0829 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040908 Oct 03 14:34:56.595294 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 282/559] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:56.601179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:56.601877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:56.608313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.608798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.609262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.610127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.610470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.611331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.766598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:56.775040 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f3adc8b-3a26-4bf3-aca7-6f802b4b138e tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.178377 Oct 03 14:34:56.776017 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 283/560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:56 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:56.781324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:56.782038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:56.788635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.789515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.790047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.791597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.792469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.793132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.945785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:56.956096 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3ae00ec-6c58-4edb-8ae1-72a6172c010e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.177221 Oct 03 14:34:56.956775 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 284/561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:56 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:56.962289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:56.963107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:56.970519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.971318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.971966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:56.973098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:56.973759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:56.974603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.067098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:34:57.068577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:34:57.069557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:34:57.070973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:34:57.071587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:34:57.084220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.084700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.085374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.086250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.086882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.087457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.127175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for project a762d2f19e454d74a937f6237b3f287a. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:34:57.134615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for user 77fb2abf524d4d8caeb1ec89d5db0d73 and project a762d2f19e454d74a937f6237b3f287a. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:34:57.150159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:34:57.153153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:34:57.232912 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5da490af-4d76-4266-b70e-d28f6138b01e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.404423 Oct 03 14:34:57.234099 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 278/562] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:34:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:34:57.245847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:57.246565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:57.253459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.254073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.254683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.255580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.256131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.256654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.297764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid 660e7ae4-72b0-4c44-8ece-82014c070066 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:57.339641 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43fa056d-56d0-4834-866e-ee6d265f18ba tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 2052 microversion: 2.25 time: 0.381594 Oct 03 14:34:57.346906 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 285/563] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:56 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 2052 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:57.369425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:57.370245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:57.382705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.383388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.384126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.385587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.386185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.386752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.751407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:57.772408 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bed3cade-6cfa-4370-a42a-ec125cfbac40 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1317 microversion: 2.1 time: 0.530101 Oct 03 14:34:57.773044 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 279/564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:57 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:57.777670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-30cf07da-8a77-43c4-b8a0-8f82740ef2ca tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:57.778288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-30cf07da-8a77-43c4-b8a0-8f82740ef2ca tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:57.897955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:57.915416 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5fe6449e-3b6b-47eb-97ce-c349068ec0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.567207 Oct 03 14:34:57.916012 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 286/565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:57 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:57.920653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:57.926029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:57.942281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.943205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.943874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.944744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:57.945368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:57.946166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:57.983816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30cf07da-8a77-43c4-b8a0-8f82740ef2ca tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:57.994308 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-30cf07da-8a77-43c4-b8a0-8f82740ef2ca tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1225 microversion: 2.1 time: 0.220163 Oct 03 14:34:57.994925 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 280/566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:57 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1225 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:58.010353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:58.028377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.028867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.035597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.036440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.037120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.037549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.078941 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-27ec11d7-9436-4b3a-9333-53eaebfa78b6 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072366 Oct 03 14:34:58.080529 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 281/567] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 3 14:34:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:34:58.085766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:58.086611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:58.094573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.095383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.096044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.096959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.097701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.099023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.104779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:58.474357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:58.483327 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eddb7dc0-d7b1-4d4e-951a-d78f0921c057 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.565974 Oct 03 14:34:58.484166 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 287/568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:57 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:58.489223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:58.490134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:58.496378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.496865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.497329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.498034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.498486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.498905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.657081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:58.667127 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cecc7403-fc91-458d-96f7-2f035d06d5ec tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.181722 Oct 03 14:34:58.667864 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 288/569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:58 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:58.673481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:58.674216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:58.681206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.682563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.683161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.684043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.684785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.685493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.757965 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17a2028d-92a3-4258-8289-d6eac50e3172 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066/action" status: 202 len: 0 microversion: 2.25 time: 0.088700 Oct 03 14:34:58.761637 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 289/570] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:34:58 2022] POST /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:34:58.764144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a3d24c1d-3b28-4eb0-8cf3-02ca9fe243c2 req-9943c1b5-16f6-4c86-90d8-3a5da9053a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2153bd-a784-4eb8-98ea-65c6cbe6dca2", "name": "network-vif-plugged", "status": "completed", "tag": "a2b4ed4a-96d7-4430-9b8d-493124034929"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:58.774344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3d24c1d-3b28-4eb0-8cf3-02ca9fe243c2 req-9943c1b5-16f6-4c86-90d8-3a5da9053a09 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.774816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3d24c1d-3b28-4eb0-8cf3-02ca9fe243c2 req-9943c1b5-16f6-4c86-90d8-3a5da9053a09 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.775238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a3d24c1d-3b28-4eb0-8cf3-02ca9fe243c2 req-9943c1b5-16f6-4c86-90d8-3a5da9053a09 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.779895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:58.795547 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a3d24c1d-3b28-4eb0-8cf3-02ca9fe243c2 req-9943c1b5-16f6-4c86-90d8-3a5da9053a09 service nova] Creating event network-vif-plugged:a2b4ed4a-96d7-4430-9b8d-493124034929 for instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 on n-h2-781139-2 Oct 03 14:34:58.803088 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a3d24c1d-3b28-4eb0-8cf3-02ca9fe243c2 req-9943c1b5-16f6-4c86-90d8-3a5da9053a09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042822 Oct 03 14:34:58.806364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:58.808286 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 290/571] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:58.816819 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1f7dcb91-0568-47f2-99b0-37152a388144 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.734996 Oct 03 14:34:58.831704 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 282/572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:58 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:58.831943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:58.831943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:58.835652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:58.836272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:58.838263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.839709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.840028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.841013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.841631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.842155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.848383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.849355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.850024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.850695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:58.851296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:58.851714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:58.992895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid 660e7ae4-72b0-4c44-8ece-82014c070066 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:34:59.006224 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5590d4e-2dfa-4f92-bb44-ef2a8d27c789 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 2057 microversion: 2.25 time: 0.196607 Oct 03 14:34:59.006843 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 291/573] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:34:58 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 2057 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:34:59.012526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:59.013372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:59.020750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.021703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.022364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.023278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.023932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.024792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.212406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:59.222542 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a591f0e-de11-4f33-8073-371270abff5b tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.214396 Oct 03 14:34:59.223226 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 292/574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:59 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:59.228707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:59.229421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:59.235631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.236401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.236951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.237856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.238373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.238881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.273584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:59.283888 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-476bb2e6-7e0d-4ea2-ab4c-ed6810cf8bb3 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1317 microversion: 2.1 time: 0.461819 Oct 03 14:34:59.298154 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 283/575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:58 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:59.316360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:59.325560 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1b6e508-46fc-422b-865e-42603dfbfdb3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1277 microversion: 2.1 time: 0.100422 Oct 03 14:34:59.326483 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 293/576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:59 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:59.468988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:59.469191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-adb9b554-6bfc-4424-b311-007c24b475b0 req-31c0dc74-3710-4477-949d-fe55f4784ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc34547e-726a-48d7-a87e-ac934587ff08", "tag": "e5b2dd85-e850-4a4d-9462-b0db8c7f6164"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:34:59.471715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:59.489774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.491505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.494242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.495613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.496282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.496819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-adb9b554-6bfc-4424-b311-007c24b475b0 req-31c0dc74-3710-4477-949d-fe55f4784ae7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.497878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-adb9b554-6bfc-4424-b311-007c24b475b0 req-31c0dc74-3710-4477-949d-fe55f4784ae7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.498522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.501054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-adb9b554-6bfc-4424-b311-007c24b475b0 req-31c0dc74-3710-4477-949d-fe55f4784ae7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.543005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-adb9b554-6bfc-4424-b311-007c24b475b0 req-31c0dc74-3710-4477-949d-fe55f4784ae7 service nova] Creating event network-changed:e5b2dd85-e850-4a4d-9462-b0db8c7f6164 for instance cc34547e-726a-48d7-a87e-ac934587ff08 on n-h1-781139-2 Oct 03 14:34:59.556185 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-adb9b554-6bfc-4424-b311-007c24b475b0 req-31c0dc74-3710-4477-949d-fe55f4784ae7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091444 Oct 03 14:34:59.558725 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 294/577] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:34:59.576194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:59.577307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:59.589216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.589721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.591751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.592831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.593509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.594102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.715213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:59.726051 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e393623-cea2-4e9b-aad4-939797c72c88 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1585 microversion: 2.1 time: 0.266454 Oct 03 14:34:59.727293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 284/578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:59 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1585 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:59.732485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:59.733335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:59.741685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.742979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.743634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.744533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.745228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.745849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.764907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:34:59.803266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:34:59.818043 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfa558fd-0a4b-4b28-a73c-f545d473003b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.254552 Oct 03 14:34:59.819349 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 295/579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:59 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:34:59.843264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:34:59.844107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:34:59.854002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.854597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.855045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:34:59.855786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:34:59.856235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:34:59.856657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.106428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:00.111677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:00.114993 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72ee0efe-9182-4771-b209-b6a0a87f6bc6 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.386168 Oct 03 14:35:00.116650 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 285/580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:59 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:00.121344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:00.122203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:00.122688 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4d606a1-34be-4aff-973f-a7fa6d34a8fa tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1320 microversion: 2.1 time: 0.283614 Oct 03 14:35:00.138433 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 296/581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:34:59 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1320 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:00.145590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.146529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.147379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.148329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.149016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.149655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.249542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:00.250401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:00.257463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.258499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.259103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.259821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.260826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.261697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.455364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid 660e7ae4-72b0-4c44-8ece-82014c070066 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:00.466797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:00.478056 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6eb37c60-e2c1-4c38-aedc-206a0891b10a tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 2037 microversion: 2.25 time: 0.359801 Oct 03 14:35:00.478960 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 286/582] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:00 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 2037 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:00.485332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:00.486139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:00.493295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.494262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.494859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.495712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.496314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.496449 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-588cc31e-c2a8-4301-83f1-76591674920e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.253426 Oct 03 14:35:00.497030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.509438 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 297/583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:00 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:00.518642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:00.519669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:00.525937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.526420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.526850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.527549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.528635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.529089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.743509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:00.757158 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7e1cdcd-27b8-4c0f-972c-320b5820e3a8 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.246435 Oct 03 14:35:00.770179 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 298/584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:00 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:00.780820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-781139-2", "block_migration": "auto"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:00.783633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:00.794123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=30 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:00.796007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.796592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.797352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.798176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.798740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.799879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.916109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'flavor' on Instance uuid 660e7ae4-72b0-4c44-8ece-82014c070066 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:00.930796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:00.945338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b2d5da4-30b7-4017-b53a-d8eef252e723 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1317 microversion: 2.1 time: 0.458214 Oct 03 14:35:00.946034 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 287/585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:00 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:00.960469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:00.961693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:00.968129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.969174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.969802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:00.970929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:00.979197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:00.979944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:01.070001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Going to try to live migrate instance to n-h1-781139-2 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:35:01.354803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:01.367260 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c263e7a1-c3b2-4c04-b0bc-69e24d7015ed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.419939 Oct 03 14:35:01.367852 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 288/586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:00 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:01.376304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:01.376978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:01.394599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:01.395219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:01.395658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:01.396483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:01.396953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:01.397668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:01.918969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:01.928778 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ea21964-7358-4240-aa96-87bd0892bd5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.559723 Oct 03 14:35:01.929847 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 289/587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:01 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:01.934810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:01.935518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:01.946879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:01.947443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:01.947862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:01.948804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:01.949282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:01.949719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.146823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:02.156547 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb2c5483-d7d4-4729-8759-18b7c6f3771a tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1470 microversion: 2.1 time: 0.225665 Oct 03 14:35:02.157295 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 290/588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:01 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:02.162021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:02.162753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:02.168782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.169317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.169873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.170663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.171213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.171858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.362527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:02.374855 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe894e50-63c0-4234-8a8b-4c47f38497cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.216172 Oct 03 14:35:02.375723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 291/589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:02 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:02.380055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1ff75395-5caf-425d-855a-d17c6238be9d req-31d2080d-53a8-4024-924b-2db90126f517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8051f6c-c92b-41d9-9bbc-8a5b674b8de6", "tag": "e723b21e-4874-4d17-89ec-48497a8578b6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:02.389664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1ff75395-5caf-425d-855a-d17c6238be9d req-31d2080d-53a8-4024-924b-2db90126f517 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.390249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1ff75395-5caf-425d-855a-d17c6238be9d req-31d2080d-53a8-4024-924b-2db90126f517 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.391049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1ff75395-5caf-425d-855a-d17c6238be9d req-31d2080d-53a8-4024-924b-2db90126f517 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.402702 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1ff75395-5caf-425d-855a-d17c6238be9d req-31d2080d-53a8-4024-924b-2db90126f517 service nova] Creating event network-changed:e723b21e-4874-4d17-89ec-48497a8578b6 for instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 on n-h1-781139-2 Oct 03 14:35:02.408127 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1ff75395-5caf-425d-855a-d17c6238be9d req-31d2080d-53a8-4024-924b-2db90126f517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031309 Oct 03 14:35:02.408728 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 292/590] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:02.413727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e9d46317-62eb-4505-868e-3e3933c0eeff req-7b96cdf8-dddf-49e1-bf8b-5e1894199453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3609b6d4-95a0-4e25-9f44-f82ca930b4b5", "tag": "521b31a5-6adc-4b91-aab6-380f628e4b11"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:02.423258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e9d46317-62eb-4505-868e-3e3933c0eeff req-7b96cdf8-dddf-49e1-bf8b-5e1894199453 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.423697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e9d46317-62eb-4505-868e-3e3933c0eeff req-7b96cdf8-dddf-49e1-bf8b-5e1894199453 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.424127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e9d46317-62eb-4505-868e-3e3933c0eeff req-7b96cdf8-dddf-49e1-bf8b-5e1894199453 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.434693 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e9d46317-62eb-4505-868e-3e3933c0eeff req-7b96cdf8-dddf-49e1-bf8b-5e1894199453 service nova] Creating event network-changed:521b31a5-6adc-4b91-aab6-380f628e4b11 for instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 on n-h1-781139-2 Oct 03 14:35:02.439516 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e9d46317-62eb-4505-868e-3e3933c0eeff req-7b96cdf8-dddf-49e1-bf8b-5e1894199453 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029395 Oct 03 14:35:02.440107 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 293/591] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:02.445305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:02.445993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:02.452317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.452792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.453246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.453932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.454377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.454793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.595140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:02.603109 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82c4bebf-68c6-4d2f-b2f1-baf8587cc435 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.161901 Oct 03 14:35:02.603713 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 294/592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:02 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:02.608027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-cd9cf71f-4db3-4e6a-ab23-144119957c6d req-5e450df2-4624-485d-be7a-ea28636453fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8", "name": "network-vif-plugged", "status": "completed", "tag": "1baf58e4-20c8-4388-9943-c8b753eb469b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:02.617705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cd9cf71f-4db3-4e6a-ab23-144119957c6d req-5e450df2-4624-485d-be7a-ea28636453fc service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.618172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cd9cf71f-4db3-4e6a-ab23-144119957c6d req-5e450df2-4624-485d-be7a-ea28636453fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.618624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cd9cf71f-4db3-4e6a-ab23-144119957c6d req-5e450df2-4624-485d-be7a-ea28636453fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.629626 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-cd9cf71f-4db3-4e6a-ab23-144119957c6d req-5e450df2-4624-485d-be7a-ea28636453fc service nova] Creating event network-vif-plugged:1baf58e4-20c8-4388-9943-c8b753eb469b for instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 on n-h2-781139-2 Oct 03 14:35:02.634754 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-cd9cf71f-4db3-4e6a-ab23-144119957c6d req-5e450df2-4624-485d-be7a-ea28636453fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029901 Oct 03 14:35:02.635596 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 295/593] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:02.640831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:02.641547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:02.648450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.648947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.649427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.650369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.650556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.650984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.848626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:02.856574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f0cf5d8-b598-4112-bdbd-e70c0ec9e191 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1317 microversion: 2.1 time: 0.219823 Oct 03 14:35:02.857172 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 296/594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:02 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:02.861614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:02.863839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:02.869594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.870073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.870499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.871178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.871618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.872024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.955128 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4c3f0e1-f767-4f75-9ebd-eaf5ace899a6 tempest-DeleteServersAdminTestJSON-1626112362 tempest-DeleteServersAdminTestJSON-1626112362-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2/action" status: 202 len: 0 microversion: 2.1 time: 0.096777 Oct 03 14:35:02.955855 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 297/595] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:02 2022] POST /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:02.960375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:02.960999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:02.962807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:02.967811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.968286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.968718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:02.969440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:02.969884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:02.970301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.104549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:03.108032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:03.113248 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1bf59bb9-121d-4823-93cb-f1a29609bda1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.156599 Oct 03 14:35:03.113822 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 298/596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:02 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:03.118598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:03.119204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:03.125584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.126062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.126495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.127177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.127625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.128048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.260601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:03.269186 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe94445e-2baf-4d4e-8e53-1584f5e3aeb7 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.154407 Oct 03 14:35:03.269871 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 299/597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:03 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:03.274771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:03.276121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:03.282299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.282887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.283534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.284322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.284844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.285299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.317392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.318025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.318519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.319034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lazy-loading 'fault' on Instance uuid 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:03.431394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:03.439230 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6243017e-7688-4a31-ab4b-d375c709bd76 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1453 microversion: 2.1 time: 0.168288 Oct 03 14:35:03.439838 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 300/598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:03 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:03.446609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:03.447274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:03.453866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.454355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.454788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.455483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.455934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.456353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.592708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:03.600695 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-afb80b33-9e91-442b-b83a-8502092edf74 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.159906 Oct 03 14:35:03.601305 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 301/599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:03 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:03.605721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:03.606207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:03.611930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.612410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.612841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.613565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.614014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.614437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.639717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:35:03.726510 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51b10f10-0d9d-466c-80a2-925560e46bad tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 204 len: 0 microversion: 2.1 time: 0.123886 Oct 03 14:35:03.727014 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 302/600] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:03 2022] DELETE /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:03.732396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:03.733135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:03.738976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.739442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.740041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.740849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.741348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.741799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.902381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:03.911267 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec5a3d04-ebd9-4b49-83f0-49e6c5cb2076 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.183129 Oct 03 14:35:03.912109 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 303/601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:03 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:03.917114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:03.917980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:03.924395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.924898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.925405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.926101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.926557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.926981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.965079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:03.966104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:03.966386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:03.967109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lazy-loading 'fault' on Instance uuid 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:04.152594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:04.160772 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ccc7502-59b5-422d-b1ea-d164a4eda0c2 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1459 microversion: 2.1 time: 0.247408 Oct 03 14:35:04.161494 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 304/602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:03 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1459 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:04.168825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:04.169716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:04.179912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:04.180401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:04.180827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:04.181574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:04.182015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:04.182406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:04.650810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:04.658952 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e1b6704-7038-4785-95d1-fd3735291c67 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1467 microversion: 2.1 time: 0.496447 Oct 03 14:35:04.660203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 305/603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:04 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1467 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:04.665953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:04.666777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:04.673037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:04.673794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:04.674447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:04.675373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:04.676040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:04.676798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:04.941145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:04.949268 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d6404db1-971d-40e9-bbf6-0853c04c41fc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1503 microversion: 2.1 time: 0.287783 Oct 03 14:35:04.949764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 306/604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:04 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:04.954394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:04.954990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:04.961131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:04.961613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:04.962040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:04.962722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:04.963176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:04.964734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:05.415429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:05.424660 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76c70b31-d6b9-4c9e-8c80-b2bd839e480f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.473365 Oct 03 14:35:05.439891 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 307/605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:04 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:05.445648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:05.446258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:05.452834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:05.453371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:05.454006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:05.454724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:05.455182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:05.455846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.158303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:06.169884 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17205e19-acac-4b00-af0e-923bb56be2a7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.728688 Oct 03 14:35:06.170470 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 308/606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:05 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:06.240440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1684850526", "block_migration": true, "disk_over_commit": false}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:06.243621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:06.250450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.251009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.251508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.252299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.252814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.253330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.280442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lazy-loading 'flavor' on Instance uuid 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:06.293588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Going to try to live migrate instance to tempest-host-1684850526 {{(pid=128868) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:35:06.300891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] HTTP exception thrown: Compute host tempest-host-1684850526 could not be found. Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Request method failure captured: Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8/action HTTP/1.1 Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 107 Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMF8Roj6rFkV91RPyfUkeJ7TKNLgh74nbGkhrCqLMDHIlPChUrXv_8p3wiRKm-662ly74riAzFFp_EdiMpKTdg2yhGhCeveAbkSZWT4KbvxT5UrJh1yT-Wb1Lb_GkLYSc49Vcss7YP3Q1FrcoaP5Q4iTUh0-OjHd6MgRfXRDVmHGdY Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b091f970b25d48cca48129106573220d Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-LiveMigrationNegativeTest-781993019 Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:35:06.304965 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b091f970b25d48cca48129106573220d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b091f970b25d48cca48129106573220d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b091f970b25d48cca48129106573220d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b091f970b25d48cca48129106573220d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-LiveMigrationNegativeTest-781993019 Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b091f970b25d48cca48129106573220d Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-781993019 Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-LiveMigrationNegativeTest-781993019-project-admin Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 4a2431f41b1b41e4b967639d6ecc7229 Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-LiveMigrationNegativeTest-781993019-project-admin Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: {"os-migrateLive": {"host": "tempest-host-1684850526", "block_migration": true, "disk_over_commit": false}} Oct 03 14:35:06.306479 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: exception: Compute host tempest-host-1684850526 could not be found. Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8', 'body': {'os-migrateLive': {'host': 'tempest-host-1684850526', 'block_migration': True, 'disk_over_commit': False}}} Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:35:06.307272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1684850526 could not be found. Oct 03 14:35:06.308492 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1684850526 could not be found. Oct 03 14:35:06.310827 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1684850526 could not be found. Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Returning 400 to user: Compute host tempest-host-1684850526 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34e2589b-6f8d-4d28-a837-257ee8ee8170 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8/action" status: 400 len: 100 microversion: 2.1 time: 0.135013 Oct 03 14:35:06.312335 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 309/607] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 3 14:35:06 2022] POST /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8/action => generated 100 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:35:06.313544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:06.314168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:06.320988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.321477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.322396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.322613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.323062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.323484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.501037 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e5d212d-2c0e-4180-89ba-3bbfbb4645d0 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066/action" status: 202 len: 0 microversion: 2.25 time: 5.729268 Oct 03 14:35:06.502133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 299/608] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:35:00 2022] POST /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066/action => generated 0 bytes in 5731 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:06.507258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:06.508075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:06.516049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.516763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.517625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.518502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.519103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.519714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.561499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.562065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.562544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.563002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lazy-loading 'fault' on Instance uuid 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:06.571899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:06.582194 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ca1c19b1-56e6-4d4f-9be3-5407b51c9e02 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.273600 Oct 03 14:35:06.597682 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 310/609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:06 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:06.604164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:06.605278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:06.612574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.613384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.614033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.614992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.616019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.616913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.685834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e37b3a80e494c7787b3fbb417f89ccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65d139c47ffe4f3c96ca156f2b63703b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:06.695332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d1d52dc-ec9c-4310-8f3b-3d88e1cb7975 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 200 len: 1459 microversion: 2.1 time: 0.192123 Oct 03 14:35:06.696151 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 300/610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:06 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 1459 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:06.713853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:06.714690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:06.723697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.724462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.725090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.725992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.726591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.727163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.839160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:06.847953 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d7f83f5-d9d7-4edf-9968-5d9b6ba62aff tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1493 microversion: 2.1 time: 0.248357 Oct 03 14:35:06.861223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 311/611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:06 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1493 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:06.871724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:06.872633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:06.879437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.880519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.880987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.881695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.882144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.882565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.918615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:06.926946 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb566b12-32aa-476e-aa96-991bce75785f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1467 microversion: 2.1 time: 0.229319 Oct 03 14:35:06.927596 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 301/612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:06 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1467 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:06.932162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:06.932772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:06.939159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.939646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.940079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:06.940778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:06.941259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:06.941682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.052828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:07.056474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:07.062516 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d9c9d948-2d87-4aec-9e7e-161d39db45bd tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.199958 Oct 03 14:35:07.063118 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 312/613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:06 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:07.068274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-dda143d1-b2b6-4e7c-8cd5-9e31769f618a req-b683c1cf-e0ef-4472-ad6f-b23ee44230e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2153bd-a784-4eb8-98ea-65c6cbe6dca2", "name": "network-vif-deleted", "tag": "a2b4ed4a-96d7-4430-9b8d-493124034929"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:07.077642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dda143d1-b2b6-4e7c-8cd5-9e31769f618a req-b683c1cf-e0ef-4472-ad6f-b23ee44230e1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.078120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dda143d1-b2b6-4e7c-8cd5-9e31769f618a req-b683c1cf-e0ef-4472-ad6f-b23ee44230e1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.078549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dda143d1-b2b6-4e7c-8cd5-9e31769f618a req-b683c1cf-e0ef-4472-ad6f-b23ee44230e1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.090596 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-dda143d1-b2b6-4e7c-8cd5-9e31769f618a req-b683c1cf-e0ef-4472-ad6f-b23ee44230e1 service nova] Creating event network-vif-deleted:a2b4ed4a-96d7-4430-9b8d-493124034929 for instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 on n-h2-781139-2 Oct 03 14:35:07.095449 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-dda143d1-b2b6-4e7c-8cd5-9e31769f618a req-b683c1cf-e0ef-4472-ad6f-b23ee44230e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 Oct 03 14:35:07.096038 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 313/614] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:07.098596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:07.102799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5b68d81-7d91-4a55-bac8-099ead57a58b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '.version_select at 0x7fb230d630d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.106294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5b68d81-7d91-4a55-bac8-099ead57a58b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.106783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5b68d81-7d91-4a55-bac8-099ead57a58b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.107220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5b68d81-7d91-4a55-bac8-099ead57a58b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.107415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:07.108795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:07.109989 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b5a5077-550a-49b5-85ac-454ad47eadd9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.181450 Oct 03 14:35:07.110549 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 302/615] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:06 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:07.115512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-522547796", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:07.116121 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5b68d81-7d91-4a55-bac8-099ead57a58b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.017617 Oct 03 14:35:07.116798 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 314/616] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:35:07 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:07.130495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.131296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.137767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.138240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.138670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.139354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.139794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.140621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.167399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:07.272959 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d67ef37d-96bd-4629-9dba-7c999f97b8c0 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1644 microversion: 2.1 time: 0.146199 Oct 03 14:35:07.274537 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 315/617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:07 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1644 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:07.279088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.279822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.294111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.294512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.294943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.295661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.296116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.296526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.411148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:07.411692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:07.412195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:07.412588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:07.413381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:07.422863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.423360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.423791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.424499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.424965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.425385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.442087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Getting quotas for project 1bd1040ed429433ab0b563f842e05ef2. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:07.447504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Getting quotas for user 41de1ec36c284e418fca1bfcede0d595 and project 1bd1040ed429433ab0b563f842e05ef2. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:07.459925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:07.462268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:07.462409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:07.470080 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87c2db6a-9032-4507-b50b-1220c749f4b3 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.194624 Oct 03 14:35:07.470658 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 316/618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:07 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:07.475236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1447018970", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "1de92605-c737-403e-8392-200d1d88069b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:07.516755 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-992e296a-ebdc-41d7-847e-7417ec59cc3e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.405061 Oct 03 14:35:07.523816 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 303/619] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:35:07.529018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f79d7eea-36ea-4299-9a44-1c7a106f7f96 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.529794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f79d7eea-36ea-4299-9a44-1c7a106f7f96 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.533404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] validate_networks() for [('1de92605-c737-403e-8392-200d1d88069b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:07.585816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f79d7eea-36ea-4299-9a44-1c7a106f7f96 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:07.594739 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f79d7eea-36ea-4299-9a44-1c7a106f7f96 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1218 microversion: 2.1 time: 0.069597 Oct 03 14:35:07.595352 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 304/620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:07 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:07.607358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.607853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.614757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.615452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.616057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.616919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.617524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.618094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.806700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:07.819553 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4dcafbfa-a9a6-4fb9-910e-02099220fa0a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.216671 Oct 03 14:35:07.820336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 305/621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:07 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:07.826373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.827634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.835032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.835742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.836449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.837649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.838413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.838979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.853543 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] HTTP exception thrown: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Request method failure captured: Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 HTTP/1.1 Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLiIemr1kyaRMkCSEEHCSkWxKwEGt4r3FFj4RHcVvRg5H49FhiTHVuNQU30L65SUOMZBBQsv1fyKIzmHutD2PENvfkjPjdHtxC0V1JiBkdvSHNh9TVxXVuwRpS_dIFS4ZcOHlG-A-CqI8D3HUaCUhU0SaR8BL8-H2pdkalvdRgJSeI Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:07.855357 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d139c47ffe4f3c96ca156f2b63703b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5e37b3a80e494c7787b3fbb417f89ccb Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.857010 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '7c2153bd-a784-4eb8-98ea-65c6cbe6dca2'} Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:07.857931 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.859407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.862038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Returning 404 to user: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:07.863084 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-153134ea-9b77-4e48-8697-c11c060500ed tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 404 len: 111 microversion: 2.1 time: 0.041197 Oct 03 14:35:07.863926 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 306/622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:07 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:07.875992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.877537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.896233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.897257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.898110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.899173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.900066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.900764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.917371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] HTTP exception thrown: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Request method failure captured: Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 HTTP/1.1 Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLiIemr1kyaRMkCSEEHCSkWxKwEGt4r3FFj4RHcVvRg5H49FhiTHVuNQU30L65SUOMZBBQsv1fyKIzmHutD2PENvfkjPjdHtxC0V1JiBkdvSHNh9TVxXVuwRpS_dIFS4ZcOHlG-A-CqI8D3HUaCUhU0SaR8BL8-H2pdkalvdRgJSeI Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:07.919460 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d139c47ffe4f3c96ca156f2b63703b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5e37b3a80e494c7787b3fbb417f89ccb Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.920997 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '7c2153bd-a784-4eb8-98ea-65c6cbe6dca2'} Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:07.921707 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.926197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.929713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Returning 404 to user: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:07.929713 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40be6e95-25ac-456e-b168-183bde073330 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 404 len: 111 microversion: 2.1 time: 0.052153 Oct 03 14:35:07.929713 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 307/623] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:07 2022] DELETE /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:35:07.930679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.931314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.938721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.939438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.940056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.941056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.941835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.942855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.962457 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] HTTP exception thrown: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Request method failure captured: Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 HTTP/1.1 Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLiIemr1kyaRMkCSEEHCSkWxKwEGt4r3FFj4RHcVvRg5H49FhiTHVuNQU30L65SUOMZBBQsv1fyKIzmHutD2PENvfkjPjdHtxC0V1JiBkdvSHNh9TVxXVuwRpS_dIFS4ZcOHlG-A-CqI8D3HUaCUhU0SaR8BL8-H2pdkalvdRgJSeI Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:07.964049 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d139c47ffe4f3c96ca156f2b63703b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5e37b3a80e494c7787b3fbb417f89ccb Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.966242 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '7c2153bd-a784-4eb8-98ea-65c6cbe6dca2'} Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:07.967491 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. Oct 03 14:35:07.968852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:07.971013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Returning 404 to user: Instance 7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:07.971013 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-360a9f9c-3fad-40ff-a34d-4e07042d34c9 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2" status: 404 len: 111 microversion: 2.1 time: 0.039052 Oct 03 14:35:07.971013 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 308/624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:07 2022] GET /compute/v2.1/servers/7c2153bd-a784-4eb8-98ea-65c6cbe6dca2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:07.975084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:07.975659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:07.982313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.982788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.983230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.983944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:07.987301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:07.987829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:07.988174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:07.988578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:07.989011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:07.989544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:07.990039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:07.993496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:07.995469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:08.000787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.001309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.001740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.003025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.003542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.003967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.013244 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] HTTP exception thrown: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Request method failure captured: Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 HTTP/1.1 Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLiIemr1kyaRMkCSEEHCSkWxKwEGt4r3FFj4RHcVvRg5H49FhiTHVuNQU30L65SUOMZBBQsv1fyKIzmHutD2PENvfkjPjdHtxC0V1JiBkdvSHNh9TVxXVuwRpS_dIFS4ZcOHlG-A-CqI8D3HUaCUhU0SaR8BL8-H2pdkalvdRgJSeI Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:08.016294 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d139c47ffe4f3c96ca156f2b63703b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5e37b3a80e494c7787b3fbb417f89ccb Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.017874 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '75dea759-c447-4eb0-ab8f-c7c95d850f04'} Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:08.018725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.020128 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.023557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Returning 404 to user: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:08.023557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8270b48-72c0-4357-aced-a0ea52475720 tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 404 len: 111 microversion: 2.1 time: 0.052470 Oct 03 14:35:08.024534 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 309/625] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:07 2022] DELETE /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:08.031255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:08.031679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b7acb897-b9f9-43bd-b94c-6b8bb9442ce5 req-ee60f266-65d5-4f61-a8b8-a9f2ed4d765f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8051f6c-c92b-41d9-9bbc-8a5b674b8de6", "name": "network-vif-plugged", "status": "completed", "tag": "e723b21e-4874-4d17-89ec-48497a8578b6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:08.037589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for user a91d62c6a8f04094b64c79e338b1dc49 and project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:08.042432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7acb897-b9f9-43bd-b94c-6b8bb9442ce5 req-ee60f266-65d5-4f61-a8b8-a9f2ed4d765f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.042906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7acb897-b9f9-43bd-b94c-6b8bb9442ce5 req-ee60f266-65d5-4f61-a8b8-a9f2ed4d765f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.044548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7acb897-b9f9-43bd-b94c-6b8bb9442ce5 req-ee60f266-65d5-4f61-a8b8-a9f2ed4d765f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.051706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:08.054818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:08.067711 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b7acb897-b9f9-43bd-b94c-6b8bb9442ce5 req-ee60f266-65d5-4f61-a8b8-a9f2ed4d765f service nova] Creating event network-vif-plugged:e723b21e-4874-4d17-89ec-48497a8578b6 for instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 on n-h1-781139-2 Oct 03 14:35:08.073576 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b7acb897-b9f9-43bd-b94c-6b8bb9442ce5 req-ee60f266-65d5-4f61-a8b8-a9f2ed4d765f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047593 Oct 03 14:35:08.074286 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 310/626] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:08.080409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:08.081120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] [instance: 75dea759-c447-4eb0-ab8f-c7c95d850f04] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:08.088058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.088539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.088996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.089693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.090181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.090599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.104835 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] HTTP exception thrown: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Request method failure captured: Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 HTTP/1.1 Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLiIemr1kyaRMkCSEEHCSkWxKwEGt4r3FFj4RHcVvRg5H49FhiTHVuNQU30L65SUOMZBBQsv1fyKIzmHutD2PENvfkjPjdHtxC0V1JiBkdvSHNh9TVxXVuwRpS_dIFS4ZcOHlG-A-CqI8D3HUaCUhU0SaR8BL8-H2pdkalvdRgJSeI Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:08.106662 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_65d139c47ffe4f3c96ca156f2b63703b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/65d139c47ffe4f3c96ca156f2b63703b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 65d139c47ffe4f3c96ca156f2b63703b Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2046783125 Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5e37b3a80e494c7787b3fbb417f89ccb Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersAdminTestJSON-2046783125-project Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.107989 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '75dea759-c447-4eb0-ab8f-c7c95d850f04'} Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:08.108696 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. Oct 03 14:35:08.109864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:08.112388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] Returning 404 to user: Instance 75dea759-c447-4eb0-ab8f-c7c95d850f04 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:08.113515 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14eb4f7b-b39e-4684-8bdc-65052cf5e39b tempest-DeleteServersAdminTestJSON-2046783125 tempest-DeleteServersAdminTestJSON-2046783125-project] 10.222.0.20 "GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04" status: 404 len: 111 microversion: 2.1 time: 0.037683 Oct 03 14:35:08.114469 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 311/627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:08 2022] GET /compute/v2.1/servers/75dea759-c447-4eb0-ab8f-c7c95d850f04 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:08.118750 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2b1ed778-41e5-41b2-85e3-98f3de4a5c05 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646938 Oct 03 14:35:08.120351 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 317/628] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:35:08.128846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:08.130199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:08.132730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a0315308-1ca2-479c-89d8-a5eededb2053 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:08.133435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a0315308-1ca2-479c-89d8-a5eededb2053 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:08.156217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.157755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.158427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.173565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.174311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.174750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.197115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a0315308-1ca2-479c-89d8-a5eededb2053 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:08.208042 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a0315308-1ca2-479c-89d8-a5eededb2053 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1211 microversion: 2.1 time: 0.079967 Oct 03 14:35:08.208728 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 318/629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:08 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:08.213476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:08.214382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:08.229202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.230124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.230879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.232503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.233145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.233906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.354327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:08.363909 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61f5d612-96a6-4270-9261-b211dc7eba02 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.248020 Oct 03 14:35:08.365332 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 312/630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:08 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:08.426387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:08.435858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:08.437473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:08.438644 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b601d78a-ad1a-4dfe-b259-a4be35a4d4d1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.228706 Oct 03 14:35:08.439524 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 319/631] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:08 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:08.494568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:08.495361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:08.501779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.502511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.503118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.504041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.504974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.505740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.617599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:08.618209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:08.625828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.626489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.626751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.627457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.627904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.628326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.678157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:08.686582 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-294c5467-40f4-4220-90b4-5af77d400644 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.196045 Oct 03 14:35:08.687167 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 313/632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:08 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:08.710773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:08.718736 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bcdc1dac-a298-4d27-9e8c-58e03b620012 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1270 microversion: 2.1 time: 0.105029 Oct 03 14:35:08.733350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 320/633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:08 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:08.844454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:08.845664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:08.868656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.869318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.869771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:08.874001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:08.875236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:08.875709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.081542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:09.090967 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-008b4bb7-168b-401e-9681-2f32dde54024 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.251682 Oct 03 14:35:09.091556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 314/634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:08 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:09.233455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:09.235170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:09.242589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.243338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.244179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.245822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.246304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.246725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.329547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:09.339855 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fad2e8d-49bd-4270-b56a-c24f57c56cab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1263 microversion: 2.1 time: 0.111523 Oct 03 14:35:09.340445 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 321/635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:09 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1263 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:09.390962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:09.391906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:09.402736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.403227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.403660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.404363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.404884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.409475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.465158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:09.465779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:09.478385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.478878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.479985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.483046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.484156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.484818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.648875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:09.661245 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e56ef250-6ab9-4261-a0e3-6ea0034a2f52 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.274964 Oct 03 14:35:09.673811 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 315/636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:09 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:09.716321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:09.716998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:09.725215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.726058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.726511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.727239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:09.727882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:09.736335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:09.988838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:10.013780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:10.015608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:10.015807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:10.021640 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c45274f8-33db-4b09-b7ca-889e848b7192 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.558213 Oct 03 14:35:10.033976 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 322/637] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:09 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:35:10.037133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca334c55-a3ee-4eed-8506-e3fbcd9178ce tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.326093 Oct 03 14:35:10.038244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 316/638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:09 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:10.070663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:10.071310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:10.078343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.079090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.079529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:10.080393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.081110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.081602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:10.118957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:10.119836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:10.140899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.146711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.156648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:10.159326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.159861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.162742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:10.486178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:10.492849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:10.503636 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fc0d5e52-b4a9-4e60-a1bb-d05cdb51bfa7 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1318 microversion: 2.1 time: 0.467761 Oct 03 14:35:10.504620 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 323/639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:10 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:10.519758 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00c78e12-9358-4ff3-b18c-73c43ed93016 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.408981 Oct 03 14:35:10.521329 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 317/640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:10 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:10.525922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:10.526755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:10.534121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.534822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.535509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:10.536480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.537285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.537966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:10.635516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:10.645247 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4aac2ae3-dfad-44e3-bcb0-1ef593c70a52 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1269 microversion: 2.1 time: 0.126738 Oct 03 14:35:10.646987 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 324/641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:10 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:10.698500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:10.699425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:10.707478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.708322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.709222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:10.710134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:10.710749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:10.711743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.062295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:11.063223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:11.066293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:11.073163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.074878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.075751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.076806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.077539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.078177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.079239 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9be1417a-ed7c-4593-a341-e0f599146eef tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1394 microversion: 2.1 time: 0.385884 Oct 03 14:35:11.080127 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 318/642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:10 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1394 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:11.088911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:11.089543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:11.105694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.106213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.106652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.107375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.107823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.108245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.370049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:11.385695 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed28201f-3811-4264-8e46-f08448b3bc58 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.304493 Oct 03 14:35:11.386617 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 319/643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:11 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:11.420635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:11.440717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:11.443564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:11.446443 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f04badc-7284-4d95-bd70-f700e0d62a3b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.388459 Oct 03 14:35:11.463911 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 325/644] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:11 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:11.532837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:11.533893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:11.541005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:11.542742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.543412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.543973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:11.544597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:11.544849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.545743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.546998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.547610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.551769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.552445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.553041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.553780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.554212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.554637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.847506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:11.859638 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a51d051-53f9-4502-aaf6-8cfdc7e6500f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1318 microversion: 2.1 time: 0.331486 Oct 03 14:35:11.861002 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 320/645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:11 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:11.871152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d31c6f5d-4435-4325-a005-0a4a6365039d req-f8b766aa-3a4d-4944-8039-110a4fe9ca8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd", "tag": "da9447c7-5ad0-491a-a638-ce2de451c682"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:11.884771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d31c6f5d-4435-4325-a005-0a4a6365039d req-f8b766aa-3a4d-4944-8039-110a4fe9ca8f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.886514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d31c6f5d-4435-4325-a005-0a4a6365039d req-f8b766aa-3a4d-4944-8039-110a4fe9ca8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.887940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d31c6f5d-4435-4325-a005-0a4a6365039d req-f8b766aa-3a4d-4944-8039-110a4fe9ca8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.905815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:11.917337 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03b9aac6-d4cb-44b5-9e79-0504b5952633 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.377287 Oct 03 14:35:11.919203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 326/646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:11 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:11.921769 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d31c6f5d-4435-4325-a005-0a4a6365039d req-f8b766aa-3a4d-4944-8039-110a4fe9ca8f service nova] Creating event network-changed:da9447c7-5ad0-491a-a638-ce2de451c682 for instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd on n-h2-781139-2 Oct 03 14:35:11.926420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:11.930090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:11.931803 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d31c6f5d-4435-4325-a005-0a4a6365039d req-f8b766aa-3a4d-4944-8039-110a4fe9ca8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069306 Oct 03 14:35:11.936330 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 321/647] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:11.939672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.940321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.940898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:11.942523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:11.943125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:11.943702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.112128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:12.114694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:12.125465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.126807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.127863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.129135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.130122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.131551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.390116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:12.407411 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c15910a-2f58-4ebd-b845-6d0e9892e31e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1573 microversion: 2.1 time: 0.308139 Oct 03 14:35:12.409871 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 322/648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:12 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1573 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:12.439166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:12.439516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:12.452580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.458603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.459691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.460672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.461691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.462543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.600720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:12.608727 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff5b9302-aa81-48c9-b1f6-0a368dbfe997 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.688278 Oct 03 14:35:12.609572 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 327/649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:11 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:12.614430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e37dfda0-bd1c-4aa4-8018-89337178970c req-f767a125-cc15-44e2-b713-2a1fd10b7db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3609b6d4-95a0-4e25-9f44-f82ca930b4b5", "name": "network-vif-plugged", "status": "completed", "tag": "521b31a5-6adc-4b91-aab6-380f628e4b11"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:12.626256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e37dfda0-bd1c-4aa4-8018-89337178970c req-f767a125-cc15-44e2-b713-2a1fd10b7db3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.626982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e37dfda0-bd1c-4aa4-8018-89337178970c req-f767a125-cc15-44e2-b713-2a1fd10b7db3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.627412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e37dfda0-bd1c-4aa4-8018-89337178970c req-f767a125-cc15-44e2-b713-2a1fd10b7db3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.641792 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e37dfda0-bd1c-4aa4-8018-89337178970c req-f767a125-cc15-44e2-b713-2a1fd10b7db3 service nova] Creating event network-vif-plugged:521b31a5-6adc-4b91-aab6-380f628e4b11 for instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 on n-h1-781139-2 Oct 03 14:35:12.646940 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e37dfda0-bd1c-4aa4-8018-89337178970c req-f767a125-cc15-44e2-b713-2a1fd10b7db3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036101 Oct 03 14:35:12.647554 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 328/650] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:12.652837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:12.653476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:12.659840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.660332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.660776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.661562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.662023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.662447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.819930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:12.830088 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76e6ed01-7be8-44b2-8bea-d52203fbd89e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.417685 Oct 03 14:35:12.844957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 323/651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:12 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:12.845643 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-20ac1ee9-1d3f-491e-b5e6-1967e921bfad tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188301 Oct 03 14:35:12.845643 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 329/652] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:35:12 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:12.851385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:12.852115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:12.861447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c05f5a18-44a7-46d2-ba89-d0cc06d670d7 req-e51a9127-c66a-4921-aad6-e8b4b59baf10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bf712c-1bc6-4798-9771-c906336c84a9", "tag": "d499f67e-28ef-4b4d-a430-de0827a421bc"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:12.866615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.868682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.869498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.870316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.870792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.871216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.879570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c05f5a18-44a7-46d2-ba89-d0cc06d670d7 req-e51a9127-c66a-4921-aad6-e8b4b59baf10 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:12.880675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c05f5a18-44a7-46d2-ba89-d0cc06d670d7 req-e51a9127-c66a-4921-aad6-e8b4b59baf10 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:12.886172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c05f5a18-44a7-46d2-ba89-d0cc06d670d7 req-e51a9127-c66a-4921-aad6-e8b4b59baf10 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:12.900180 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c05f5a18-44a7-46d2-ba89-d0cc06d670d7 req-e51a9127-c66a-4921-aad6-e8b4b59baf10 service nova] Creating event network-changed:d499f67e-28ef-4b4d-a430-de0827a421bc for instance f8bf712c-1bc6-4798-9771-c906336c84a9 on n-h2-781139-2 Oct 03 14:35:12.905544 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c05f5a18-44a7-46d2-ba89-d0cc06d670d7 req-e51a9127-c66a-4921-aad6-e8b4b59baf10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072447 Oct 03 14:35:12.906383 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 324/653] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:13.117649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dc42f1a-7e71-4b5d-bf26-9768f64c7417 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1844651307", "id": 1828869472, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:13.138997 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2dc42f1a-7e71-4b5d-bf26-9768f64c7417 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.230663 Oct 03 14:35:13.139603 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 325/654] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:12 2022] POST /compute/v2.1/flavors => generated 439 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:13.142623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:13.145121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:13.146068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:13.152977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.153876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.155559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:13.157276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:13.158038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:13.158813 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b9995852-9958-42b8-b7fe-9a4531a27fc9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.319097 Oct 03 14:35:13.159023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.159506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.159931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:13.175660 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 330/655] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:12 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:13.180900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:13.184533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:13.190852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.191681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.192184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:13.193069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.193763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.194271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:13.410962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:13.421081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:13.421665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9719696c-d761-45cb-9d56-dc94ea701946 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.244169 Oct 03 14:35:13.434592 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb494e84-ef87-416a-a62b-511b17cb09b2 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1318 microversion: 2.1 time: 0.293411 Oct 03 14:35:13.435536 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 326/656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:13 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:13.437723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 331/657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:13 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:13.441009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ead8fd75-9c60-436f-9b3f-68b96b0fe8a0 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:13.519792 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ead8fd75-9c60-436f-9b3f-68b96b0fe8a0 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1828869472/action" status: 200 len: 97 microversion: 2.1 time: 0.082758 Oct 03 14:35:13.520818 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 327/658] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 3 14:35:13 2022] POST /compute/v2.1/flavors/1828869472/action => generated 97 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:35:13.531034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66078385-693b-4306-87cd-e58670109275 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:13.610022 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-66078385-693b-4306-87cd-e58670109275 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 70ceb3b776c84f4a99f71a4dc158dbd7 combination. Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66078385-693b-4306-87cd-e58670109275 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Request method failure captured: Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/flavors/1828869472/action HTTP/1.1 Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 67 Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMfk_63kQgWGlxM1H77B9g6NjT_qiitVcxG1WwcEIUPFw5lKNHzKnFmPRz5rhBqbsXXUsXbaKGKrZQMSruUTmqb8dJmQC6RWrLPA0C3Fq3YvZF3mLbngtFCPHZ6L0-g7Vb6542M38lDfJoHS2pR02uK3nSJpDelw1TStKOiMmL-QuM Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 0591285dd2364d2882d8ba78cab4ad50 Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:35:13.627794 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0591285dd2364d2882d8ba78cab4ad50", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 0591285dd2364d2882d8ba78cab4ad50 Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e3934e9f271d4b47b65b08ec735cd4be Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: {"addTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} Oct 03 14:35:13.629381 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: exception: Flavor access already exists for flavor 34 and project 70ceb3b776c84f4a99f71a4dc158dbd7 combination. Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1828869472', 'body': {'addTenantAccess': {'tenant': '70ceb3b776c84f4a99f71a4dc158dbd7'}}} Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result.read() Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:35:13.630261 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-70ceb3b776c84f4a99f71a4dc158dbd7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi session.flush() Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 14:35:13.631399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 14:35:13.636762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:35:13.639670 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result.read() Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-70ceb3b776c84f4a99f71a4dc158dbd7' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 3, 14, 35, 13, 604455), 'updated_at': None, 'flavor_id': 34, 'project_id': '70ceb3b776c84f4a99f71a4dc158dbd7'}] Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:13.644082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project 70ceb3b776c84f4a99f71a4dc158dbd7 combination. Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:13.648162 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project 70ceb3b776c84f4a99f71a4dc158dbd7 combination. Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:13.655343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:13.657039 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project 70ceb3b776c84f4a99f71a4dc158dbd7 combination. Oct 03 14:35:13.657039 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:13.657039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66078385-693b-4306-87cd-e58670109275 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 70ceb3b776c84f4a99f71a4dc158dbd7 combination. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:13.657039 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66078385-693b-4306-87cd-e58670109275 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1828869472/action" status: 409 len: 152 microversion: 2.1 time: 0.102430 Oct 03 14:35:13.657039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 332/659] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 3 14:35:13 2022] POST /compute/v2.1/flavors/1828869472/action => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:35:13.657039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7bb3d77-5206-4c58-95e3-7072262095d3 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:13.661517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:13.662458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:13.671512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.672288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.672969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:13.673887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.674981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.677856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:13.733060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:13.738293 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7bb3d77-5206-4c58-95e3-7072262095d3 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1828869472/action" status: 200 len: 21 microversion: 2.1 time: 0.103163 Oct 03 14:35:13.740740 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 333/660] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 3 14:35:13 2022] POST /compute/v2.1/flavors/1828869472/action => generated 21 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:35:13.749540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-313374c2-9630-4c0e-8680-7ff847a7cd6d tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:13.772172 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-313374c2-9630-4c0e-8680-7ff847a7cd6d tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1828869472" status: 202 len: 0 microversion: 2.1 time: 0.026261 Oct 03 14:35:13.772805 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 334/661] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:35:13 2022] DELETE /compute/v2.1/flavors/1828869472 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:35:13.780995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2265ff3d-40c0-4c0a-8691-71dea52555da tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:13.815443 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2265ff3d-40c0-4c0a-8691-71dea52555da tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.038038 Oct 03 14:35:13.829056 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 335/662] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:13 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:13.839626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45f2cca0-2d08-40fd-952e-d7f07f1aa5dd tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-536015594", "id": 1969846650, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:13.874057 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45f2cca0-2d08-40fd-952e-d7f07f1aa5dd tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.038659 Oct 03 14:35:13.885550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 336/663] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:13 2022] POST /compute/v2.1/flavors => generated 437 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:13.892431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:13.894801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:13.902665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.903546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.905022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:13.906256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:13.906930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:13.907615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.023732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.035630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ace982a-09ad-4600-9cce-04323fa87300 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.388701 Oct 03 14:35:14.041097 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 328/664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:13 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:14.047300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4258680e-68a0-42ff-a9f2-80ee5e234af4 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.070817 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4258680e-68a0-42ff-a9f2-80ee5e234af4 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4258680e-68a0-42ff-a9f2-80ee5e234af4 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Request method failure captured: Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/flavors/1969846650/os-flavor-access HTTP/1.1 Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMfk_63kQgWGlxM1H77B9g6NjT_qiitVcxG1WwcEIUPFw5lKNHzKnFmPRz5rhBqbsXXUsXbaKGKrZQMSruUTmqb8dJmQC6RWrLPA0C3Fq3YvZF3mLbngtFCPHZ6L0-g7Vb6542M38lDfJoHS2pR02uK3nSJpDelw1TStKOiMmL-QuM Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 0591285dd2364d2882d8ba78cab4ad50 Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:35:14.074131 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0591285dd2364d2882d8ba78cab4ad50", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 0591285dd2364d2882d8ba78cab4ad50 Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e3934e9f271d4b47b65b08ec735cd4be Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: exception: Access list not available for public flavors. Oct 03 14:35:14.075407 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'flavor_id': '1969846650'} Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 03 14:35:14.076123 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.077988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4258680e-68a0-42ff-a9f2-80ee5e234af4 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:14.079292 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4258680e-68a0-42ff-a9f2-80ee5e234af4 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1969846650/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.036517 Oct 03 14:35:14.084302 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 329/665] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/flavors/1969846650/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:35:14.088524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d6cad11c-8c55-4b24-b83a-32e43ac1f8da req-676003a2-5f66-424f-b127-2b5438e2bb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660e7ae4-72b0-4c44-8ece-82014c070066", "name": "network-vif-unplugged", "status": "completed", "tag": "81a132de-4f8c-4bc6-b575-447721adc30c"}, {"name": "network-changed", "server_uuid": "660e7ae4-72b0-4c44-8ece-82014c070066", "tag": "81a132de-4f8c-4bc6-b575-447721adc30c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.101020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d6cad11c-8c55-4b24-b83a-32e43ac1f8da req-676003a2-5f66-424f-b127-2b5438e2bb47 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.101496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d6cad11c-8c55-4b24-b83a-32e43ac1f8da req-676003a2-5f66-424f-b127-2b5438e2bb47 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.101924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d6cad11c-8c55-4b24-b83a-32e43ac1f8da req-676003a2-5f66-424f-b127-2b5438e2bb47 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.113184 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d6cad11c-8c55-4b24-b83a-32e43ac1f8da req-676003a2-5f66-424f-b127-2b5438e2bb47 service nova] Creating event network-vif-unplugged:81a132de-4f8c-4bc6-b575-447721adc30c for instance 660e7ae4-72b0-4c44-8ece-82014c070066 on n-h2-781139-2 Oct 03 14:35:14.113920 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d6cad11c-8c55-4b24-b83a-32e43ac1f8da req-676003a2-5f66-424f-b127-2b5438e2bb47 service nova] Creating event network-changed:81a132de-4f8c-4bc6-b575-447721adc30c for instance 660e7ae4-72b0-4c44-8ece-82014c070066 on n-h2-781139-2 Oct 03 14:35:14.119705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d6cad11c-8c55-4b24-b83a-32e43ac1f8da req-676003a2-5f66-424f-b127-2b5438e2bb47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037300 Oct 03 14:35:14.121471 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 330/666] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:14.127582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56db6980-a833-4d29-831d-0793bcabd273 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.155685 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56db6980-a833-4d29-831d-0793bcabd273 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1969846650" status: 202 len: 0 microversion: 2.1 time: 0.032823 Oct 03 14:35:14.156530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 331/667] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:35:14 2022] DELETE /compute/v2.1/flavors/1969846650 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:14.168064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61ebee8b-fcea-4045-9a80-28875bc0a167 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.198451 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61ebee8b-fcea-4045-9a80-28875bc0a167 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.035894 Oct 03 14:35:14.209027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 332/668] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:14.209027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.209027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:14.209542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.215955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.215955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.215955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.215955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.216362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.216445 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df284d24-ea25-4e60-a6f6-3a7168628a5c tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.325929 Oct 03 14:35:14.216525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.216614 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 337/669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:13 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:14.221304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85d1b747-785b-4679-b278-96c8d0271f40 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-739505351", "id": 378926394, "os-flavor-access:is_public": "False"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.252791 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-85d1b747-785b-4679-b278-96c8d0271f40 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.035034 Oct 03 14:35:14.260908 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 338/670] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/flavors => generated 435 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:14.392764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.397852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-819f4dcf-0673-47c5-85ad-5ad7ecf78658 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.400723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-819f4dcf-0673-47c5-85ad-5ad7ecf78658 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '0f3d0d8508ce4aaf9ffe0797600ff4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceb3b776c84f4a99f71a4dc158dbd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.402266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-819f4dcf-0673-47c5-85ad-5ad7ecf78658 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Request method failure captured: Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/flavors/378926394/action HTTP/1.1 Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 67 Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMfLc1CHnZW_prAD358opPtbE1X4oBMPdAbThf88grVeEH8Xt54sN9WEIfLc5ejCR3s41Q18-nXFIp1kBXrQ9BsDrLJIe4bhZAZrtcsDG70Lg8Ds6SVLQlDy2AhqfxJHYE5A6fIS2UYTO8uHXOk3eBig7XBWpJKNXGiNFKz3T39XTM Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 70ceb3b776c84f4a99f71a4dc158dbd7 Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-676978814 Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:35:14.402397 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70ceb3b776c84f4a99f71a4dc158dbd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70ceb3b776c84f4a99f71a4dc158dbd7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70ceb3b776c84f4a99f71a4dc158dbd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70ceb3b776c84f4a99f71a4dc158dbd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-676978814 Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 70ceb3b776c84f4a99f71a4dc158dbd7 Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-676978814 Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FlavorsAccessNegativeTestJSON-676978814-project Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 0f3d0d8508ce4aaf9ffe0797600ff4fa Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-676978814-project Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: {"addTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} Oct 03 14:35:14.403637 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '378926394', 'body': {'addTenantAccess': {'tenant': '70ceb3b776c84f4a99f71a4dc158dbd7'}}} Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:35:14.404399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 03 14:35:14.405589 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.406747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-819f4dcf-0673-47c5-85ad-5ad7ecf78658 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:14.406821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.406919 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-819f4dcf-0673-47c5-85ad-5ad7ecf78658 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] 10.222.0.20 "POST /compute/v2.1/flavors/378926394/action" status: 403 len: 130 microversion: 2.1 time: 0.141417 Oct 03 14:35:14.406919 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 339/671] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/flavors/378926394/action => generated 130 bytes in 143 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:14.407566 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e775f62-ce78-4c21-b4df-174b69a2c0ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.204849 Oct 03 14:35:14.408154 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 333/672] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:14.409161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.409873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:14.413589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f96d0199-ca22-49ae-a530-a41b73ca35d5 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.417226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.417713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.418289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.419149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.419599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.420017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.434345 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f96d0199-ca22-49ae-a530-a41b73ca35d5 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/378926394" status: 202 len: 0 microversion: 2.1 time: 0.024914 Oct 03 14:35:14.435281 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 334/673] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:35:14 2022] DELETE /compute/v2.1/flavors/378926394 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:14.442820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:14.445438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ac24db2-1738-4327-8835-4e2721885853 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.468499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ac24db2-1738-4327-8835-4e2721885853 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.029174 Oct 03 14:35:14.469490 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 335/674] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:14.480321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.481048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:14.490185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.490675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.491176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.492417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.493897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.494331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.576482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.585365 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb00d6a3-d3ba-48d9-bd1d-13b198124554 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1573 microversion: 2.1 time: 0.179956 Oct 03 14:35:14.585950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 340/675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:14.590691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.591296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:14.597354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.597835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.598266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.599276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.599757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.600769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.654382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.658114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:14.663795 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d1227d5-8763-4156-8332-23052f4e9dd1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1325 microversion: 2.1 time: 0.189310 Oct 03 14:35:14.677896 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 336/676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:14.687892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c07f19c5-6004-4fb0-9013-c131c1b1e9cd tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-771794778", "id": 851635981, "os-flavor-access:is_public": "False"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.719771 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c07f19c5-6004-4fb0-9013-c131c1b1e9cd tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.040605 Oct 03 14:35:14.728335 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 337/677] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/flavors => generated 435 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:14.733214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b299ccea-d963-4ad8-9bc4-03021d203632 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.777036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.785481 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f48abce3-194f-45f3-abbf-8abaab51d735 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1318 microversion: 2.1 time: 0.198403 Oct 03 14:35:14.787517 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 341/678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:14.815205 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b299ccea-d963-4ad8-9bc4-03021d203632 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/851635981/action" status: 200 len: 96 microversion: 2.1 time: 0.085626 Oct 03 14:35:14.817091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 338/679] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/flavors/851635981/action => generated 96 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:35:14.827170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1a7c3e9e-bc91-45c1-8599-d5866bbbd8e0 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.830672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1a7c3e9e-bc91-45c1-8599-d5866bbbd8e0 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '0f3d0d8508ce4aaf9ffe0797600ff4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ceb3b776c84f4a99f71a4dc158dbd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1a7c3e9e-bc91-45c1-8599-d5866bbbd8e0 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Request method failure captured: Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/flavors/851635981/action HTTP/1.1 Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 70 Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMfLc1CHnZW_prAD358opPtbE1X4oBMPdAbThf88grVeEH8Xt54sN9WEIfLc5ejCR3s41Q18-nXFIp1kBXrQ9BsDrLJIe4bhZAZrtcsDG70Lg8Ds6SVLQlDy2AhqfxJHYE5A6fIS2UYTO8uHXOk3eBig7XBWpJKNXGiNFKz3T39XTM Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 70ceb3b776c84f4a99f71a4dc158dbd7 Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-676978814 Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:35:14.832384 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/70ceb3b776c84f4a99f71a4dc158dbd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_70ceb3b776c84f4a99f71a4dc158dbd7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70ceb3b776c84f4a99f71a4dc158dbd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/70ceb3b776c84f4a99f71a4dc158dbd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-676978814 Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 70ceb3b776c84f4a99f71a4dc158dbd7 Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-676978814 Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FlavorsAccessNegativeTestJSON-676978814-project Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 0f3d0d8508ce4aaf9ffe0797600ff4fa Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-676978814-project Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: {"removeTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} Oct 03 14:35:14.834023 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '851635981', 'body': {'removeTenantAccess': {'tenant': '70ceb3b776c84f4a99f71a4dc158dbd7'}}} Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can( Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:35:14.834769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 03 14:35:14.836481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:14.838158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1a7c3e9e-bc91-45c1-8599-d5866bbbd8e0 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:14.838158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1a7c3e9e-bc91-45c1-8599-d5866bbbd8e0 tempest-FlavorsAccessNegativeTestJSON-676978814 tempest-FlavorsAccessNegativeTestJSON-676978814-project] 10.222.0.20 "POST /compute/v2.1/flavors/851635981/action" status: 403 len: 133 microversion: 2.1 time: 0.011139 Oct 03 14:35:14.838158 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 342/680] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/flavors/851635981/action => generated 133 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:14.843247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0cb987a-9386-420e-b729-4b699f0bcc6f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "70ceb3b776c84f4a99f71a4dc158dbd7"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.921177 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0cb987a-9386-420e-b729-4b699f0bcc6f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/851635981/action" status: 200 len: 21 microversion: 2.1 time: 0.081694 Oct 03 14:35:14.921962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 339/681] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/flavors/851635981/action => generated 21 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:35:14.935699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4aa1f87-c2dc-4c2d-a252-fced453cd69b tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.936414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b33af32f-e4f4-40ef-b172-9dc28497fa54 req-5cc623bc-6d54-4991-beeb-00c4a595b060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8051f6c-c92b-41d9-9bbc-8a5b674b8de6", "tag": "e723b21e-4874-4d17-89ec-48497a8578b6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:14.946665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b33af32f-e4f4-40ef-b172-9dc28497fa54 req-5cc623bc-6d54-4991-beeb-00c4a595b060 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:14.947114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b33af32f-e4f4-40ef-b172-9dc28497fa54 req-5cc623bc-6d54-4991-beeb-00c4a595b060 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:14.947662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b33af32f-e4f4-40ef-b172-9dc28497fa54 req-5cc623bc-6d54-4991-beeb-00c4a595b060 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:14.959834 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b33af32f-e4f4-40ef-b172-9dc28497fa54 req-5cc623bc-6d54-4991-beeb-00c4a595b060 service nova] Creating event network-changed:e723b21e-4874-4d17-89ec-48497a8578b6 for instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 on n-h1-781139-2 Oct 03 14:35:14.962152 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4aa1f87-c2dc-4c2d-a252-fced453cd69b tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/851635981" status: 202 len: 0 microversion: 2.1 time: 0.030243 Oct 03 14:35:14.962891 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 343/682] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:35:14 2022] DELETE /compute/v2.1/flavors/851635981 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:14.966478 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b33af32f-e4f4-40ef-b172-9dc28497fa54 req-5cc623bc-6d54-4991-beeb-00c4a595b060 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033604 Oct 03 14:35:14.966478 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 340/683] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:14.971502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69a4a439-2b84-4545-a3c4-99a9f1ef3f89 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:14.993744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69a4a439-2b84-4545-a3c4-99a9f1ef3f89 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.026056 Oct 03 14:35:14.994361 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 341/684] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:14 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:15.015560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-77ecb64b-cc8a-4e1b-9d3e-0ec5c65bdb7f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-349261978", "id": 1947891140, "os-flavor-access:is_public": "False"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:15.037045 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-77ecb64b-cc8a-4e1b-9d3e-0ec5c65bdb7f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.025365 Oct 03 14:35:15.037667 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 344/685] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:15 2022] POST /compute/v2.1/flavors => generated 438 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:35:15.050866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13c7c278-51e4-4782-82c6-ff1252f5fa0f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bfe62bd9dfed481f9b85a1a38d9198ea"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:15.060867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:15.064127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:15.077832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.078535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.079209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:15.081473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.082239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.082764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:15.139537 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-13c7c278-51e4-4782-82c6-ff1252f5fa0f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] HTTP exception thrown: Flavor access not found for 38 / bfe62bd9dfed481f9b85a1a38d9198ea combination. Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13c7c278-51e4-4782-82c6-ff1252f5fa0f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Request method failure captured: Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/flavors/1947891140/action HTTP/1.1 Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 70 Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMfk_63kQgWGlxM1H77B9g6NjT_qiitVcxG1WwcEIUPFw5lKNHzKnFmPRz5rhBqbsXXUsXbaKGKrZQMSruUTmqb8dJmQC6RWrLPA0C3Fq3YvZF3mLbngtFCPHZ6L0-g7Vb6542M38lDfJoHS2pR02uK3nSJpDelw1TStKOiMmL-QuM Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 0591285dd2364d2882d8ba78cab4ad50 Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:35:15.142765 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0591285dd2364d2882d8ba78cab4ad50", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0591285dd2364d2882d8ba78cab4ad50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 0591285dd2364d2882d8ba78cab4ad50 Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-229988289 Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e3934e9f271d4b47b65b08ec735cd4be Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: {"removeTenantAccess": {"tenant": "bfe62bd9dfed481f9b85a1a38d9198ea"}} Oct 03 14:35:15.144384 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: exception: Flavor access not found for 38 / bfe62bd9dfed481f9b85a1a38d9198ea combination. Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1947891140', 'body': {'removeTenantAccess': {'tenant': 'bfe62bd9dfed481f9b85a1a38d9198ea'}}} Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 03 14:35:15.145210 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / bfe62bd9dfed481f9b85a1a38d9198ea combination. Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / bfe62bd9dfed481f9b85a1a38d9198ea combination. Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:15.146368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / bfe62bd9dfed481f9b85a1a38d9198ea combination. Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13c7c278-51e4-4782-82c6-ff1252f5fa0f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Returning 404 to user: Flavor access not found for 38 / bfe62bd9dfed481f9b85a1a38d9198ea combination. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13c7c278-51e4-4782-82c6-ff1252f5fa0f tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1947891140/action" status: 404 len: 124 microversion: 2.1 time: 0.097766 Oct 03 14:35:15.147520 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 342/686] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 3 14:35:15 2022] POST /compute/v2.1/flavors/1947891140/action => generated 124 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:35:15.156177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eaeb5d9b-aede-4e41-914e-1da0ab302c14 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:15.176058 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eaeb5d9b-aede-4e41-914e-1da0ab302c14 tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1947891140" status: 202 len: 0 microversion: 2.1 time: 0.025674 Oct 03 14:35:15.177357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 343/687] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:35:15 2022] DELETE /compute/v2.1/flavors/1947891140 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:15.185628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42eb6cf5-4af6-45f1-a7dd-8d22249cf83d tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:15.207190 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42eb6cf5-4af6-45f1-a7dd-8d22249cf83d tempest-FlavorsAccessNegativeTestJSON-229988289 tempest-FlavorsAccessNegativeTestJSON-229988289-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.025442 Oct 03 14:35:15.207789 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 344/688] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:15 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:15.249411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:15.252841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:15.264760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.265806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.266431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:15.267495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.268470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.268960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:15.546986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:15.560063 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d6ba7a7-f02e-4ca0-bad2-7bf04a234631 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.326700 Oct 03 14:35:15.565132 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 345/689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:15 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:15.573543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:15.574394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:15.594686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.595816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.597063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:15.599530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.602580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.603219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:15.649142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:15.656870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46649e87-6466-4ff1-bc38-aa76e7abe384 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.601003 Oct 03 14:35:15.657482 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 345/690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:15 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:15.692867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:15.693780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:15.700888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.701780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.702563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:15.703466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:15.704211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:15.704610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.110343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.128061 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0da0ac2-209b-4dc0-a254-0429de460046 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.438708 Oct 03 14:35:16.147685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.152818 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 346/691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:15 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:16.157372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.158832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.160016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:16.160856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:16.166809 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49cdff19-e3f6-4a83-9b97-f8043421adee tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.599105 Oct 03 14:35:16.167657 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 346/692] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:15 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:16.175254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:16.176168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:16.186515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.187279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.188012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.188918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.189602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.190787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.199736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.200415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.201099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.202048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.202638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.203442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.423205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.432002 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7dccdcb2-0459-4ee6-a8c2-83f98279fbf1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.261801 Oct 03 14:35:16.445686 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 347/693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:16 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:16.455691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb66faed-652e-48d2-88f6-ac3bba64823a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1468967597", "metadata": {"": ""}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb66faed-652e-48d2-88f6-ac3bba64823a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action HTTP/1.1 Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 107 Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:16.460032 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1468967597", "metadata": {"": ""}}} Oct 03 14:35:16.461522 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3609b6d4-95a0-4e25-9f44-f82ca930b4b5', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1468967597', 'metadata': {'': ''}}}} Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'': ''} Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:16.462369 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:16.463990 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb66faed-652e-48d2-88f6-ac3bba64823a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:16.465797 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb66faed-652e-48d2-88f6-ac3bba64823a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action" status: 400 len: 170 microversion: 2.1 time: 0.011318 Oct 03 14:35:16.470102 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 348/694] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 3 14:35:16 2022] POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action => generated 170 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:35:16.476143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:16.476943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:16.484523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.485261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.486237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.486970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.487426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.487852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.631616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.640031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.644214 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-67769ef1-c940-4111-b7d8-dc02bb97e523 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1318 microversion: 2.1 time: 0.488886 Oct 03 14:35:16.655596 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 347/695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:16 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:16.655596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:16.655596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:16.660195 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6d2df4a-7341-429f-8db0-ee2893ab330a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.188337 Oct 03 14:35:16.660575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.661268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.661568 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 349/696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:16 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:16.662596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.663404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.663922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.664350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.679948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:16.680552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:16.686706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.687045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.687479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.688367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.688803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.689443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.826150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.835022 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c922ed2c-cdb2-4a6c-b7bc-acf83e60a8f4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.159256 Oct 03 14:35:16.835690 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 350/697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:16 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:16.840745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:16.841372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:16.847437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.847946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.848680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.849839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:16.850293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:16.851493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:16.888186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:16.898696 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d79db13d-0452-41e4-b886-9a47e3d5b655 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.251167 Oct 03 14:35:16.913922 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 348/698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:16 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:17.000656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.008889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71ca0245-2c6d-4eb5-bfa4-6796ee4402fe tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.172032 Oct 03 14:35:17.009716 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 351/699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:16 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:17.031495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-043e0c3a-a577-4266-adb6-5d31bdae7299 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1595364950", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-043e0c3a-a577-4266-adb6-5d31bdae7299 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action HTTP/1.1 Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 619 Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:35:17.036002 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:17.037674 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:35:17.038473 n-d-781139-2 devstack@n-api.service[128868]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1595364950", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 03 14:35:17.038473 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:17.038473 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3609b6d4-95a0-4e25-9f44-f82ca930b4b5', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1595364950', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 03 14:35:17.038687 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:17.039385 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.040411 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:17.041475 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:17.041475 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:17.041475 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:35:17.041475 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:35:17.041475 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:35:17.041475 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.041996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-043e0c3a-a577-4266-adb6-5d31bdae7299 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:17.041996 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-043e0c3a-a577-4266-adb6-5d31bdae7299 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action" status: 400 len: 938 microversion: 2.1 time: 0.010081 Oct 03 14:35:17.041996 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 349/700] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 3 14:35:17 2022] POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action => generated 938 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:35:17.048079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:17.049767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.057230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.057807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.058302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.059196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.059708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.060331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.197368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:17.198105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.200675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.206087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.206650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.207319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.208182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.208809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.209269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.210100 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d6be421-66f7-4439-a441-7f4a3d508924 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.167811 Oct 03 14:35:17.211233 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 352/701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:17 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:17.237500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:17.238116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.244369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.244891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.245329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.246032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.246524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.247068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.381187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.389448 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98281243-0ea7-4c1e-9d91-f61a02dde330 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.155854 Oct 03 14:35:17.390026 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 353/702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:17 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:17.415897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1b956b6-c73d-46ab-8289-e2844935d4c3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1b956b6-c73d-46ab-8289-e2844935d4c3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action HTTP/1.1 Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 285 Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:17.422274 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:35:17.424155 n-d-781139-2 devstack@n-api.service[128869]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3609b6d4-95a0-4e25-9f44-f82ca930b4b5', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:35:17.426129 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:35:17.426923 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:35:17.428375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:35:17.429373 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:35:17.429373 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:17.429373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1b956b6-c73d-46ab-8289-e2844935d4c3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:17.429373 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1b956b6-c73d-46ab-8289-e2844935d4c3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action" status: 400 len: 619 microversion: 2.1 time: 0.013279 Oct 03 14:35:17.429728 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 354/703] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 3 14:35:17 2022] POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:35:17.429815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.436933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:17.438307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.438556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.439907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.440500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:17.441291 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a950d59-a3b3-46bf-a17f-57d56f97991c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.248072 Oct 03 14:35:17.441977 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 350/704] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:17 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:35:17.453122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.453122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.453122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.453122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.453515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.453515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.591803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:17.633762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.645654 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af133c33-3d31-4fe1-83cf-9521209080f2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.212094 Oct 03 14:35:17.646616 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 355/705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:17 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:17.668548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:17.669183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.677066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:17.678017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.678622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.679357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.679921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=11 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:17.681178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.682860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.684527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.685493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.685734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.686319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.686772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.687476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.688093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.688728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.837957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.846459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af884265-37f8-45f5-ac96-451c2492d9b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.173466 Oct 03 14:35:17.847041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 356/706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:17 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:17.860327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:17.869265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:17.869764 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-89a5f61f-fa44-48d7-963f-7556af45776e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1318 microversion: 2.1 time: 0.205555 Oct 03 14:35:17.870495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.870609 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 351/707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:17 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:17.876152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-10564497"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:17.878678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.878934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:17.879931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.881073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.882073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.882742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.883411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.885660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.886133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.886645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:17.887353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:17.887789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:17.888381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.021457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:18.074924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:18.092044 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec242460-db1d-4ab7-b079-3187d438514c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.229533 Oct 03 14:35:18.113083 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 357/708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:17 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:18.119814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:18.120837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:18.129452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.130259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.131127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.132000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.132642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.133806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.211632 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51c2b4eb-5a46-44a3-b934-995f63e2fdef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action" status: 202 len: 0 microversion: 2.1 time: 0.339977 Oct 03 14:35:18.213899 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 352/709] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:17 2022] POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:35:18.235089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1860526827"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:18.241877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:18.253057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:18.256667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.257363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.258020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.259053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.259742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.260315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.316782 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Cannot 'createImage' instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 while it is in task_state image_snapshot_pending Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action HTTP/1.1 Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 85 Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:35:18.323186 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1860526827"}} Oct 03 14:35:18.324602 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: exception: Cannot 'createImage' instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 while it is in task_state image_snapshot_pending Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3609b6d4-95a0-4e25-9f44-f82ca930b4b5', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1860526827'}}} Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:18.325493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 while it is in task_state image_snapshot_pending Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 while it is in task_state image_snapshot_pending Oct 03 14:35:18.326856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:18.328290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 409 to user: Cannot 'createImage' instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 while it is in task_state image_snapshot_pending {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:18.337856 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ef16e133-eb50-4d0d-b588-998535a23079 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action" status: 409 len: 167 microversion: 2.1 time: 0.098299 Oct 03 14:35:18.338535 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 353/710] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:18 2022] POST /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5/action => generated 167 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:35:18.350654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:18.357882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7e28579d-31d3-4f85-9a9f-7865ad129153 req-d4a9c0e1-ba21-4367-9f08-9f79fde4dbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd", "name": "network-vif-plugged", "status": "completed", "tag": "da9447c7-5ad0-491a-a638-ce2de451c682"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:18.360799 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2f98af2-7843-4229-9e8d-ed6a4097151e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.245457 Oct 03 14:35:18.368035 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 358/711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:18 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:18.374248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e28579d-31d3-4f85-9a9f-7865ad129153 req-d4a9c0e1-ba21-4367-9f08-9f79fde4dbdf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.374994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e28579d-31d3-4f85-9a9f-7865ad129153 req-d4a9c0e1-ba21-4367-9f08-9f79fde4dbdf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.375549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e28579d-31d3-4f85-9a9f-7865ad129153 req-d4a9c0e1-ba21-4367-9f08-9f79fde4dbdf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.377544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38002028-59c1-4e88-b88e-e2f9105f7e8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '.version_select at 0x7fb230aa1f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:18.397224 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7e28579d-31d3-4f85-9a9f-7865ad129153 req-d4a9c0e1-ba21-4367-9f08-9f79fde4dbdf service nova] Creating event network-vif-plugged:da9447c7-5ad0-491a-a638-ce2de451c682 for instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd on n-h2-781139-2 Oct 03 14:35:18.403955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7e28579d-31d3-4f85-9a9f-7865ad129153 req-d4a9c0e1-ba21-4367-9f08-9f79fde4dbdf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063728 Oct 03 14:35:18.405191 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 354/712] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:18.503983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:18.505604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:18.513004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.514101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.514631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.515831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.516541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.516682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.586765 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38002028-59c1-4e88-b88e-e2f9105f7e8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/images/4a9a23e0-ddfb-4274-9ce3-852298973db4" status: 204 len: 0 microversion: 2.1 time: 0.217519 Oct 03 14:35:18.587353 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 359/713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:18 2022] DELETE /compute/v2.1/images/4a9a23e0-ddfb-4274-9ce3-852298973db4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:18.595648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:18.596483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:18.604683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.605436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.606026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.607041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.607659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.609182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.777337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:18.783109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:18.787597 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16385daa-9fe6-47b1-86a2-96791fe823ed tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1535 microversion: 2.1 time: 0.193819 Oct 03 14:35:18.788394 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 360/714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:18 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1535 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:18.805418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:18.807364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:18.808538 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14e866f4-9fa9-4815-81b0-a8d3e1a2f5c0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.321881 Oct 03 14:35:18.817607 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 355/715] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:18 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:18.894282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:18.894785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:18.900826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.901351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.901788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:18.902517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:18.902961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:18.903379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.038468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:19.047166 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0266ba45-1cf7-4e4f-bf8b-ebf43488f6ff tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1318 microversion: 2.1 time: 0.157173 Oct 03 14:35:19.047725 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 361/716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:18 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:19.116901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:19.117566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:19.124062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.125011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.125733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.126479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.127166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.127668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.278027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:19.288870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f507698-83ff-4449-bf4c-23f817ffc511 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.175553 Oct 03 14:35:19.290216 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 356/717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:19 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:19.387318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:19.387923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:19.394351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.394848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.395487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.396351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.396814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.397243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.533121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:19.541529 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b785142-f3c3-410f-ba9c-fd0bdc2ef076 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.158088 Oct 03 14:35:19.542117 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 362/718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:19 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:19.811621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:19.812258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:19.819071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.819612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.820100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.820797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.821382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.821838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.834136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:19.834923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:19.841903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.842474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.842984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:19.843740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:19.844326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:19.844853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.028411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.037076 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46a425cf-4a35-45e9-a6ea-dc0b3f403a63 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1535 microversion: 2.1 time: 0.229230 Oct 03 14:35:20.057141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 357/719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:19 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1535 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:20.205566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.215236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230d63ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.217016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.217492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.217915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.220289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.222425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.223650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-890130c4-7bfa-48c8-ab00-bbf1d49b9a21 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.393418 Oct 03 14:35:20.224871 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 363/720] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:19 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:20.228876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.229503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:20.232213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.232857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.233348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.235581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.236456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.236893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.237604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.238304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.238728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.242859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:20.244601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.245116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.245566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.251593 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9559cbc-34f3-4ab9-9bcc-dbb7d19c64d7 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.193105 Oct 03 14:35:20.252174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 358/721] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.263276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230a5e820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.265707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.266177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.266704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.287164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.287859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.287992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.300788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.301293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.301968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.310475 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c18d05ae-d24a-403c-a67d-9f50c033a9e6 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.050579 Oct 03 14:35:20.311078 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 359/722] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:20.317383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.322703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:20.327231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.328740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.329211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.329906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.330357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.330810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.349308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:20.370379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.378383 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-626fdf7a-725b-4c0d-8419-7ef17071eb07 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1467 microversion: 2.1 time: 0.152822 Oct 03 14:35:20.378962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 364/723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1467 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:20.383644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230a69b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.385465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.385936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.386358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.400698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.401378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.401623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.411836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.412328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.412737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.418503 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c03261c1-0a5f-4bd3-aad7-bfcc634a5ef0 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.038604 Oct 03 14:35:20.419287 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 365/724] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.426033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:20.426769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:20.432808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.433332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.433763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.434460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.434903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.435319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.457759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lazy-loading 'flavor' on Instance uuid d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:20.468314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.476965 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9f0ea1f8-341e-492f-9adf-345add3567ba tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.164889 Oct 03 14:35:20.477844 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 360/725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:20.482093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230c654c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.483971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.484458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.484894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.500622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.501149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.501631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.508563 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9277b835-9863-4adf-a769-badb95ab7090 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.029879 Oct 03 14:35:20.509197 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 361/726] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.513644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e57613e7-0f19-4f36-befe-fd2a19a23122 req-ef0405cb-f9f0-4b90-aab7-743deb86cc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf712c-1bc6-4798-9771-c906336c84a9", "name": "network-vif-plugged", "status": "completed", "tag": "d499f67e-28ef-4b4d-a430-de0827a421bc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:20.523951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e57613e7-0f19-4f36-befe-fd2a19a23122 req-ef0405cb-f9f0-4b90-aab7-743deb86cc18 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.524507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e57613e7-0f19-4f36-befe-fd2a19a23122 req-ef0405cb-f9f0-4b90-aab7-743deb86cc18 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.524998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e57613e7-0f19-4f36-befe-fd2a19a23122 req-ef0405cb-f9f0-4b90-aab7-743deb86cc18 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.529306 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b37f292-c027-4cd9-95fe-e5c079964bec tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd/action" status: 202 len: 0 microversion: 2.1 time: 0.107081 Oct 03 14:35:20.533075 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 366/727] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:20 2022] POST /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:20.535247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57c0fc20-d186-4501-9914-398dddb85f35 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230acfe50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.537266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0fc20-d186-4501-9914-398dddb85f35 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.537981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0fc20-d186-4501-9914-398dddb85f35 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.538416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c0fc20-d186-4501-9914-398dddb85f35 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.544694 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e57613e7-0f19-4f36-befe-fd2a19a23122 req-ef0405cb-f9f0-4b90-aab7-743deb86cc18 service nova] Creating event network-vif-plugged:d499f67e-28ef-4b4d-a430-de0827a421bc for instance f8bf712c-1bc6-4798-9771-c906336c84a9 on n-h2-781139-2 Oct 03 14:35:20.550004 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e57613e7-0f19-4f36-befe-fd2a19a23122 req-ef0405cb-f9f0-4b90-aab7-743deb86cc18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039678 Oct 03 14:35:20.551045 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 362/728] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.556998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.557703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:20.558629 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57c0fc20-d186-4501-9914-398dddb85f35 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.027108 Oct 03 14:35:20.559412 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 367/729] 10.222.0.20 () {58 vars in 1179 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.564610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.565408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:20.569252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.570060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.570751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.571857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.572593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.573571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.573711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.574070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.574506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.575200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.575671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.576090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.718053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.726745 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a17f7b6-977c-4b61-9ac2-3d3c8623a494 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.165726 Oct 03 14:35:20.727562 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 368/730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:20.746036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:20.748026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230a35a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.749850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.750537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.750979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.755065 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8eae9a8a-c0d7-4d2f-a0b4-6b56a76c368e tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1475 microversion: 2.1 time: 0.202626 Oct 03 14:35:20.755760 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 363/731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:20.768372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.768866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.769332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.780012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.780493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.780954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.788142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45fe5218-5422-496e-8bf3-1877993c8f0d tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043645 Oct 03 14:35:20.788771 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 369/732] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.799645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230d98700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.801672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.802153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.802583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.815881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.816350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.816778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.825346 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-958e0859-9f57-4585-bf1d-2ea9c4f25e02 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.029660 Oct 03 14:35:20.825923 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 364/733] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.840182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230d01160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.842028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.842504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.842945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.856080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.857226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.857656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.863854 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1c9e73f-6871-4a8a-8ab7-0170595ad7b5 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.027337 Oct 03 14:35:20.864507 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 370/734] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:20.878589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Calling method '.version_select at 0x7fb230d98f70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:20.880425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.880897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.881352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.894517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.894978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.895504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:20.906041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:20.906502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:20.906921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.068972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:21.069582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:21.076037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.077226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.077666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.078353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.078805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.079225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.131033 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f5852b3-f3a9-4b22-bae6-335a48e35d10 tempest-HypervisorAdminTestJSON-954462398 tempest-HypervisorAdminTestJSON-954462398-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.255776 Oct 03 14:35:21.132151 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 365/735] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 3 14:35:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:21.232957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:21.240796 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e024016e-8bc0-4355-8113-f22658c21223 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1535 microversion: 2.1 time: 0.175869 Oct 03 14:35:21.241386 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 371/736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:21 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1535 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:21.250592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:21.251518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:21.259799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.260370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.260873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.261632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.262125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.262647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.398954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:21.416533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:21.416533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:21.416773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f7f4f91-9e7b-4e7c-bff0-a1dc43118179 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.170346 Oct 03 14:35:21.417523 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 366/737] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:21 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:21.499547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:21.500146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:21.506490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.506967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.507397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.508093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.508531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.508957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.696575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:21.706123 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe8f69d5-3c02-47a7-959a-dd769192e107 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1311 microversion: 2.1 time: 0.210593 Oct 03 14:35:21.706783 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 372/738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:21 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:21.751504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:21.752713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:21.759611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.760217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.760708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.762186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.762746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.763233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.779159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:21.780030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:21.786183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.786673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.787109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.787870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:21.788318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:21.788876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:21.994018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:21.995841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:22.010529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58d81209-bb83-4c1c-9b2d-7de4df11e1ef tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.262937 Oct 03 14:35:22.015802 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 367/739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:21 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:22.031524 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef27d3b3-f7d6-45e4-9b8a-ab4f0f2bb2dd tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1458 microversion: 2.1 time: 0.256247 Oct 03 14:35:22.033016 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 373/740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:21 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1458 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:22.061071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:22.061706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:22.070739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.071506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.072105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.073231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.073686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.074113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.267543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:22.268894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:22.279347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.280281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.281182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.282153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.282914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.283925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.499904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:22.509148 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20ee101a-f90a-423b-800e-f605d9188b8c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1541 microversion: 2.1 time: 0.247728 Oct 03 14:35:22.525668 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 374/741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:22 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1541 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:22.533019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:22.534595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:22.542460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.542956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.543557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.544601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.545092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.545519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.717065 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b1761f5-5b00-4cbb-9de4-6c211948ff14 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1609 microversion: 2.1 time: 0.663157 Oct 03 14:35:22.717680 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 368/742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:22 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1609 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:22.735318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:22.736069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:22.744714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.745317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.746330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.747278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.748679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.749377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.759539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:22.768478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:22.774225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:22.779047 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-535d2135-dbf3-46b2-a66c-4773e8410422 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1569 microversion: 2.25 time: 0.251820 Oct 03 14:35:22.780203 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 375/743] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:22 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:22.788137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:22.795316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.795812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.796257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.797302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.802795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.803305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.835495 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1adf6eeb-60a1-40e4-9208-3e13b9e7ef1e tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053427 Oct 03 14:35:22.844105 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 376/744] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:35:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:22.850875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-781139-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:22.853736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:22.862008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.862495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.863135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.863896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.865684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.866109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.899013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Lazy-loading 'flavor' on Instance uuid d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:22.914072 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd while it is in vm_state suspended Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Request method failure captured: Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd/action HTTP/1.1 Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 97 Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMF8Roj6rFkV91RPyfUkeJ7TKNLgh74nbGkhrCqLMDHIlPChUrXv_8p3wiRKm-662ly74riAzFFp_EdiMpKTdg2yhGhCeveAbkSZWT4KbvxT5UrJh1yT-Wb1Lb_GkLYSc49Vcss7YP3Q1FrcoaP5Q4iTUh0-OjHd6MgRfXRDVmHGdY Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b091f970b25d48cca48129106573220d Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveMigrationNegativeTest-781993019 Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:35:22.917141 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b091f970b25d48cca48129106573220d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b091f970b25d48cca48129106573220d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b091f970b25d48cca48129106573220d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b091f970b25d48cca48129106573220d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-LiveMigrationNegativeTest-781993019 Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b091f970b25d48cca48129106573220d Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-781993019 Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-LiveMigrationNegativeTest-781993019-project-admin Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 4a2431f41b1b41e4b967639d6ecc7229 Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-LiveMigrationNegativeTest-781993019-project-admin Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: {"os-migrateLive": {"host": "n-h1-781139-2", "block_migration": true, "disk_over_commit": false}} Oct 03 14:35:22.918438 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'os-migrateLive' instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd while it is in vm_state suspended Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd86bd398-6cf6-4e9a-9f6b-04c84cf5fffd', 'body': {'os-migrateLive': {'host': 'n-h1-781139-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 03 14:35:22.919159 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:22.920237 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd while it is in vm_state suspended Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd while it is in vm_state suspended Oct 03 14:35:22.921487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:22.926276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd while it is in vm_state suspended {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:22.928535 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3282f53-d030-4bbe-8dac-518ca30aef38 tempest-LiveMigrationNegativeTest-781993019 tempest-LiveMigrationNegativeTest-781993019-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd/action" status: 409 len: 155 microversion: 2.1 time: 0.083170 Oct 03 14:35:22.934227 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 377/745] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:22 2022] POST /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd/action => generated 155 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:35:22.940291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:22.941220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:22.949269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.949413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:22.949765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.950208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.950923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:22.951538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:22.951808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:22.960917 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94177cc1-d742-481d-b548-b05d6e3de0e7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1493 microversion: 2.1 time: 0.235036 Oct 03 14:35:22.976983 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 369/746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:22 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1493 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:22.986708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:22.987399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.005198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.009738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.009738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.009738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.010885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:35:23.012004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.012542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.103829 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f98bc75c-f585-42f8-8b94-900dcdfdf69d tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 204 len: 0 microversion: 2.1 time: 0.167676 Oct 03 14:35:23.104753 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 378/747] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:22 2022] DELETE /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:23.110449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:23.111362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.118281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.118981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.119599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.120469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.121191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.121585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.126082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:23.274915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:23.280709 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25d49b68-1e13-4bcd-888c-ef0d4ebf3d7e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1644 microversion: 2.1 time: 0.297944 Oct 03 14:35:23.281546 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 370/748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:22 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1644 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:23.292252 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eec5eae0-fce7-4d5d-9483-115b4da40593 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.181160 Oct 03 14:35:23.292252 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 379/749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:23 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:23.292492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:23.293114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.303183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:23.303836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.309825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.310019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.310333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.310785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.311107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.311228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.311903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.312316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.312541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.313038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.313182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.313657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.495303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:23.505278 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f705395e-5251-4ae9-a02c-3df50ed8c39b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1464 microversion: 2.1 time: 0.216105 Oct 03 14:35:23.505994 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 380/750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:23 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:23.538031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:23.538792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.545273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.545844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.546306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.547114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.547562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.547982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.667924 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f972c514-0d85-4834-98f1-7749ca8b01f1 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1644 microversion: 2.1 time: 0.368641 Oct 03 14:35:23.681448 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 371/751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:23 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1644 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:23.689844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:23.694263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.694750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.695384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.696661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.697328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.697809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.709677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:23.719247 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72c16e23-a0a2-41dc-b4b9-804377a5aa51 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1541 microversion: 2.1 time: 0.185349 Oct 03 14:35:23.729690 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2071d62e-f7d1-4776-9e48-cdb8581743f8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037890 Oct 03 14:35:23.729690 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 372/752] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:35:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:35:23.736315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:23.736858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.740084 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 381/753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:23 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1541 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:23.743440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.743874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.744314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.745053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.745502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.745922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.806592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:23.808105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.813258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.813745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.814374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.815278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.815727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.816223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.841926 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-098c71ba-4bee-4c73-bfa7-e19aac2cd912 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9/action" status: 202 len: 0 microversion: 2.1 time: 0.108947 Oct 03 14:35:23.843833 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 373/754] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:23 2022] POST /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:23.853138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:23.853935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:23.856014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:23.861664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.864167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.865508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.874021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:23.875905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:23.876596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:23.982029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:23.996307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:23.998399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:24.000557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f6f7f15-a283-4119-b6dd-0fc2006bbae9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1544 microversion: 2.25 time: 0.198632 Oct 03 14:35:24.002531 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 382/755] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:23 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:24.031302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-045ef710-9c91-4867-82a7-27511de5221d tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '.version_select at 0x7fb230aa1d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:24.035385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-045ef710-9c91-4867-82a7-27511de5221d tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.036268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-045ef710-9c91-4867-82a7-27511de5221d tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.037049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-045ef710-9c91-4867-82a7-27511de5221d tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.055131 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-045ef710-9c91-4867-82a7-27511de5221d tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.028217 Oct 03 14:35:24.055762 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 383/756] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 3 14:35:24 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:35:24.070387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:24.071005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:24.077027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.077508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.077673 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-426199f6-7cfd-4d7e-9479-d58984506d44 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1649 microversion: 2.1 time: 0.229514 Oct 03 14:35:24.077963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.078257 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 374/757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:23 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1649 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:24.078639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.080145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.080769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.215357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid 660e7ae4-72b0-4c44-8ece-82014c070066 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:24.230307 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6e930153-392d-467b-ba1a-e06e556e17db tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 2037 microversion: 2.25 time: 0.163657 Oct 03 14:35:24.230897 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 384/758] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:24 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 2037 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:35:24.264956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9dcc406-01a3-43bb-9690-7a27e859a7d0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Action: 'create', calling method: .version_select at 0x7fb230d4b940>, body: {"keypair": {"name": "tempest-keypair-6568233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdmG6U6c0E6Y0KGV4ncjNyBLsYoK6HNKOYdJBX2zTLgrsBo+vhUyQ+SZoK4xprW5UB56XWSJhvewGumam/RWxx+OVPMn/AR79WaQQbqgcBq9HIlzCkBPoSuJ4Y0COgHIw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:24.282098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c9dcc406-01a3-43bb-9690-7a27e859a7d0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:24.287776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c9dcc406-01a3-43bb-9690-7a27e859a7d0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for user 19b2b042d70a426989bb5dc6b986b7c5 and project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:24.311716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:24.312323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:24.320488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.321304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.323323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.324394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.325047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.325167 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9dcc406-01a3-43bb-9690-7a27e859a7d0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.25 time: 0.063918 Oct 03 14:35:24.327606 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 375/759] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:35:24 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:35:24.332513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.480513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-bf69c522-7a44-4107-a5ba-46217e045f7b req-bbf67722-67c9-4ea4-948c-9bc2e76de63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3609b6d4-95a0-4e25-9f44-f82ca930b4b5", "name": "network-vif-plugged", "status": "completed", "tag": "521b31a5-6adc-4b91-aab6-380f628e4b11"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:24.503687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bf69c522-7a44-4107-a5ba-46217e045f7b req-bbf67722-67c9-4ea4-948c-9bc2e76de63b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.505405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bf69c522-7a44-4107-a5ba-46217e045f7b req-bbf67722-67c9-4ea4-948c-9bc2e76de63b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.507300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bf69c522-7a44-4107-a5ba-46217e045f7b req-bbf67722-67c9-4ea4-948c-9bc2e76de63b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.547405 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-bf69c522-7a44-4107-a5ba-46217e045f7b req-bbf67722-67c9-4ea4-948c-9bc2e76de63b service nova] Creating event network-vif-plugged:521b31a5-6adc-4b91-aab6-380f628e4b11 for instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 on n-h1-781139-2 Oct 03 14:35:24.563944 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-bf69c522-7a44-4107-a5ba-46217e045f7b req-bbf67722-67c9-4ea4-948c-9bc2e76de63b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087200 Oct 03 14:35:24.564565 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 376/760] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:35:24.570164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:24.570890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:24.579848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.580511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.581138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.582012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.582680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.583283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.588166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:24.601218 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acc6244a-0785-4dbd-b20d-bc8b230d2eaa tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.293255 Oct 03 14:35:24.602182 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 385/761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:24 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:24.745208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:24.746020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:24.746632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:24.754610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.755567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.756755 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f285863-7d30-4aca-838e-9ebfcf5bb330 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1464 microversion: 2.1 time: 0.190767 Oct 03 14:35:24.760977 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 377/762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:24 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:24.761356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:24.762309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:24.762869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:24.763387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.000865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:25.023302 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab52dedc-0cdd-4e1d-9862-4eed68e8df38 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1541 microversion: 2.1 time: 0.283323 Oct 03 14:35:25.024013 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 386/763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:24 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1541 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:25.106724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:25.110887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:25.124256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.125259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.125504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.126822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.129389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.130560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.145010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Action: 'update', calling method: .version_select at 0x7fb231157700>, body: {"quota_set": {"ram": "5120"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:25.237652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.238233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.238589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.239578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.240037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.240470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.299509 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-914203bd-083a-481d-ae0a-ef11762d1761 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e" status: 200 len: 148 microversion: 2.57 time: 0.342789 Oct 03 14:35:25.300364 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 378/764] 10.222.0.20 () {62 vars in 1303 bytes} [Mon Oct 3 14:35:24 2022] PUT /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e => generated 148 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:35:25.313700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Calling method '.version_select at 0x7fb230df2d30>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:25.390396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.390887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.391316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.392392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.392841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.393500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.430717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2395668-5163-4810-a0b2-09c152e3ec8e tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e/detail" status: 200 len: 463 microversion: 2.57 time: 0.122833 Oct 03 14:35:25.431495 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4958f411-5379-43e6-8c7f-8b5c59867e3b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1629 microversion: 2.1 time: 0.332817 Oct 03 14:35:25.444272 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 387/765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:25 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1629 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:25.453499 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 379/766] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Oct 3 14:35:25 2022] GET /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e/detail => generated 463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:35:25.476231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-781139-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:25.481879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:25.499061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.501834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.502308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.503109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.504792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.506714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.572095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-896860d6-30b9-4824-8a78-4256ceace7e3 req-6c441d7f-df58-4b4f-bbf8-87ce5616c492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd", "name": "network-vif-deleted", "tag": "da9447c7-5ad0-491a-a638-ce2de451c682"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:25.590691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lazy-loading 'flavor' on Instance uuid f8bf712c-1bc6-4798-9771-c906336c84a9 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:25.604965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-896860d6-30b9-4824-8a78-4256ceace7e3 req-6c441d7f-df58-4b4f-bbf8-87ce5616c492 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.605461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-896860d6-30b9-4824-8a78-4256ceace7e3 req-6c441d7f-df58-4b4f-bbf8-87ce5616c492 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.605918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-896860d6-30b9-4824-8a78-4256ceace7e3 req-6c441d7f-df58-4b4f-bbf8-87ce5616c492 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.621772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Going to try to live migrate instance to n-h1-781139-2 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:35:25.651235 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-896860d6-30b9-4824-8a78-4256ceace7e3 req-6c441d7f-df58-4b4f-bbf8-87ce5616c492 service nova] Creating event network-vif-deleted:da9447c7-5ad0-491a-a638-ce2de451c682 for instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd on n-h2-781139-2 Oct 03 14:35:25.670228 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-896860d6-30b9-4824-8a78-4256ceace7e3 req-6c441d7f-df58-4b4f-bbf8-87ce5616c492 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088528 Oct 03 14:35:25.672988 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 380/767] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:25.695820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:25.702066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:25.727821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.728913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.731470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.737556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:25.740240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:25.742136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:25.942273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:25.946292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:25.951650 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b0a830a-100b-4ee2-9d4e-1cae823ded61 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.272860 Oct 03 14:35:25.952405 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 381/768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:25 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:25.957205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Action: 'update', calling method: .version_select at 0x7fb230a8ac10>, body: {"quota_set": {"ram": "2048"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:26.039282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.039938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.040580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.041513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.041974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.042557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.082233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.083872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.084911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.086333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.087002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.087524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.167938 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-caea26d7-c492-4d9d-88d6-26132c7f0a21 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e?user_id=2537d1d8d4de4ed69f8b1aa514fed993" status: 200 len: 148 microversion: 2.57 time: 0.214269 Oct 03 14:35:26.169146 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 382/769] 10.222.0.20 () {62 vars in 1384 bytes} [Mon Oct 3 14:35:25 2022] PUT /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e?user_id=2537d1d8d4de4ed69f8b1aa514fed993 => generated 148 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:35:26.180208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:26.181479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:26.189563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.190209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.191366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.192557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.193312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.194086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.251332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.252481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.253182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.254677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lazy-loading 'fault' on Instance uuid d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:26.306186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:26.315947 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c01835ce-8934-43ab-98d6-2da5b11a122b tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 200 len: 1308 microversion: 2.1 time: 0.144779 Oct 03 14:35:26.316679 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 383/770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:26 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:26.321945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:26.322644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:26.328699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.329422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.329860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.330721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:26.331168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:26.331766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:26.469553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:26.477759 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6bc53378-ff4d-4c57-8603-a9e31be98f1f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1541 microversion: 2.1 time: 0.159678 Oct 03 14:35:26.478345 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 384/771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:26 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1541 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:26.482613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e17c319f-9d29-4f1e-9eee-c6e7d948a317 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] Calling method '.version_select at 0x7fb230a98c10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:26.569526 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e17c319f-9d29-4f1e-9eee-c6e7d948a317 tempest-QuotasAdminTestV257-1770940113 tempest-QuotasAdminTestV257-1770940113-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e?user_id=2537d1d8d4de4ed69f8b1aa514fed993" status: 200 len: 190 microversion: 2.57 time: 0.090080 Oct 03 14:35:26.570107 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 385/772] 10.222.0.20 () {60 vars in 1364 bytes} [Mon Oct 3 14:35:26 2022] GET /compute/v2.1/os-quota-sets/cbf469e23661479190988787ecfad14e?user_id=2537d1d8d4de4ed69f8b1aa514fed993 => generated 190 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:35:26.574639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-958543930", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "3bec1a14-e895-4900-8f12-af133bd5e217"}], "security_groups": [{"name": "tempest-securitygroup--860148827"}], "key_name": "tempest-keypair-6568233", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:26.684190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] validate_networks() for [('3bec1a14-e895-4900-8f12-af133bd5e217', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:27.078144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:27.079428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:27.079964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:27.080403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:27.080838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:27.089733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.090239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.090657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.091366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.091825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.092244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.109727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:27.114677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for user 19b2b042d70a426989bb5dc6b986b7c5 and project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:27.127075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:27.129528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:27.182155 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4eeade63-8a85-41d0-abf0-692b57d0630a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 0.611001 Oct 03 14:35:27.183332 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 386/773] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:35:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:35:27.209314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:27.210124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:27.219957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.220448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.221096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.221966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.222424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.222853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.444247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:27.460428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e3298b74-72f1-4cc5-9993-90d93cab3fc9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1471 microversion: 2.1 time: 0.275980 Oct 03 14:35:27.463150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 387/774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:27 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:27.469787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83e7ac0e-5335-42a0-9de5-d80984f927e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:27.470785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83e7ac0e-5335-42a0-9de5-d80984f927e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:27.493738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:27.553295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83e7ac0e-5335-42a0-9de5-d80984f927e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:27.563396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83e7ac0e-5335-42a0-9de5-d80984f927e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:27.565008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83e7ac0e-5335-42a0-9de5-d80984f927e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:27.567215 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83e7ac0e-5335-42a0-9de5-d80984f927e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1282 microversion: 2.25 time: 0.101781 Oct 03 14:35:27.581436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 388/775] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:27 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:27.581436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:27.581436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:27.588299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.588299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.588299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.588299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.588596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.588596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.607930 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] HTTP exception thrown: Instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd could not be found. Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Request method failure captured: Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd HTTP/1.1 Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMEpu2JVt_9QiMVg7_S0lCbIZtcQvZrXmV5aTWeiK-uQc0tzIrwM8wQVpmM7gcGpcT9vbtr0LBpdsdQOP-B6jVka9Q9ljJjjqVH9MMjzBASR_YdTFye8gjbtvx5tqJGGb2bnhN0uChhbqR1TAFsmD-2pn5Cq-WvwfQzHg5kEJGYj5A Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 1bd1040ed429433ab0b563f842e05ef2 Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-LiveMigrationNegativeTest-725374940 Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:35:27.610022 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1bd1040ed429433ab0b563f842e05ef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1bd1040ed429433ab0b563f842e05ef2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1bd1040ed429433ab0b563f842e05ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1bd1040ed429433ab0b563f842e05ef2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-LiveMigrationNegativeTest-725374940 Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 1bd1040ed429433ab0b563f842e05ef2 Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-725374940 Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-LiveMigrationNegativeTest-725374940-project Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 41de1ec36c284e418fca1bfcede0d595 Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-LiveMigrationNegativeTest-725374940-project Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd could not be found. Oct 03 14:35:27.611356 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'd86bd398-6cf6-4e9a-9f6b-04c84cf5fffd'} Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd could not be found. Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:27.612129 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd could not be found. Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd could not be found. Oct 03 14:35:27.614503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:27.615578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Returning 404 to user: Instance d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:27.615578 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ff50e19-415a-4303-8620-daf2f8499545 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd" status: 404 len: 111 microversion: 2.1 time: 0.041848 Oct 03 14:35:27.615578 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 389/776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:27 2022] GET /compute/v2.1/servers/d86bd398-6cf6-4e9a-9f6b-04c84cf5fffd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:27.618705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:27.619587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:27.626823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.627414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.627854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.628800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.629348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.629885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.795968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:27.807000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a736bc0d-c78b-4d15-b118-14e8c1dbed18 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1541 microversion: 2.1 time: 0.192966 Oct 03 14:35:27.807540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 390/777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:27 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1541 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:27.812053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:27.812556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:27.818852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.819300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.819733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.820435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:27.820889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:27.821387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:27.849212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:35:27.982925 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-01add7e8-d1ca-4509-82be-0b542f0143e4 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 204 len: 0 microversion: 2.1 time: 0.174076 Oct 03 14:35:27.983658 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 391/778] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:27 2022] DELETE /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:27.994608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:27.995341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:28.008634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.009161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.009593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.010685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.011140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.011567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.159913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:28.171706 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-65bf8013-436d-43a2-8fef-e2b9e1d1c3b5 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1473 microversion: 2.1 time: 0.183093 Oct 03 14:35:28.172483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 392/779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:27 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:28.488846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:28.489500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:28.496249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.496774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.497246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.497947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.498522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.498970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.642394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:28.651989 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5ee23c8-eb38-47f5-99f9-269defef5ae9 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1477 microversion: 2.1 time: 0.167128 Oct 03 14:35:28.652686 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 393/780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:28 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:28.657590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:28.658204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:28.664731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.665184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.665792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.666574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.666976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.667377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.733050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:28.742431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:28.744624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:28.746502 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-872716cd-f35f-47e5-a8d3-598b3bdb596a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1278 microversion: 2.25 time: 0.092934 Oct 03 14:35:28.753408 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 394/781] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:28 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:28.831028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:28.832035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:28.838440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.838951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.839377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.840099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.840505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.840936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.854252 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7217d3d4-5877-47ea-810c-7a3fed29971b tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9/action" status: 202 len: 0 microversion: 2.1 time: 3.392392 Oct 03 14:35:28.855137 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 388/782] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:25 2022] POST /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9/action => generated 0 bytes in 3394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:28.863713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:28.864644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:28.874221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.875081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.875841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:28.877642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:28.878356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:28.878766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:29.001499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:29.007184 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0733079e-7457-467e-800d-322aaa0c486a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1536 microversion: 2.1 time: 0.180262 Oct 03 14:35:29.007775 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 395/783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:28 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1536 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:29.033658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:29.041794 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25cc3a9f-02b4-4cf1-a68f-514e3324e34f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.181806 Oct 03 14:35:29.042394 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 389/784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:28 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:29.195817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:29.196587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:29.203124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:29.203625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:29.204050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:29.204731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:29.205205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:29.205628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:29.381247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:29.389662 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5ce317c7-47b5-43f3-84ff-7ce091079ba0 tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1473 microversion: 2.1 time: 0.197837 Oct 03 14:35:29.390700 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 396/785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:29 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:29.677704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:29.678523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:29.686495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:29.687655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:29.688313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:29.689281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:29.689923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:29.690692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:29.773289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:29.782373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:29.799828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:29.800304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:29.800750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:29.806146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:29.806973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:29.807402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:29.902380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:29.903708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:29.915186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:29.916733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:29.917894 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c9134a0-83b3-4f43-a4e4-6fed1587e3e4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1352 microversion: 2.25 time: 0.149820 Oct 03 14:35:29.918794 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 397/786] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:29 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:35:29.921215 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-651e8bf5-8a6e-4ec7-a51d-3317abc0a5cf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1477 microversion: 2.1 time: 0.249480 Oct 03 14:35:29.921914 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 390/787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:29 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:30.041024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:30.042680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:30.060255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.061933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.063037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.064835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.065706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:30.065706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:30.079526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.084639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.111415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.113211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.116416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.117504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.118200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.118782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.375910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:30.387875 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-02f46602-dde1-4dad-b384-938afe6121ba tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1536 microversion: 2.1 time: 0.358092 Oct 03 14:35:30.400965 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 398/788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:30 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1536 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:30.419049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ad638b71-4fc0-4bc0-b510-1fb6362c201e req-afa3cd31-767a-4a5b-8420-7449d6944709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8", "name": "network-vif-deleted", "tag": "1baf58e4-20c8-4388-9943-c8b753eb469b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:30.437257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad638b71-4fc0-4bc0-b510-1fb6362c201e req-afa3cd31-767a-4a5b-8420-7449d6944709 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.438145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad638b71-4fc0-4bc0-b510-1fb6362c201e req-afa3cd31-767a-4a5b-8420-7449d6944709 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.439369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad638b71-4fc0-4bc0-b510-1fb6362c201e req-afa3cd31-767a-4a5b-8420-7449d6944709 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.456135 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ad638b71-4fc0-4bc0-b510-1fb6362c201e req-afa3cd31-767a-4a5b-8420-7449d6944709 service nova] Creating event network-vif-deleted:1baf58e4-20c8-4388-9943-c8b753eb469b for instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 on n-h2-781139-2 Oct 03 14:35:30.462323 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ad638b71-4fc0-4bc0-b510-1fb6362c201e req-afa3cd31-767a-4a5b-8420-7449d6944709 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064197 Oct 03 14:35:30.467440 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 399/789] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:30.475974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:30.477177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:30.485746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.486607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.487314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.488998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.489777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.490595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.550897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.551888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.552606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.552990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lazy-loading 'fault' on Instance uuid 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:30.557908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:30.612479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41de1ec36c284e418fca1bfcede0d595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd1040ed429433ab0b563f842e05ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:30.630659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:30.644115 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a0b3d6a4-5875-495b-a837-8113e17aaa8a tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 200 len: 1307 microversion: 2.1 time: 0.172054 Oct 03 14:35:30.649125 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 400/790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:30 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:30.650151 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-260f4ee9-d003-4dcf-9007-cb80f75e6310 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.586077 Oct 03 14:35:30.652655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 391/791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:30 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:30.667855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7d5bf82f-b8a8-4117-8517-3e12881afc4d req-b8713cc6-b236-45cb-b5d2-d03638e71b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc3a975-8b74-4921-9106-0160c9bcc3bf", "name": "network-vif-unplugged", "status": "completed", "tag": "3114f95d-0543-4f63-a146-ecadff0a8ba9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:30.684198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7d5bf82f-b8a8-4117-8517-3e12881afc4d req-b8713cc6-b236-45cb-b5d2-d03638e71b9a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.684675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7d5bf82f-b8a8-4117-8517-3e12881afc4d req-b8713cc6-b236-45cb-b5d2-d03638e71b9a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.685124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7d5bf82f-b8a8-4117-8517-3e12881afc4d req-b8713cc6-b236-45cb-b5d2-d03638e71b9a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.702223 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7d5bf82f-b8a8-4117-8517-3e12881afc4d req-b8713cc6-b236-45cb-b5d2-d03638e71b9a service nova] Creating event network-vif-unplugged:3114f95d-0543-4f63-a146-ecadff0a8ba9 for instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf on n-h1-781139-2 Oct 03 14:35:30.709484 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7d5bf82f-b8a8-4117-8517-3e12881afc4d req-b8713cc6-b236-45cb-b5d2-d03638e71b9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051064 Oct 03 14:35:30.711461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 392/792] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:30.834311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-547848477", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:30.901754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:30.946390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:30.948745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:30.956298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.956711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.957218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:30.958130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:30.958608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:30.959053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.162280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:31.162703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:31.163225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:31.163634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:31.164056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:31.176192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.176683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.177217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.177993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.178446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.179432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:31.180313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.200488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:31.202426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:31.203903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e9b591b-5d68-49d4-9b96-92142aa2c2b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1340 microversion: 2.25 time: 0.263855 Oct 03 14:35:31.204539 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 393/793] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:30 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1340 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:35:31.207575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Getting quotas for project a80020ec000d4ca8be3d5aadb8c820b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:31.210221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:31.211009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:31.214764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Getting quotas for user b9ac507afaef4475939e3390549cd2e9 and project a80020ec000d4ca8be3d5aadb8c820b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:31.217347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.218032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.218628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.219498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.220108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.220692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.229914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:31.232385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:31.283819 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6136b17b-adf0-43af-abe9-82d6ef352134 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632512 Oct 03 14:35:31.284578 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 401/794] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:35:31.296989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06f3628e-63e4-4161-991d-d36c6656598f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:31.297466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-06f3628e-63e4-4161-991d-d36c6656598f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:31.372737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-06f3628e-63e4-4161-991d-d36c6656598f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:31.385933 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06f3628e-63e4-4161-991d-d36c6656598f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1221 microversion: 2.1 time: 0.093778 Oct 03 14:35:31.386679 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 402/795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:31 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:31.414885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:31.415902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:31.423889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.425261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.425894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.426889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.427497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.428073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.521892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:31.525789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:31.530893 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5bf97d16-f369-4fab-8e98-0d0aaa6d44b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1477 microversion: 2.1 time: 0.325084 Oct 03 14:35:31.544389 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 394/796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:31 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:31.646184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:31.654891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-892a8809-4108-4545-99fa-35f5474e8751 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1536 microversion: 2.1 time: 0.245555 Oct 03 14:35:31.660955 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 403/797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:31 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1536 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:31.677082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:31.677700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] [instance: 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:31.684913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.685443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:31.685875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.686141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:31.686646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.687518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.688506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.689675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.697044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.697558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.698254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.699690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:31.700169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:31.701553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:31.711300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] HTTP exception thrown: Instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 could not be found. Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Request method failure captured: Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 HTTP/1.1 Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMEpu2JVt_9QiMVg7_S0lCbIZtcQvZrXmV5aTWeiK-uQc0tzIrwM8wQVpmM7gcGpcT9vbtr0LBpdsdQOP-B6jVka9Q9ljJjjqVH9MMjzBASR_YdTFye8gjbtvx5tqJGGb2bnhN0uChhbqR1TAFsmD-2pn5Cq-WvwfQzHg5kEJGYj5A Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 1bd1040ed429433ab0b563f842e05ef2 Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveMigrationNegativeTest-725374940 Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:31.713622 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1bd1040ed429433ab0b563f842e05ef2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1bd1040ed429433ab0b563f842e05ef2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1bd1040ed429433ab0b563f842e05ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1bd1040ed429433ab0b563f842e05ef2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-LiveMigrationNegativeTest-725374940 Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 1bd1040ed429433ab0b563f842e05ef2 Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-725374940 Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-LiveMigrationNegativeTest-725374940-project Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 41de1ec36c284e418fca1bfcede0d595 Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-LiveMigrationNegativeTest-725374940-project Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 could not be found. Oct 03 14:35:31.715265 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8'} Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 could not be found. Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:31.716196 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 could not be found. Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 could not be found. Oct 03 14:35:31.717887 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:31.723707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] Returning 404 to user: Instance 0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:31.725621 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b27373e-b9cc-4e54-bf6b-eb51170a044f tempest-LiveMigrationNegativeTest-725374940 tempest-LiveMigrationNegativeTest-725374940-project] 10.222.0.20 "GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8" status: 404 len: 111 microversion: 2.1 time: 0.051944 Oct 03 14:35:31.726732 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 395/798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:31 2022] GET /compute/v2.1/servers/0390c8e9-4700-4ac5-9f2d-1b407cdf0ba8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:32.005684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:32.022548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5fe1c4c-ec09-46b3-acfa-777209b8034d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.346705 Oct 03 14:35:32.037606 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 404/799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:31 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:32.231148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:32.232508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:32.240408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.241468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.242146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.243938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.244745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.245417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.415053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:32.416595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:32.428070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.429115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.430658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.431866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.432618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.433440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.535786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:32.559702 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-266c4a58-2e1b-444c-8e1b-e9662ae6c27c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1273 microversion: 2.1 time: 0.150841 Oct 03 14:35:32.563279 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 405/800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:32 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:32.571041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:32.571671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:32.583595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.584365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.584810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.585575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.586039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.586463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.623484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:32.634858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:32.638622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:32.640419 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3e9bc79-34f2-40ff-8900-a05a778c6bec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1407 microversion: 2.25 time: 0.413123 Oct 03 14:35:32.641380 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 396/801] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:32 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:32.679839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:32.680718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:32.688327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.689094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.690009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.691269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.692754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.693396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.808882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:32.847969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:32.863327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ffb8f4e-1de2-4d68-bdc7-dfbab08b31dd tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1477 microversion: 2.1 time: 0.298342 Oct 03 14:35:32.864221 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 406/802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:32 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:32.879560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-651583b8-19fd-410b-99f5-345f5af04441 req-1cd3f340-df1f-45dc-a428-ec589beb7807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3609b6d4-95a0-4e25-9f44-f82ca930b4b5", "name": "network-vif-unplugged", "status": "completed", "tag": "521b31a5-6adc-4b91-aab6-380f628e4b11"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:32.882236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-651583b8-19fd-410b-99f5-345f5af04441 req-1cd3f340-df1f-45dc-a428-ec589beb7807 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.882835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-651583b8-19fd-410b-99f5-345f5af04441 req-1cd3f340-df1f-45dc-a428-ec589beb7807 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.883526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-651583b8-19fd-410b-99f5-345f5af04441 req-1cd3f340-df1f-45dc-a428-ec589beb7807 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.897297 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-651583b8-19fd-410b-99f5-345f5af04441 req-1cd3f340-df1f-45dc-a428-ec589beb7807 service nova] Creating event network-vif-unplugged:521b31a5-6adc-4b91-aab6-380f628e4b11 for instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 on n-h1-781139-2 Oct 03 14:35:32.903282 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-651583b8-19fd-410b-99f5-345f5af04441 req-1cd3f340-df1f-45dc-a428-ec589beb7807 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037726 Oct 03 14:35:32.904085 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 407/803] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:32.913195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-55fdf0f5-b836-4983-8358-759ae89511c0 req-64b51bde-b381-42b2-b15d-edee6afad2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ef74ed-5f46-4ff0-af09-071498ff108a", "tag": "32956cd1-1afd-4280-8f68-d4ffe4f4afb7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:32.935232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-55fdf0f5-b836-4983-8358-759ae89511c0 req-64b51bde-b381-42b2-b15d-edee6afad2e0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:32.935787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-55fdf0f5-b836-4983-8358-759ae89511c0 req-64b51bde-b381-42b2-b15d-edee6afad2e0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:32.936297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-55fdf0f5-b836-4983-8358-759ae89511c0 req-64b51bde-b381-42b2-b15d-edee6afad2e0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:32.962037 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-55fdf0f5-b836-4983-8358-759ae89511c0 req-64b51bde-b381-42b2-b15d-edee6afad2e0 service nova] Creating event network-changed:32956cd1-1afd-4280-8f68-d4ffe4f4afb7 for instance c3ef74ed-5f46-4ff0-af09-071498ff108a on n-h2-781139-2 Oct 03 14:35:32.969153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-55fdf0f5-b836-4983-8358-759ae89511c0 req-64b51bde-b381-42b2-b15d-edee6afad2e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063570 Oct 03 14:35:32.970423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 408/804] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:33.015903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:33.025432 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b82e43e-0a3b-4758-8eea-3bb374fd23fc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1523 microversion: 2.1 time: 0.349972 Oct 03 14:35:33.026170 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 397/805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:32 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:33.049803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:33.050508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:33.052276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:33.053205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:33.058175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.059211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.059676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.063005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.064165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.064952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.075434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.075963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.076445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.077650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.078114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.078602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.118266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:35:33.274560 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13ecbd87-c8c0-47a2-9e67-9c6965a2fc3e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 204 len: 0 microversion: 2.1 time: 0.228817 Oct 03 14:35:33.278264 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 409/806] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:33 2022] DELETE /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:33.305105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:33.309976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:33.329470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.330325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.331533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.334333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.336828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.337428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.432692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:33.450518 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9cb2dfeb-da47-4bd4-a87c-776e438f4a92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.401310 Oct 03 14:35:33.451331 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 398/807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:33 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:33.532572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cc0ff39c-d9a8-4447-8b46-0307b6f38c33 req-ea21e0d4-1eb4-49aa-b4b9-daee35a75f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf712c-1bc6-4798-9771-c906336c84a9", "name": "network-vif-unplugged", "status": "completed", "tag": "d499f67e-28ef-4b4d-a430-de0827a421bc"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:33.545547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc0ff39c-d9a8-4447-8b46-0307b6f38c33 req-ea21e0d4-1eb4-49aa-b4b9-daee35a75f7b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.546351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc0ff39c-d9a8-4447-8b46-0307b6f38c33 req-ea21e0d4-1eb4-49aa-b4b9-daee35a75f7b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.547295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc0ff39c-d9a8-4447-8b46-0307b6f38c33 req-ea21e0d4-1eb4-49aa-b4b9-daee35a75f7b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.564698 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cc0ff39c-d9a8-4447-8b46-0307b6f38c33 req-ea21e0d4-1eb4-49aa-b4b9-daee35a75f7b service nova] Creating event network-vif-unplugged:d499f67e-28ef-4b4d-a430-de0827a421bc for instance f8bf712c-1bc6-4798-9771-c906336c84a9 on n-h2-781139-2 Oct 03 14:35:33.571868 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cc0ff39c-d9a8-4447-8b46-0307b6f38c33 req-ea21e0d4-1eb4-49aa-b4b9-daee35a75f7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043221 Oct 03 14:35:33.573242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 399/808] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:35:33.584183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:33.585046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:33.591765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.592240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.592727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.593458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.594345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.594345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.675650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:33.684439 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08d09c10-45bd-4fe0-bbae-cbe773872529 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1279 microversion: 2.1 time: 0.104479 Oct 03 14:35:33.685307 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 400/809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:33 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:33.699455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:33.700770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:33.709285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.709881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.710605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:33.711564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:33.712332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:33.712565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:34.019443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:34.028482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:34.031818 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a44cb91c-31e2-4883-b6c6-f06c696c37b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1529 microversion: 2.1 time: 0.750875 Oct 03 14:35:34.034052 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 410/810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:33 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1529 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:34.039632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:34.041135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:34.042276 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f0affd9-4717-45ab-bcb0-6ba0c72c48ca tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1407 microversion: 2.25 time: 0.347540 Oct 03 14:35:34.043520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:34.044908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:34.053342 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 401/811] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:33 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:34.054516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:34.055007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:34.055440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:34.056345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:34.057026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:34.057573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:34.335503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:34.347329 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db199a77-4b42-4c55-9e9e-c41b26e0a670 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1477 microversion: 2.1 time: 0.308626 Oct 03 14:35:34.347329 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 411/812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:34 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1477 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:34.476267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:34.479420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:34.482205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:34.489370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:34.490306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:34.490911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:34.491924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:34.492547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:34.493067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:34.650371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:34.664446 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cabcc72-7d74-482d-8007-9ac451d8b08a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.192513 Oct 03 14:35:34.665220 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 402/813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:34 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:34.710676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:34.711304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:34.721638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:34.722587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:34.723426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:34.724402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:34.725101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:34.725533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:34.810117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:34.823764 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-962bbee0-0381-47e6-a5a6-6d692ddc01c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1279 microversion: 2.1 time: 0.120412 Oct 03 14:35:34.824380 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 412/814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:34 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1279 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:35.058993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:35.059833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:35.069666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:35.070282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:35.079485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.082513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.082695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.084057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.085348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.085901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.086831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.087429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.087859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.089788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.090485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.090769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.534080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:35.544689 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49cddfea-30a4-4000-9ada-4b37d2d3fd70 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1529 microversion: 2.1 time: 0.489220 Oct 03 14:35:35.546130 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 403/815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:35 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1529 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:35.551404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ec5b8416-6d70-4076-8c9f-70fef09d902b req-66a54753-e1ce-4297-8193-ab2de6510685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc3a975-8b74-4921-9106-0160c9bcc3bf", "name": "network-vif-plugged", "status": "completed", "tag": "3114f95d-0543-4f63-a146-ecadff0a8ba9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:35.561449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ec5b8416-6d70-4076-8c9f-70fef09d902b req-66a54753-e1ce-4297-8193-ab2de6510685 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.562240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ec5b8416-6d70-4076-8c9f-70fef09d902b req-66a54753-e1ce-4297-8193-ab2de6510685 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.562934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ec5b8416-6d70-4076-8c9f-70fef09d902b req-66a54753-e1ce-4297-8193-ab2de6510685 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.576561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ec5b8416-6d70-4076-8c9f-70fef09d902b req-66a54753-e1ce-4297-8193-ab2de6510685 service nova] Creating event network-vif-plugged:3114f95d-0543-4f63-a146-ecadff0a8ba9 for instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf on n-h1-781139-2 Oct 03 14:35:35.583131 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ec5b8416-6d70-4076-8c9f-70fef09d902b req-66a54753-e1ce-4297-8193-ab2de6510685 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034928 Oct 03 14:35:35.589738 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 404/816] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:35.596191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:35.597050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:35.604137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.605057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.605619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.606417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.607758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.608294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.689691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:35.708712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:35.713543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:35.714955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1cd0acfe-d5b8-4c83-a7b7-d8cbfc4956b6 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1407 microversion: 2.25 time: 0.649762 Oct 03 14:35:35.718961 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 413/817] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:35 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:35.733140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6d7f4842-a64b-490c-b85f-ac3a1ade0877 req-980b651b-3f92-42f5-9851-04fbb292d150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bf712c-1bc6-4798-9771-c906336c84a9", "tag": "d499f67e-28ef-4b4d-a430-de0827a421bc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:35.744378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6d7f4842-a64b-490c-b85f-ac3a1ade0877 req-980b651b-3f92-42f5-9851-04fbb292d150 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.745166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6d7f4842-a64b-490c-b85f-ac3a1ade0877 req-980b651b-3f92-42f5-9851-04fbb292d150 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.745771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6d7f4842-a64b-490c-b85f-ac3a1ade0877 req-980b651b-3f92-42f5-9851-04fbb292d150 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.761784 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6d7f4842-a64b-490c-b85f-ac3a1ade0877 req-980b651b-3f92-42f5-9851-04fbb292d150 service nova] Creating event network-changed:d499f67e-28ef-4b4d-a430-de0827a421bc for instance f8bf712c-1bc6-4798-9771-c906336c84a9 on n-h2-781139-2 Oct 03 14:35:35.767716 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6d7f4842-a64b-490c-b85f-ac3a1ade0877 req-980b651b-3f92-42f5-9851-04fbb292d150 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047327 Oct 03 14:35:35.768598 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 414/818] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:35.775278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:35.776223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:35.782900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.783622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.784052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.784755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.785277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.785701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.915923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:35.924170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4bd9fbc-f23c-49ab-b7de-e66719026144 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1477 microversion: 2.1 time: 0.333061 Oct 03 14:35:35.925230 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 405/819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:35 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1477 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:35.930891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:35.931722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:35.939023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.939694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.940302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:35.942238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:35.942876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:35.943475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:36.170650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:36.179628 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14928cd3-f9db-4f5f-a4da-b569aee0bd76 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.253470 Oct 03 14:35:36.180218 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 406/820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:35 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:36.315709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1530416112", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:36.368396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:36.403818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:36.421840 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c43837ae-f83d-4eab-8fb8-ef3fc30780ab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.651457 Oct 03 14:35:36.422352 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 415/821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:35 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:36.582692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:36.583746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:36.585083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:36.585716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:36.586662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:36.588459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:36.589581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:36.597521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:36.598078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:36.598230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:36.598511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:36.598883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:36.599255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:36.599491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:36.599883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:36.600233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:36.600760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:36.601356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:36.601896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:36.620284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:36.625811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for user 7415ca24b92d4ba193b3f6762d4196b3 and project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:36.638403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:36.641353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:36.689941 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7133df60-9e3d-4110-b140-60b76a750c60 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508252 Oct 03 14:35:36.690873 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 407/822] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:35:36.703365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c46927c0-27d2-44d0-9eab-8cb1cd13e1bf tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:36.704134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c46927c0-27d2-44d0-9eab-8cb1cd13e1bf tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:36.769026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c46927c0-27d2-44d0-9eab-8cb1cd13e1bf tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:36.776534 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c46927c0-27d2-44d0-9eab-8cb1cd13e1bf tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1213 microversion: 2.1 time: 0.078196 Oct 03 14:35:36.777320 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 408/823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:36 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:36.783504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:36.784273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:36.797401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:36.797968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:36.798460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:36.799389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:36.800056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:36.800559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:36.982935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:36.996556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:36.998603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:37.000091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71bcc6e3-4678-4f34-ae5e-fb20dfd6da6a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1407 microversion: 2.25 time: 0.221671 Oct 03 14:35:37.000948 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 409/824] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:36 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:37.014327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:37.015960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:37.032642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.034411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.034955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.036912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.038728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.040347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.206211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:37.216814 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-286196df-671a-4df6-9761-ea5b9d12f409 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1477 microversion: 2.1 time: 0.211932 Oct 03 14:35:37.217931 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 410/825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:37 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:37.224110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:37.224748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:37.231124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.232290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.236848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.239412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.240575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.241169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.269437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:37.283496 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-44cfc07f-223e-4f3b-b8bd-dc6f7f7ced7e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1529 microversion: 2.1 time: 0.702309 Oct 03 14:35:37.284126 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 416/826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:36 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1529 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:37.438283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:37.447332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:37.449292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:37.460187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.460588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.461055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.461800 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1ae9515-93e3-46b9-bfd6-43b01a54d8e6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.242637 Oct 03 14:35:37.462901 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 411/827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:37 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:37.464097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.464710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.465317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.801034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:37.802230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:37.807980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.808461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.808897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.809628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.810078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.810499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.816703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:37.826334 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0b8439c-c366-43e5-9ba1-485648d52860 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.383027 Oct 03 14:35:37.838155 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 417/828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:37 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:37.868748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-988698aa-46f8-44e7-af05-8d491af91d76 req-04eeb484-83f8-4250-be33-25eec51fbe0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3609b6d4-95a0-4e25-9f44-f82ca930b4b5", "name": "network-vif-deleted", "tag": "521b31a5-6adc-4b91-aab6-380f628e4b11"}, {"name": "network-changed", "server_uuid": "5b2b20ad-a733-4372-b729-e68a1addd00d", "tag": "b53f097b-0955-4b40-acc3-7ef2af42eff1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:37.878167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:37.879730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-988698aa-46f8-44e7-af05-8d491af91d76 req-04eeb484-83f8-4250-be33-25eec51fbe0b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:37.880218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-988698aa-46f8-44e7-af05-8d491af91d76 req-04eeb484-83f8-4250-be33-25eec51fbe0b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:37.880685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-988698aa-46f8-44e7-af05-8d491af91d76 req-04eeb484-83f8-4250-be33-25eec51fbe0b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:37.886148 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bb2320d-6c63-4bd7-8c6d-2a87d03a98e4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1265 microversion: 2.1 time: 0.089457 Oct 03 14:35:37.886720 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 412/829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:37 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:37.894721 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-988698aa-46f8-44e7-af05-8d491af91d76 req-04eeb484-83f8-4250-be33-25eec51fbe0b service nova] Creating event network-vif-deleted:521b31a5-6adc-4b91-aab6-380f628e4b11 for instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 on n-h1-781139-2 Oct 03 14:35:37.895295 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-988698aa-46f8-44e7-af05-8d491af91d76 req-04eeb484-83f8-4250-be33-25eec51fbe0b service nova] Creating event network-changed:b53f097b-0955-4b40-acc3-7ef2af42eff1 for instance 5b2b20ad-a733-4372-b729-e68a1addd00d on n-h2-781139-2 Oct 03 14:35:37.903625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-988698aa-46f8-44e7-af05-8d491af91d76 req-04eeb484-83f8-4250-be33-25eec51fbe0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038460 Oct 03 14:35:37.904255 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 418/830] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:38.032298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:38.033568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:38.054147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.055584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.057601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.059317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.061200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.062115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.253634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:38.256357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:38.290031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.294564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.295940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.297696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.301007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.301953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.416560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:38.428908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:38.430534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:38.431897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a698cf42-b5f6-42ac-a07b-d961ecf954be tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1407 microversion: 2.25 time: 0.403842 Oct 03 14:35:38.432904 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 413/831] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:38 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:38.438658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:38.439493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:38.446675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.447455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.448113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.449069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.449738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.450271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.489079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.489756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.490308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.490841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lazy-loading 'fault' on Instance uuid 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:38.552916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:38.559926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:38.567113 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-796efaff-56ed-4266-8993-ca623a884624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 200 len: 1315 microversion: 2.1 time: 0.132953 Oct 03 14:35:38.583186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:38.584145 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 414/832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:38 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:38.585596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:38.590316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-830fe4a5-be36-4211-aad4-299df1c8e4c3 req-10fde40b-5613-4233-a74b-c275c8a494eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ef74ed-5f46-4ff0-af09-071498ff108a", "name": "network-vif-plugged", "status": "completed", "tag": "32956cd1-1afd-4280-8f68-d4ffe4f4afb7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:38.595498 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94b89633-e1fa-4c84-b273-c9034242e0b0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1462 microversion: 2.1 time: 0.358197 Oct 03 14:35:38.602314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-830fe4a5-be36-4211-aad4-299df1c8e4c3 req-10fde40b-5613-4233-a74b-c275c8a494eb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.603933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-830fe4a5-be36-4211-aad4-299df1c8e4c3 req-10fde40b-5613-4233-a74b-c275c8a494eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.604516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-830fe4a5-be36-4211-aad4-299df1c8e4c3 req-10fde40b-5613-4233-a74b-c275c8a494eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.609340 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 419/833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:38 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1462 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:38.619509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:38.620139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:38.623803 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-830fe4a5-be36-4211-aad4-299df1c8e4c3 req-10fde40b-5613-4233-a74b-c275c8a494eb service nova] Creating event network-vif-plugged:32956cd1-1afd-4280-8f68-d4ffe4f4afb7 for instance c3ef74ed-5f46-4ff0-af09-071498ff108a on n-h2-781139-2 Oct 03 14:35:38.630455 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-830fe4a5-be36-4211-aad4-299df1c8e4c3 req-10fde40b-5613-4233-a74b-c275c8a494eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044783 Oct 03 14:35:38.630896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.631762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.631966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 415/834] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:38.632541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.633959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.634743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.635326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.638710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:38.642484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:38.649265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.649757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.650241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.650953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.651552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.652160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.743727 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93029bfb-083c-4494-b723-fec7252bafba tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action" status: 202 len: 0 microversion: 2.1 time: 0.109783 Oct 03 14:35:38.748678 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 416/835] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:38 2022] POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:38.754372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:38.755259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:38.761786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.762494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.763112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.764020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.764352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.765260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.800361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.801159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.801690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.802304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lazy-loading 'fault' on Instance uuid 5dc3a975-8b74-4921-9106-0160c9bcc3bf {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:38.952293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:38.960784 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c1ea627b-5ea3-4cd4-8c9b-65f91f571286 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.350176 Oct 03 14:35:38.961662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 420/836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:38 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:38.966529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:38.967291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:38.973340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.973990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.974601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:38.975450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:38.976040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:38.976599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.113538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f86c2dcb-212a-4648-85c3-3f953c0f3c19 tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1596 microversion: 2.1 time: 0.359538 Oct 03 14:35:39.114533 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 417/837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:38 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1596 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:39.122960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:39.123775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.131393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.132267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.132809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.133733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.134448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.135128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.202906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:39.212952 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d75bb946-cf99-48e1-9285-5ded495f35b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.250007 Oct 03 14:35:39.213691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 421/838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:38 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:39.218605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:39.221609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.228244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.229188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.229853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.230873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.231396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.231887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.269937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:39.278513 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a2033e1-9d67-47be-be23-1629a1acfedb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1271 microversion: 2.1 time: 0.160561 Oct 03 14:35:39.279209 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 418/839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:39 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:39.308741 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f25ff711-f4bf-41f3-9234-9e1ba1855b4d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action" status: 202 len: 0 microversion: 2.1 time: 0.093563 Oct 03 14:35:39.312282 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 422/840] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:39 2022] POST /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:35:39.318295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:39.319092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.325132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.325646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.326079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.326810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.327261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.327679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.457666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:39.458492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.462589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:39.466336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.466806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.467424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.468125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.468577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.469030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.568248 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7db3431-750c-4f25-bfef-19507945976d tempest-ServersAdminTestJSON-1268838849 tempest-ServersAdminTestJSON-1268838849-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1613 microversion: 2.1 time: 0.253847 Oct 03 14:35:39.568970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 419/841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:39 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1613 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:39.591038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:39.591960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.598855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.599445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.599920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.600756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.601388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.601839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.619169 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 HTTP/1.1 Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:39.620869 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:35:39.622453 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3609b6d4-95a0-4e25-9f44-f82ca930b4b5'} Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:39.623330 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:35:39.624804 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:39.626179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:39.626179 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56b63d3f-4ab3-4080-8795-f95fa2c26573 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 404 len: 111 microversion: 2.1 time: 0.035705 Oct 03 14:35:39.629110 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 420/842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:39 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:35:39.631142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:39.634476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:39.635039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.641822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.642366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.642926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.643881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.644338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.644993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.645225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:39.646675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:39.647790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-95ac6e09-336d-45b8-a5fd-ec72fc601af7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1407 microversion: 2.25 time: 0.194370 Oct 03 14:35:39.648360 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 423/843] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:39 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:39.652855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ecadd46-77c9-4d10-9e52-e22d22cb86d3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'create', calling method: .version_select at 0x7fb231144940>, body: {"keypair": {"name": "tempest-keypair-1155393463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDWJDUZUuHaYUDc+GnDfrD8nRiddlLDce/qtFomiFLlrG6yhRp/zsLCeBxAfSnAxzrSsPu1WTX9OlTyry54GtIRwbA5Es4KVYxnX7s7HW/G51sqKXEnnnwKtSiYIHctPg=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:39.669168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1ecadd46-77c9-4d10-9e52-e22d22cb86d3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for project a762d2f19e454d74a937f6237b3f287a. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:39.671364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:35:39.674852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1ecadd46-77c9-4d10-9e52-e22d22cb86d3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for user 77fb2abf524d4d8caeb1ec89d5db0d73 and project a762d2f19e454d74a937f6237b3f287a. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:39.703922 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ecadd46-77c9-4d10-9e52-e22d22cb86d3 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054398 Oct 03 14:35:39.711179 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 424/844] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:35:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:39.759479 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33c74535-f05c-42a1-b058-f58733f36a06 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 204 len: 0 microversion: 2.1 time: 0.128724 Oct 03 14:35:39.760283 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 421/845] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:39 2022] DELETE /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:39.770792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:39.771408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.778875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.779350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.779789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.780491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.780949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.781846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.946496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:39.954627 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-782b7ff2-3f85-4f00-9c18-b4e39d985b82 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1470 microversion: 2.1 time: 0.189478 Oct 03 14:35:39.955280 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 425/846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:39 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:39.985349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:39.986138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:39.992481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.993061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.993510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:39.994200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:39.994650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:39.995089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:40.136356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:40.145525 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b255c93-47ce-48f8-9f0f-ced89354fb24 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.164289 Oct 03 14:35:40.155354 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 422/847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:39 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:40.236700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:40.237353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:40.244074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:40.244870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:40.245342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:40.246039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:40.246493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:40.246921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:40.304240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:40.305081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:40.311826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:40.312382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:40.312906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:40.313706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:40.314203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:40.314703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:40.450635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:40.457944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:40.459302 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb545678-240d-4f82-bb57-c14f4db37804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.161406 Oct 03 14:35:40.460411 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 423/848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:40 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:40.471114 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df4fd126-86bf-4530-8f41-6a31ae7dbf55 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.238413 Oct 03 14:35:40.472351 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 426/849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:40 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:40.673935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:40.674741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:40.682583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:40.683193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:40.683736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:40.684529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:40.685105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:40.686062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:40.900833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:40.916154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:40.918847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:40.920976 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47508f13-18a4-42be-aae1-58fc46cf6967 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1407 microversion: 2.25 time: 0.250185 Oct 03 14:35:40.921984 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 424/850] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:40 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:40.981808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:40.982663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:40.992410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.002045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.010533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.011558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.013602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.014470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.168420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:41.169978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:41.180729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.182205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.182991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.184282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.185159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.185789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.195455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=15 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:41.344997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:41.359323 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e3519903-c830-4d4a-b6a6-650be89b22b2 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1470 microversion: 2.1 time: 0.384979 Oct 03 14:35:41.361628 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 427/851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:40 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:41.490262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:41.491287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:41.501295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.503871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.504395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.506354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.506856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.507272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.574554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:41.584602 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b7ee408-ba25-44b5-911b-935bbd0bb88f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.420602 Oct 03 14:35:41.599859 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 425/852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:41 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:41.603942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:41.604568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:41.611726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.612320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.612759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.613543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:41.614740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:41.615209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:41.880963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:41.891302 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f86d141-8dbf-494a-9640-7b4eb192fe1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.295745 Oct 03 14:35:41.892210 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 426/853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:41 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:41.909628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-347528804", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:41.980784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] validate_networks() for [('c9d9ff27-356e-417a-acdf-f6fd563a5575', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:42.135001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:42.157167 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2857230c-b5e5-4744-9c23-1883d4efb506 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.678080 Oct 03 14:35:42.158669 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 428/854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:41 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:42.165398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-67b0c590-0104-45d8-b8af-518a39d81797 req-e4f6be08-b0a4-4919-b98e-1625d201d20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3391fb69-afb2-4b6d-9e80-ff790a5efe1c", "tag": "26c09168-e710-43fc-95bb-48db3c675f1f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:42.181387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-67b0c590-0104-45d8-b8af-518a39d81797 req-e4f6be08-b0a4-4919-b98e-1625d201d20b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.182543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-67b0c590-0104-45d8-b8af-518a39d81797 req-e4f6be08-b0a4-4919-b98e-1625d201d20b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.183385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-67b0c590-0104-45d8-b8af-518a39d81797 req-e4f6be08-b0a4-4919-b98e-1625d201d20b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.202117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-67b0c590-0104-45d8-b8af-518a39d81797 req-e4f6be08-b0a4-4919-b98e-1625d201d20b service nova] Creating event network-changed:26c09168-e710-43fc-95bb-48db3c675f1f for instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c on n-h2-781139-2 Oct 03 14:35:42.210593 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-67b0c590-0104-45d8-b8af-518a39d81797 req-e4f6be08-b0a4-4919-b98e-1625d201d20b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049762 Oct 03 14:35:42.213104 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 429/855] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:42.219831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:42.222043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:42.232009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.233573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.235087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.235978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.237730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.239105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.589713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:42.602152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:42.604127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:42.604629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:42.605069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:42.605637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:42.606058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:42.606351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:42.607860 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e1d4e826-8bd5-4d14-ae6f-1027df78a351 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1603 microversion: 2.25 time: 0.393181 Oct 03 14:35:42.608669 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 430/856] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:35:42 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1603 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:35:42.615554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:42.616387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:42.623171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.623777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.624435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.626205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.626913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.627566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.631652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.632512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.633506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.634697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.635294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.636340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.656964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for project a762d2f19e454d74a937f6237b3f287a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:42.662420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for user 77fb2abf524d4d8caeb1ec89d5db0d73 and project a762d2f19e454d74a937f6237b3f287a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:42.674979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:42.677524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:42.722749 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f3b977b-d696-4687-83ee-2d5bce338f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.820609 Oct 03 14:35:42.730537 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 427/857] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:35:42.730537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:42.730537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:42.735217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.735708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.736112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.736844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.737311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.737765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.896650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:42.905962 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0548b273-e9d8-42c4-b295-0e485fe9d55e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.181164 Oct 03 14:35:42.906524 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 428/858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:42 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:42.913428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:42.913918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:42.931723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.932219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.932655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.933713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:42.933900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:42.934273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:42.943934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:42.957768 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3939176-aff4-4d94-869d-ff7aa976c6f5 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1470 microversion: 2.1 time: 0.347491 Oct 03 14:35:42.958457 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 431/859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:42 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1470 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:42.965579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4a3bccc-1238-4d3f-af50-df244e46e213 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:42.966186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d4a3bccc-1238-4d3f-af50-df244e46e213 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:43.052235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2183fed-9fdc-4aef-a2cd-45a130a2782c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.144535 Oct 03 14:35:43.052873 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 429/860] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:35:42 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:35:43.066835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4a3bccc-1238-4d3f-af50-df244e46e213 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:43.074149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:43.074814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:43.079042 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4a3bccc-1238-4d3f-af50-df244e46e213 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1224 microversion: 2.1 time: 0.117033 Oct 03 14:35:43.079873 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 432/861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:42 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:43.086807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.097754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.098293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.099061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.099529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.099953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.116305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:43.181179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:43.181895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:43.193864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.194376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.194885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.195523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.195984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.196409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.295795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:43.308549 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0559bd51-6bba-4e89-883b-301cd3fe778e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.244970 Oct 03 14:35:43.334194 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 430/862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:43 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:43.362989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-19bbc951-0f25-4f62-87d9-0cc244806272 req-7591a47f-7fb4-4202-81ed-d877fa13b4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6f819f-fe1e-4600-91d6-0a068a24b8c6", "name": "network-vif-deleted", "tag": "0b0ca6d8-8f04-4205-9759-4f348a5a7efe"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:43.373983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-19bbc951-0f25-4f62-87d9-0cc244806272 req-7591a47f-7fb4-4202-81ed-d877fa13b4e4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.375263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-19bbc951-0f25-4f62-87d9-0cc244806272 req-7591a47f-7fb4-4202-81ed-d877fa13b4e4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.375853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-19bbc951-0f25-4f62-87d9-0cc244806272 req-7591a47f-7fb4-4202-81ed-d877fa13b4e4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.391554 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-19bbc951-0f25-4f62-87d9-0cc244806272 req-7591a47f-7fb4-4202-81ed-d877fa13b4e4 service nova] Creating event network-vif-deleted:0b0ca6d8-8f04-4205-9759-4f348a5a7efe for instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 on n-h1-781139-2 Oct 03 14:35:43.397153 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-19bbc951-0f25-4f62-87d9-0cc244806272 req-7591a47f-7fb4-4202-81ed-d877fa13b4e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045974 Oct 03 14:35:43.398360 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 431/863] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:43.539225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:43.553354 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54cab0e8-4daa-405c-9f6b-a67d513dbad5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.376583 Oct 03 14:35:43.554145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 433/864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:43 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:43.933426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:43.934991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:43.937080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:43.942961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.943508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.943944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.944693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.945177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.945612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.981674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:43.982336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:43.988884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.989664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.990257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:43.991116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:43.991728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:43.992325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.027779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.028327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.028770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.029390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lazy-loading 'fault' on Instance uuid 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:44.078164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:44.086509 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2e69599-d2b0-48c6-bfab-732f5d1db1da tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 200 len: 1304 microversion: 2.1 time: 0.108619 Oct 03 14:35:44.089410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:44.097665 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 434/865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:43 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:44.098611 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-223addf5-e219-4b05-b595-ff2d7fe20f67 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.170446 Oct 03 14:35:44.113646 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 432/866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:43 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:44.116954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:44.117635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:44.124407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.125143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.125587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.126296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.126756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.127188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.214540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:44.225334 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53faf488-d286-48a4-b7ad-9e5ad283ab1d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1220 microversion: 2.1 time: 0.122728 Oct 03 14:35:44.239793 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 435/867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:44 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:44.251196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-40f911ce-2d26-4dd1-87a5-968a20d6380c req-b897cddc-896e-4202-b721-717353bc4b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2b20ad-a733-4372-b729-e68a1addd00d", "name": "network-vif-plugged", "status": "completed", "tag": "b53f097b-0955-4b40-acc3-7ef2af42eff1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:44.263702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-40f911ce-2d26-4dd1-87a5-968a20d6380c req-b897cddc-896e-4202-b721-717353bc4b09 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.264395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-40f911ce-2d26-4dd1-87a5-968a20d6380c req-b897cddc-896e-4202-b721-717353bc4b09 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.265191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-40f911ce-2d26-4dd1-87a5-968a20d6380c req-b897cddc-896e-4202-b721-717353bc4b09 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.277832 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-40f911ce-2d26-4dd1-87a5-968a20d6380c req-b897cddc-896e-4202-b721-717353bc4b09 service nova] Creating event network-vif-plugged:b53f097b-0955-4b40-acc3-7ef2af42eff1 for instance 5b2b20ad-a733-4372-b729-e68a1addd00d on n-h2-781139-2 Oct 03 14:35:44.284361 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-40f911ce-2d26-4dd1-87a5-968a20d6380c req-b897cddc-896e-4202-b721-717353bc4b09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037532 Oct 03 14:35:44.285133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 433/868] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:44.336781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:44.337827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:44.345271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.346127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.346671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.347793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.348718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.349203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.579697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:44.580965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:44.591595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.593486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.594150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.595855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:44.598459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:44.599138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:44.626457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:44.639404 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4867b1bf-fb93-4beb-94dc-857d01c40040 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1503 microversion: 2.1 time: 0.307038 Oct 03 14:35:44.640727 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 436/869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:44 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:44.814062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:44.825954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b9e8c5c-82c3-4c9e-a01d-dbe5defd2d1e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.250755 Oct 03 14:35:44.826801 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 434/870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:44 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:45.113042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.113781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 4d6f819f-fe1e-4600-91d6-0a068a24b8c6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.121067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.121555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.121957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.122840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.123046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.123510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.123877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.124797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.128475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:45.133431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.134044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.134615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.135467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.136024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.136557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.140596 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] HTTP exception thrown: Instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 could not be found. Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Request method failure captured: Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 HTTP/1.1 Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKjyfNSoyFOg8tgn4AtT68t1cd5KuqRLseWZwJmj069GxpQ0MKWh7EwoDWL1mnWPr6m5yf2Zdbv4ziATq97D0Rfujb-Y4M-2Ak1ZvA7XvRdaN7P9sn5i419IMlPk3wJK_i0-iCq1kwWO4OYCH1LnQlIOdSmtxIlm6uniXSIeWjeIB4 Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 78dce6cc05804cc0b807cc6da75ec0aa Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:35:45.142393 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_78dce6cc05804cc0b807cc6da75ec0aa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 78dce6cc05804cc0b807cc6da75ec0aa Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminTestJSON-1907038498-project Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b54fe4de8a9e4cc79a0e09c98d0d570e Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminTestJSON-1907038498-project Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 could not be found. Oct 03 14:35:45.143810 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4d6f819f-fe1e-4600-91d6-0a068a24b8c6'} Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 could not be found. Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:45.145145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 could not be found. Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 could not be found. Oct 03 14:35:45.146391 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:45.147446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Returning 404 to user: Instance 4d6f819f-fe1e-4600-91d6-0a068a24b8c6 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:45.147446 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d37a4a5c-419d-4d5b-a869-471889e6a3ad tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6" status: 404 len: 111 microversion: 2.1 time: 0.034793 Oct 03 14:35:45.147446 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 437/871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/servers/4d6f819f-fe1e-4600-91d6-0a068a24b8c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:45.153307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.153811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.161541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.162032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.162471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.163176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.163687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.164108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.202897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:35:45.298759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:45.310921 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ccff577-713d-49cd-adca-fa557ee57e23 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1321 microversion: 2.1 time: 0.192436 Oct 03 14:35:45.329874 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 435/872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:45.338138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.339518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.348710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.349558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.350288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.351357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.352006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.352698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.355548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c027d61c-0b53-4f29-8b16-90cce5363aa7 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 204 len: 0 microversion: 2.1 time: 0.206280 Oct 03 14:35:45.359345 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 438/873] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:45 2022] DELETE /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:45.365122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.368372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.381590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.382076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.382527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.388807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.389473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.390380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.451743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:45.463560 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45e58f3d-3299-41c7-a597-3ee9c56e94ef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1284 microversion: 2.1 time: 0.132242 Oct 03 14:35:45.464538 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 436/874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:45.469109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-02ff68af-1e73-46e4-bba5-a4b39b954fdd req-09727ced-67f1-4e2e-b320-3799e9d5b600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ef74ed-5f46-4ff0-af09-071498ff108a", "tag": "32956cd1-1afd-4280-8f68-d4ffe4f4afb7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:45.478920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-02ff68af-1e73-46e4-bba5-a4b39b954fdd req-09727ced-67f1-4e2e-b320-3799e9d5b600 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.479393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-02ff68af-1e73-46e4-bba5-a4b39b954fdd req-09727ced-67f1-4e2e-b320-3799e9d5b600 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.479816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-02ff68af-1e73-46e4-bba5-a4b39b954fdd req-09727ced-67f1-4e2e-b320-3799e9d5b600 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.493374 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-02ff68af-1e73-46e4-bba5-a4b39b954fdd req-09727ced-67f1-4e2e-b320-3799e9d5b600 service nova] Creating event network-changed:32956cd1-1afd-4280-8f68-d4ffe4f4afb7 for instance c3ef74ed-5f46-4ff0-af09-071498ff108a on n-h2-781139-2 Oct 03 14:35:45.503245 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-02ff68af-1e73-46e4-bba5-a4b39b954fdd req-09727ced-67f1-4e2e-b320-3799e9d5b600 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036941 Oct 03 14:35:45.503972 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 437/875] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:45.588589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:45.598574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99c05e55-26f0-41b5-aa3d-025b77f0df45 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1469 microversion: 2.1 time: 0.236969 Oct 03 14:35:45.599854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 439/876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:45.664037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.664807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.671310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.671783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.672209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.672911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.673374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.673789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.850383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.851175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.857310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.857860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.858689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.859449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.859960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.860809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.892217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:45.901467 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b7e5ee5-b1c3-4d05-a3dd-502a9deb76bd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1478 microversion: 2.1 time: 0.241764 Oct 03 14:35:45.902860 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 438/877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1478 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:45.929057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1dbb6fbb-6b46-4c95-b596-eb774a86c7ff tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '.version_select at 0x7fb230c50a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.933435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dbb6fbb-6b46-4c95-b596-eb774a86c7ff tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.933947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dbb6fbb-6b46-4c95-b596-eb774a86c7ff tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.934444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dbb6fbb-6b46-4c95-b596-eb774a86c7ff tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.945236 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1dbb6fbb-6b46-4c95-b596-eb774a86c7ff tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.020169 Oct 03 14:35:45.945854 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 439/878] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:45.960243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:45.960857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:45.966789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.967276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.968100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:45.968817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:45.969292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:45.969728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:46.239485 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4aba3b8-a5b7-47d7-8a4e-41e897e52f45 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1629 microversion: 2.1 time: 0.281665 Oct 03 14:35:46.249583 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 440/879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1629 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:46.272004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16fa6682-26a5-42d2-b402-4bff9b888f7a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Action: 'create', calling method: .version_select at 0x7fb230d39670>, body: {"keypair": {"name": "tempest-keypair-920014205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxDk6p08SHpn70Qr4nRd027OO+eUIvzx2vB/z0EaCCDxmQHKjg0AU+yRub9bpn0ILlGEym+mzL/GqnlWqiC8IMcNjpVJCgBXOAytGeVCvtaDF4SHVZsN6axpzDWpnYkcw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:46.291176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-16fa6682-26a5-42d2-b402-4bff9b888f7a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for project 387637769447441dbf4d5df340ddecce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:46.296590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-16fa6682-26a5-42d2-b402-4bff9b888f7a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for user a91d62c6a8f04094b64c79e338b1dc49 and project 387637769447441dbf4d5df340ddecce. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:46.309898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:46.319533 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-065f52ef-f702-4a62-9105-1392bcc93975 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.473290 Oct 03 14:35:46.320118 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 440/880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:45 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:46.338425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:46.339174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:46.341288 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16fa6682-26a5-42d2-b402-4bff9b888f7a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074192 Oct 03 14:35:46.342691 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 441/881] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:35:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:35:46.348388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:46.349890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:46.350582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:46.351551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:46.352226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:46.352879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:46.492631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:46.493703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:46.502040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:46.502664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:46.503699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:46.504473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:46.505019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:46.505618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:46.557407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:46.567751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1c2bf8c-1c86-419e-97e6-68852075a8bc tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1471 microversion: 2.1 time: 0.235922 Oct 03 14:35:46.582561 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 441/882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:46 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:46.593657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:46.608845 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-deb7f6e6-044c-4811-a96c-d1f6b4fee873 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1294 microversion: 2.1 time: 0.120844 Oct 03 14:35:46.609970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 442/883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:46 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:46.636620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:46.637700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:46.645516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:46.646111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:46.646835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:46.647644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:46.648157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:46.648677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:46.811653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-737ce8c6-0817-4463-ad30-660f8f6ed269 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:46.812463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-737ce8c6-0817-4463-ad30-660f8f6ed269 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] [instance: 58efa9ec-e81e-4831-a5ac-ae4dc733d693] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:46.818968 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-737ce8c6-0817-4463-ad30-660f8f6ed269 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] HTTP exception thrown: Instance 58efa9ec-e81e-4831-a5ac-ae4dc733d693 could not be found. Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-737ce8c6-0817-4463-ad30-660f8f6ed269 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Request method failure captured: Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/58efa9ec-e81e-4831-a5ac-ae4dc733d693/action HTTP/1.1 Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMyiKzuroXDtjpTZALH_sbEGWlhyhjuz965YKG_0WwDjd3YezlIS7_xWdTHYwzas2qOZ6stxcZNqHjqf_ZoarFUyRQR117srgPpCiiIP9p0YT4FueOIDwUY-Y9hbXP4lGfRarSIUGcySMCK1Bk5SYbGJtRGsgfn85aydLrZK0bzXOQ Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:35:46.821790 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68afa642e21945869980e290d0896bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68afa642e21945869980e290d0896bd2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 13a1e48b3e6e4205a5b767dc554ae149 Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: {"migrate": {}} Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:35:46.823240 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 58efa9ec-e81e-4831-a5ac-ae4dc733d693 could not be found. Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '58efa9ec-e81e-4831-a5ac-ae4dc733d693', 'body': {'migrate': {}}} Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58efa9ec-e81e-4831-a5ac-ae4dc733d693 could not be found. Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:46.824216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58efa9ec-e81e-4831-a5ac-ae4dc733d693 could not be found. Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58efa9ec-e81e-4831-a5ac-ae4dc733d693 could not be found. Oct 03 14:35:46.826097 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:35:46.828050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-737ce8c6-0817-4463-ad30-660f8f6ed269 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Returning 404 to user: Instance 58efa9ec-e81e-4831-a5ac-ae4dc733d693 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:46.829111 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-737ce8c6-0817-4463-ad30-660f8f6ed269 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/58efa9ec-e81e-4831-a5ac-ae4dc733d693/action" status: 404 len: 111 microversion: 2.1 time: 0.238326 Oct 03 14:35:46.830545 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 442/884] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:46 2022] POST /compute/v2.1/servers/58efa9ec-e81e-4831-a5ac-ae4dc733d693/action => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:35:46.872352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:46.882380 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a99defc-aaba-419e-8631-1ff1408dc8fe tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1469 microversion: 2.1 time: 0.250126 Oct 03 14:35:46.883683 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 443/885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:46 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:46.964229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1196191813", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:47.027299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:47.344224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:47.345011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:47.352981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:47.353577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:47.354109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:47.355014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:47.355651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:47.356200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:47.565129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:47.574673 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfd3c97c-8d39-4206-a1f4-c53d7dba23bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.235385 Oct 03 14:35:47.575242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 444/886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:47 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:47.632291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:47.632919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:47.641782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:47.642052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:47.642547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:47.643450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:47.644415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:47.645762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:47.658349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:47.659405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:47.660339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:47.660901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:47.661519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:47.673760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:47.674404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:47.674934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:47.676062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:47.677029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:47.677707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:47.702297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Getting quotas for project a80020ec000d4ca8be3d5aadb8c820b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:47.708416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Getting quotas for user b9ac507afaef4475939e3390549cd2e9 and project a80020ec000d4ca8be3d5aadb8c820b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:47.735913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:47.740617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:47.829425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24d87643-5d63-44a4-8b9f-99b92eaacbc8 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867840 Oct 03 14:35:47.837072 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 443/887] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:35:47.857735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-945a7f24-985e-48f8-8724-bc911d3a327f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:47.865557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-945a7f24-985e-48f8-8724-bc911d3a327f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:47.994961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:47.998723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-945a7f24-985e-48f8-8724-bc911d3a327f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:48.009206 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-945a7f24-985e-48f8-8724-bc911d3a327f tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1222 microversion: 2.1 time: 0.164807 Oct 03 14:35:48.011862 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 444/888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:47 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:48.019526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:48.020140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:48.024782 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-757f5ddb-f5c6-4192-aca0-fe64cf815cb2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.396320 Oct 03 14:35:48.025415 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 445/889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:47 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:48.058313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:48.059773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:48.065094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:48.066392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:48.069594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:48.071349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:48.206012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-23b1389e-0b77-4641-b67e-58c9f7e13066 req-5e269aea-7a67-4d39-82ce-c4aa06c91f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec214f-3bd5-4963-9bf7-28bb6b7403e5", "name": "network-vif-deleted", "tag": "cb72ef60-69de-435d-a9e3-5f8d864fc731"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:48.224835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:48.230310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-23b1389e-0b77-4641-b67e-58c9f7e13066 req-5e269aea-7a67-4d39-82ce-c4aa06c91f1f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:48.230725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-23b1389e-0b77-4641-b67e-58c9f7e13066 req-5e269aea-7a67-4d39-82ce-c4aa06c91f1f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:48.231145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-23b1389e-0b77-4641-b67e-58c9f7e13066 req-5e269aea-7a67-4d39-82ce-c4aa06c91f1f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:48.239396 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e396281a-cde2-49dc-bb02-dadc4d0d88d8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1427 microversion: 2.1 time: 0.225571 Oct 03 14:35:48.240988 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 445/890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:48 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1427 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:48.249624 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-23b1389e-0b77-4641-b67e-58c9f7e13066 req-5e269aea-7a67-4d39-82ce-c4aa06c91f1f service nova] Creating event network-vif-deleted:cb72ef60-69de-435d-a9e3-5f8d864fc731 for instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 on n-h1-781139-2 Oct 03 14:35:48.267439 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-23b1389e-0b77-4641-b67e-58c9f7e13066 req-5e269aea-7a67-4d39-82ce-c4aa06c91f1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065124 Oct 03 14:35:48.270735 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 446/891] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:35:48.601757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:48.602521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:48.616482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:48.617020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:48.619031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:48.620833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b67b6db9-64dd-45cd-a3a3-b7ad1a09a454 req-c5002227-b289-4455-bda6-910eda61f8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3391fb69-afb2-4b6d-9e80-ff790a5efe1c", "name": "network-vif-plugged", "status": "completed", "tag": "26c09168-e710-43fc-95bb-48db3c675f1f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:48.640314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:48.640945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:48.641790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b67b6db9-64dd-45cd-a3a3-b7ad1a09a454 req-c5002227-b289-4455-bda6-910eda61f8ba service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:48.642272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b67b6db9-64dd-45cd-a3a3-b7ad1a09a454 req-c5002227-b289-4455-bda6-910eda61f8ba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:48.642530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:48.642697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b67b6db9-64dd-45cd-a3a3-b7ad1a09a454 req-c5002227-b289-4455-bda6-910eda61f8ba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:48.682772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b67b6db9-64dd-45cd-a3a3-b7ad1a09a454 req-c5002227-b289-4455-bda6-910eda61f8ba service nova] Creating event network-vif-plugged:26c09168-e710-43fc-95bb-48db3c675f1f for instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c on n-h2-781139-2 Oct 03 14:35:48.699996 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b67b6db9-64dd-45cd-a3a3-b7ad1a09a454 req-c5002227-b289-4455-bda6-910eda61f8ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090324 Oct 03 14:35:48.705542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 447/892] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:35:49.027987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:49.041171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:49.042244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:49.059147 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4aeaef8d-d515-4e36-8313-f0c57b0ade31 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.462780 Oct 03 14:35:49.062536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 446/893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:48 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:49.067713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:49.068637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:49.069639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:49.070759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:49.072836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:49.075282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:49.080220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:49.081127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:49.096540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:49.097471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:49.100837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:49.101892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:49.102811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:49.103514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:49.205111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:49.215689 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44a669e2-5700-47a5-9c46-e011ed3e543a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1274 microversion: 2.1 time: 0.181066 Oct 03 14:35:49.216445 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 448/894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:49 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:49.265482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:49.266907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:49.277731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:49.278385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:49.278972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:49.280108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:49.280610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:49.281208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:49.316193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:49.316946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:49.317339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:49.317939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lazy-loading 'fault' on Instance uuid bbec214f-3bd5-4963-9bf7-28bb6b7403e5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:49.372463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:49.380578 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb064c38-74a9-4dae-a66d-b4a4555f907b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.315315 Oct 03 14:35:49.382060 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 447/895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:49 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:49.387358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-462605106", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "1de92605-c737-403e-8392-200d1d88069b"}], "security_groups": [{"name": "tempest-securitygroup--27829297"}], "key_name": "tempest-keypair-920014205", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:49.423199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:49.459570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40a255ad-982b-4452-94b4-3a06ffbbd61e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1304 microversion: 2.1 time: 0.199344 Oct 03 14:35:49.463498 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 449/896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:49 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:49.541388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] validate_networks() for [('1de92605-c737-403e-8392-200d1d88069b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:35:50.086806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:50.087997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:50.096412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.097467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.098671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.099900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.100584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.101328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.243550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:35:50.244053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:35:50.244428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:35:50.244879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:35:50.245514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:35:50.251932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=61 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:50.261053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.261544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.261974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.262860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.263311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.264234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.271709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:50.280610 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60d959d5-7c4c-43e6-b49d-3022f472c565 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1313 microversion: 2.1 time: 0.199207 Oct 03 14:35:50.283839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 450/897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:50 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:50.289088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:35:50.305310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for user a91d62c6a8f04094b64c79e338b1dc49 and project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:35:50.305939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:50.307103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:50.315309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.316368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.317947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.319085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.320173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.320902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.321320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:35:50.323660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:35:50.372168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:50.411017 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87971a1c-d4d1-4c35-a836-78a5d0085ea5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.027613 Oct 03 14:35:50.411834 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 448/898] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:35:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:35:50.416665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-92dc1aa4-2bba-44a6-ac4e-f0de4063078e req-ef3ec8e4-7949-47f4-9420-362c7aecbfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70288b68-bdda-44ce-b9e0-b67137888f94", "tag": "aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:50.431636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-92dc1aa4-2bba-44a6-ac4e-f0de4063078e req-ef3ec8e4-7949-47f4-9420-362c7aecbfe5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.432595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-92dc1aa4-2bba-44a6-ac4e-f0de4063078e req-ef3ec8e4-7949-47f4-9420-362c7aecbfe5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.433274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-92dc1aa4-2bba-44a6-ac4e-f0de4063078e req-ef3ec8e4-7949-47f4-9420-362c7aecbfe5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.450461 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-92dc1aa4-2bba-44a6-ac4e-f0de4063078e req-ef3ec8e4-7949-47f4-9420-362c7aecbfe5 service nova] Creating event network-changed:aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f for instance 70288b68-bdda-44ce-b9e0-b67137888f94 on n-h1-781139-2 Oct 03 14:35:50.457394 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-92dc1aa4-2bba-44a6-ac4e-f0de4063078e req-ef3ec8e4-7949-47f4-9420-362c7aecbfe5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043667 Oct 03 14:35:50.459035 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 449/899] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:50.460642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:50.466926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:50.467708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:50.474834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:50.475923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.476792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.477478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.478524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.482004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.482004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.488993 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-932a53f2-4a33-43bb-8de4-0e68a603c90a tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1280 microversion: 2.1 time: 0.202912 Oct 03 14:35:50.490014 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 451/900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:50 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:50.495389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3096a606-bf55-429e-869b-3ef43944606b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:50.496343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3096a606-bf55-429e-869b-3ef43944606b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:50.586038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3096a606-bf55-429e-869b-3ef43944606b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:50.594178 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3096a606-bf55-429e-869b-3ef43944606b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1233 microversion: 2.1 time: 0.102829 Oct 03 14:35:50.606785 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 452/901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:50 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1233 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:50.619127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:50.619996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:50.629086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.629886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.630572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.631519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.632177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.633007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.676778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:50.677552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:50.678470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:50.679080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lazy-loading 'fault' on Instance uuid bbec214f-3bd5-4963-9bf7-28bb6b7403e5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:50.773366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:50.781887 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b54bf6e5-123c-4e7a-8cbe-ee0203d7f0c1 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1304 microversion: 2.1 time: 0.167330 Oct 03 14:35:50.782998 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 453/902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:50 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:50.986930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:50.999645 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c6a7a84-9064-4f56-83a1-aba8dfb3b768 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.538962 Oct 03 14:35:51.003231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 450/903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:50 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:51.306305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:51.306927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:51.314344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.314827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.315261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.316234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.316967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.317155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.459342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:51.467828 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ffe001b9-4876-43e7-984b-8217c8922835 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1463 microversion: 2.1 time: 0.165500 Oct 03 14:35:51.468496 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 454/904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:51 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:51.514243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:51.515266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:51.521938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.522409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.523057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.523952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.524620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.525416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.547601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:51.549359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:51.556813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.557334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.557763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.558458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.558969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.559411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.660226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:51.668289 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e21a6a1d-c617-46b8-ba40-bfb410a4f107 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.157945 Oct 03 14:35:51.668863 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 455/905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:51 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:51.673392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:51.673988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:51.680710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.681135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.681571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.682251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.682696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.683114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.747088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:51.755611 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da83a7d8-a16f-486e-a87e-dc018ae7d6c7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1237 microversion: 2.1 time: 0.085552 Oct 03 14:35:51.756035 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 456/906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:51 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:51.808567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:51.809209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:51.815407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.816177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.816587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.817311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.817793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.818209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.852325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:51.852844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:51.853328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:51.853778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lazy-loading 'fault' on Instance uuid bbec214f-3bd5-4963-9bf7-28bb6b7403e5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:51.897206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:51.905376 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c12d304-83e1-4a2f-a03c-bfe993deb4b8 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1304 microversion: 2.1 time: 0.101628 Oct 03 14:35:51.905955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 457/907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:51 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:52.012958 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b53f236d-f076-47e5-a180-b399fdda7f55 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1614 microversion: 2.1 time: 0.525868 Oct 03 14:35:52.013525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 451/908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:51 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1614 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:52.023722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:52.024336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:52.031165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.031907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.032215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.032940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.033410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.033834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.036532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:52.037017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:52.043135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.043802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.044443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.045156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.045767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.046348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.125397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '318c6060cbf44cc78496927ef499297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1a3826336420dae7fc63cff307355', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:52.125993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] flavor_id is None. Assuming migration. {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 14:35:52.126437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 14:35:52.184155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:52.193461 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-777ad6e4-ae1c-4561-a817-1b9f1ab96113 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.173695 Oct 03 14:35:52.194780 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 458/909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:52 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:52.303519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8843d254-cf75-42be-9c3c-8e692e37a91f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c/action" status: 202 len: 0 microversion: 2.1 time: 0.271500 Oct 03 14:35:52.304483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 452/910] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:52 2022] POST /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:35:52.312576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:52.313205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:52.323794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.324281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.324714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.325458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.325934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.326530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.473721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:52.481003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ee1b2074-3ad5-47cc-ac1c-d516f3dc9a77 req-22383390-13d7-4c82-a1af-d75cc4905459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4500536c-43bd-4cd1-ba97-5cfa38d3a7b6", "tag": "14de6f68-c33d-4fee-82d5-bed584cadbe5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:52.483973 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1f1ab0e-30e2-424b-8faf-4a3ce1c3cd9f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1472 microversion: 2.1 time: 0.175276 Oct 03 14:35:52.484696 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 459/911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:52 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:52.504973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ee1b2074-3ad5-47cc-ac1c-d516f3dc9a77 req-22383390-13d7-4c82-a1af-d75cc4905459 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.505824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ee1b2074-3ad5-47cc-ac1c-d516f3dc9a77 req-22383390-13d7-4c82-a1af-d75cc4905459 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.506417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ee1b2074-3ad5-47cc-ac1c-d516f3dc9a77 req-22383390-13d7-4c82-a1af-d75cc4905459 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.518868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ee1b2074-3ad5-47cc-ac1c-d516f3dc9a77 req-22383390-13d7-4c82-a1af-d75cc4905459 service nova] Creating event network-changed:14de6f68-c33d-4fee-82d5-bed584cadbe5 for instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 on n-h2-781139-2 Oct 03 14:35:52.525494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ee1b2074-3ad5-47cc-ac1c-d516f3dc9a77 req-22383390-13d7-4c82-a1af-d75cc4905459 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048493 Oct 03 14:35:52.526082 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 453/912] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:52.692095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:52.692722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:52.694712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:52.701279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.701935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.702585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.703396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.703942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.704554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.783844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:52.788914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:52.796680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.797437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.798102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.799733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.800270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.800842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.848134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:52.856177 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2aab3e5e-0931-4bae-9b5a-bcf10b3fc949 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.169385 Oct 03 14:35:52.856756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 460/913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:52 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:52.884070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:52.893454 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f22f8c43-e9ac-4c71-a061-2014b4e141e9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1237 microversion: 2.1 time: 0.114350 Oct 03 14:35:52.894280 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 454/914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:52 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:52.927946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:52.928703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:52.934996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.935982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.936429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.937159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.937619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.938044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.973236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:52.973722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:52.974154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:52.974682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lazy-loading 'fault' on Instance uuid bbec214f-3bd5-4963-9bf7-28bb6b7403e5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:53.017070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:53.025148 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1fb1cbd-da0e-4af7-950b-e3ddda3391dc tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 200 len: 1304 microversion: 2.1 time: 0.101143 Oct 03 14:35:53.025729 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 461/915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:52 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:53.216202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:53.216719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:53.223667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.224154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.224589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:53.225319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.225771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.226179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:53.367516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:53.371151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:53.376241 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3767d23f-2f27-4edc-a29e-e54faafc4d28 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.164143 Oct 03 14:35:53.376816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 455/916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:53 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:53.512297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:53.513223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:53.525607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.526537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.527125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:53.528192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.528885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.529546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:53.700396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:53.709619 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c9600afd-d1c4-4902-8ac9-0bc63db3a4cb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1472 microversion: 2.1 time: 0.204686 Oct 03 14:35:53.710508 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 462/917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:53 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:53.882494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:53.883318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:53.893110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.893656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.894153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:53.895604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.895604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.895808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:53.915740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:53.917137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:53.922712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.923651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.923651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:53.924349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:53.924798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:53.925390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.001303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:54.004441 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76c74574-4f05-4728-a170-a138a58912f5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1285 microversion: 2.1 time: 0.092560 Oct 03 14:35:54.005080 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 463/918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:53 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:54.048054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:54.049085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: bbec214f-3bd5-4963-9bf7-28bb6b7403e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:54.057151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.058171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.058872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.059577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.060060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.060705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.077662 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] HTTP exception thrown: Instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 could not be found. Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Request method failure captured: Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 HTTP/1.1 Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKjyfNSoyFOg8tgn4AtT68t1cd5KuqRLseWZwJmj069GxpQ0MKWh7EwoDWL1mnWPr6m5yf2Zdbv4ziATq97D0Rfujb-Y4M-2Ak1ZvA7XvRdaN7P9sn5i419IMlPk3wJK_i0-iCq1kwWO4OYCH1LnQlIOdSmtxIlm6uniXSIeWjeIB4 Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 78dce6cc05804cc0b807cc6da75ec0aa Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:35:54.079383 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_78dce6cc05804cc0b807cc6da75ec0aa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 78dce6cc05804cc0b807cc6da75ec0aa Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersAdminTestJSON-1907038498-project Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: b54fe4de8a9e4cc79a0e09c98d0d570e Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminTestJSON-1907038498-project Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 could not be found. Oct 03 14:35:54.080737 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'bbec214f-3bd5-4963-9bf7-28bb6b7403e5'} Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 could not be found. Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:35:54.081538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 could not be found. Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 could not be found. Oct 03 14:35:54.082734 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:35:54.085021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Returning 404 to user: Instance bbec214f-3bd5-4963-9bf7-28bb6b7403e5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:35:54.085021 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd7f2890-3eb8-4660-834b-810a1a819f8e tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5" status: 404 len: 111 microversion: 2.1 time: 0.037202 Oct 03 14:35:54.085021 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 464/919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:54 2022] GET /compute/v2.1/servers/bbec214f-3bd5-4963-9bf7-28bb6b7403e5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:35:54.089868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:54.090370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:54.098109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.098605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.099043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.099749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.100206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.100630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.128136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:35:54.208603 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3294dde6-08ac-4c26-bb68-f134ec7ec1bf tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 204 len: 0 microversion: 2.1 time: 0.122292 Oct 03 14:35:54.209227 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 465/920] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:35:54 2022] DELETE /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:35:54.217993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:54.218848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:54.225189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.226241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.226241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.226821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:54.226945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.227349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.227846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.235047 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c44977c3-3e8d-4cc1-8e5c-9eeb7a5c8b5d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.360132 Oct 03 14:35:54.235687 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 456/921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:53 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:54.360987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:54.369147 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14cd948f-1be7-4231-8760-237a6e0daf84 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1468 microversion: 2.1 time: 0.155473 Oct 03 14:35:54.369929 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 466/922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:54 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:54.400614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:54.401251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:54.408074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.408970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.409418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.410505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.410964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.411384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.643105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:54.651060 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7a85a24-230b-475c-8007-e36b34e4fcbc tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.255226 Oct 03 14:35:54.651637 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 457/923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:54 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:54.736119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:54.736959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:54.744371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.744851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.745480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.746177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:54.746626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:54.747043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:54.762262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:54.879961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:54.888030 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aee64bd7-7889-4a03-b676-2e47f72597f0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1472 microversion: 2.1 time: 0.157573 Oct 03 14:35:54.888602 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 467/924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:54 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:55.030433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:55.031459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:55.039193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.039677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.040107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.040789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.041274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.041678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.105166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:55.113283 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fdc561d3-e103-44b5-92ff-53d1503ced43 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1293 microversion: 2.1 time: 0.088144 Oct 03 14:35:55.114402 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 458/925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:55 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:55.258463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:55.259048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:55.268134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.268629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.269159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.269905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.270345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.270765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.392285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:55.393331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:55.400494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.401106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.401439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.402075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:55.402252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.402585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.403038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.410090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec25454d-426c-475d-b64e-fe4c44ad13c9 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.155729 Oct 03 14:35:55.410642 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 468/926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:55 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:55.535901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:55.544343 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-857a21d8-4168-449c-a6ff-40345aaaa069 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1468 microversion: 2.1 time: 0.156415 Oct 03 14:35:55.544962 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 459/927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:55 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1468 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:55.678417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:55.679298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:55.689874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.690820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.691350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.692043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.692490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.692913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.837999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:55.851954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7933d1d-2007-48e2-a1b6-b91fa1c8dd9c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.180329 Oct 03 14:35:55.868243 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 469/928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:55 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:55.913638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:55.914558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:55.927911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.928850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.929658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:55.930718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:55.941035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:55.941922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.120482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:56.128503 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58fbadf1-a531-42b0-8ecf-fa93e7ca5e4d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1472 microversion: 2.1 time: 0.220942 Oct 03 14:35:56.129092 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 460/929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:55 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:56.137861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:56.138473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:56.140731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:35:56.146969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.147516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.147952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.148639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.149174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.149624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.212648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:56.221855 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52dd4098-b7fd-476e-938f-00a0dc424ec3 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1291 microversion: 2.1 time: 0.089488 Oct 03 14:35:56.223094 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 470/930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:56 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1291 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:56.432454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:56.433100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:56.440211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.440763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.441417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.442914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.443472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.443902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.570403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:56.571270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:56.594573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.595256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.595843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.596710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.597454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.598183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.742113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:56.766953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:56.768151 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ffebe18-4c24-4851-82c4-3638c92a2ca7 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.339494 Oct 03 14:35:56.769641 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 461/931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:56 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:56.775120 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abb9da8b-0fad-45b9-aed2-2bf7d9fe1240 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1468 microversion: 2.1 time: 0.209027 Oct 03 14:35:56.776971 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 471/932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:56 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1468 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:56.875127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:56.875732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:56.882323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.882788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.883442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:56.884121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:56.884744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:56.885169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.156269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:57.157677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:57.181989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.184664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.185685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.186872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.187664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.188246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.188558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:57.206349 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72145641-2bdd-43a4-a52a-41ef364adfef tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.335259 Oct 03 14:35:57.221721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 462/933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:56 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:57.228265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-88c901f6-550f-4a7b-a367-03988816d320 req-98e0e135-6719-47d9-b15a-72cbf6e2f719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70288b68-bdda-44ce-b9e0-b67137888f94", "name": "network-vif-plugged", "status": "completed", "tag": "aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:57.241221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-88c901f6-550f-4a7b-a367-03988816d320 req-98e0e135-6719-47d9-b15a-72cbf6e2f719 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.242061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-88c901f6-550f-4a7b-a367-03988816d320 req-98e0e135-6719-47d9-b15a-72cbf6e2f719 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.242965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-88c901f6-550f-4a7b-a367-03988816d320 req-98e0e135-6719-47d9-b15a-72cbf6e2f719 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.259139 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-88c901f6-550f-4a7b-a367-03988816d320 req-98e0e135-6719-47d9-b15a-72cbf6e2f719 service nova] Creating event network-vif-plugged:aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f for instance 70288b68-bdda-44ce-b9e0-b67137888f94 on n-h1-781139-2 Oct 03 14:35:57.265013 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-88c901f6-550f-4a7b-a367-03988816d320 req-98e0e135-6719-47d9-b15a-72cbf6e2f719 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040682 Oct 03 14:35:57.266349 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 463/934] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:57.272721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:57.273823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:57.281775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.282652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.283309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.284305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.285671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.286411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.372149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:57.381028 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-231eb309-2ded-4778-9dea-a1f489d625a7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1472 microversion: 2.1 time: 0.232859 Oct 03 14:35:57.381631 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 472/935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:57 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:57.619740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:57.627856 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f100c44-3479-462f-b45f-95d77378d403 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1291 microversion: 2.1 time: 0.360116 Oct 03 14:35:57.628498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 464/936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:57 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1291 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:57.792037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:57.792693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:57.801811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.802331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.803101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.803682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:57.804141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.804990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.805389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:57.805500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.817163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.818148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.832486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.833700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.835505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.836196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:57.964473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:57.974564 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6e13527-54af-40ad-b906-7500daeeecea tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.186424 Oct 03 14:35:57.975278 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 473/937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:57 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:57.983351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f3217b2a-a10b-443b-a989-350ae530f2ca req-22fd6861-b7ed-431b-ba12-c68e02440cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc3a975-8b74-4921-9106-0160c9bcc3bf", "name": "network-vif-deleted", "tag": "3114f95d-0543-4f63-a146-ecadff0a8ba9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:57.987070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:57.995011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3217b2a-a10b-443b-a989-350ae530f2ca req-22fd6861-b7ed-431b-ba12-c68e02440cd1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:57.995646 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3c96b4a-67ba-4e5c-867c-be9bfc738fa4 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1426 microversion: 2.1 time: 0.198997 Oct 03 14:35:57.996118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3217b2a-a10b-443b-a989-350ae530f2ca req-22fd6861-b7ed-431b-ba12-c68e02440cd1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:57.996705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3217b2a-a10b-443b-a989-350ae530f2ca req-22fd6861-b7ed-431b-ba12-c68e02440cd1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:58.008279 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 465/938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:57 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1426 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:58.024302 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f3217b2a-a10b-443b-a989-350ae530f2ca req-22fd6861-b7ed-431b-ba12-c68e02440cd1 service nova] Creating event network-vif-deleted:3114f95d-0543-4f63-a146-ecadff0a8ba9 for instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf on n-h1-781139-2 Oct 03 14:35:58.033231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f3217b2a-a10b-443b-a989-350ae530f2ca req-22fd6861-b7ed-431b-ba12-c68e02440cd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056291 Oct 03 14:35:58.034140 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 474/939] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:58.233232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:58.233868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:58.243840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:58.244843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:58.245599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:58.246478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:58.247188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:58.247763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:58.405774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:58.413614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:58.421375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:58.422282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:58.423111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:58.423942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:58.424600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:58.425670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:58.498849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:58.507894 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c28920ac-42c9-4fb4-bb45-84b57458807e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1324 microversion: 2.1 time: 0.278524 Oct 03 14:35:58.509244 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 466/940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:58 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:58.593191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:58.601420 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98e9cb69-ea34-47f8-8f34-f285ff3078d5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1472 microversion: 2.1 time: 0.200292 Oct 03 14:35:58.602321 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 475/941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:58 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1472 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:58.652110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:58.653034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:58.659291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:58.660073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:58.660638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:58.661371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:58.662004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:58.662431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:58.852632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:58.860794 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8277a039-bad5-4408-91c0-380e1bad169e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.212842 Oct 03 14:35:58.861459 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 467/942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:58 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:58.999789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:59.000406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:59.009441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.010485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.010485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.011084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.011622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.012090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.026577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:59.027222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:59.036822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.037583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.038192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.038892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.039347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.040568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.078456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.079210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.079967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.080759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lazy-loading 'fault' on Instance uuid 5dc3a975-8b74-4921-9106-0160c9bcc3bf {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:35:59.174784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54fe4de8a9e4cc79a0e09c98d0d570e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dce6cc05804cc0b807cc6da75ec0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:59.183209 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-edbfab4a-5838-4e71-a042-228f8b3f7054 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 200 len: 1303 microversion: 2.1 time: 0.160703 Oct 03 14:35:59.184108 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 468/943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:59 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:59.188401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:59.205335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5bed8e5-4983-4756-ba65-7fa33190099d tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.209382 Oct 03 14:35:59.206184 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 476/944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:58 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:59.454620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-43527025-567f-47c1-80fd-f5df3073d01c req-3ecb032c-839d-42d5-b971-5a1552d4bd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4500536c-43bd-4cd1-ba97-5cfa38d3a7b6", "name": "network-vif-plugged", "status": "completed", "tag": "14de6f68-c33d-4fee-82d5-bed584cadbe5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:59.465136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-43527025-567f-47c1-80fd-f5df3073d01c req-3ecb032c-839d-42d5-b971-5a1552d4bd44 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.465611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-43527025-567f-47c1-80fd-f5df3073d01c req-3ecb032c-839d-42d5-b971-5a1552d4bd44 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.466047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-43527025-567f-47c1-80fd-f5df3073d01c req-3ecb032c-839d-42d5-b971-5a1552d4bd44 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.477587 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-43527025-567f-47c1-80fd-f5df3073d01c req-3ecb032c-839d-42d5-b971-5a1552d4bd44 service nova] Creating event network-vif-plugged:14de6f68-c33d-4fee-82d5-bed584cadbe5 for instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 on n-h2-781139-2 Oct 03 14:35:59.482513 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-43527025-567f-47c1-80fd-f5df3073d01c req-3ecb032c-839d-42d5-b971-5a1552d4bd44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031611 Oct 03 14:35:59.483127 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 469/945] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:35:59.531369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:59.532014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:59.539456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.539946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.540390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.541129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.541582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.542007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.624289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:59.625050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:59.632221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.632908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.633523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.634385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.634980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.635556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.695961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:59.705788 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c451571-1e7c-4a35-bbe6-838f182f958e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1521 microversion: 2.1 time: 0.178287 Oct 03 14:35:59.717697 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 477/946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:59 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:59.734555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:59.735288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:59.742137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.742702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.743231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.743991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.744501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.745016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.880293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:59.888912 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80417be1-d2c5-4993-b933-365e93e4bb23 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1521 microversion: 2.1 time: 0.158429 Oct 03 14:35:59.890165 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 478/947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:59 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:35:59.890436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:35:59.899109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:35:59.899590 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e80f81c9-71b7-42cb-96b4-e53c5baae2dc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.279203 Oct 03 14:35:59.899884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:59.900958 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 470/948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:59 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:35:59.906654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.907222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.907707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.908467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.909161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.909676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.919427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1571118000"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:35:59.922037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:35:59.928570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.929207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.929706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:35:59.930474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:35:59.930983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:35:59.931475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.062088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:00.072345 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44afe338-5a10-4b0d-adf4-11db3ffe66d9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.177620 Oct 03 14:36:00.073222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 479/949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:35:59 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:00.085568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fea6bd43-45d3-4766-9e99-106939cea273 req-dfbca5d2-9b6b-4552-9acf-9311f1aeafcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf0cae3-a215-4491-bcc9-6ce278351274", "tag": "d2339708-7bad-42a0-938d-9ef9e761a731"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:00.096718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fea6bd43-45d3-4766-9e99-106939cea273 req-dfbca5d2-9b6b-4552-9acf-9311f1aeafcf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.097467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fea6bd43-45d3-4766-9e99-106939cea273 req-dfbca5d2-9b6b-4552-9acf-9311f1aeafcf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.097901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fea6bd43-45d3-4766-9e99-106939cea273 req-dfbca5d2-9b6b-4552-9acf-9311f1aeafcf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.109991 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fea6bd43-45d3-4766-9e99-106939cea273 req-dfbca5d2-9b6b-4552-9acf-9311f1aeafcf service nova] Creating event network-changed:d2339708-7bad-42a0-938d-9ef9e761a731 for instance 1cf0cae3-a215-4491-bcc9-6ce278351274 on n-h1-781139-2 Oct 03 14:36:00.115869 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fea6bd43-45d3-4766-9e99-106939cea273 req-dfbca5d2-9b6b-4552-9acf-9311f1aeafcf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036290 Oct 03 14:36:00.117101 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 480/950] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:00.155705 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a47dce20-dc1d-4563-a777-300bd3fe10b2 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94/action" status: 202 len: 0 microversion: 2.1 time: 0.240798 Oct 03 14:36:00.156350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 471/951] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:35:59 2022] POST /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:36:00.170815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caea86fe-bf3d-46f1-ad8d-ba14b31ba19c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '.version_select at 0x7fb2309df160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:00.207891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:00.208623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] [instance: 5dc3a975-8b74-4921-9106-0160c9bcc3bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:00.216624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.217155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.217588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.218505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.219044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.219638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.225104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:00.236419 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] HTTP exception thrown: Instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf could not be found. Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Request method failure captured: Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf HTTP/1.1 Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKjyfNSoyFOg8tgn4AtT68t1cd5KuqRLseWZwJmj069GxpQ0MKWh7EwoDWL1mnWPr6m5yf2Zdbv4ziATq97D0Rfujb-Y4M-2Ak1ZvA7XvRdaN7P9sn5i419IMlPk3wJK_i0-iCq1kwWO4OYCH1LnQlIOdSmtxIlm6uniXSIeWjeIB4 Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 78dce6cc05804cc0b807cc6da75ec0aa Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:00.237945 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_78dce6cc05804cc0b807cc6da75ec0aa", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/78dce6cc05804cc0b807cc6da75ec0aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 78dce6cc05804cc0b807cc6da75ec0aa Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminTestJSON-1907038498 Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminTestJSON-1907038498-project Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b54fe4de8a9e4cc79a0e09c98d0d570e Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminTestJSON-1907038498-project Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf could not be found. Oct 03 14:36:00.239631 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '5dc3a975-8b74-4921-9106-0160c9bcc3bf'} Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf could not be found. Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:00.240464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf could not be found. Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf could not be found. Oct 03 14:36:00.241761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.242903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] Returning 404 to user: Instance 5dc3a975-8b74-4921-9106-0160c9bcc3bf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:00.242903 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d9af1ad5-b29a-4211-a3ed-742a76259fb0 tempest-ServersAdminTestJSON-1907038498 tempest-ServersAdminTestJSON-1907038498-project] 10.222.0.20 "GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf" status: 404 len: 111 microversion: 2.1 time: 0.035923 Oct 03 14:36:00.242903 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 472/952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:00 2022] GET /compute/v2.1/servers/5dc3a975-8b74-4921-9106-0160c9bcc3bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:00.244551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:00.245265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:00.251267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.251747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.252181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.252900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.253826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.253967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.276452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:00.311359 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caea86fe-bf3d-46f1-ad8d-ba14b31ba19c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863" status: 204 len: 0 microversion: 2.1 time: 0.147351 Oct 03 14:36:00.311937 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 481/953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:00 2022] DELETE /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:00.315772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:00.322900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3ece6bd-396e-4729-b479-9f2c4e7d34d9 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '.version_select at 0x7fb2310adf70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:00.346863 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f3ece6bd-396e-4729-b479-9f2c4e7d34d9 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Image not found. Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3ece6bd-396e-4729-b479-9f2c4e7d34d9 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863 HTTP/1.1 Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:00.349596 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'aef1519c-0057-4740-8951-bab9b61e8863'} Oct 03 14:36:00.350913 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:36:00.354935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aef1519c-0057-4740-8951-bab9b61e8863 Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:36:00.356422 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aef1519c-0057-4740-8951-bab9b61e8863 could not be found. Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:36:00.357840 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:00.359519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3ece6bd-396e-4729-b479-9f2c4e7d34d9 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:00.360777 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3ece6bd-396e-4729-b479-9f2c4e7d34d9 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863" status: 404 len: 62 microversion: 2.1 time: 0.034353 Oct 03 14:36:00.360777 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 482/954] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:36:00 2022] GET /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:36:00.360777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:00.360777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:00.370744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.372013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.372757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.373621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.374129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.374595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.416031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:00.424232 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-147c905d-88a3-40cc-a7c1-96f965a44619 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1322 microversion: 2.1 time: 0.183409 Oct 03 14:36:00.424824 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 473/955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:00 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:00.530215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:00.538460 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5df9f24-dac5-4f00-96c3-44aa4497b382 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1541 microversion: 2.1 time: 0.183028 Oct 03 14:36:00.539197 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 483/956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:00 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1541 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:00.925275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:00.925949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:00.933325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.933819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.934318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:00.935070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:00.935526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:00.935955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.072664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:01.081477 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7313c4de-dda4-41ab-bc9f-f0cd1e3c8da8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.159999 Oct 03 14:36:01.081959 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 474/957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:00 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:01.095549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:01.096139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:01.098225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:01.105072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.105683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.106589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.107569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.108303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.109093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.242547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:01.250542 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d036bd5-7814-42ea-b1b1-983022ce080f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.159106 Oct 03 14:36:01.251150 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 484/958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:01 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:01.449936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:01.450560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:01.457349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.457878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.458214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.458913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.459358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.459773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.560974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:01.561539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:01.567689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.568169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.568599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.569321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.569772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.570187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.595351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:01.614241 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2886ae25-a292-426d-a74b-4aa82ba40f14 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1472 microversion: 2.1 time: 0.168023 Oct 03 14:36:01.614821 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 475/959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:01 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:01.636762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:01.637400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:01.643876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.644360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.644787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.645705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.646624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.647069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.671055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lazy-loading 'flavor' on Instance uuid 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:01.711259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:01.720238 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eff78a4c-c3c5-4c52-8bc3-1869af7eda37 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1541 microversion: 2.1 time: 0.163196 Oct 03 14:36:01.720988 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 485/960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:01 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1541 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:01.752907 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d168c0b-b7b1-46a1-9895-2cdf5e6fb728 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6/action" status: 202 len: 0 microversion: 2.1 time: 0.119836 Oct 03 14:36:01.753954 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 476/961] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:36:01 2022] POST /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:36:01.763029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:01.763644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:01.770877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.771465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.772014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:01.772868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:01.773420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:01.773908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:02.013275 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-906665b8-1962-4d80-8a4f-60551fc5ec44 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1631 microversion: 2.1 time: 0.254316 Oct 03 14:36:02.013855 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 486/962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:01 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1631 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:02.107652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:02.108319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:02.116246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:02.116736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:02.117205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:02.117927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:02.118381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:02.118792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:02.274884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:02.275492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:02.282142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:02.282627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:02.283053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:02.283801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:02.284287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:02.284708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:02.300888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:02.310018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:02.320364 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f657362-0ad1-428d-8568-c0565053654f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.218398 Oct 03 14:36:02.321669 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 477/963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:02 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:02.441323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:02.449922 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce81dd69-c072-45ca-9278-b51662fdad34 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.179241 Oct 03 14:36:02.450501 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 487/964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:02 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:02.746292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:02.746965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:02.773092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:02.773447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:02.774564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:02.775438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:02.776003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:02.776496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:02.971719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:02.989077 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2de11e73-6e86-4be4-b85b-b072fd3c53ea tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1533 microversion: 2.1 time: 0.248126 Oct 03 14:36:03.005246 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 478/965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:02 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1533 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:03.037111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:03.037724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:03.045370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.046091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.046727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.047670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.048476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.049133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.309678 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42559e98-5662-43d4-9ff8-fa7275fa2f42 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1614 microversion: 2.1 time: 0.276582 Oct 03 14:36:03.332654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:03.334068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:03.339325 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 488/966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:03 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1614 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:03.346683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.348530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:03.353413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.354209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.354919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:03.356200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.358097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.360004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.374537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.375039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.375696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.376300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.376752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.377500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.409939 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] HTTP exception thrown: Cannot 'migrate' instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 while it is in vm_state suspended Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Request method failure captured: Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6/action HTTP/1.1 Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMyiKzuroXDtjpTZALH_sbEGWlhyhjuz965YKG_0WwDjd3YezlIS7_xWdTHYwzas2qOZ6stxcZNqHjqf_ZoarFUyRQR117srgPpCiiIP9p0YT4FueOIDwUY-Y9hbXP4lGfRarSIUGcySMCK1Bk5SYbGJtRGsgfn85aydLrZK0bzXOQ Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:36:03.414050 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68afa642e21945869980e290d0896bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68afa642e21945869980e290d0896bd2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 13a1e48b3e6e4205a5b767dc554ae149 Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: {"migrate": {}} Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:03.415691 n-d-781139-2 devstack@n-api.service[128868]: exception: Cannot 'migrate' instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 while it is in vm_state suspended Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4500536c-43bd-4cd1-ba97-5cfa38d3a7b6', 'body': {'migrate': {}}} Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 in vm_state suspended. Cannot resize while the instance is in this state. Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.416615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 while it is in vm_state suspended Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.419198 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.421428 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:03.421428 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:03.421428 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 while it is in vm_state suspended Oct 03 14:36:03.421428 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.422780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Returning 409 to user: Cannot 'migrate' instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 while it is in vm_state suspended {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:03.423886 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e84bf3a3-e3df-46d8-a7c5-585d57363b81 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6/action" status: 409 len: 148 microversion: 2.1 time: 0.095245 Oct 03 14:36:03.425202 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 479/967] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:36:03 2022] POST /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6/action => generated 148 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:36:03.440010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a3910207-55cd-44ec-ba4f-6c635587b445 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a3910207-55cd-44ec-ba4f-6c635587b445 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Request method failure captured: Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d/action HTTP/1.1 Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 39 Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMyiKzuroXDtjpTZALH_sbEGWlhyhjuz965YKG_0WwDjd3YezlIS7_xWdTHYwzas2qOZ6stxcZNqHjqf_ZoarFUyRQR117srgPpCiiIP9p0YT4FueOIDwUY-Y9hbXP4lGfRarSIUGcySMCK1Bk5SYbGJtRGsgfn85aydLrZK0bzXOQ Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:36:03.445109 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68afa642e21945869980e290d0896bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68afa642e21945869980e290d0896bd2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 13a1e48b3e6e4205a5b767dc554ae149 Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: {"os-resetState": {"state": "invalid"}} Oct 03 14:36:03.446858 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '5b2b20ad-a733-4372-b729-e68a1addd00d', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.447582 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:36:03.449994 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 03 14:36:03.451130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.452396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a3910207-55cd-44ec-ba4f-6c635587b445 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:03.453497 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a3910207-55cd-44ec-ba4f-6c635587b445 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d/action" status: 400 len: 144 microversion: 2.1 time: 0.017387 Oct 03 14:36:03.454653 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 480/968] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:36:03 2022] POST /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:36:03.465202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-907a635d-56c1-44d7-8d76-a4aceaa705f7 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-907a635d-56c1-44d7-8d76-a4aceaa705f7 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Request method failure captured: Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d/action HTTP/1.1 Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 31 Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMyiKzuroXDtjpTZALH_sbEGWlhyhjuz965YKG_0WwDjd3YezlIS7_xWdTHYwzas2qOZ6stxcZNqHjqf_ZoarFUyRQR117srgPpCiiIP9p0YT4FueOIDwUY-Y9hbXP4lGfRarSIUGcySMCK1Bk5SYbGJtRGsgfn85aydLrZK0bzXOQ Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:36:03.469550 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68afa642e21945869980e290d0896bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68afa642e21945869980e290d0896bd2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 13a1e48b3e6e4205a5b767dc554ae149 Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: {"os-resetState": {"state": 1}} Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:03.470911 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '5b2b20ad-a733-4372-b729-e68a1addd00d', 'body': {'os-resetState': {'state': 1}}} Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 1 Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:03.471769 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 03 14:36:03.473076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.475638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-907a635d-56c1-44d7-8d76-a4aceaa705f7 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:03.476892 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-907a635d-56c1-44d7-8d76-a4aceaa705f7 tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d/action" status: 400 len: 120 microversion: 2.1 time: 0.015575 Oct 03 14:36:03.478330 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 481/969] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:36:03 2022] POST /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:36:03.487115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:03.488244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:03.494807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.495656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.496317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.497318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.498051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.498902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.661441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:03.666767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:03.670548 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a5b81bd-db96-4b20-9392-ea2cbf99bb1b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.329839 Oct 03 14:36:03.674667 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 489/970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:03 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:03.684912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e2b4137-2a87-42e0-9c5b-33130cb7286c tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:03.686400 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7947293-516f-429a-9230-4cc501e45e9e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.205823 Oct 03 14:36:03.687226 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 482/971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:03 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:03.688995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e2b4137-2a87-42e0-9c5b-33130cb7286c tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Failed to fetch instance by id 999 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 14:36:03.689533 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5e2b4137-2a87-42e0-9c5b-33130cb7286c tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e2b4137-2a87-42e0-9c5b-33130cb7286c tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Request method failure captured: Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 37 Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMyiKzuroXDtjpTZALH_sbEGWlhyhjuz965YKG_0WwDjd3YezlIS7_xWdTHYwzas2qOZ6stxcZNqHjqf_ZoarFUyRQR117srgPpCiiIP9p0YT4FueOIDwUY-Y9hbXP4lGfRarSIUGcySMCK1Bk5SYbGJtRGsgfn85aydLrZK0bzXOQ Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:36:03.708911 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68afa642e21945869980e290d0896bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68afa642e21945869980e290d0896bd2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68afa642e21945869980e290d0896bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 68afa642e21945869980e290d0896bd2 Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1293008163 Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 13a1e48b3e6e4205a5b767dc554ae149 Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1293008163-project-admin Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: {"os-resetState": {"state": "error"}} Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:03.710467 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 999 could not be found. Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:36:03.711239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e2b4137-2a87-42e0-9c5b-33130cb7286c tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:03.712510 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e2b4137-2a87-42e0-9c5b-33130cb7286c tempest-ServersAdminNegativeTestJSON-1293008163 tempest-ServersAdminNegativeTestJSON-1293008163-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.034842 Oct 03 14:36:03.713509 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 490/972] 10.222.0.20 () {60 vars in 1179 bytes} [Mon Oct 3 14:36:03 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:36:03.720456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:03.721193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:03.727868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.728671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.729176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.730036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.730645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.731071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.762751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:36:03.876106 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-311b1f1d-5a4f-414f-a6bd-2c54d7936be6 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 204 len: 0 microversion: 2.1 time: 0.158026 Oct 03 14:36:03.880653 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 483/973] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:03 2022] DELETE /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:03.891930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:03.892551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:03.902518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.903035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.903396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:03.904543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:03.904773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:03.905271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:04.016138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:04.016836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:04.023383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:04.023863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:04.024287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:04.025012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:04.025456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:04.026239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:04.095574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:04.108448 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06e16885-aca0-4d7f-8df3-20aed0ae78ae tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1469 microversion: 2.1 time: 0.223460 Oct 03 14:36:04.124372 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 491/974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:03 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:04.219601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:04.242350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4d51497-fe87-4965-b2e4-852bc361f48b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1533 microversion: 2.1 time: 0.230837 Oct 03 14:36:04.245434 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 484/975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:04 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1533 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:04.694427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:04.695607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:04.702360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:04.702822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:04.703622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:04.711878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:04.712587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:04.716813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:04.717447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:04.717896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:04.727022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:04.727946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:04.728538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:04.730228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:04.731159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:04.731768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:04.890965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:04.900088 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-23db437f-c671-4dda-b204-af98f3702e3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.192175 Oct 03 14:36:04.900941 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 485/976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:04 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:05.140169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:05.141596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:05.149779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:05.150617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:05.151262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:05.151980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:05.152438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:05.152896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:05.233421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:05.248166 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0570b075-96be-464a-a152-478a1f7a4d2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.553544 Oct 03 14:36:05.250062 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 492/977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:04 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:05.278367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:05.279376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:05.293213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:05.294078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:05.294647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:05.295472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:05.296686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:05.297199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:05.382004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:05.393488 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa9ae0cf-96e1-40ad-9b5f-994a89233be1 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1469 microversion: 2.1 time: 0.261406 Oct 03 14:36:05.410715 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 486/978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:05 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:05.629334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:05.637285 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92c96d54-6cb6-4b53-940a-6f53eeee74f1 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1539 microversion: 2.1 time: 0.369129 Oct 03 14:36:05.649542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 493/979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:05 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:05.923465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:05.924234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:05.932421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:05.932951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:05.933393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:05.934091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:05.934910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:05.935335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.087597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-42fb4dd5-1762-4cc7-a55f-787860842220 req-4732573c-276f-4325-b682-bf551cb59cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4500536c-43bd-4cd1-ba97-5cfa38d3a7b6", "name": "network-vif-deleted", "tag": "14de6f68-c33d-4fee-82d5-bed584cadbe5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:06.117533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42fb4dd5-1762-4cc7-a55f-787860842220 req-4732573c-276f-4325-b682-bf551cb59cb2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.117533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42fb4dd5-1762-4cc7-a55f-787860842220 req-4732573c-276f-4325-b682-bf551cb59cb2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.117533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42fb4dd5-1762-4cc7-a55f-787860842220 req-4732573c-276f-4325-b682-bf551cb59cb2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.149678 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-42fb4dd5-1762-4cc7-a55f-787860842220 req-4732573c-276f-4325-b682-bf551cb59cb2 service nova] Creating event network-vif-deleted:14de6f68-c33d-4fee-82d5-bed584cadbe5 for instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 on n-h2-781139-2 Oct 03 14:36:06.160280 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-42fb4dd5-1762-4cc7-a55f-787860842220 req-4732573c-276f-4325-b682-bf551cb59cb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079008 Oct 03 14:36:06.161292 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 494/980] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:06.166008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:06.191791 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ea763d65-5936-4c29-93ba-80f77be7e080 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.270281 Oct 03 14:36:06.193927 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 487/981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:05 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:06.275335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:06.276041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:06.282371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.283582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.284407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.285191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.285894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.286321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.415759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:06.416758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:06.435095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.435795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.436388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.437293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.437897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.438525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.469897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:06.487907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.488641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.489295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.489902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lazy-loading 'fault' on Instance uuid 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:06.533114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:06.542597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dda594da-621a-437d-8516-96ca7ac34000 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 200 len: 1312 microversion: 2.1 time: 0.130484 Oct 03 14:36:06.543855 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 488/982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:06 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 1312 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:06.629959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:06.638707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb6f5dbc-2524-40f2-81d5-aaa58689d92c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.370658 Oct 03 14:36:06.639297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 495/983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:06 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:06.663219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:06.663752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:06.670348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.670856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.671310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.672505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.672986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.673401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.684204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-99aeddb1-8ffc-48e1-bd09-25e7059da9f5 req-6378df74-6972-41a1-95b2-f2c5735e752f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf0cae3-a215-4491-bcc9-6ce278351274", "name": "network-vif-plugged", "status": "completed", "tag": "d2339708-7bad-42a0-938d-9ef9e761a731"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:06.701590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-99aeddb1-8ffc-48e1-bd09-25e7059da9f5 req-6378df74-6972-41a1-95b2-f2c5735e752f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:06.702365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-99aeddb1-8ffc-48e1-bd09-25e7059da9f5 req-6378df74-6972-41a1-95b2-f2c5735e752f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:06.702488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-99aeddb1-8ffc-48e1-bd09-25e7059da9f5 req-6378df74-6972-41a1-95b2-f2c5735e752f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:06.728359 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-99aeddb1-8ffc-48e1-bd09-25e7059da9f5 req-6378df74-6972-41a1-95b2-f2c5735e752f service nova] Creating event network-vif-plugged:d2339708-7bad-42a0-938d-9ef9e761a731 for instance 1cf0cae3-a215-4491-bcc9-6ce278351274 on n-h1-781139-2 Oct 03 14:36:06.745895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-99aeddb1-8ffc-48e1-bd09-25e7059da9f5 req-6378df74-6972-41a1-95b2-f2c5735e752f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065440 Oct 03 14:36:06.746746 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 496/984] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:06.881158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:06.893015 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fd43106-d92b-4edd-b1b1-3b8e0defab8f tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1539 microversion: 2.1 time: 0.234476 Oct 03 14:36:06.906662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 489/985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:06 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1539 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:07.215743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:07.216913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:07.223865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.224742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.225419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.226521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.227272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.227909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.435648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:07.447059 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e86cbc1e-dd01-4097-8ff4-fca5a5917346 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.235429 Oct 03 14:36:07.447815 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 497/986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:07 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:07.567309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:07.568077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:07.575569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.576176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.576734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.577554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.578194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.578891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.593893 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] HTTP exception thrown: Instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 could not be found. Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Request method failure captured: Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 HTTP/1.1 Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMxfz6IRxhio3MGi0meIyxqjtR57L11YLMS___o7IPgrOz5O4ah44u93D2UBppAVPRbV2cUSTTSbeG_z35jBYurpYuNjwESSQPGDFazmzjbqV1kHj9j6bqdGklYPBXJQ7bLU9h55-eJ-_wKx6NaoLJo1C79OLZ56KgJFffHvLdNojU Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a80020ec000d4ca8be3d5aadb8c820b2 Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1266113074 Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:07.597571 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a80020ec000d4ca8be3d5aadb8c820b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a80020ec000d4ca8be3d5aadb8c820b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a80020ec000d4ca8be3d5aadb8c820b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a80020ec000d4ca8be3d5aadb8c820b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1266113074 Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a80020ec000d4ca8be3d5aadb8c820b2 Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1266113074 Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminNegativeTestJSON-1266113074-project Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b9ac507afaef4475939e3390549cd2e9 Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1266113074-project Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 could not be found. Oct 03 14:36:07.599206 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4500536c-43bd-4cd1-ba97-5cfa38d3a7b6'} Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 could not be found. Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:07.600156 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 could not be found. Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 could not be found. Oct 03 14:36:07.601735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:07.604013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Returning 404 to user: Instance 4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:07.605240 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1bf1be24-7873-49de-a850-48293f75dc9c tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6" status: 404 len: 111 microversion: 2.1 time: 0.042158 Oct 03 14:36:07.606017 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 490/987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:07 2022] GET /compute/v2.1/servers/4500536c-43bd-4cd1-ba97-5cfa38d3a7b6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:07.614821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:07.615651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:07.622176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.622672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.623119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.623831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.624283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.624748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.664457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:36:07.665453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:07.666533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:07.675802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.677544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.678013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.679610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.680145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.680831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.757227 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd930bc0-707c-4bde-94b5-a5148b92e386 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 204 len: 0 microversion: 2.1 time: 0.146474 Oct 03 14:36:07.758548 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 498/988] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:07 2022] DELETE /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:07.769155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:07.770525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:07.777492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.778242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.778681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.779391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.779842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.780287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.850447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:07.867160 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51d78f83-7fb9-4d0e-8a3b-bc31da3f3c27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.207982 Oct 03 14:36:07.895367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 491/989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:07 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:07.921993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:07.922584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:07.930170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.931237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.931843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:07.932549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:07.933100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:07.934233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:08.007219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:08.019025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fa1b7a6-03a0-4617-a755-28ca8a41e860 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1477 microversion: 2.1 time: 0.255950 Oct 03 14:36:08.020032 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 499/990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:07 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1477 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:08.128502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:08.137864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4c4634cb-1d62-4362-b564-1c77a1af5be5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1539 microversion: 2.1 time: 0.220156 Oct 03 14:36:08.141598 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 492/991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:07 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:08.470591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:08.471203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:08.478299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:08.478788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:08.479267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:08.480382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:08.480835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:08.485972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:08.727579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:08.739864 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3273b5f3-6a84-4889-b6ae-fae8b666025a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1357 microversion: 2.1 time: 0.272922 Oct 03 14:36:08.776484 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 500/992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:08 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:08.893370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:08.894197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:08.905057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:08.906863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:08.907462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:08.916279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:08.918653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:08.920880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:08.921565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:09.042803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:09.043428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:09.053365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:09.053855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:09.054297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:09.055080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:09.064290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:09.064756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:09.145072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:09.155805 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f0b2245-add9-4505-9429-8474bb731bb2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.267593 Oct 03 14:36:09.156646 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 493/993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:08 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:09.162720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:09.163559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:09.170484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:09.171187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:09.171818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:09.172690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:09.173323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:09.173912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:09.426936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:09.438072 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98507520-83d1-4843-8990-8943090513cd tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1477 microversion: 2.1 time: 0.399118 Oct 03 14:36:09.441962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 501/994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:09 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:09.697616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:09.707372 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ab7352df-8c20-4b5c-a436-8678bfe5e6d6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1539 microversion: 2.1 time: 0.547843 Oct 03 14:36:09.708578 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 494/995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:09 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1539 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:09.773822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:09.774412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:09.792634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:09.793161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:09.793600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:09.794315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:09.794776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:09.795198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.035743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:10.051894 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c01da659-2b45-45c3-991e-9d1c98c3ede8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1540 microversion: 2.1 time: 0.280369 Oct 03 14:36:10.061160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 502/996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:09 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1540 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:10.084379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:10.085556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:10.105200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.105709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.106142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.106861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.110681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.111603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.190030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:10.191436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:10.203377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.205757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.207789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.213733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.214478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.216313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.249399 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9304101-aed5-4c88-a9a1-1e17e980727a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173658 Oct 03 14:36:10.250209 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 495/997] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:36:10 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:10.272962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-81fced9e-046d-48a7-9489-5d3beae42c0c req-c3cace52-c7f8-43d2-8b75-ea960ba63ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70288b68-bdda-44ce-b9e0-b67137888f94", "name": "network-vif-plugged", "status": "completed", "tag": "aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:10.301910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-81fced9e-046d-48a7-9489-5d3beae42c0c req-c3cace52-c7f8-43d2-8b75-ea960ba63ca1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.302867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-81fced9e-046d-48a7-9489-5d3beae42c0c req-c3cace52-c7f8-43d2-8b75-ea960ba63ca1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.303473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-81fced9e-046d-48a7-9489-5d3beae42c0c req-c3cace52-c7f8-43d2-8b75-ea960ba63ca1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.318904 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-81fced9e-046d-48a7-9489-5d3beae42c0c req-c3cace52-c7f8-43d2-8b75-ea960ba63ca1 service nova] Creating event network-vif-plugged:aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f for instance 70288b68-bdda-44ce-b9e0-b67137888f94 on n-h1-781139-2 Oct 03 14:36:10.350749 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-81fced9e-046d-48a7-9489-5d3beae42c0c req-c3cace52-c7f8-43d2-8b75-ea960ba63ca1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076842 Oct 03 14:36:10.351990 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 496/998] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:10.469744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:10.471484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:10.480601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.481512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.482468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.483488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.484857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.485650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.878309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ac507afaef4475939e3390549cd2e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a80020ec000d4ca8be3d5aadb8c820b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:10.897315 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eeb7bf25-990f-4ee8-8f34-68489d3dd22e tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 200 len: 1435 microversion: 2.1 time: 0.436951 Oct 03 14:36:10.899269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 497/999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:10 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 1435 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:10.906283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6d8e7fcd-5b06-4b7c-bd19-a8be9233ecdb req-f67e0f16-504a-499a-8310-fecffa2e729b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2b20ad-a733-4372-b729-e68a1addd00d", "name": "network-vif-deleted", "tag": "b53f097b-0955-4b40-acc3-7ef2af42eff1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:10.927211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6d8e7fcd-5b06-4b7c-bd19-a8be9233ecdb req-f67e0f16-504a-499a-8310-fecffa2e729b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.929814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6d8e7fcd-5b06-4b7c-bd19-a8be9233ecdb req-f67e0f16-504a-499a-8310-fecffa2e729b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.930938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6d8e7fcd-5b06-4b7c-bd19-a8be9233ecdb req-f67e0f16-504a-499a-8310-fecffa2e729b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.952058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6d8e7fcd-5b06-4b7c-bd19-a8be9233ecdb req-f67e0f16-504a-499a-8310-fecffa2e729b service nova] Creating event network-vif-deleted:b53f097b-0955-4b40-acc3-7ef2af42eff1 for instance 5b2b20ad-a733-4372-b729-e68a1addd00d on n-h2-781139-2 Oct 03 14:36:10.959748 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6d8e7fcd-5b06-4b7c-bd19-a8be9233ecdb req-f67e0f16-504a-499a-8310-fecffa2e729b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057890 Oct 03 14:36:10.961442 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 498/1000] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:10.968226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:10.969087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:10.978920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.979588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.980262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.981596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:10.982260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:10.982630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:10.994284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:11.007230 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a6a2828-db47-4ada-9d5f-bcc269306a28 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.827298 Oct 03 14:36:11.008618 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 503/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:10 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:11.285781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:11.303377 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8cd205ed-6fc6-4209-8bd7-051634a016b6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1521 microversion: 2.1 time: 0.337379 Oct 03 14:36:11.304388 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 499/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:10 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:11.338690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:11.339404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:11.351382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:11.352389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:11.354684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:11.357037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:11.359050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:11.359795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:11.420648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:36:11.429095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:11.593792 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-543922c7-7998-4d5a-8016-11d3c1d8f624 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 204 len: 0 microversion: 2.1 time: 0.261750 Oct 03 14:36:11.595529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 504/1003] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:11 2022] DELETE /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:11.604232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:11.604901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:11.616146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:11.616762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:11.617432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:11.618347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:11.618874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:11.619730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:11.927284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:11.928582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] [instance: 5b2b20ad-a733-4372-b729-e68a1addd00d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:11.939595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:11.944937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:11.945349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:11.946229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:11.946701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:11.950581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:11.990071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:11.990352 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] HTTP exception thrown: Instance 5b2b20ad-a733-4372-b729-e68a1addd00d could not be found. Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Request method failure captured: Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d HTTP/1.1 Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMxfz6IRxhio3MGi0meIyxqjtR57L11YLMS___o7IPgrOz5O4ah44u93D2UBppAVPRbV2cUSTTSbeG_z35jBYurpYuNjwESSQPGDFazmzjbqV1kHj9j6bqdGklYPBXJQ7bLU9h55-eJ-_wKx6NaoLJo1C79OLZ56KgJFffHvLdNojU Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a80020ec000d4ca8be3d5aadb8c820b2 Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1266113074 Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:11.993861 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a80020ec000d4ca8be3d5aadb8c820b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a80020ec000d4ca8be3d5aadb8c820b2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a80020ec000d4ca8be3d5aadb8c820b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a80020ec000d4ca8be3d5aadb8c820b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1266113074 Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a80020ec000d4ca8be3d5aadb8c820b2 Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1266113074 Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersAdminNegativeTestJSON-1266113074-project Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: b9ac507afaef4475939e3390549cd2e9 Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1266113074-project Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 5b2b20ad-a733-4372-b729-e68a1addd00d could not be found. Oct 03 14:36:11.995897 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5b2b20ad-a733-4372-b729-e68a1addd00d'} Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2b20ad-a733-4372-b729-e68a1addd00d could not be found. Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:11.996797 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2b20ad-a733-4372-b729-e68a1addd00d could not be found. Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2b20ad-a733-4372-b729-e68a1addd00d could not be found. Oct 03 14:36:11.998285 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:12.000715 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d8901b76-810b-4247-8d11-747682a0491a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1527 microversion: 2.1 time: 0.400832 Oct 03 14:36:12.001992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] Returning 404 to user: Instance 5b2b20ad-a733-4372-b729-e68a1addd00d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:12.004483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 500/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:11 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1527 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:12.007460 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7d8ce92-cc6c-4436-96d2-5ca0d964a393 tempest-ServersAdminNegativeTestJSON-1266113074 tempest-ServersAdminNegativeTestJSON-1266113074-project] 10.222.0.20 "GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d" status: 404 len: 111 microversion: 2.1 time: 0.083020 Oct 03 14:36:12.008548 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 505/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:11 2022] GET /compute/v2.1/servers/5b2b20ad-a733-4372-b729-e68a1addd00d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:12.043598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:12.044374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:12.067753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:12.072030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:12.072996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:12.075460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:12.077298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:12.080906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:12.552914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:12.571848 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e747fc04-4b35-41d8-9be3-434cce487f3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.528375 Oct 03 14:36:12.585726 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 501/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:12 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:13.023598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c4582c47-0d1e-4b5c-a814-7d764683dd27 req-134b3bdc-9e98-4279-b8b9-83d77082ff00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf0cae3-a215-4491-bcc9-6ce278351274", "tag": "d2339708-7bad-42a0-938d-9ef9e761a731"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:13.026906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:13.027550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:13.038540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c4582c47-0d1e-4b5c-a814-7d764683dd27 req-134b3bdc-9e98-4279-b8b9-83d77082ff00 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:13.039060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c4582c47-0d1e-4b5c-a814-7d764683dd27 req-134b3bdc-9e98-4279-b8b9-83d77082ff00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:13.042936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:13.043511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:13.043868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:13.044600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:13.045083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:13.045571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c4582c47-0d1e-4b5c-a814-7d764683dd27 req-134b3bdc-9e98-4279-b8b9-83d77082ff00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:13.046885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:13.068191 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c4582c47-0d1e-4b5c-a814-7d764683dd27 req-134b3bdc-9e98-4279-b8b9-83d77082ff00 service nova] Creating event network-changed:d2339708-7bad-42a0-938d-9ef9e761a731 for instance 1cf0cae3-a215-4491-bcc9-6ce278351274 on n-h1-781139-2 Oct 03 14:36:13.074437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c4582c47-0d1e-4b5c-a814-7d764683dd27 req-134b3bdc-9e98-4279-b8b9-83d77082ff00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054823 Oct 03 14:36:13.076344 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 506/1007] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:13.481613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:13.508754 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-27f824d1-dab2-4787-a78b-ec35d900ab7c tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1527 microversion: 2.1 time: 0.482110 Oct 03 14:36:13.510240 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 502/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:13 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1527 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:13.596532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:13.597841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:13.607674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:13.608155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:13.608590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:13.609324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:13.609763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:13.614433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:14.039580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:14.054108 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ca3858b-ebdd-4d19-a34a-f1df51033707 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.461955 Oct 03 14:36:14.056612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 507/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:13 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:14.537991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:14.539442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:14.555438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:14.558601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:14.559151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:14.568312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:14.569114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:14.569811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:14.727692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:14.735884 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b1d1061-e069-4fd0-a0a8-f5c06e424685 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1485 microversion: 2.1 time: 0.204498 Oct 03 14:36:14.737134 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 503/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:14 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1485 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:15.079679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:15.080514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:15.094184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6995abbb-8a8c-483d-a994-54a9e759ea97 req-c776d344-1250-4c14-b976-2d99bc7ff22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70288b68-bdda-44ce-b9e0-b67137888f94", "name": "network-vif-deleted", "tag": "aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:15.105961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:15.106440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:15.126385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:15.131349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:15.131604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:15.132044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:15.134057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6995abbb-8a8c-483d-a994-54a9e759ea97 req-c776d344-1250-4c14-b976-2d99bc7ff22c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:15.135384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6995abbb-8a8c-483d-a994-54a9e759ea97 req-c776d344-1250-4c14-b976-2d99bc7ff22c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:15.135915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6995abbb-8a8c-483d-a994-54a9e759ea97 req-c776d344-1250-4c14-b976-2d99bc7ff22c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:15.167313 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6995abbb-8a8c-483d-a994-54a9e759ea97 req-c776d344-1250-4c14-b976-2d99bc7ff22c service nova] Creating event network-vif-deleted:aaa0ce22-ded7-4ae9-bffa-291f8eeb0e1f for instance 70288b68-bdda-44ce-b9e0-b67137888f94 on n-h1-781139-2 Oct 03 14:36:15.180212 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6995abbb-8a8c-483d-a994-54a9e759ea97 req-c776d344-1250-4c14-b976-2d99bc7ff22c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089917 Oct 03 14:36:15.183721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 504/1011] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:15.406800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:15.427110 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eacd4e8b-adb3-4c7d-a0d1-a31336c315fe tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.351216 Oct 03 14:36:15.447165 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 508/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:15 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:15.666042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ed68e6e-6466-4437-a749-2294775c0044 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Action: 'create', calling method: .version_select at 0x7fb2309d9790>, body: {"keypair": {"name": "tempest-keypair-1252763527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FxDfDMKpTls8rYKth71ghwwchPRUFICV4dk0H0gpq6LaDvIc2AV2vkMQUa++zUHQ19d4NlUef0THXnsNe1Qz/dP7mX2UUdYdk88e33PR5U1iXsGGXwzvmyFkaznjfHA=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:15.689466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4ed68e6e-6466-4437-a749-2294775c0044 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Getting quotas for project 86217b1343254b55bf90b9240aba1332. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:36:15.696481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4ed68e6e-6466-4437-a749-2294775c0044 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Getting quotas for user ce74b5279d524df88e5e84b20b920261 and project 86217b1343254b55bf90b9240aba1332. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:36:15.729327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ed68e6e-6466-4437-a749-2294775c0044 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.384972 Oct 03 14:36:15.729969 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 505/1013] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:36:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:15.767962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:15.769494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:15.779712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:15.780606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:15.781339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:15.782220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:15.782786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:15.783396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:15.831971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:15.832757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:15.833287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:15.833890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lazy-loading 'fault' on Instance uuid 70288b68-bdda-44ce-b9e0-b67137888f94 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:15.898161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:15.909036 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-493252f9-ae23-4924-b2bb-c09de4f720e4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 200 len: 1314 microversion: 2.1 time: 0.148221 Oct 03 14:36:15.910360 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 509/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:15 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:16.456753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:16.457912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:16.467321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.467811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.468239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.468958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.469581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.470756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.771934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:16.775645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.776135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.776678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.777399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.777851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.778270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.779392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:16.787959 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2011abb5-8c31-450a-bade-6137219e979e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.337919 Oct 03 14:36:16.801037 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 506/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:16 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:16.805121 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e12411ea-51c5-4bf6-ad6f-970a97a3f879 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.178342 Oct 03 14:36:16.806280 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 510/1016] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:16 2022] GET /compute/v2.1/os-services => generated 944 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:16.821669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:16.825633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.826106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.826549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.827275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.828204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.828619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.853815 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03b6759c-014a-4ab9-8f84-564bae54e825 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-781139-2" status: 200 len: 578 microversion: 2.1 time: 0.036386 Oct 03 14:36:16.854458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 507/1017] 10.222.0.20 () {58 vars in 1172 bytes} [Mon Oct 3 14:36:16 2022] GET /compute/v2.1/os-services?host=n-d-781139-2 => generated 578 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:16.867618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:16.871365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.872028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.872465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.873215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.873658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.874069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.900647 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-481de540-1377-4261-a15c-29782e6eca89 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036947 Oct 03 14:36:16.901316 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 511/1018] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:36:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:16.914341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:16.917949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.918435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.918864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.919615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.920062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.920962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.933519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:16.934242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:16.947137 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a13d920-0138-4ea8-aed5-1c7acf1eadd7 tempest-ServicesAdminTestJSON-916933114 tempest-ServicesAdminTestJSON-916933114-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.036460 Oct 03 14:36:16.947766 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 508/1019] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:16 2022] GET /compute/v2.1/os-services => generated 944 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:16.947897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.948909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.949438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.950288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:16.950799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:16.951291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:16.970122 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 HTTP/1.1 Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:16.972209 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:16.973865 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '70288b68-bdda-44ce-b9e0-b67137888f94'} Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:16.974661 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:16.975836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:16.976884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:16.976884 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fab77dc4-b662-4100-8992-b1fcc78201e6 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 404 len: 111 microversion: 2.1 time: 0.046814 Oct 03 14:36:16.976884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 512/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:16 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:17.130861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2003973235", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:17.221827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] validate_networks() for [('c9d9ff27-356e-417a-acdf-f6fd563a5575', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:36:17.636674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1686667579", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c51dc43f-a678-400c-ac70-0fe299e232d0"}], "security_groups": [{"name": "tempest-securitygroup--1667269628"}], "key_name": "tempest-keypair-1252763527", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:17.752001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] validate_networks() for [('c51dc43f-a678-400c-ac70-0fe299e232d0', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:36:17.946658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:18.096676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:36:18.097470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:36:18.098052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:36:18.098739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:36:18.099515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:36:18.112483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:18.113152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:18.113695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:18.114489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:18.115045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:18.115584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:18.136347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for project a762d2f19e454d74a937f6237b3f287a. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:36:18.142862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Getting quotas for user 77fb2abf524d4d8caeb1ec89d5db0d73 and project a762d2f19e454d74a937f6237b3f287a. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:36:18.163730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:36:18.167394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:36:18.196993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:36:18.197603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:36:18.198247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:36:18.198680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:36:18.199079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:36:18.210519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:18.210998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:18.211708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:18.212645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:18.213535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:18.214172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:18.234109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Getting quotas for project 86217b1343254b55bf90b9240aba1332. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:36:18.242217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Getting quotas for user ce74b5279d524df88e5e84b20b920261 and project 86217b1343254b55bf90b9240aba1332. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:36:18.244343 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-88b7ccf5-60ce-42d8-9cf5-fe496b76f868 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.117156 Oct 03 14:36:18.247322 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 509/1021] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:36:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:36:18.257811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:18.258504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:18.265750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:18.266446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:18.267032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:18.267882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:18.268672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:18.269289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:18.270298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:36:18.276950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:36:18.398231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7441b313-ba8a-468b-99cd-e322f4af6185 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765148 Oct 03 14:36:18.398899 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 513/1022] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:36:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:36:18.410458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddffae05-5fcf-4625-acb7-8c301f4a9771 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:18.411807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddffae05-5fcf-4625-acb7-8c301f4a9771 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:18.465871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:18.470838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:18.478529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa13f751-d91a-4f08-ad05-5037baf54e30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.230040 Oct 03 14:36:18.494030 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 510/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:18 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:18.494315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddffae05-5fcf-4625-acb7-8c301f4a9771 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:18.502066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f72cc8a-c628-4b8a-9722-cf5df6c597f6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:18.503162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4f72cc8a-c628-4b8a-9722-cf5df6c597f6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:18.504406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddffae05-5fcf-4625-acb7-8c301f4a9771 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1225 microversion: 2.1 time: 0.102360 Oct 03 14:36:18.505158 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 514/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:18 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:18.570651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4f72cc8a-c628-4b8a-9722-cf5df6c597f6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:18.579508 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f72cc8a-c628-4b8a-9722-cf5df6c597f6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1242 microversion: 2.1 time: 0.083925 Oct 03 14:36:18.580092 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 511/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:18 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:19.506651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:19.507461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:19.514617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:19.515101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:19.515520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:19.516241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:19.516764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:19.517250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:19.527692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:19.528279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:19.535802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:19.536376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:19.536875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:19.537726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:19.538256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:19.539015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:19.614098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:19.624442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c049325-31d9-421b-bb51-247eb18be30a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1277 microversion: 2.1 time: 0.100539 Oct 03 14:36:19.625136 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 512/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:19 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:19.630943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:19.631774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:19.637968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:19.638450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:19.638885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:19.639941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:19.640393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:19.640813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:19.669389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:19.681731 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5362394c-82be-4e0a-be0c-bfde46d9e9c7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.178915 Oct 03 14:36:19.683877 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 515/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:19 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:19.744407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:19.754560 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bbdd578d-a1bc-4730-a27e-886db3fbcbab tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1238 microversion: 2.1 time: 0.127819 Oct 03 14:36:19.755565 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 513/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:19 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1238 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.018994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b06f15c-77c6-4b6e-94a9-655940f72d65 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.027231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b06f15c-77c6-4b6e-94a9-655940f72d65 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.187057 Oct 03 14:36:20.027813 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 516/1029] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:20.043003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e81c4f5-cbb1-4293-9e31-7048fbe1cb79 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.076393 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e81c4f5-cbb1-4293-9e31-7048fbe1cb79 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3077 microversion: 2.1 time: 0.037446 Oct 03 14:36:20.077681 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 514/1030] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors => generated 3077 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.094225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b3bd3c1-1347-4859-866c-4f64495fde0a tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.107780 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b3bd3c1-1347-4859-866c-4f64495fde0a tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017509 Oct 03 14:36:20.108429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 517/1031] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.122489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-47629b0b-223f-431e-90b7-683930963964 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.131960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-47629b0b-223f-431e-90b7-683930963964 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013914 Oct 03 14:36:20.133375 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 515/1032] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.146248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fd37d64-5e7c-430d-beab-5d54daa41f62 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.174100 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6fd37d64-5e7c-430d-beab-5d54daa41f62 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032130 Oct 03 14:36:20.175508 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 518/1033] 10.222.0.20 () {58 vars in 1165 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.195655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aae1829d-a72d-41cd-844e-9bee0766b821 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.205989 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aae1829d-a72d-41cd-844e-9bee0766b821 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015109 Oct 03 14:36:20.213075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 516/1034] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.223143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b881e131-2539-4c52-b665-f12dd5517e95 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.255762 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b881e131-2539-4c52-b665-f12dd5517e95 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.038450 Oct 03 14:36:20.256972 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 519/1035] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.273821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cec34a12-9075-4023-a928-e5a5d880c622 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.293381 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cec34a12-9075-4023-a928-e5a5d880c622 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.023283 Oct 03 14:36:20.303674 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 517/1036] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.315768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f724784-1ba3-4d73-8e66-002448d916fb tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.331372 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f724784-1ba3-4d73-8e66-002448d916fb tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024530 Oct 03 14:36:20.332528 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 520/1037] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.345521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fbb87ede-ec0e-4c90-aa4b-04d84c6ef1b2 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.385818 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fbb87ede-ec0e-4c90-aa4b-04d84c6ef1b2 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.044134 Oct 03 14:36:20.387117 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 518/1038] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.407291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67a5e1b5-9053-4cb1-89b8-bfaaaad792ca tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.426162 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67a5e1b5-9053-4cb1-89b8-bfaaaad792ca tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022799 Oct 03 14:36:20.427582 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 521/1039] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.440300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0691f724-6174-42e2-99e2-792a47de880a tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.493690 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0691f724-6174-42e2-99e2-792a47de880a tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.057409 Oct 03 14:36:20.498782 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 519/1040] 10.222.0.20 () {58 vars in 1144 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.515095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16d55a38-af1b-484e-93cd-8082bde1544a tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.530296 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16d55a38-af1b-484e-93cd-8082bde1544a tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019584 Oct 03 14:36:20.534096 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 522/1041] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.544590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0bf2a3a6-4d8b-410c-bf0d-b038117b9c3d tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.631877 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0bf2a3a6-4d8b-410c-bf0d-b038117b9c3d tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.091039 Oct 03 14:36:20.635689 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 520/1042] 10.222.0.20 () {58 vars in 1148 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.653081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4de29ce9-67b9-453b-840f-32d15be25da9 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.676314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.682494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:20.696879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:20.700024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:20.701761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:20.703281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:20.703774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:20.704215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:20.706338 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4de29ce9-67b9-453b-840f-32d15be25da9 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.054376 Oct 03 14:36:20.715985 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 523/1043] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:20.723338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.724307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:20.737386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:20.738033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:20.738569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:20.739384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:20.740481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:20.741056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:20.945816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:20.961540 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4f5859e-c61d-4830-a5f7-86b1c950c101 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.304000 Oct 03 14:36:20.979893 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 521/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:20.981712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:20.987935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46122201-0546-4490-ba83-4a0cbe2d2d41 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:20.993693 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a650b7b1-3a9c-40b9-9c2f-bfd598d34287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.275681 Oct 03 14:36:20.994376 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 524/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:21.004213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:21.005342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:21.013068 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46122201-0546-4490-ba83-4a0cbe2d2d41 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023450 Oct 03 14:36:21.014072 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 522/1046] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:21.020013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:21.021042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:21.027628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:21.028438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:21.029121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:21.030041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:21.030692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:21.031394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:21.037509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:21.038376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:21.039076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:21.041121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:21.041787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:21.052290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:21.288863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid c3ef74ed-5f46-4ff0-af09-071498ff108a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:21.322866 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d92c618c-c088-47ab-91cf-8ee75ecbaed5 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 2340 microversion: 2.25 time: 0.306969 Oct 03 14:36:21.324079 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 523/1047] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:21 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 2340 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:21.334563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-864df7fc-86b0-45d7-84f8-cbb009cd4735 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:21.364358 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-864df7fc-86b0-45d7-84f8-cbb009cd4735 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.037919 Oct 03 14:36:21.365263 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 524/1048] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:36:21 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:21.371296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:21.378921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:21.379889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:21.380400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:21.381320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:21.381849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:21.382504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:21.411189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d062c357-dd9c-486d-a9c0-5bd083480071 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043758 Oct 03 14:36:21.415932 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 525/1049] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 3 14:36:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:36:21.421268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b271434b-8749-4a01-8ebf-f6794fa37871 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:21.429166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:21.448242 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b271434b-8749-4a01-8ebf-f6794fa37871 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.030761 Oct 03 14:36:21.449343 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 526/1050] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:36:21 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:21.469628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f1c719ee-6501-4369-94d9-aa7d02d056d6 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:21.480147 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f1c719ee-6501-4369-94d9-aa7d02d056d6 tempest-FlavorsV2TestJSON-915318748 tempest-FlavorsV2TestJSON-915318748-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015240 Oct 03 14:36:21.480751 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 527/1051] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:21.545441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:21.555892 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4098031-4064-448e-8717-792bc743afa8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1300 microversion: 2.1 time: 0.559671 Oct 03 14:36:21.560701 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 525/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:20 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1300 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:21.855975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-69d8f9f0-0b3a-465d-a745-a8f9140aff27 req-ef9320fc-2730-4798-b39d-5b5689ff20e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2297b2b8-6f89-4329-ad4a-acd77f4ec532", "tag": "059c2658-c6c6-4300-995c-c0bf355b8be1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:21.894506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-69d8f9f0-0b3a-465d-a745-a8f9140aff27 req-ef9320fc-2730-4798-b39d-5b5689ff20e8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:21.895862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-69d8f9f0-0b3a-465d-a745-a8f9140aff27 req-ef9320fc-2730-4798-b39d-5b5689ff20e8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:21.897220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-69d8f9f0-0b3a-465d-a745-a8f9140aff27 req-ef9320fc-2730-4798-b39d-5b5689ff20e8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:21.912992 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-69d8f9f0-0b3a-465d-a745-a8f9140aff27 req-ef9320fc-2730-4798-b39d-5b5689ff20e8 service nova] Creating event network-changed:059c2658-c6c6-4300-995c-c0bf355b8be1 for instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 on n-h2-781139-2 Oct 03 14:36:21.919426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-69d8f9f0-0b3a-465d-a745-a8f9140aff27 req-ef9320fc-2730-4798-b39d-5b5689ff20e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070467 Oct 03 14:36:21.920786 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 528/1053] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:21.993444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:21.994071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:22.023405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:22.024314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:22.040404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:22.041198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:22.041586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:22.042178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:22.042738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:22.043452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:22.043753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:22.044320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:22.046640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:22.047198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:22.047689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:22.048132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:22.440959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:22.457770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4c39eb3-4b18-45f3-be72-8665a0fde849 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.469088 Oct 03 14:36:22.459194 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 526/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:21 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:22.515952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:22.529929 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29e559f4-fad3-4d46-90c1-b7ab6f20e925 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.513438 Oct 03 14:36:22.546425 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 529/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:22 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:22.584935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:22.585559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:22.600442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:22.600953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:22.601610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:22.602520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:22.603302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:22.603931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:22.972342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:22.990184 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d82c65c9-88bb-4eef-b0d1-6264595e93bb tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.410100 Oct 03 14:36:23.001529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 527/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:22 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:23.485803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:23.486735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:23.494011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:23.494740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:23.495407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:23.496648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:23.497324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:23.498102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:23.560524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:23.562207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:23.572537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:23.574461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:23.575536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:23.576856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:23.577662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:23.578299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:23.670229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:23.681545 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8dfcaa7a-6982-4c48-9e64-ef4aae1c8ee7 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.199524 Oct 03 14:36:23.682379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 530/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:23 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:23.691393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-704c6625-a96c-4f78-96f3-09cc847b17fe req-bd11e881-5b1b-4c22-9919-6549c9c960ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab23598-1a23-485b-ab9f-bb59994dc62b", "tag": "42aa44f3-eff3-471b-ac4e-7a6ed884c45b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:23.707380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-704c6625-a96c-4f78-96f3-09cc847b17fe req-bd11e881-5b1b-4c22-9919-6549c9c960ab service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:23.707380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-704c6625-a96c-4f78-96f3-09cc847b17fe req-bd11e881-5b1b-4c22-9919-6549c9c960ab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:23.707380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-704c6625-a96c-4f78-96f3-09cc847b17fe req-bd11e881-5b1b-4c22-9919-6549c9c960ab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:23.720518 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-704c6625-a96c-4f78-96f3-09cc847b17fe req-bd11e881-5b1b-4c22-9919-6549c9c960ab service nova] Creating event network-changed:42aa44f3-eff3-471b-ac4e-7a6ed884c45b for instance 2ab23598-1a23-485b-ab9f-bb59994dc62b on n-h2-781139-2 Oct 03 14:36:23.725355 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-704c6625-a96c-4f78-96f3-09cc847b17fe req-bd11e881-5b1b-4c22-9919-6549c9c960ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041590 Oct 03 14:36:23.725992 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 531/1058] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:23.862691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:23.883828 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec81d13f-5cd0-4257-8aac-ed49bf5bc3e1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.327365 Oct 03 14:36:23.885865 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 528/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:23 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:24.020479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:24.021427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:24.033961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:24.038183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:24.040976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:24.041953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:24.042417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:24.042833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:24.418090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:24.427129 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f80a3153-61a1-484e-8d61-bc97e0997729 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.410819 Oct 03 14:36:24.428116 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 532/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:24 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:24.704205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:24.705552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:24.712324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:24.712804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:24.713261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:24.714024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:24.714475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:24.715167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:24.849352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:24.857897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c08d241-fe06-45b1-95b2-4fc461ebdbf4 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.157930 Oct 03 14:36:24.858909 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 529/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:24 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:24.914559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:24.916220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:24.923925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:24.924788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:24.925239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:24.925975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:24.926400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:24.926820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:25.161359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:25.169460 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4078aea-d3d1-4120-b7ff-c63bfae34207 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.260056 Oct 03 14:36:25.181322 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 533/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:24 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:25.450414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:25.451606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:25.458037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:25.458838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:25.459263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:25.460030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:25.460588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:25.461087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:25.609138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d7165c7-9071-4692-848c-e5ab50e2dba3", "device": "/dev/xvdb"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:25.613505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:25.620850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:25.621932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:25.622681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:25.623535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:25.624030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:25.624516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:25.634096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:25.645372 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61bd0ff7-b38e-4f12-9e0f-41721bcb290c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.198640 Oct 03 14:36:25.646505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 530/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:25 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:25.880849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:25.881795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:25.894357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:25.898115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:25.898804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:25.899649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:25.900230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:25.901148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:26.053791 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c3bbb17-0e29-4efa-b859-fe024ad48622 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "POST /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.442261 Oct 03 14:36:26.054490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 534/1064] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 3 14:36:25 2022] POST /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:36:26.099614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:26.110320 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0c8746b-5a37-4c90-84c7-b30d827324bf tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.232710 Oct 03 14:36:26.111354 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 531/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:25 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:26.196098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:26.197535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:26.207294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:26.207790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:26.208732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:26.209357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:26.210227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:26.211166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:26.434842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:26.446400 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db125ae7-0e36-4d8f-9533-670120a84a4b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.255157 Oct 03 14:36:26.447374 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 535/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:26 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:26.668645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:26.669413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:26.682536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:26.683007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:26.683533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:26.684392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:26.684960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:26.685435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:26.701661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:26.837651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:26.847634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e8573d3-0217-4a35-9f46-f868bbe807f2 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.182953 Oct 03 14:36:26.853987 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 532/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:26 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:27.134667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:27.136416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:27.148450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:27.149362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:27.150078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:27.151839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:27.152784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:27.153481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:27.468035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:27.471488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:27.472484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:27.486061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:27.486894 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0ec6410-bc84-49f9-b466-8ee39eb7fd1b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.350898 Oct 03 14:36:27.487463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:27.487992 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 536/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:27 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:27.489335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:27.490502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:27.492293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:27.492742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:27.671583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:27.686845 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fff7994-8e27-4584-96e6-ea5c3d2e971b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.220293 Oct 03 14:36:27.688276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 533/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:27 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:27.878575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:27.879561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:27.887867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:27.888732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:27.889795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:27.890720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:27.891399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:27.892031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:28.193389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:28.201532 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-867f4c52-a28a-4d3f-9707-ac4913df370b tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.327481 Oct 03 14:36:28.202417 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 537/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:27 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:28.510083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:28.511248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:28.515587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:28.517547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:28.530280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:28.531310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:28.531999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:28.533144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:28.534631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:28.535526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:28.706675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=12 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:28.711109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:28.711747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:28.729725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:28.730772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:28.731278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:28.731714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:28.732429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:28.732880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:28.733329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:28.742657 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a91557f0-96fa-4b78-9504-fe605082f207 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.236669 Oct 03 14:36:28.743715 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 534/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:28 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:28.907747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:28.908015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:28.918863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:28.919354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:28.919789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:28.920504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:28.925708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:28.926263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:28.963054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:28.972536 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52c5a41e-401a-4195-b275-73bdc4862b54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.266532 Oct 03 14:36:28.977575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:36:28.982218 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 538/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:28 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:29.117047 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69fbd195-6579-4aa4-b506-b09c67d42099 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 204 len: 0 microversion: 2.1 time: 0.214118 Oct 03 14:36:29.118635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 535/1073] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:28 2022] DELETE /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:29.127543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:29.129024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:29.137448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:29.138280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:29.139517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:29.140639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:29.141541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:29.142464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:29.186802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c4765795-0b4d-4ba2-b01d-3567c6112765 req-1b9df9ce-7e52-4ca4-a65b-571ff7e45f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2297b2b8-6f89-4329-ad4a-acd77f4ec532", "name": "network-vif-plugged", "status": "completed", "tag": "059c2658-c6c6-4300-995c-c0bf355b8be1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:29.204890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c4765795-0b4d-4ba2-b01d-3567c6112765 req-1b9df9ce-7e52-4ca4-a65b-571ff7e45f9f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:29.209490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c4765795-0b4d-4ba2-b01d-3567c6112765 req-1b9df9ce-7e52-4ca4-a65b-571ff7e45f9f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:29.210262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c4765795-0b4d-4ba2-b01d-3567c6112765 req-1b9df9ce-7e52-4ca4-a65b-571ff7e45f9f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:29.232106 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c4765795-0b4d-4ba2-b01d-3567c6112765 req-1b9df9ce-7e52-4ca4-a65b-571ff7e45f9f service nova] Creating event network-vif-plugged:059c2658-c6c6-4300-995c-c0bf355b8be1 for instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 on n-h2-781139-2 Oct 03 14:36:29.237704 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c4765795-0b4d-4ba2-b01d-3567c6112765 req-1b9df9ce-7e52-4ca4-a65b-571ff7e45f9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055133 Oct 03 14:36:29.238683 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 536/1074] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:29.243981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:29.244862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:29.252444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:29.253002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:29.253434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:29.254197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:29.254647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:29.255070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:29.437436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:29.448347 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11217e96-ad06-4124-834c-692160f32881 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.208480 Oct 03 14:36:29.448972 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 537/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:29 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:29.587243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:29.609107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:29.620058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ece9d635-3571-40e2-aed5-3985d9768e20 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1709 microversion: 2.1 time: 0.496137 Oct 03 14:36:29.621266 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 539/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:29 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1709 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:29.766695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:29.767301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:29.775619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:29.789900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:29.790006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:29.790694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:29.791467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:29.792109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:30.008906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:30.009569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:30.024843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:30.038683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:30.040127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:30.045603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:30.046961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:30.047565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:30.059534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:30.069035 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e635ee5e-ebe6-4c94-840e-22f059ac796e tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.306488 Oct 03 14:36:30.071004 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 538/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:29 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:30.226363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:30.235918 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7973f95d-4576-49bd-a20c-d2363298d8b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.233746 Oct 03 14:36:30.249646 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 540/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:30 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:30.380875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1737586780", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "1073fcc1-d3cc-4166-a49d-07b433f3c7e5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:30.461781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] validate_networks() for [('1073fcc1-d3cc-4166-a49d-07b433f3c7e5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:36:30.473282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:30.473892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:30.480637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:30.481037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:30.481469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:30.489175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:30.489175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:30.489175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:30.673514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:30.689957 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-741d618e-c875-4ff2-b7c9-14527aee5517 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.221300 Oct 03 14:36:30.706947 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 541/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:30 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:30.715805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:30.716735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:30.725500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:30.726326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:30.727006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:30.728010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:30.728668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:30.729320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:30.974007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:30.987568 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6024966a-72f6-4cbd-b712-d16a9510b179 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1709 microversion: 2.1 time: 0.286583 Oct 03 14:36:30.988179 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 542/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:30 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1709 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:31.015110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:36:31.017235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:36:31.017946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:36:31.018547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:36:31.018982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:36:31.029481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.030056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.030555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:31.031364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.031878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.032363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:31.051958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:36:31.057799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for user e62b7df215b144de94e02cd1e01f6f21 and project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:36:31.075192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:36:31.077744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:36:31.091886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:31.092791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:31.099860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.100337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.100768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:31.101491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.102007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.102426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:31.133005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-364e7a36-d88b-454f-b191-081c969db0a3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879174 Oct 03 14:36:31.134006 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 539/1081] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:36:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:36:31.149297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a7a9480-ab91-4e65-bc57-f289ef3f5a61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:31.151262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a7a9480-ab91-4e65-bc57-f289ef3f5a61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:31.229152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a7a9480-ab91-4e65-bc57-f289ef3f5a61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:31.236851 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a7a9480-ab91-4e65-bc57-f289ef3f5a61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1208 microversion: 2.1 time: 0.095323 Oct 03 14:36:31.238166 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 540/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:31 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1208 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:31.286216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:31.287888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:31.320994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.321539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.327103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:31.327103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.327469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.328021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:31.392315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:31.635755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:31.658892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:31.659425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-689b8878-fdba-47cc-94d5-b35f003b2f9b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1325 microversion: 2.1 time: 0.570686 Oct 03 14:36:31.660262 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 543/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:31 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1325 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:31.668951 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1db50ce-e835-4b19-9852-fb8457a0125f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1477 microversion: 2.1 time: 0.409157 Oct 03 14:36:31.669653 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 541/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:31 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1477 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:31.716751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:31.724484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:31.739404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.743607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.744214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:31.749114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:31.749733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:31.750246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.012768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:32.023657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:32.050665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.052499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.053916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.055252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.056276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.056740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.279602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:32.309113 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35a766f2-7480-434d-b35b-15126d20a331 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1709 microversion: 2.1 time: 0.300934 Oct 03 14:36:32.318362 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 542/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:32 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1709 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:32.339087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:32.339967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:32.348616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.351327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.352087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.353066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.356488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.357246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.503811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:32.539525 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0702bc7-6733-4717-9a56-f5f1c403aa52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1204 microversion: 2.1 time: 0.212901 Oct 03 14:36:32.540710 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 543/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:32 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1204 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:32.709395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:32.710292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:32.713008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:32.719924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.720803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.721576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.722518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.723169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.723817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.877800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:32.887298 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a79e7cfc-06f1-4fdc-bf92-78ff5c4a27e8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 1.174222 Oct 03 14:36:32.907131 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 544/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:31 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:32.918399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:32.919294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:32.930492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.933665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.934264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:32.938106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:32.938551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:32.939016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.007189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:33.015726 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f607b20-1a62-45d8-8354-e2c037176b79 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1523 microversion: 2.1 time: 0.315758 Oct 03 14:36:33.016763 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 544/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:32 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:33.022153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b8df4e27-df35-4521-975d-ca0bddfcdafd req-fca7721e-a949-4717-858b-c09d01df2cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab23598-1a23-485b-ab9f-bb59994dc62b", "name": "network-vif-plugged", "status": "completed", "tag": "42aa44f3-eff3-471b-ac4e-7a6ed884c45b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:33.050078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b8df4e27-df35-4521-975d-ca0bddfcdafd req-fca7721e-a949-4717-858b-c09d01df2cd6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.051220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b8df4e27-df35-4521-975d-ca0bddfcdafd req-fca7721e-a949-4717-858b-c09d01df2cd6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.051646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b8df4e27-df35-4521-975d-ca0bddfcdafd req-fca7721e-a949-4717-858b-c09d01df2cd6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.063984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b8df4e27-df35-4521-975d-ca0bddfcdafd req-fca7721e-a949-4717-858b-c09d01df2cd6 service nova] Creating event network-vif-plugged:42aa44f3-eff3-471b-ac4e-7a6ed884c45b for instance 2ab23598-1a23-485b-ab9f-bb59994dc62b on n-h2-781139-2 Oct 03 14:36:33.069126 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b8df4e27-df35-4521-975d-ca0bddfcdafd req-fca7721e-a949-4717-858b-c09d01df2cd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050421 Oct 03 14:36:33.069739 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 545/1089] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:33.075276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:33.075867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:33.083077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.083789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.084419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.085429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.086075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.086683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.117129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:36:33.222101 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c536f3d-c927-4f3c-b1a0-e8108accb367 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 204 len: 0 microversion: 2.1 time: 0.150432 Oct 03 14:36:33.222726 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 546/1090] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:33 2022] DELETE /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:33.238337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:33.239622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:33.246706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.247592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.248316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.249448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.250068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.250497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.417081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:33.453168 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be843556-6547-49f1-9e9f-cf11848dc851 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1476 microversion: 2.1 time: 0.542740 Oct 03 14:36:33.455420 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 545/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:32 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1476 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:33.471009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:33.480633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:33.481838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:33.485849 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bb82f71-abb7-490b-b0b8-6b46632c98f5 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1529 microversion: 2.1 time: 0.253277 Oct 03 14:36:33.489622 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 547/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:33 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1529 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:33.502236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.503208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.507440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.509372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.513149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.513725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.566316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:33.567028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:33.579458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.581334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.581794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.582524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.582980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.583514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.662412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:33.679854 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2875bdd3-e763-4a37-bd3d-25faa9db367f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1641 microversion: 2.1 time: 0.222916 Oct 03 14:36:33.681393 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 546/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:33 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1641 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:33.728274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:33.733163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d29bb888-31d1-4ddc-a91a-4ac47f220cdf req-9726bf59-906f-4c7a-ba91-99f1bcf7966d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3391fb69-afb2-4b6d-9e80-ff790a5efe1c", "name": "network-vif-unplugged", "status": "completed", "tag": "26c09168-e710-43fc-95bb-48db3c675f1f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:33.735133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:33.776718 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a6400b8-f354-4b94-85cd-1216a1d67d8a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1278 microversion: 2.1 time: 0.214960 Oct 03 14:36:33.777375 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 548/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:33 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:33.786962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d29bb888-31d1-4ddc-a91a-4ac47f220cdf req-9726bf59-906f-4c7a-ba91-99f1bcf7966d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.787439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d29bb888-31d1-4ddc-a91a-4ac47f220cdf req-9726bf59-906f-4c7a-ba91-99f1bcf7966d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.787866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d29bb888-31d1-4ddc-a91a-4ac47f220cdf req-9726bf59-906f-4c7a-ba91-99f1bcf7966d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.841228 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d29bb888-31d1-4ddc-a91a-4ac47f220cdf req-9726bf59-906f-4c7a-ba91-99f1bcf7966d service nova] Creating event network-vif-unplugged:26c09168-e710-43fc-95bb-48db3c675f1f for instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c on n-h1-781139-2 Oct 03 14:36:33.862403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-d29bb888-31d1-4ddc-a91a-4ac47f220cdf req-9726bf59-906f-4c7a-ba91-99f1bcf7966d service nova] Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:36:33.901851 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d29bb888-31d1-4ddc-a91a-4ac47f220cdf req-9726bf59-906f-4c7a-ba91-99f1bcf7966d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179088 Oct 03 14:36:33.908044 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 547/1095] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:33.917655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:33.918325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:33.930542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.931405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.933337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:33.933666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:33.934129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:33.934557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.282241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:34.296217 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2504d589-8631-4d49-93be-5dc2f32c7a6e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.385660 Oct 03 14:36:34.299910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 549/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:33 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:34.477852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:34.478549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:34.513121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:34.513648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:34.533044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.535251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.535577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.537493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.549993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.553958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.557254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.558688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.559422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.561912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.562323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.563480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.809453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:34.820985 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d76ea25-b77b-46c9-81d2-37c1bffde2dd tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1529 microversion: 2.1 time: 0.312295 Oct 03 14:36:34.822240 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 550/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:34 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1529 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:34.827504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:34.828421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:34.835949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.836993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.837666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.838647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.839299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.840014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.879558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:34.892653 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83e193ee-5105-4216-a8f7-cab1e0fd3580 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1476 microversion: 2.1 time: 0.418872 Oct 03 14:36:34.923525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 548/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:34 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:34.924478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.924989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.925436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.929002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:34.933334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lazy-loading 'fault' on Instance uuid cc34547e-726a-48d7-a87e-ac934587ff08 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:34.937304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:34.951720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.957879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.958495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:34.959591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:34.960349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:34.960949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:35.011906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01fed2159b9c4c97aef7978920b4c959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de6554f52fa546d5b7396f907f2f3e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:35.022608 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23517c37-8304-4769-bfff-9ae4becf024d tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 200 len: 1351 microversion: 2.1 time: 0.199020 Oct 03 14:36:35.029708 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 551/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:34 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 1351 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:35.323973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:35.324579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:35.338795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:35.340725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:35.341737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:35.344133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:35.358084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:35.363341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:35.448303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:35.456903 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c894405-a423-419d-a29b-aeffa7f2518e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.531686 Oct 03 14:36:35.458282 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 549/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:34 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:35.854281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:35.855201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:35.863087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:35.863761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:35.864222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:35.865035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:35.865490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:35.865909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.027776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:36.046080 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-18633dc8-f9cf-486d-aea9-d3a481effa05 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1529 microversion: 2.1 time: 0.194068 Oct 03 14:36:36.058411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 550/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:35 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1529 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:36.063329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:36.063940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:36.094315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.094806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.101777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.102531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.102992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.103573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.176711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:36.185984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01d6291d-3ba8-48f7-94ce-1ec3dfd5a475 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1368 microversion: 2.1 time: 0.866698 Oct 03 14:36:36.193939 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 552/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:35 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1368 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:36.206427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc34547e-726a-48d7-a87e-ac934587ff08", "name": "network-vif-deleted", "tag": "e5b2dd85-e850-4a4d-9462-b0db8c7f6164"}, {"name": "network-changed", "server_uuid": "3391fb69-afb2-4b6d-9e80-ff790a5efe1c", "tag": "26c09168-e710-43fc-95bb-48db3c675f1f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:36.247110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.247470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.247948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.293360 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] Creating event network-vif-deleted:e5b2dd85-e850-4a4d-9462-b0db8c7f6164 for instance cc34547e-726a-48d7-a87e-ac934587ff08 on n-h1-781139-2 Oct 03 14:36:36.293881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] Creating event network-changed:26c09168-e710-43fc-95bb-48db3c675f1f for instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c on n-h1-781139-2 Oct 03 14:36:36.311583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:36:36.346264 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-588cd227-ae20-4189-a16d-40f63e211466 req-058ca8ff-a5ff-411b-8965-98790649f969 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.150763 Oct 03 14:36:36.347162 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 553/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:36.353257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:36.353977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:36.361071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.361839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.362475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.363540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.364151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.364734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.383013 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] HTTP exception thrown: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Request method failure captured: Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 HTTP/1.1 Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKanDx-TYG91oL04kBrY7CFV1hzeqz6EnO20L_ttzq1zsttP7nqCeTD7fQ0k9-YjlwYqWkK86QeuTpjvuJAuUdhSZYIIc_KZaR9dvTvs7-zx_AwWrTKW9spRtP3SzxRawCoUyy7WILLsqrtLeVEW8tJgZJsAn4ngrE4kl8WKXfJ9XY Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:36.385330 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6554f52fa546d5b7396f907f2f3e81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 01fed2159b9c4c97aef7978920b4c959 Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:36.386919 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'cc34547e-726a-48d7-a87e-ac934587ff08'} Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:36.387836 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:36.389691 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.390996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Returning 404 to user: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:36.393728 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65f9cd17-844c-481c-ae86-de1204d4b638 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 404 len: 111 microversion: 2.1 time: 0.045276 Oct 03 14:36:36.395324 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 554/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:36 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:36.405605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:36.406367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:36.417007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.422188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.422926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.423790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.425170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.425629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.457564 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] HTTP exception thrown: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Request method failure captured: Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f HTTP/1.1 Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKanDx-TYG91oL04kBrY7CFV1hzeqz6EnO20L_ttzq1zsttP7nqCeTD7fQ0k9-YjlwYqWkK86QeuTpjvuJAuUdhSZYIIc_KZaR9dvTvs7-zx_AwWrTKW9spRtP3SzxRawCoUyy7WILLsqrtLeVEW8tJgZJsAn4ngrE4kl8WKXfJ9XY Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:36.459733 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6554f52fa546d5b7396f907f2f3e81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 01fed2159b9c4c97aef7978920b4c959 Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.461326 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '512b8784-a0b5-45a8-95d9-85d2faaf4e5f'} Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:36.462190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.463784 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.465975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Returning 404 to user: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:36.467198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e70f11c8-3d02-40b1-8f64-bd5a17b352d8 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 404 len: 111 microversion: 2.1 time: 0.066018 Oct 03 14:36:36.471744 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 555/1105] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:36 2022] DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:36.479605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:36.480732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:36.488106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.488887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.489585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.490468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.491080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.491820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.495286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:36.509787 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a83648b3-a1db-483c-9236-327395e9a837 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1474 microversion: 2.1 time: 0.448411 Oct 03 14:36:36.512128 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 551/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:36 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:36.516186 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] HTTP exception thrown: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Request method failure captured: Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f HTTP/1.1 Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKanDx-TYG91oL04kBrY7CFV1hzeqz6EnO20L_ttzq1zsttP7nqCeTD7fQ0k9-YjlwYqWkK86QeuTpjvuJAuUdhSZYIIc_KZaR9dvTvs7-zx_AwWrTKW9spRtP3SzxRawCoUyy7WILLsqrtLeVEW8tJgZJsAn4ngrE4kl8WKXfJ9XY Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:36.518494 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6554f52fa546d5b7396f907f2f3e81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 01fed2159b9c4c97aef7978920b4c959 Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.519803 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '512b8784-a0b5-45a8-95d9-85d2faaf4e5f'} Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:36.520518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:36.521746 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:36.524986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Returning 404 to user: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:36.526090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2bd689d-7913-4a98-a829-011e5cc6c88f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 404 len: 111 microversion: 2.1 time: 0.050705 Oct 03 14:36:36.526877 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 556/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:36 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:36.530760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:36.533624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:36.536371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d503a0cd-a1e5-419a-b91a-22c0f59f20e0 req-5d8c0def-d147-4df7-9b44-dd3921e8d87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2297b2b8-6f89-4329-ad4a-acd77f4ec532", "name": "network-vif-deleted", "tag": "059c2658-c6c6-4300-995c-c0bf355b8be1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:36.555081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d503a0cd-a1e5-419a-b91a-22c0f59f20e0 req-5d8c0def-d147-4df7-9b44-dd3921e8d87e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.555999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d503a0cd-a1e5-419a-b91a-22c0f59f20e0 req-5d8c0def-d147-4df7-9b44-dd3921e8d87e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.556708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d503a0cd-a1e5-419a-b91a-22c0f59f20e0 req-5d8c0def-d147-4df7-9b44-dd3921e8d87e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.575896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.581113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.581750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.582530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:36.585740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:36.586195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:36.596119 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d503a0cd-a1e5-419a-b91a-22c0f59f20e0 req-5d8c0def-d147-4df7-9b44-dd3921e8d87e service nova] Creating event network-vif-deleted:059c2658-c6c6-4300-995c-c0bf355b8be1 for instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 on n-h2-781139-2 Oct 03 14:36:36.609338 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d503a0cd-a1e5-419a-b91a-22c0f59f20e0 req-5d8c0def-d147-4df7-9b44-dd3921e8d87e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078212 Oct 03 14:36:36.610710 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 557/1108] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:36.621297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14c61dc9-ff29-41f5-8193-2501fadbf449 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '.version_select at 0x7fb2309d5160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:36.683413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14c61dc9-ff29-41f5-8193-2501fadbf449 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-3290191" status: 202 len: 0 microversion: 2.1 time: 0.070386 Oct 03 14:36:36.686836 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 558/1109] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 3 14:36:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-3290191 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:36:36.863879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:36.876394 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3131c359-2971-446f-bc92-cde1e9720123 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.360111 Oct 03 14:36:36.877107 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 552/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:36 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:37.070824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:37.071568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:37.078106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.078611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.079050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.079830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.080360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.080790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.153693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.155631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.155631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.155631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lazy-loading 'fault' on Instance uuid 2297b2b8-6f89-4329-ad4a-acd77f4ec532 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:37.224056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:37.224721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:37.245145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77fb2abf524d4d8caeb1ec89d5db0d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a762d2f19e454d74a937f6237b3f287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:37.253494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.254658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.254798 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-393a3f45-1aa6-4f95-b53f-85b9213b2f57 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 200 len: 1315 microversion: 2.1 time: 0.187781 Oct 03 14:36:37.264962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 559/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:37 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:37.266341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.282222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.284038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.285584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.538950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:37.539538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:37.546430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.546943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.547355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.548094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.548571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.549091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.630135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:37.641410 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b8278c6b-3728-4d9b-a685-82601c6cb529 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1559 microversion: 2.1 time: 0.422826 Oct 03 14:36:37.643044 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 553/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:37 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1559 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:37.666587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:37.667175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:37.673905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.674118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.674641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.675390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.676115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.676603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.738665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:37.749655 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c31b5877-542b-4c55-9366-d7edccc96fe9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1474 microversion: 2.1 time: 0.214665 Oct 03 14:36:37.750244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 560/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:37 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1474 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:37.784773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5195f402-97e9-4550-a658-e5761f475d9a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122723 Oct 03 14:36:37.785483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 554/1114] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:36:37 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:37.901567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:37.902072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:37.908684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.909244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.909682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:37.910402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:37.910846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:37.911262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.158995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:38.169919 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a81041cf-9b3b-4a5a-8ce5-c38851fdf2cd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.271826 Oct 03 14:36:38.170931 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 561/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:37 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:38.291323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.295247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 2297b2b8-6f89-4329-ad4a-acd77f4ec532] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.311073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fea6d0d-0e75-458d-945b-90e8dac93bc4 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.323019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.323519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.326167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.330768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.331285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.331720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.360429 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fea6d0d-0e75-458d-945b-90e8dac93bc4 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/219638355" status: 202 len: 0 microversion: 2.1 time: 0.054010 Oct 03 14:36:38.361968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 562/1116] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:36:38 2022] DELETE /compute/v2.1/flavors/219638355 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:36:38.367294 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 could not be found. Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 HTTP/1.1 Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:38.369000 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 could not be found. Oct 03 14:36:38.370641 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '2297b2b8-6f89-4329-ad4a-acd77f4ec532'} Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 could not be found. Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.371565 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 could not be found. Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 could not be found. Oct 03 14:36:38.373269 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.374763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Instance 2297b2b8-6f89-4329-ad4a-acd77f4ec532 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.374763 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6e4d38e9-b7b7-49c8-94cb-954fd31d319b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532" status: 404 len: 111 microversion: 2.1 time: 0.090940 Oct 03 14:36:38.374763 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 555/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:38 2022] GET /compute/v2.1/servers/2297b2b8-6f89-4329-ad4a-acd77f4ec532 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:38.377316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68b70948-c87a-46f6-a251-1ba6496498c0 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.379532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fa1b45b-0904-4ed5-a22e-f4d3b00c130b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '.version_select at 0x7fb230a8dd30>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.403314 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9fa1b45b-0904-4ed5-a22e-f4d3b00c130b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Image not found. Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fa1b45b-0904-4ed5-a22e-f4d3b00c130b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863 HTTP/1.1 Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:38.405418 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: exception: Image not found. Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'aef1519c-0057-4740-8951-bab9b61e8863'} Oct 03 14:36:38.407001 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aef1519c-0057-4740-8951-bab9b61e8863 to delete Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.408132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aef1519c-0057-4740-8951-bab9b61e8863 could not be found. Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.409517 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:36:38.411138 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.414822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fa1b45b-0904-4ed5-a22e-f4d3b00c130b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Image not found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.414927 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68b70948-c87a-46f6-a251-1ba6496498c0 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.046999 Oct 03 14:36:38.415034 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9fa1b45b-0904-4ed5-a22e-f4d3b00c130b tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863" status: 404 len: 62 microversion: 2.1 time: 0.038897 Oct 03 14:36:38.415144 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 563/1118] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:36:38 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:38.418762 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 556/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:38 2022] DELETE /compute/v2.1/images/aef1519c-0057-4740-8951-bab9b61e8863 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:36:38.427180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.427722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.434819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.435519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.435693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25aaeb27-75fe-4bff-aaf6-0558a75c9fae tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.436137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.436998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.437546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.438066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.452681 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 HTTP/1.1 Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:38.454422 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.456027 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '70288b68-bdda-44ce-b9e0-b67137888f94'} Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.456949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.458343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.459744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.459744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ca62fe3-1f0e-40f4-a741-97372a9c67f0 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 404 len: 111 microversion: 2.1 time: 0.033280 Oct 03 14:36:38.459744 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 564/1120] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:38 2022] DELETE /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:38.464646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.465316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 70288b68-bdda-44ce-b9e0-b67137888f94] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.471040 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25aaeb27-75fe-4bff-aaf6-0558a75c9fae tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1107244729" status: 202 len: 0 microversion: 2.1 time: 0.040658 Oct 03 14:36:38.472983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.473126 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 557/1121] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:36:38 2022] DELETE /compute/v2.1/flavors/1107244729 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:36:38.473239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.473239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.473736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.474335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.474986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.480734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-707deffa-88cb-497b-956f-ba601e613259 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.490313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 HTTP/1.1 Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:38.491991 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.493397 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '70288b68-bdda-44ce-b9e0-b67137888f94'} Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.494120 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. Oct 03 14:36:38.495952 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.497829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Instance 70288b68-bdda-44ce-b9e0-b67137888f94 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.497829 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d25c876c-430b-4d6d-8ba7-80927c9c751d tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94" status: 404 len: 111 microversion: 2.1 time: 0.032963 Oct 03 14:36:38.497829 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 565/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:38 2022] GET /compute/v2.1/servers/70288b68-bdda-44ce-b9e0-b67137888f94 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:38.502543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-237c6e41-aacd-475d-ab5c-b027740c3bca tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '.version_select at 0x7fb23096fe50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.505179 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-707deffa-88cb-497b-956f-ba601e613259 tempest-ServersWithSpecificFlavorTestJSON-298661497 tempest-ServersWithSpecificFlavorTestJSON-298661497-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028852 Oct 03 14:36:38.509075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 558/1123] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:36:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:38.522983 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-237c6e41-aacd-475d-ab5c-b027740c3bca tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155393463" status: 202 len: 0 microversion: 2.1 time: 0.024167 Oct 03 14:36:38.523807 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 566/1124] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155393463 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:36:38.531870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.532386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.540323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.540817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.541367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.542068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.542518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.542936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.558404 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] HTTP exception thrown: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Request method failure captured: Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 HTTP/1.1 Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKanDx-TYG91oL04kBrY7CFV1hzeqz6EnO20L_ttzq1zsttP7nqCeTD7fQ0k9-YjlwYqWkK86QeuTpjvuJAuUdhSZYIIc_KZaR9dvTvs7-zx_AwWrTKW9spRtP3SzxRawCoUyy7WILLsqrtLeVEW8tJgZJsAn4ngrE4kl8WKXfJ9XY Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:38.559963 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6554f52fa546d5b7396f907f2f3e81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 01fed2159b9c4c97aef7978920b4c959 Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.561549 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'cc34547e-726a-48d7-a87e-ac934587ff08'} Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.562404 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.563780 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.566822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Returning 404 to user: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.567693 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd887fe3-d25b-48c0-bcf8-e43b385966e3 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 404 len: 111 microversion: 2.1 time: 0.040355 Oct 03 14:36:38.568268 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 559/1125] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:38 2022] DELETE /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:38.577323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.578618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: cc34547e-726a-48d7-a87e-ac934587ff08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.586388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.587162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.587599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.588305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.588757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.589219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.604477 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] HTTP exception thrown: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Request method failure captured: Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 HTTP/1.1 Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKanDx-TYG91oL04kBrY7CFV1hzeqz6EnO20L_ttzq1zsttP7nqCeTD7fQ0k9-YjlwYqWkK86QeuTpjvuJAuUdhSZYIIc_KZaR9dvTvs7-zx_AwWrTKW9spRtP3SzxRawCoUyy7WILLsqrtLeVEW8tJgZJsAn4ngrE4kl8WKXfJ9XY Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:38.606066 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6554f52fa546d5b7396f907f2f3e81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 01fed2159b9c4c97aef7978920b4c959 Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.607405 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'cc34547e-726a-48d7-a87e-ac934587ff08'} Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.608158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. Oct 03 14:36:38.609401 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.610462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Returning 404 to user: Instance cc34547e-726a-48d7-a87e-ac934587ff08 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.610462 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5f9d8ac-57ee-4ae4-afa9-b42348252a6f tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08" status: 404 len: 111 microversion: 2.1 time: 0.035061 Oct 03 14:36:38.610462 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 567/1126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:38 2022] GET /compute/v2.1/servers/cc34547e-726a-48d7-a87e-ac934587ff08 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:38.617667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.618164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.624036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.624518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.624965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.625658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.626216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.626837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.630528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-23fae5e8-2261-4110-9368-120377954151 req-dbdc1b3c-d185-4ab6-a642-478d90a0bf82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906e2b64-19c2-4e64-b53b-037cbbf0f202", "tag": "db205e77-fa49-4cdb-ad12-92c89e857fd7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:38.641211 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] HTTP exception thrown: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Request method failure captured: Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f HTTP/1.1 Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKanDx-TYG91oL04kBrY7CFV1hzeqz6EnO20L_ttzq1zsttP7nqCeTD7fQ0k9-YjlwYqWkK86QeuTpjvuJAuUdhSZYIIc_KZaR9dvTvs7-zx_AwWrTKW9spRtP3SzxRawCoUyy7WILLsqrtLeVEW8tJgZJsAn4ngrE4kl8WKXfJ9XY Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:38.642997 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6554f52fa546d5b7396f907f2f3e81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 01fed2159b9c4c97aef7978920b4c959 Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.644307 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '512b8784-a0b5-45a8-95d9-85d2faaf4e5f'} Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.645077 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.646316 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.647592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-23fae5e8-2261-4110-9368-120377954151 req-dbdc1b3c-d185-4ab6-a642-478d90a0bf82 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.647688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Returning 404 to user: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.647779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-23fae5e8-2261-4110-9368-120377954151 req-dbdc1b3c-d185-4ab6-a642-478d90a0bf82 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.647864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e66d7756-7182-430b-ab7b-811f4a8b7966 tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 404 len: 111 microversion: 2.1 time: 0.030961 Oct 03 14:36:38.647947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-23fae5e8-2261-4110-9368-120377954151 req-dbdc1b3c-d185-4ab6-a642-478d90a0bf82 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.648035 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 560/1127] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:38 2022] DELETE /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:38.653550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.654382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] [instance: 512b8784-a0b5-45a8-95d9-85d2faaf4e5f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.657445 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-23fae5e8-2261-4110-9368-120377954151 req-dbdc1b3c-d185-4ab6-a642-478d90a0bf82 service nova] Creating event network-changed:db205e77-fa49-4cdb-ad12-92c89e857fd7 for instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 on n-h1-781139-2 Oct 03 14:36:38.661251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.661739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.662181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.663228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.663762 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-23fae5e8-2261-4110-9368-120377954151 req-dbdc1b3c-d185-4ab6-a642-478d90a0bf82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037906 Oct 03 14:36:38.664012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.664586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.668206 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 568/1128] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:38.680915 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] HTTP exception thrown: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Request method failure captured: Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f HTTP/1.1 Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKanDx-TYG91oL04kBrY7CFV1hzeqz6EnO20L_ttzq1zsttP7nqCeTD7fQ0k9-YjlwYqWkK86QeuTpjvuJAuUdhSZYIIc_KZaR9dvTvs7-zx_AwWrTKW9spRtP3SzxRawCoUyy7WILLsqrtLeVEW8tJgZJsAn4ngrE4kl8WKXfJ9XY Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:38.682590 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de6554f52fa546d5b7396f907f2f3e81", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de6554f52fa546d5b7396f907f2f3e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: de6554f52fa546d5b7396f907f2f3e81 Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598 Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 01fed2159b9c4c97aef7978920b4c959 Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1575224598-project Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.684233 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '512b8784-a0b5-45a8-95d9-85d2faaf4e5f'} Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:38.685130 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. Oct 03 14:36:38.686435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:38.687542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] Returning 404 to user: Instance 512b8784-a0b5-45a8-95d9-85d2faaf4e5f could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:38.687542 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54ea12a6-2682-421b-ae96-7061d424c49e tempest-ServersWithSpecificFlavorTestJSON-1575224598 tempest-ServersWithSpecificFlavorTestJSON-1575224598-project] 10.222.0.20 "GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f" status: 404 len: 111 microversion: 2.1 time: 0.035096 Oct 03 14:36:38.687542 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 561/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:38 2022] GET /compute/v2.1/servers/512b8784-a0b5-45a8-95d9-85d2faaf4e5f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:36:38.776046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:38.777259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:38.786623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.787859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.788522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:38.789522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:38.790168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:38.790781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:39.195756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:39.196374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:39.217974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:39.218466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:39.222820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:39.224252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:39.224735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:39.225215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:39.232756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:39.249713 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae85c2e9-e3af-41d4-b4fb-5485a5f53ad9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1474 microversion: 2.1 time: 0.479623 Oct 03 14:36:39.250307 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 569/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:38 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1474 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:39.500279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:39.504306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:39.512554 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f47a425-d994-431d-aee1-7bef43e3c869 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.321489 Oct 03 14:36:39.513534 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 562/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:39 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:39.539781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f610bb9a-24fb-472c-9687-0790c506e160 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '.version_select at 0x7fb23096f9d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:39.568158 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f610bb9a-24fb-472c-9687-0790c506e160 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Image not found. Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f610bb9a-24fb-472c-9687-0790c506e160 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/4a9a23e0-ddfb-4274-9ce3-852298973db4 HTTP/1.1 Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:39.575890 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '4a9a23e0-ddfb-4274-9ce3-852298973db4'} Oct 03 14:36:39.578156 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4a9a23e0-ddfb-4274-9ce3-852298973db4 to delete Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:39.583076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a9a23e0-ddfb-4274-9ce3-852298973db4 could not be found. Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:39.584700 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f610bb9a-24fb-472c-9687-0790c506e160 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:39.586417 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f610bb9a-24fb-472c-9687-0790c506e160 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/images/4a9a23e0-ddfb-4274-9ce3-852298973db4" status: 404 len: 62 microversion: 2.1 time: 0.042164 Oct 03 14:36:39.587599 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 570/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:39 2022] DELETE /compute/v2.1/images/4a9a23e0-ddfb-4274-9ce3-852298973db4 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:36:39.587689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:39.588781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:39.604037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:39.604584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:39.605139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:39.610315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:39.612838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:39.615795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:39.636825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 HTTP/1.1 Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:39.638433 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.640268 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3609b6d4-95a0-4e25-9f44-f82ca930b4b5'} Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:39.641058 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.642337 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.643733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:39.643733 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d65cce99-b03f-47df-92e4-2c759672285a tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 404 len: 111 microversion: 2.1 time: 0.057410 Oct 03 14:36:39.650150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:39.651089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] [instance: 3609b6d4-95a0-4e25-9f44-f82ca930b4b5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:39.655203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 563/1133] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:39 2022] DELETE /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:39.660201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:39.660689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:39.661380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:39.662359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:39.662960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:39.663656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:39.678468 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] HTTP exception thrown: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Request method failure captured: Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 HTTP/1.1 Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMNsAXVcnisqIoKjb9OUEBDyr5-2PSa7_BUuLvqh6VeZkMU7t_l5jzxHWER8pt2qeaTARGealqhMt5EiMeVt6s7qZFEx6Y2GGGRZGC4nnBiYiSIcZjOKufRQaWmzMsDRNXwN9BW4F-O0PJTNx6BArb4-CkZB6nSoTA7_Oo0ejmEJ_4 Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:39.680493 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a762d2f19e454d74a937f6237b3f287a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a762d2f19e454d74a937f6237b3f287a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a762d2f19e454d74a937f6237b3f287a Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-393267342 Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 77fb2abf524d4d8caeb1ec89d5db0d73 Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-393267342-project Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.682233 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3609b6d4-95a0-4e25-9f44-f82ca930b4b5'} Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:39.683061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. Oct 03 14:36:39.684398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:39.686501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] Returning 404 to user: Instance 3609b6d4-95a0-4e25-9f44-f82ca930b4b5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:39.687609 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5801f71-a1db-4b6c-aeb9-d4e686a2ce82 tempest-ImagesOneServerNegativeTestJSON-393267342 tempest-ImagesOneServerNegativeTestJSON-393267342-project] 10.222.0.20 "GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5" status: 404 len: 111 microversion: 2.1 time: 0.042548 Oct 03 14:36:39.692133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 571/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:39 2022] GET /compute/v2.1/servers/3609b6d4-95a0-4e25-9f44-f82ca930b4b5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:40.278823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:40.279709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:40.288467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.289327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.290093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.290945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.291538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.292748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.471734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:40.484323 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83d114a3-13ce-4308-9d14-6ad3546f6fcd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1471 microversion: 2.1 time: 0.212025 Oct 03 14:36:40.488498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 564/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:40 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:40.530001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:40.531165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:40.540798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:40.542478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:40.556567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.557106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.557546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.561843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.563321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.563803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.564273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.564716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.565734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.567373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.568043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.570383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.653880 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5de51024-8fdb-4f3d-a0ac-60fc5b33d90b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c/action" status: 204 len: 0 microversion: 2.1 time: 0.130154 Oct 03 14:36:40.654544 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 572/1136] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:36:40 2022] POST /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c/action => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:40.664371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:40.665115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:40.672439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.673191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.673842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.674890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.675560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.676209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.768602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:40.778708 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61dd5cd6-588c-4d57-92ae-6fe11b4c6752 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.242198 Oct 03 14:36:40.780307 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 565/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:40 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:40.790178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:40.791706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:40.799740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.800426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.800971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.801704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:40.802208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:40.802866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:40.965950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid c3ef74ed-5f46-4ff0-af09-071498ff108a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:40.989313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e09112a4-e357-485b-ae7e-146d4ae9dd05 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 2418 microversion: 2.25 time: 0.333455 Oct 03 14:36:40.992024 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 573/1138] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:40 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 2418 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:40.999363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7b867c4d-8e66-498c-8c67-bdb621c241dd req-7de49e0b-8145-49e1-ab51-9591e3072293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab23598-1a23-485b-ab9f-bb59994dc62b", "tag": "42aa44f3-eff3-471b-ac4e-7a6ed884c45b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:41.010281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7b867c4d-8e66-498c-8c67-bdb621c241dd req-7de49e0b-8145-49e1-ab51-9591e3072293 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:41.011117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7b867c4d-8e66-498c-8c67-bdb621c241dd req-7de49e0b-8145-49e1-ab51-9591e3072293 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:41.011766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7b867c4d-8e66-498c-8c67-bdb621c241dd req-7de49e0b-8145-49e1-ab51-9591e3072293 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:41.034185 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7b867c4d-8e66-498c-8c67-bdb621c241dd req-7de49e0b-8145-49e1-ab51-9591e3072293 service nova] Creating event network-changed:42aa44f3-eff3-471b-ac4e-7a6ed884c45b for instance 2ab23598-1a23-485b-ab9f-bb59994dc62b on n-h2-781139-2 Oct 03 14:36:41.039839 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7b867c4d-8e66-498c-8c67-bdb621c241dd req-7de49e0b-8145-49e1-ab51-9591e3072293 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046435 Oct 03 14:36:41.041052 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 574/1139] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:41.050051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-781139-2", "block_migration": "auto"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:41.053176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:41.063211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:41.065856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:41.066756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:41.067381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:41.068363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:41.069038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:41.069856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:41.070151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:41.080617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9bd3cf66-86d2-4442-9912-024fcbf21438 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1471 microversion: 2.1 time: 0.298141 Oct 03 14:36:41.081836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:41.085216 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 566/1140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:40 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:41.110053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'flavor' on Instance uuid c3ef74ed-5f46-4ff0-af09-071498ff108a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:41.127089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Going to try to live migrate instance to n-h1-781139-2 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:36:41.233023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:41.807879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:41.808869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:41.817137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:41.817580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:41.818294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:41.819524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:41.820390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:41.821120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:41.983512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:41.998401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59c8cfac-19c2-419b-af77-dbbaa07f022a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.195616 Oct 03 14:36:41.999501 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 567/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:41 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:42.110047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:42.110808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:42.125816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:42.126454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:42.127227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:42.128356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:42.129101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:42.129653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:42.267744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:42.275864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42064458-f8a9-4374-b3ec-39060b4b3e47 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1471 microversion: 2.1 time: 0.169847 Oct 03 14:36:42.276562 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 568/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:42 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:42.730101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-05273829-3581-4347-8968-e0e76ecd7ddc req-2d1ef089-ac12-4786-9acd-d4aa1ab6a507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3391fb69-afb2-4b6d-9e80-ff790a5efe1c", "name": "network-vif-plugged", "status": "completed", "tag": "26c09168-e710-43fc-95bb-48db3c675f1f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:42.746965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-05273829-3581-4347-8968-e0e76ecd7ddc req-2d1ef089-ac12-4786-9acd-d4aa1ab6a507 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:42.747439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-05273829-3581-4347-8968-e0e76ecd7ddc req-2d1ef089-ac12-4786-9acd-d4aa1ab6a507 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:42.748078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-05273829-3581-4347-8968-e0e76ecd7ddc req-2d1ef089-ac12-4786-9acd-d4aa1ab6a507 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:42.760605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-05273829-3581-4347-8968-e0e76ecd7ddc req-2d1ef089-ac12-4786-9acd-d4aa1ab6a507 service nova] Creating event network-vif-plugged:26c09168-e710-43fc-95bb-48db3c675f1f for instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c on n-h1-781139-2 Oct 03 14:36:42.767112 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-05273829-3581-4347-8968-e0e76ecd7ddc req-2d1ef089-ac12-4786-9acd-d4aa1ab6a507 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042489 Oct 03 14:36:42.767981 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 569/1143] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:43.024237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:43.024904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:43.033380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:43.034246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:43.035174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:43.035877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:43.036517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:43.036953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:43.356228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:43.368047 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d25bcbd9-0c62-487a-a5d8-ab96c3836288 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.348070 Oct 03 14:36:43.368663 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 570/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:43 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:43.373867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:43.375125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:43.387556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:43.390504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:43.392764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:43.393580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:43.394061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:43.394495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:43.744645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:43.753774 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53b09bcb-4ab1-4982-acfd-162110b7d5b1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1463 microversion: 2.1 time: 0.383403 Oct 03 14:36:43.759555 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 571/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:43 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1463 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:43.786291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:43.787111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:43.804617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:43.805175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:43.805654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:43.806366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:43.806856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:43.807283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:44.414360 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45fa32c0-d8a7-45af-b69e-9b6a2c13454e tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1614 microversion: 2.1 time: 0.632202 Oct 03 14:36:44.425465 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 572/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:43 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1614 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:44.432613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:44.433641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:44.441553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:44.442052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:44.442493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:44.443288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:44.443759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:44.444183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:44.699950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:44.710962 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd2eec0e-e6c9-4c7b-b290-4afd3efb5cf8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.282403 Oct 03 14:36:44.729039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 573/1147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:44 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:44.752821 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38f48bdb-15da-406b-a5a4-742b8c3d1b99 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/action" status: 202 len: 0 microversion: 2.25 time: 3.709868 Oct 03 14:36:44.754443 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 575/1148] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:36:41 2022] POST /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/action => generated 0 bytes in 3712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:44.757741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce34dfa1-7aad-418b-94ae-c71bb2c47efe tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '.version_select at 0x7fb2308945e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:44.762451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce34dfa1-7aad-418b-94ae-c71bb2c47efe tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:44.763310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:44.764476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:44.768378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce34dfa1-7aad-418b-94ae-c71bb2c47efe tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:44.769016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce34dfa1-7aad-418b-94ae-c71bb2c47efe tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:44.782096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:44.783301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:44.784843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:44.786019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:44.786637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:44.787331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:44.806693 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce34dfa1-7aad-418b-94ae-c71bb2c47efe tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2328 microversion: 2.1 time: 0.070242 Oct 03 14:36:44.825329 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 574/1149] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:36:44 2022] GET /compute/v2.1/os-migrations => generated 2328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:44.972619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-252407876", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:45.050541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:36:45.249439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.263105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.265321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.267493 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef8e543c-8056-46de-9d91-f64e068f67ec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.508698 Oct 03 14:36:45.269013 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 576/1150] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:44 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:45.281891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:45.305651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.306680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Searching by: {'deleted': False, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:36:45.318543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.319783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.320317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.322928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.323525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.324097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.389517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:36:45.389934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:36:45.390404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:36:45.390810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:36:45.391223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:36:45.396759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:45.402925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.403416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.403863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.404612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.405099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.405702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.427411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:36:45.437872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for user 7415ca24b92d4ba193b3f6762d4196b3 and project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:36:45.438270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:36:45.466020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:36:45.468962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:36:45.515733 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f22496dd-6e44-4cca-89af-297f877dffd5 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.245270 Oct 03 14:36:45.525654 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 577/1151] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:36:45 2022] GET /compute/v2.1/servers => generated 334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:45.531653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:45.543836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.545092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Searching by: {'deleted': False, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:36:45.552747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.553757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.554405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.555451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.556193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.557074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.564305 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dfc244c4-3d6c-47e2-8b84-7e92fa464d74 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607118 Oct 03 14:36:45.572183 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 575/1152] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:36:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:36:45.577168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b01e2b5e-90db-4a79-906e-a5aaf617a9d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:45.577783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b01e2b5e-90db-4a79-906e-a5aaf617a9d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:45.598947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:36:45.651731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.660082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.660848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.661721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.701363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b01e2b5e-90db-4a79-906e-a5aaf617a9d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.710515 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b01e2b5e-90db-4a79-906e-a5aaf617a9d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1212 microversion: 2.1 time: 0.137165 Oct 03 14:36:45.711420 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 576/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:45 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1212 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:45.735426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:45.736336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:45.743546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.744308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.745136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.746599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:45.747358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:45.747885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:45.946050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:45.957068 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e596508e-e293-4d1f-9e64-9a81e2bcc8e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.225809 Oct 03 14:36:45.957668 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 577/1154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:45 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:46.279512 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f055548-6dfb-459c-8e7c-9c949ad30a3d tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.751468 Oct 03 14:36:46.295052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:46.296027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:46.309144 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 578/1155] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:36:45 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:46.315386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce35ed3-ca5c-4d3d-8688-6e51ccc0f59f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:46.316246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:46.317759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:46.322577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:46.323876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:46.324575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:46.325223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:46.351561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ce35ed3-ca5c-4d3d-8688-6e51ccc0f59f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041189 Oct 03 14:36:46.364213 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 579/1156] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:36:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:46.677208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:46.686146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:46.688211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:46.690432 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7d5e2ae-4330-4e97-88c9-6b2ebe295b76 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.400924 Oct 03 14:36:46.691250 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 578/1157] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:46 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:36:46.716743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:46.717413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:46.727773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:46.733470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:46.734087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:46.738841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:46.741026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:46.742160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:46.744470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:46.747333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:46.750419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:46.762155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:46.763743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:46.768398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:46.769161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:46.774146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:46.855192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:36:46.996254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:46.997172 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-088b9957-e410-4e15-b40c-8e9beec7586c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1264 microversion: 2.1 time: 0.267647 Oct 03 14:36:47.013228 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 579/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:46 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1264 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:47.021821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:47.023574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:47.025335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:47.032224 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-140a3b1b-1b0f-4474-b5ef-6ed26705f82f tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 204 len: 0 microversion: 2.1 time: 0.319993 Oct 03 14:36:47.036431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:47.037386 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 580/1159] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:36:46 2022] DELETE /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:36:47.042872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:47.043757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:47.044000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:47.044723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:47.045894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:47.046636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:47.049913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:47.053302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:47.054004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:47.054600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:47.055509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:47.056147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:47.056775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:47.309058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:47.319206 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ffb64d4-3b82-4bfa-85d9-5cb6ee03c98e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.304262 Oct 03 14:36:47.330010 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 580/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:47 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:47.344655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-79dcd85d-f7ce-494a-b4bc-7dbd6c11daea req-be63020b-d6dd-4f61-b605-3386db6443ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906e2b64-19c2-4e64-b53b-037cbbf0f202", "name": "network-vif-plugged", "status": "completed", "tag": "db205e77-fa49-4cdb-ad12-92c89e857fd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:47.357446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79dcd85d-f7ce-494a-b4bc-7dbd6c11daea req-be63020b-d6dd-4f61-b605-3386db6443ed service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:47.358354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79dcd85d-f7ce-494a-b4bc-7dbd6c11daea req-be63020b-d6dd-4f61-b605-3386db6443ed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:47.359025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79dcd85d-f7ce-494a-b4bc-7dbd6c11daea req-be63020b-d6dd-4f61-b605-3386db6443ed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:47.376724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-79dcd85d-f7ce-494a-b4bc-7dbd6c11daea req-be63020b-d6dd-4f61-b605-3386db6443ed service nova] Creating event network-vif-plugged:db205e77-fa49-4cdb-ad12-92c89e857fd7 for instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 on n-h1-781139-2 Oct 03 14:36:47.383343 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-79dcd85d-f7ce-494a-b4bc-7dbd6c11daea req-be63020b-d6dd-4f61-b605-3386db6443ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051738 Oct 03 14:36:47.384637 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 581/1161] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:47.434391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:47.445863 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c914135-cad0-4cb2-ba54-1abcac9ded94 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1698 microversion: 2.1 time: 0.406372 Oct 03 14:36:47.446571 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 581/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:47 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1698 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:47.721068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:47.722702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:47.734968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:47.737384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:47.738812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:47.740642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:47.741585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:47.742805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:48.035919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:48.036900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:48.047540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:48.049153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:48.049867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:48.051327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:48.053297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:48.054997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:48.061216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:48.097790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:48.103089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:48.109132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c637be14-6bec-4d98-87d9-bfd75c8cce02 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.394503 Oct 03 14:36:48.113330 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 582/1163] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:47 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:48.347688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:48.350271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:48.359608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:48.361121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:48.362867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:48.364658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:48.365404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:48.366063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:48.583855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:48.588289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:48.596248 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45d91d53-a511-4151-b1b6-38e8f19e5d28 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.254635 Oct 03 14:36:48.597624 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 583/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:48 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:48.614770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:48.615445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:48.631598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:48.632162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:48.632609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:48.633542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:48.635945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:48.636557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:48.893363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:48.905188 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e3bea936-cffb-4742-9165-bd1154e818a3 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1698 microversion: 2.1 time: 0.306162 Oct 03 14:36:48.922452 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 584/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:48 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1698 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:48.927703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:48.937537 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36c74acd-7978-45b5-8faa-e318fab25c90 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1312 microversion: 2.1 time: 0.905446 Oct 03 14:36:48.938474 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 582/1166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:48 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1312 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:49.143005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:49.144790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:49.153805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:49.154648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:49.155858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:49.156916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:49.158249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:49.159065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:49.409983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:49.422937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:49.426772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:49.430637 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6a6ea07e-6f08-44f6-8579-4e7aa515d24d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.293812 Oct 03 14:36:49.451533 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 585/1167] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:49 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:49.622567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:49.622765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:49.641388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:49.642279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:49.643051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:49.644876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:49.646441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:49.646818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:49.933597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:49.934206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:49.943751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:49.948602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:49.949335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:49.950785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:49.951408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:49.953204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:50.065767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:50.076187 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-632c271a-09fb-4164-9898-3af23e3b55bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1308 microversion: 2.1 time: 0.455802 Oct 03 14:36:50.078361 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 583/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:49 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:50.097349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:50.097971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:50.118825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:50.119332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:50.126663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:50.132785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:50.136628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:50.137767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:50.730231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:50.741048 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ed3bd73-8895-46ba-9c1b-e3a9c9f7e06d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1312 microversion: 2.1 time: 0.657023 Oct 03 14:36:50.743589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 584/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:50 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1312 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:50.752059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:50.756329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:50.774342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:50.775116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:50.775768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:50.776671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:50.777427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:50.778077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:50.808266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:50.826331 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7833dae3-455d-42da-b316-1570e3a76f23 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1698 microversion: 2.1 time: 0.897727 Oct 03 14:36:50.828299 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 586/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:49 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1698 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:50.899449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-bd805161-68e3-4f5d-bdb6-769d7c009c84 req-b459a125-d97e-477a-8361-52c460887f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5d4472-5a15-4669-9f9c-abfad1afd9a8", "tag": "6ed8a1bb-17a8-4a46-b317-c702126c5e6f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:50.915614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bd805161-68e3-4f5d-bdb6-769d7c009c84 req-b459a125-d97e-477a-8361-52c460887f01 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:50.928598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bd805161-68e3-4f5d-bdb6-769d7c009c84 req-b459a125-d97e-477a-8361-52c460887f01 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:50.929470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bd805161-68e3-4f5d-bdb6-769d7c009c84 req-b459a125-d97e-477a-8361-52c460887f01 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:50.953882 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-bd805161-68e3-4f5d-bdb6-769d7c009c84 req-b459a125-d97e-477a-8361-52c460887f01 service nova] Creating event network-changed:6ed8a1bb-17a8-4a46-b317-c702126c5e6f for instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 on n-h2-781139-2 Oct 03 14:36:50.970736 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-bd805161-68e3-4f5d-bdb6-769d7c009c84 req-b459a125-d97e-477a-8361-52c460887f01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074966 Oct 03 14:36:50.985824 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 587/1171] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:51.101278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:51.102426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:51.116906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.117425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.117866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:51.118582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.119031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.119483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:51.466082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:51.477677 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-26174508-9a16-4aa3-86c1-beb7553f88fe tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1489 microversion: 2.1 time: 0.381339 Oct 03 14:36:51.494575 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 588/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:51 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1489 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:51.507986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:51.508524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:51.523083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.527501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.531039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:51.531820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.534168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.547416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:51.694605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35668dc8-bc58-4cbb-af25-eace687e8d5d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202/action" status: 202 len: 0 microversion: 2.1 time: 0.190513 Oct 03 14:36:51.695997 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 589/1173] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:36:51 2022] POST /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:36:51.704393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:51.705494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:51.719010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.726229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.726920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:51.727919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.728642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.729329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:51.831930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:51.853890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:51.857045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:51.860707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b63caa0c-2894-40e6-b33a-2757c5a0339a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 1.115698 Oct 03 14:36:51.878974 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 585/1174] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:50 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:51.888243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:51.889511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:51.896318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.896806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.897266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:51.897974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:51.898476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:51.898901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:52.614164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:52.626198 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e24e8d1-c6a5-4252-bee3-816dbf00d621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1494 microversion: 2.1 time: 0.925781 Oct 03 14:36:52.629274 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 590/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:51 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1494 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:52.636318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:52.636945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:52.658601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:52.660696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:52.662428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:52.663450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:52.666368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:52.667095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:52.909407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:52.917150 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1bfcf6a1-ec4c-481d-883f-6adb95746d30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1312 microversion: 2.1 time: 1.036874 Oct 03 14:36:52.917728 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 586/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:51 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1312 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:52.937256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:52.937595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:52.938837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:52.946886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:52.950320 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92a07987-922e-4aff-88bb-4383e973f76b tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1698 microversion: 2.1 time: 0.319758 Oct 03 14:36:52.950948 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 591/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:52 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1698 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:52.965500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:52.971071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:52.975099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:52.977187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:52.977813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:53.371081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:53.387861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:53.390772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:53.393963 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d232808-f5a0-4ac2-a9ee-38e2f83783f8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.471139 Oct 03 14:36:53.400410 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 587/1178] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:52 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:53.648904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e7a1b63c-4f73-45ae-a1fd-4523ca1b2d77 req-0a5b7726-bad8-4926-8f4e-d2f8ae672014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8051f6c-c92b-41d9-9bbc-8a5b674b8de6", "name": "network-vif-deleted", "tag": "e723b21e-4874-4d17-89ec-48497a8578b6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:53.654098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:53.654726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:53.666292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:53.674480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e7a1b63c-4f73-45ae-a1fd-4523ca1b2d77 req-0a5b7726-bad8-4926-8f4e-d2f8ae672014 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:53.675685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:53.676361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:53.677379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:53.678091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:53.678229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e7a1b63c-4f73-45ae-a1fd-4523ca1b2d77 req-0a5b7726-bad8-4926-8f4e-d2f8ae672014 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:53.678715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e7a1b63c-4f73-45ae-a1fd-4523ca1b2d77 req-0a5b7726-bad8-4926-8f4e-d2f8ae672014 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:53.679108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:53.683857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:53.708272 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e7a1b63c-4f73-45ae-a1fd-4523ca1b2d77 req-0a5b7726-bad8-4926-8f4e-d2f8ae672014 service nova] Creating event network-vif-deleted:e723b21e-4874-4d17-89ec-48497a8578b6 for instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 on n-h1-781139-2 Oct 03 14:36:53.721553 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e7a1b63c-4f73-45ae-a1fd-4523ca1b2d77 req-0a5b7726-bad8-4926-8f4e-d2f8ae672014 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082184 Oct 03 14:36:53.727419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 592/1179] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:53.952773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:53.957709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:53.979109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:53.982418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:53.983738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:53.984875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:54.001656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:54.012354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:54.230160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:54.238974 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-169b6541-02cc-40fc-a10d-1add13376e05 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 200 len: 1474 microversion: 2.1 time: 0.589155 Oct 03 14:36:54.241235 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 588/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:53 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 1474 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:54.249901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:54.252419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:54.291824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:54.292708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:54.293570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:54.295859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:54.297260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:54.301570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:54.445001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:54.459882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:54.460808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:54.461552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lazy-loading 'fault' on Instance uuid f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:36:54.593309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74fbc9e372994766b6a3979dd355c881', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8c0030da91477dad8a2c2354f7703d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:54.603143 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31dac950-f59d-48c3-9638-aa61831f473e tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 200 len: 1359 microversion: 2.1 time: 0.360629 Oct 03 14:36:54.608672 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 589/1181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:54 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:54.623286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1462893703"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:54.626468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:54.644502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:54.647916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:54.659478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:54.660265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:54.662083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:54.662542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:55.005193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:55.028319 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bba41ed6-a0a2-42c4-899c-79e52acadd12 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1312 microversion: 2.1 time: 1.087348 Oct 03 14:36:55.029520 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 593/1182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:53 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1312 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:36:55.040140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:55.040751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:55.048637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:55.049419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:55.049851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:55.050698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:55.051154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:55.051570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:55.146647 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5be0b6d-8d0e-4c92-8d16-6db0242c93eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202/action" status: 202 len: 0 microversion: 2.1 time: 0.536283 Oct 03 14:36:55.153726 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 590/1183] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:36:54 2022] POST /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:36:55.165255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86f4fef6-ed49-4546-90e3-d4620eb3a34e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bfa310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:55.227363 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86f4fef6-ed49-4546-90e3-d4620eb3a34e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.066359 Oct 03 14:36:55.228305 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 591/1184] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:36:55 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:55.418593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:55.624606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:55.639812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:55.640872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] [instance: f8051f6c-c92b-41d9-9bbc-8a5b674b8de6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:55.659714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:55.676281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:55.682793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:55.683281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:55.684054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:55.684513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:55.684963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:55.707933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:36:55.717375 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] HTTP exception thrown: Instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 could not be found. Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Request method failure captured: Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 HTTP/1.1 Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvMB8nVQJ9mm8b7mUn_6HJF3Sk-MjbH29lkxO-_5WM6FAmqP9DJlf4i8D2i-x2OHTRl5ZyK0CQXdisswGO15CKULV8QxRsr1DmPiUhLlrYOulvW8oS_57SKTV5dIyufsJPIrYqnowPWeFAMVblKt9lAoioJX0f10sUdtKv7RwMu6B_8 Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ef8c0030da91477dad8a2c2354f7703d Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-79509721 Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:55.719106 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef8c0030da91477dad8a2c2354f7703d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef8c0030da91477dad8a2c2354f7703d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef8c0030da91477dad8a2c2354f7703d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef8c0030da91477dad8a2c2354f7703d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-79509721 Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ef8c0030da91477dad8a2c2354f7703d Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-79509721 Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-79509721-project Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 74fbc9e372994766b6a3979dd355c881 Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-79509721-project Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 could not be found. Oct 03 14:36:55.720629 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f8051f6c-c92b-41d9-9bbc-8a5b674b8de6'} Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 could not be found. Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:55.721533 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 could not be found. Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 could not be found. Oct 03 14:36:55.723953 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:55.725296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Returning 404 to user: Instance f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:55.725296 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d48e70b-13d6-4eeb-8c35-ea231ee65521 tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6" status: 404 len: 111 microversion: 2.1 time: 0.097147 Oct 03 14:36:55.725296 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 592/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:55 2022] GET /compute/v2.1/servers/f8051f6c-c92b-41d9-9bbc-8a5b674b8de6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:36:55.729967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3793b47b-1507-402b-b59b-efaeeff22e5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] Calling method '.version_select at 0x7fb234bfa8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:55.742840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:55.758830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:55.760447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:55.763175 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6015399-3add-4050-a8f0-27b4735e6807 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.732221 Oct 03 14:36:55.766296 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 594/1186] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:55 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:55.772708 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3793b47b-1507-402b-b59b-efaeeff22e5c tempest-ServersTestJSON-79509721 tempest-ServersTestJSON-79509721-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-345637909" status: 202 len: 0 microversion: 2.1 time: 0.046360 Oct 03 14:36:55.776351 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 593/1187] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 14:36:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-345637909 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:36:56.054287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:56.057202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:56.064827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:56.065752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:56.066986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:56.069533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:56.070404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:56.071926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:56.244088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05a1d6b7-2c14-420a-a1fa-426af89bdf1a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234ccf160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:56.308628 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05a1d6b7-2c14-420a-a1fa-426af89bdf1a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.068737 Oct 03 14:36:56.309949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 594/1188] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:36:56 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:56.654413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:56.666532 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8229e38b-e85f-4913-8d3e-43ca87f767f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1312 microversion: 2.1 time: 0.616821 Oct 03 14:36:56.687550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 595/1189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:56 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1312 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:56.801371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:56.802073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:56.819919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:56.820962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:56.822501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:56.823754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:56.824777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:56.825385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:57.193898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:57.212462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:57.214266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:57.215491 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdc76ed4-3123-416f-985c-e1e67f51278e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.421770 Oct 03 14:36:57.216394 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 595/1190] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:56 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:36:57.325149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f52789d-773c-44de-ab81-6486ed94b5c0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23085b8b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:57.393020 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f52789d-773c-44de-ab81-6486ed94b5c0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.070955 Oct 03 14:36:57.395505 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 596/1191] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:36:57 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:57.702058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:57.702665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:57.712155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:57.713082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:57.713743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:57.715202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:57.717604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:57.721772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:58.245496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:58.246393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:58.253629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:58.254370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:58.255004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:58.255872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:58.256478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:58.257121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:58.436495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:58.442323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:58.465643 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-762aa579-1aa4-4a1e-b07b-c9646c9c21cd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1312 microversion: 2.1 time: 0.773192 Oct 03 14:36:58.466246 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 596/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:57 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1312 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:58.469676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:58.475271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:58.479441 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4915df77-8674-4474-939c-926cf3b6e8dc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.237757 Oct 03 14:36:58.482151 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 597/1193] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:58 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:36:58.493032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-505d7ad2-876b-41bc-a9cb-8713efd84124 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23084f8b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:58.557150 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-505d7ad2-876b-41bc-a9cb-8713efd84124 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.073708 Oct 03 14:36:58.558606 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 598/1194] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:36:58 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:58.753384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f82c806-87d1-4584-ae9a-6792c2bdddc9 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Calling method '.version_select at 0x7fb234ccf4c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:58.763477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-07ce62e8-a23e-40b8-95b1-5d7f052d299a req-ade611d4-e575-4f79-a822-84e7cf6478af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5d4472-5a15-4669-9f9c-abfad1afd9a8", "name": "network-vif-plugged", "status": "completed", "tag": "6ed8a1bb-17a8-4a46-b317-c702126c5e6f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:58.784209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-07ce62e8-a23e-40b8-95b1-5d7f052d299a req-ade611d4-e575-4f79-a822-84e7cf6478af service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:58.785065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-07ce62e8-a23e-40b8-95b1-5d7f052d299a req-ade611d4-e575-4f79-a822-84e7cf6478af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:58.786317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-07ce62e8-a23e-40b8-95b1-5d7f052d299a req-ade611d4-e575-4f79-a822-84e7cf6478af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:58.802097 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-07ce62e8-a23e-40b8-95b1-5d7f052d299a req-ade611d4-e575-4f79-a822-84e7cf6478af service nova] Creating event network-vif-plugged:6ed8a1bb-17a8-4a46-b317-c702126c5e6f for instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 on n-h2-781139-2 Oct 03 14:36:58.808348 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-07ce62e8-a23e-40b8-95b1-5d7f052d299a req-ade611d4-e575-4f79-a822-84e7cf6478af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052614 Oct 03 14:36:58.809906 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 599/1195] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:36:58.815532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-7f82c806-87d1-4584-ae9a-6792c2bdddc9 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:36:58.816553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-7f82c806-87d1-4584-ae9a-6792c2bdddc9 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Neutron security group 92efc118-4eb3-422f-bb8b-19148ef39a5a not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:36:58.818306 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7f82c806-87d1-4584-ae9a-6792c2bdddc9 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] HTTP exception thrown: Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist Oct 03 14:36:58.818306 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-66be0a6b-60b5-4ad5-9845-da135e38004a'] Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f82c806-87d1-4584-ae9a-6792c2bdddc9 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Request method failure captured: Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/92efc118-4eb3-422f-bb8b-19148ef39a5a HTTP/1.1 Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvOKtT2ib9p7amchAz_k5KRFIfwMcQkwfWjGJ5Xw9Q235sExBHz0YTPmwbeLHHHVaQTywniOsWsgrpK-9CfN8xZzCxSigqD0s4cNVVlMck96y3FBlIV_y-ho4o65wcnuGYn0o2aIA-VndQOvD2sr9MLJRsnkpZgNrK822sgpB7fQBDo Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:58.823565 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a5b66fecb5546c0b8934202a116a504", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 4f074c6dea264b58b683c63c673dfb21 Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-66be0a6b-60b5-4ad5-9845-da135e38004a'] Oct 03 14:36:58.824999 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '92efc118-4eb3-422f-bb8b-19148ef39a5a'} Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:58.825834 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66be0a6b-60b5-4ad5-9845-da135e38004a'] Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:36:58.827031 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66be0a6b-60b5-4ad5-9845-da135e38004a'] Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66be0a6b-60b5-4ad5-9845-da135e38004a'] Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:58.830139 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:58.833259 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:58.833259 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:58.833259 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:58.833259 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:58.833259 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist Oct 03 14:36:58.833259 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66be0a6b-60b5-4ad5-9845-da135e38004a'] Oct 03 14:36:58.833259 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:58.835746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f82c806-87d1-4584-ae9a-6792c2bdddc9 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Returning 404 to user: Security group 92efc118-4eb3-422f-bb8b-19148ef39a5a does not exist Oct 03 14:36:58.835746 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-66be0a6b-60b5-4ad5-9845-da135e38004a'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:58.837358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f82c806-87d1-4584-ae9a-6792c2bdddc9 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/92efc118-4eb3-422f-bb8b-19148ef39a5a" status: 404 len: 194 microversion: 2.1 time: 0.368006 Oct 03 14:36:58.838650 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 597/1196] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:36:58 2022] DELETE /compute/v2.1/os-security-groups/92efc118-4eb3-422f-bb8b-19148ef39a5a => generated 194 bytes in 370 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:58.860864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-23550926-685a-4d16-80e0-12b1d03f486c tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005911 Oct 03 14:36:58.862002 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 600/1197] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 3 14:36:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 14:36:58.872437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b314f634-a68e-4e42-a0ab-47d77e37589f tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Calling method '.version_select at 0x7fb234c41f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:59.270609 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b314f634-a68e-4e42-a0ab-47d77e37589f tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.403623 Oct 03 14:36:59.282931 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 598/1198] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:36:58 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:36:59.290121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc7e06d0-d6ca-40cd-8c7e-45d6d3162e1c tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Calling method '.version_select at 0x7fb23084fb80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:59.419802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-dc7e06d0-d6ca-40cd-8c7e-45d6d3162e1c tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:36:59.420709 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-dc7e06d0-d6ca-40cd-8c7e-45d6d3162e1c tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 03 14:36:59.420709 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-ce7c9ba5-2e54-44ff-9a1d-9ba51da6893a'] Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc7e06d0-d6ca-40cd-8c7e-45d6d3162e1c tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Request method failure captured: Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-security-groups/f05fb37a-47d5-471f-9cb6-653e83b4e20a HTTP/1.1 Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvOKtT2ib9p7amchAz_k5KRFIfwMcQkwfWjGJ5Xw9Q235sExBHz0YTPmwbeLHHHVaQTywniOsWsgrpK-9CfN8xZzCxSigqD0s4cNVVlMck96y3FBlIV_y-ho4o65wcnuGYn0o2aIA-VndQOvD2sr9MLJRsnkpZgNrK822sgpB7fQBDo Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:59.425993 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a5b66fecb5546c0b8934202a116a504", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 4f074c6dea264b58b683c63c673dfb21 Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: exception: Insufficient rights for removing default security group. Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-ce7c9ba5-2e54-44ff-9a1d-9ba51da6893a'] Oct 03 14:36:59.427711 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f05fb37a-47d5-471f-9cb6-653e83b4e20a'} Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.428573 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce7c9ba5-2e54-44ff-9a1d-9ba51da6893a'] Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 03 14:36:59.430055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce7c9ba5-2e54-44ff-9a1d-9ba51da6893a'] Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce7c9ba5-2e54-44ff-9a1d-9ba51da6893a'] Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.432417 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:59.435472 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:59.435472 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:59.435472 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:59.435472 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 03 14:36:59.435472 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce7c9ba5-2e54-44ff-9a1d-9ba51da6893a'] Oct 03 14:36:59.435472 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.439056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc7e06d0-d6ca-40cd-8c7e-45d6d3162e1c tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 03 14:36:59.439056 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-ce7c9ba5-2e54-44ff-9a1d-9ba51da6893a'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:59.441090 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc7e06d0-d6ca-40cd-8c7e-45d6d3162e1c tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f05fb37a-47d5-471f-9cb6-653e83b4e20a" status: 400 len: 182 microversion: 2.1 time: 0.154661 Oct 03 14:36:59.442166 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 601/1199] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:36:59 2022] DELETE /compute/v2.1/os-security-groups/f05fb37a-47d5-471f-9cb6-653e83b4e20a => generated 182 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:36:59.453523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3adb8b98-e8cf-4bac-90ae-bef1ecb1a075 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Calling method '.version_select at 0x7fb230a53670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:59.491427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-3adb8b98-e8cf-4bac-90ae-bef1ecb1a075 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:36:59.492024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-3adb8b98-e8cf-4bac-90ae-bef1ecb1a075 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Neutron security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:36:59.492730 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3adb8b98-e8cf-4bac-90ae-bef1ecb1a075 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] HTTP exception thrown: Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist Oct 03 14:36:59.492730 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-64b83c79-a76d-4ade-ae6d-f43adf93421c'] Oct 03 14:36:59.498393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:59.499143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3adb8b98-e8cf-4bac-90ae-bef1ecb1a075 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Request method failure captured: Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-security-groups/b4e77cb4-650c-4e26-9728-616e8a05a3f6 HTTP/1.1 Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvOKtT2ib9p7amchAz_k5KRFIfwMcQkwfWjGJ5Xw9Q235sExBHz0YTPmwbeLHHHVaQTywniOsWsgrpK-9CfN8xZzCxSigqD0s4cNVVlMck96y3FBlIV_y-ho4o65wcnuGYn0o2aIA-VndQOvD2sr9MLJRsnkpZgNrK822sgpB7fQBDo Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:36:59.503799 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a5b66fecb5546c0b8934202a116a504", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 4f074c6dea264b58b683c63c673dfb21 Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-64b83c79-a76d-4ade-ae6d-f43adf93421c'] Oct 03 14:36:59.505258 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b4e77cb4-650c-4e26-9728-616e8a05a3f6'} Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.506044 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64b83c79-a76d-4ade-ae6d-f43adf93421c'] Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:36:59.507289 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64b83c79-a76d-4ade-ae6d-f43adf93421c'] Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64b83c79-a76d-4ade-ae6d-f43adf93421c'] Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.511105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64b83c79-a76d-4ade-ae6d-f43adf93421c'] Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3adb8b98-e8cf-4bac-90ae-bef1ecb1a075 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Returning 404 to user: Security group b4e77cb4-650c-4e26-9728-616e8a05a3f6 does not exist Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-64b83c79-a76d-4ade-ae6d-f43adf93421c'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3adb8b98-e8cf-4bac-90ae-bef1ecb1a075 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/b4e77cb4-650c-4e26-9728-616e8a05a3f6" status: 404 len: 194 microversion: 2.1 time: 0.056004 Oct 03 14:36:59.514583 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 599/1200] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:36:59 2022] GET /compute/v2.1/os-security-groups/b4e77cb4-650c-4e26-9728-616e8a05a3f6 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:59.518381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:59.520333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:59.521047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:59.521427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:59.521985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:59.522435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:59.523258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:59.525779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:36:59.532775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:59.533295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:59.533736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:59.534444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:36:59.534897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:36:59.535322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:36:59.722156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:59.739603 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-af2c2edc-7b6a-4f9f-b39b-949c2a93a562 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1312 microversion: 2.1 time: 0.252174 Oct 03 14:36:59.741548 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 602/1201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:36:59 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:59.747325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86667f1c-0ddf-4c11-b151-07edb657cef8 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Action: 'update', calling method: .version_select at 0x7fb230782d30>, body: {"security_group": {"name": "tempest-sg-2045161375", "description": "tempest-description-1904416516"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:36:59.780705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-86667f1c-0ddf-4c11-b151-07edb657cef8 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:36:59.782230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.security_group_api [None req-86667f1c-0ddf-4c11-b151-07edb657cef8 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Neutron security group 51dba2aa-1471-4e74-9554-06b134a0d573 not found {{(pid=128868) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:36:59.783821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-86667f1c-0ddf-4c11-b151-07edb657cef8 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] HTTP exception thrown: Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist Oct 03 14:36:59.783821 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-114e5731-1c8e-4094-8547-0692cf44c60f'] Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86667f1c-0ddf-4c11-b151-07edb657cef8 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Request method failure captured: Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/os-security-groups/51dba2aa-1471-4e74-9554-06b134a0d573 HTTP/1.1 Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 102 Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvOKtT2ib9p7amchAz_k5KRFIfwMcQkwfWjGJ5Xw9Q235sExBHz0YTPmwbeLHHHVaQTywniOsWsgrpK-9CfN8xZzCxSigqD0s4cNVVlMck96y3FBlIV_y-ho4o65wcnuGYn0o2aIA-VndQOvD2sr9MLJRsnkpZgNrK822sgpB7fQBDo Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:36:59.787424 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a5b66fecb5546c0b8934202a116a504", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a5b66fecb5546c0b8934202a116a504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 0a5b66fecb5546c0b8934202a116a504 Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994 Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 4f074c6dea264b58b683c63c673dfb21 Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2072023994-project Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: {"security_group": {"name": "tempest-sg-2045161375", "description": "tempest-description-1904416516"}} Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:36:59.789316 n-d-781139-2 devstack@n-api.service[128868]: exception: Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-114e5731-1c8e-4094-8547-0692cf44c60f'] Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '51dba2aa-1471-4e74-9554-06b134a0d573', 'body': {'security_group': {'name': 'tempest-sg-2045161375', 'description': 'tempest-description-1904416516'}}} Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:36:59.790481 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-114e5731-1c8e-4094-8547-0692cf44c60f'] Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:36:59.791841 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-114e5731-1c8e-4094-8547-0692cf44c60f'] Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-114e5731-1c8e-4094-8547-0692cf44c60f'] Oct 03 14:36:59.794265 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-114e5731-1c8e-4094-8547-0692cf44c60f'] Oct 03 14:36:59.796716 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:36:59.799795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86667f1c-0ddf-4c11-b151-07edb657cef8 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] Returning 404 to user: Security group 51dba2aa-1471-4e74-9554-06b134a0d573 does not exist Oct 03 14:36:59.799795 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-114e5731-1c8e-4094-8547-0692cf44c60f'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:36:59.801384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-86667f1c-0ddf-4c11-b151-07edb657cef8 tempest-SecurityGroupsNegativeTestJSON-2072023994 tempest-SecurityGroupsNegativeTestJSON-2072023994-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/51dba2aa-1471-4e74-9554-06b134a0d573" status: 404 len: 194 microversion: 2.1 time: 0.058560 Oct 03 14:36:59.810593 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 603/1202] 10.222.0.20 () {60 vars in 1290 bytes} [Mon Oct 3 14:36:59 2022] PUT /compute/v2.1/os-security-groups/51dba2aa-1471-4e74-9554-06b134a0d573 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:36:59.822494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07af6397-d742-4841-86e2-f7884d919a58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23084f790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:36:59.872400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:59.889814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:59.890741 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07af6397-d742-4841-86e2-f7884d919a58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.078612 Oct 03 14:36:59.894923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:36:59.900671 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 604/1203] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:36:59 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:36:59.902864 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89924448-59a2-4c64-966f-1546a15c664d tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.390317 Oct 03 14:36:59.903816 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 600/1204] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:36:59 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:00.767986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:00.769234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:00.786859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:00.787714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:00.788350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:00.789253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:00.793639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:00.794478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:00.907055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91807f59-0a81-48ab-91d9-da530cf0148c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bfa820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:00.976744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91807f59-0a81-48ab-91d9-da530cf0148c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.073513 Oct 03 14:37:00.988642 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 601/1205] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:00 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:00.994440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:00.995388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:01.004895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:01.005641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:01.006229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:01.007097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:01.007745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:01.008339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:01.179280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:01.191118 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-521849d2-a20c-4a6d-9a5e-00f4f8fc7fc3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1461 microversion: 2.1 time: 0.430402 Oct 03 14:37:01.194182 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 605/1206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:00 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1461 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:01.222037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:01.224699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:01.236965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:01.239033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:01.240197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:01.244546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:01.245295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:01.246033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:01.387509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:01.416488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:01.422479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:01.430307 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a0e074f-024b-4e00-b5c0-9b85fcdd5ce9 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.439675 Oct 03 14:37:01.446203 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 602/1207] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:00 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:01.499094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:01.505927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Old instance type m1.heat2, new instance type m1.heat {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 14:37:01.522717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:37:01.522717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:37:01.523339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:37:01.523587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:37:01.527834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:37:01.684875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:01.720590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97b31ddd-3616-424c-9c24-147920d10789 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-498265286", "ram": 512, "vcpus": 1, "disk": 10, "id": 82101794, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:01.744989 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97b31ddd-3616-424c-9c24-147920d10789 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.243191 Oct 03 14:37:01.745929 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 603/1208] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:37:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:01.757194 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-534ae65f-6967-480e-a0d6-c66803cd1136 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8/action" status: 202 len: 0 microversion: 2.1 time: 0.534489 Oct 03 14:37:01.757194 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 606/1209] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:37:01 2022] POST /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:37:01.762254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:01.762880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:01.764467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9af22c6d-c943-491b-a608-ae2da5beb417 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:01.777441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:01.778054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:01.778339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:01.779403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:01.779548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:01.779882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:01.806321 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9af22c6d-c943-491b-a608-ae2da5beb417 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/82101794/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046515 Oct 03 14:37:01.807184 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 604/1210] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 3 14:37:01 2022] POST /compute/v2.1/flavors/82101794/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:01.955756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59d4b2e4-e4fc-4608-8e37-f8c3cbe92669 tempest-FlavorsExtraSpecsTestJSON-72854311 tempest-FlavorsExtraSpecsTestJSON-72854311-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:01.971738 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59d4b2e4-e4fc-4608-8e37-f8c3cbe92669 tempest-FlavorsExtraSpecsTestJSON-72854311 tempest-FlavorsExtraSpecsTestJSON-72854311-project] 10.222.0.20 "GET /compute/v2.1/flavors/82101794/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.158119 Oct 03 14:37:01.975126 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 605/1211] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 3 14:37:01 2022] GET /compute/v2.1/flavors/82101794/os-extra_specs => generated 66 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:01.992365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1b70b65-43ef-4508-98ea-2ff3cab3031f tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:02.053722 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1b70b65-43ef-4508-98ea-2ff3cab3031f tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/82101794/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.070276 Oct 03 14:37:02.058860 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 606/1212] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 3 14:37:01 2022] POST /compute/v2.1/flavors/82101794/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:02.069308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3529af52-04fc-402d-b1c1-0aa3b4cb0df9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c41940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.144212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:02.156359 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-803d3563-3ced-435d-a2d9-309a7983d213 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1470 microversion: 2.1 time: 0.402078 Oct 03 14:37:02.169464 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 607/1213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:01 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:02.169464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b0dd3329-1fd7-4a63-b361-e3dd9567818f tempest-FlavorsExtraSpecsTestJSON-72854311 tempest-FlavorsExtraSpecsTestJSON-72854311-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.186470 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b0dd3329-1fd7-4a63-b361-e3dd9567818f tempest-FlavorsExtraSpecsTestJSON-72854311 tempest-FlavorsExtraSpecsTestJSON-72854311-project] 10.222.0.20 "GET /compute/v2.1/flavors/82101794/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.025913 Oct 03 14:37:02.196366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3529af52-04fc-402d-b1c1-0aa3b4cb0df9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.138665 Oct 03 14:37:02.197581 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 607/1214] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:02 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:02.205348 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 608/1215] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:37:02 2022] GET /compute/v2.1/flavors/82101794/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:02.209579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-449b0560-4d9d-4eb4-89f8-5238f3e51069 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:02.259149 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-449b0560-4d9d-4eb4-89f8-5238f3e51069 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/82101794/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060271 Oct 03 14:37:02.261284 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 608/1216] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 3 14:37:02 2022] POST /compute/v2.1/flavors/82101794/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:02.270640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f8114ab-a4c1-499a-ac9c-13409d50e06e tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.287160 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f8114ab-a4c1-499a-ac9c-13409d50e06e tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/82101794/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020647 Oct 03 14:37:02.287750 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 609/1217] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 3 14:37:02 2022] GET /compute/v2.1/flavors/82101794/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:37:02.300466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecc3e363-88c9-4c4e-b024-2135e36ab62c tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:02.363026 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecc3e363-88c9-4c4e-b024-2135e36ab62c tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/82101794/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.069255 Oct 03 14:37:02.367670 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 609/1218] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 3 14:37:02 2022] PUT /compute/v2.1/flavors/82101794/os-extra_specs/hw:numa_nodes => generated 22 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:02.372994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd371158-2385-4a5e-a50b-95077093f8b4 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.393150 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd371158-2385-4a5e-a50b-95077093f8b4 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/82101794/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023966 Oct 03 14:37:02.395954 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 610/1219] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 3 14:37:02 2022] GET /compute/v2.1/flavors/82101794/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:02.404012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23d4424b-f424-43c7-bf30-a4397a316123 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.459148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.459785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:02.467923 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23d4424b-f424-43c7-bf30-a4397a316123 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/82101794/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.068444 Oct 03 14:37:02.474305 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 610/1220] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:37:02 2022] DELETE /compute/v2.1/flavors/82101794/os-extra_specs/hw:numa_nodes => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:37:02.475808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:02.476544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:02.477181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:02.478059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:02.483330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de341338-89e4-4caf-a28a-481e497b7a81 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.484258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:02.486129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:02.541888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:02.548250 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de341338-89e4-4caf-a28a-481e497b7a81 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/82101794/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.072793 Oct 03 14:37:02.549576 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 611/1221] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:37:02 2022] DELETE /compute/v2.1/flavors/82101794/os-extra_specs/hw:cpu_policy => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 14:37:02.557301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f475a71-619a-4b19-8921-369d2a362a3d tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.566863 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f475a71-619a-4b19-8921-369d2a362a3d tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/82101794/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013384 Oct 03 14:37:02.567795 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 612/1222] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 3 14:37:02 2022] GET /compute/v2.1/flavors/82101794/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:37:02.582539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f544541-3404-4efa-a644-431d4b8282a6 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.614249 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f544541-3404-4efa-a644-431d4b8282a6 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/82101794" status: 202 len: 0 microversion: 2.1 time: 0.037790 Oct 03 14:37:02.615237 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 613/1223] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 14:37:02 2022] DELETE /compute/v2.1/flavors/82101794 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:37:02.636512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d424fa10-bcb5-4edc-8719-ed693072d918 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:02.670104 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d424fa10-bcb5-4edc-8719-ed693072d918 tempest-FlavorsExtraSpecsTestJSON-1872740255 tempest-FlavorsExtraSpecsTestJSON-1872740255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050146 Oct 03 14:37:02.684301 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 614/1224] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:37:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:02.817350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:02.838163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:02.839980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:02.841467 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1a53ea46-fa2c-48e7-8a1d-5c11ec3a4931 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.387731 Oct 03 14:37:02.842842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 611/1225] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:02 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:37:03.193332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:03.194097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:03.212710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f96c69b0-a616-4de6-b08f-c4cfd88c3525 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230997550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:03.217738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:03.218109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:03.218545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:03.231086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:03.231662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:03.232311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:03.310436 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f96c69b0-a616-4de6-b08f-c4cfd88c3525 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.101509 Oct 03 14:37:03.311687 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 612/1226] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:03 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:03.519924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-486f37c6-5279-47b7-b122-1ae7d97e16a4 req-df82e1cd-5eae-44a1-bdea-ded01a44404a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906e2b64-19c2-4e64-b53b-037cbbf0f202", "name": "network-vif-plugged", "status": "completed", "tag": "db205e77-fa49-4cdb-ad12-92c89e857fd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:03.544246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-486f37c6-5279-47b7-b122-1ae7d97e16a4 req-df82e1cd-5eae-44a1-bdea-ded01a44404a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:03.546220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-486f37c6-5279-47b7-b122-1ae7d97e16a4 req-df82e1cd-5eae-44a1-bdea-ded01a44404a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:03.547849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-486f37c6-5279-47b7-b122-1ae7d97e16a4 req-df82e1cd-5eae-44a1-bdea-ded01a44404a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:03.572242 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-486f37c6-5279-47b7-b122-1ae7d97e16a4 req-df82e1cd-5eae-44a1-bdea-ded01a44404a service nova] Creating event network-vif-plugged:db205e77-fa49-4cdb-ad12-92c89e857fd7 for instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 on n-h1-781139-2 Oct 03 14:37:03.597265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:03.598620 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-486f37c6-5279-47b7-b122-1ae7d97e16a4 req-df82e1cd-5eae-44a1-bdea-ded01a44404a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083207 Oct 03 14:37:03.599640 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 613/1227] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:03.607943 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c9ba0b0-63f0-4d3d-b0d8-17a93aa80150 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1470 microversion: 2.1 time: 0.428700 Oct 03 14:37:03.612347 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 615/1228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:03 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:03.874166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:03.875102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:03.888008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:03.889152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:03.890120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:03.891000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:03.891676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:03.892803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:04.328608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97ac2f4c-fa42-420f-85ac-5c43bae7398b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c418b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:04.426483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97ac2f4c-fa42-420f-85ac-5c43bae7398b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.101724 Oct 03 14:37:04.436359 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 616/1229] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:04 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:04.588046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:04.600854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:04.602789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:04.604141 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1f72fc98-7191-4a85-b398-0d67e7e4d17b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.735482 Oct 03 14:37:04.605408 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 614/1230] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:03 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:04.633237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:04.634210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:04.650508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:04.661198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:04.661850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:04.662801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:04.663440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:04.663868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:05.448618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b4f7bf7-881c-445e-a418-1b5eec17fab5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2306a6550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:05.527036 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b4f7bf7-881c-445e-a418-1b5eec17fab5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.087243 Oct 03 14:37:05.527543 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 615/1231] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:05 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:05.576223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c521f489-6ea3-461b-b0a0-cf4e1f934d66 req-ca0cfd35-6841-4d5f-8930-34b89266bb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ef74ed-5f46-4ff0-af09-071498ff108a", "name": "network-vif-unplugged", "status": "completed", "tag": "32956cd1-1afd-4280-8f68-d4ffe4f4afb7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:05.596705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c521f489-6ea3-461b-b0a0-cf4e1f934d66 req-ca0cfd35-6841-4d5f-8930-34b89266bb79 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:05.597235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c521f489-6ea3-461b-b0a0-cf4e1f934d66 req-ca0cfd35-6841-4d5f-8930-34b89266bb79 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:05.597662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c521f489-6ea3-461b-b0a0-cf4e1f934d66 req-ca0cfd35-6841-4d5f-8930-34b89266bb79 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:05.615740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:05.631049 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6de161a-08b1-48cf-92d3-22cd7c395b80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1470 microversion: 2.1 time: 1.002531 Oct 03 14:37:05.645902 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 617/1232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:04 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1470 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:05.648831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:05.656007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:05.661472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c521f489-6ea3-461b-b0a0-cf4e1f934d66 req-ca0cfd35-6841-4d5f-8930-34b89266bb79 service nova] Creating event network-vif-unplugged:32956cd1-1afd-4280-8f68-d4ffe4f4afb7 for instance c3ef74ed-5f46-4ff0-af09-071498ff108a on n-h2-781139-2 Oct 03 14:37:05.674607 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c521f489-6ea3-461b-b0a0-cf4e1f934d66 req-ca0cfd35-6841-4d5f-8930-34b89266bb79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102793 Oct 03 14:37:05.675215 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 616/1233] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:37:05.676245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:05.677361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:05.679901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:05.682075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:05.682702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:05.683458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:06.421119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:06.435681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:06.444125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:06.446937 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e980579c-29aa-458e-8e9c-6bf117f5aa49 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.811576 Oct 03 14:37:06.450984 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 618/1234] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:05 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:06.543886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da937f99-f631-47fe-90bf-603ae93b8416 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2306d1790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:06.634957 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da937f99-f631-47fe-90bf-603ae93b8416 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.095535 Oct 03 14:37:06.635661 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 617/1235] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:06 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:06.660670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:06.662032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:06.672124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:06.673120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:06.674707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:06.675701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:06.676368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:06.677043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:07.159210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:07.177009 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64d06ee7-b67d-4307-a548-ee2ef99f2aba tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1470 microversion: 2.1 time: 0.514154 Oct 03 14:37:07.178641 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 619/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:06 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1470 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:07.478337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:07.487360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:07.504340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:07.505184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:07.505612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:07.506332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:07.506783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:07.507202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:07.652174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e83a1c7-863b-408c-b7ee-4ba0e1477536 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2309d5dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:07.744090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e83a1c7-863b-408c-b7ee-4ba0e1477536 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.097044 Oct 03 14:37:07.752374 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 620/1237] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:07 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:07.766513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-827e082f-88c9-49d1-8617-64e817f56fa1 req-88494e3b-7d00-4560-8684-bdef22b7dc46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ef74ed-5f46-4ff0-af09-071498ff108a", "tag": "32956cd1-1afd-4280-8f68-d4ffe4f4afb7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:07.786865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-827e082f-88c9-49d1-8617-64e817f56fa1 req-88494e3b-7d00-4560-8684-bdef22b7dc46 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:07.789791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-827e082f-88c9-49d1-8617-64e817f56fa1 req-88494e3b-7d00-4560-8684-bdef22b7dc46 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:07.793520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-827e082f-88c9-49d1-8617-64e817f56fa1 req-88494e3b-7d00-4560-8684-bdef22b7dc46 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:07.810767 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-827e082f-88c9-49d1-8617-64e817f56fa1 req-88494e3b-7d00-4560-8684-bdef22b7dc46 service nova] Creating event network-changed:32956cd1-1afd-4280-8f68-d4ffe4f4afb7 for instance c3ef74ed-5f46-4ff0-af09-071498ff108a on n-h2-781139-2 Oct 03 14:37:07.825027 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-827e082f-88c9-49d1-8617-64e817f56fa1 req-88494e3b-7d00-4560-8684-bdef22b7dc46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071209 Oct 03 14:37:07.826091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 621/1238] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:07.907327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:07.920867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:07.925346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:07.926699 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5b10cf3-24e1-4f5f-9cbf-140771f08792 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.453409 Oct 03 14:37:07.930277 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 618/1239] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:07 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:08.202485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:08.203238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:08.215997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:08.216740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:08.217391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:08.218393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:08.219017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:08.225145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:08.528843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:08.537499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8b783b8-ffd4-4de5-8979-de9a432666a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.340106 Oct 03 14:37:08.543642 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 622/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:08 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:08.759566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f0fa2fa2-c7f8-4142-9b31-6b38880412fd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230662af0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:08.831369 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f0fa2fa2-c7f8-4142-9b31-6b38880412fd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.075496 Oct 03 14:37:08.849190 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 619/1241] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:08 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:08.955902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:08.957072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:08.966688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:08.967197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:08.967640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:08.971332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:08.974162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:08.974817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:09.562821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:09.566629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:09.588330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:09.588841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:09.589308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:09.591981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:09.592450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:09.593049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:09.895616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:09.908261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:09.910074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:09.926304 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e81db6e1-454b-45cc-9cd4-33bb60ef3811 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.974284 Oct 03 14:37:09.926919 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 623/1242] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:08 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:09.935914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c51dc80-adfc-439d-8047-943d3d5255c3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bbc160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:09.971503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:09.990444 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-16a76f82-0b20-4e17-a39d-fd185376625b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.429701 Oct 03 14:37:10.004951 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 620/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:09 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:10.031377 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c51dc80-adfc-439d-8047-943d3d5255c3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.103357 Oct 03 14:37:10.041403 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 624/1244] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:09 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:10.953078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:10.953839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:10.964729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:10.965244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:10.965679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:10.966390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:10.966838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:10.967258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:11.072801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42f94c22-ebb7-4a02-bd20-8dce3818ff83 tempest-InstanceUsageAuditLogTestJSON-1713963906 tempest-InstanceUsageAuditLogTestJSON-1713963906-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:11.104251 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42f94c22-ebb7-4a02-bd20-8dce3818ff83 tempest-InstanceUsageAuditLogTestJSON-1713963906 tempest-InstanceUsageAuditLogTestJSON-1713963906-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03 14:37:10" status: 200 len: 318 microversion: 2.1 time: 0.366450 Oct 03 14:37:11.105265 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 621/1245] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:37:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-03%2014%3A37%3A10 => generated 318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:11.111039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:11.112975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:11.119364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:11.119850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:11.120288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:11.121031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:11.121489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:11.121901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:11.281208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:11.296649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:11.299240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:11.300699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f9882e8-170b-4b67-a284-c169f48059ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.352296 Oct 03 14:37:11.323913 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 625/1246] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:10 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:37:11.341437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c44da203-ea7e-4e34-8785-6fc441598c29 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bbc280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:11.357361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:11.372166 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a2b8774-df1b-4ada-a844-b8303c526e18 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.265746 Oct 03 14:37:11.375206 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 622/1247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:11 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:11.383525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-086dd1c6-98a8-4d3a-81fa-1ab0a4a1a6a6 tempest-InstanceUsageAuditLogTestJSON-1713963906 tempest-InstanceUsageAuditLogTestJSON-1713963906-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:11.422625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-086dd1c6-98a8-4d3a-81fa-1ab0a4a1a6a6 tempest-InstanceUsageAuditLogTestJSON-1713963906 tempest-InstanceUsageAuditLogTestJSON-1713963906-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.042020 Oct 03 14:37:11.423688 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 623/1248] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 3 14:37:11 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:11.463640 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c44da203-ea7e-4e34-8785-6fc441598c29 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.138191 Oct 03 14:37:11.464232 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 626/1249] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:11 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:12.341989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:12.344750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:12.358922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:12.362817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:12.363614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:12.365148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:12.367590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:12.369811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:12.403700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:12.404450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:12.416814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:12.417364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:12.417808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:12.418551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:12.418997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:12.419420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:12.471508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:12.878923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:12.890705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ac3b1a2-d973-4f7d-8351-ad9d4eb417e7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.491315 Oct 03 14:37:12.893901 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 627/1250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:12 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:12.904669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3405d8e-b79a-4393-a70e-ccb8297f7b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2309d5280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:13.033331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:13.073189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:13.075122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:13.076840 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0979e3b0-96b7-4ca5-b709-228c8d2ec282 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.741700 Oct 03 14:37:13.088591 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 624/1251] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:12 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:13.113270 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3405d8e-b79a-4393-a70e-ccb8297f7b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.218067 Oct 03 14:37:13.116747 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 628/1252] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:12 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:13.925239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:13.925988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:13.940146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:13.943624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:13.949789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:13.952704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:13.953325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:13.954524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:14.131699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:14.142532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:14.159407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:14.165648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:14.168109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:14.169122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:14.176016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:14.178648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:14.811808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:14.824191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:14.838969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:14.840561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-039c9a25-44ca-44d2-a035-a2c752d80594 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.727889 Oct 03 14:37:14.841708 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 629/1253] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:14 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:14.848498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b579e690-3b04-48ab-8466-c156f9ef2771 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c578b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:14.944711 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b579e690-3b04-48ab-8466-c156f9ef2771 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.101662 Oct 03 14:37:14.951219 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 630/1254] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:14 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:14.982406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:15.015041 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2aaf1fe6-52e0-4793-8d3f-844b7d8d24b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 1.072185 Oct 03 14:37:15.017490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 625/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:13 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:15.873657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:15.874268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:15.890452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:15.906953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:15.908731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:15.914985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:15.915477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:15.916773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:15.967626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7aed33b9-75af-445e-abed-b04cd29334ad tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23089b5e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:16.090337 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7aed33b9-75af-445e-abed-b04cd29334ad tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.126852 Oct 03 14:37:16.092548 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 626/1256] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:15 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:16.097763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:16.098827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:16.121030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:16.126893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:16.127713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:16.130301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:16.132470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:16.134609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:16.135303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:16.636911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:16.652464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1bd3c806-4d53-475d-b460-d09716e1a960 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.552990 Oct 03 14:37:16.655554 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 627/1257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:16 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:16.675804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49f28207-2133-438d-b2c2-4d8afa4b8840"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:16.700617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:16.717246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:16.718422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:16.719536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:16.723295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:16.724009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:16.727591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:16.821565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:16.837920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:16.851338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:16.857319 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76cf27e6-30b1-4686-a1b5-6763f0acc853 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.988260 Oct 03 14:37:16.859950 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 631/1258] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:15 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:17.109205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7838bb82-6b45-4464-8ba6-9535f390cc5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c57b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:17.199047 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7838bb82-6b45-4464-8ba6-9535f390cc5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.092900 Oct 03 14:37:17.202133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 632/1259] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:17 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:17.680173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:17.680791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:17.691416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:17.691910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:17.692351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:17.693101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:17.705630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:17.706195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:17.796162 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bba5e058-148c-42bb-8805-80444224b457 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "POST /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.137991 Oct 03 14:37:17.826785 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 628/1260] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:37:16 2022] POST /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 194 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:17.889263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:17.889977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:17.922118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:17.922833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:17.923283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:17.924010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:17.924463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:17.924892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:18.566502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:18.583232 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca566a41-1b64-428c-a0b3-b30d100daaa9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.903051 Oct 03 14:37:18.601053 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 633/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:17 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:18.604563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e49b6f7a-08d0-43ec-b9e4-5abf57f2b077 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2309d53a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:18.646536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:18.670050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:18.671496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:18.672784 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5b106d69-639d-4f0a-a5a2-d96f57432bb3 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.788897 Oct 03 14:37:18.684914 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 629/1262] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:17 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:37:18.716726 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e49b6f7a-08d0-43ec-b9e4-5abf57f2b077 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.128227 Oct 03 14:37:18.718634 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 634/1263] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:18 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:19.608422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:19.609665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:19.626720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:19.629617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:19.631591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:19.638058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:19.639139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:19.640644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:19.718468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:19.719328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:19.740884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:19.741405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:19.741845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:19.751428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:19.755829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:19.756300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:20.225120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:20.242171 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-02e7e6f1-1ff8-41a3-80aa-38ef3a4c8674 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.635533 Oct 03 14:37:20.242808 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 630/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:19 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:20.273769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:20.274799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00503c8f-94ae-4519-b194-cabb6a00fb24 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23084f5e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:20.283939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:20.297881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:20.299142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7387426-98a7-47f8-be97-abcc98923a52 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.584794 Oct 03 14:37:20.305282 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 635/1265] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:19 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:37:20.427373 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00503c8f-94ae-4519-b194-cabb6a00fb24 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.177721 Oct 03 14:37:20.429215 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 631/1266] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:20 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:21.144494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57580800-d323-4bcc-af9c-cb0cb13c86d2 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Action: 'create', calling method: .version_select at 0x7fb234ccf9d0>, body: {"keypair": {"name": "tempest-keypair-568419762", "type": "ssh", "user_id": "1917b67c1baf4c5b8fda1a249a52c917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxJ1bj7sxfQ/+X84BtGuTrX3DttgBwyUsLK2fS0oxq225jJ7vyH85cibI/UCjMro92Ux8wRbVhXw/h33j1z7aHLXUmDlmRhe8T5fNXFf+XdcFDnmVtUNbfwaEmbP37qZg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:21.197326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-57580800-d323-4bcc-af9c-cb0cb13c86d2 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Getting quotas for project d3a1be057dcf480ab85b8303d283ab39. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:21.210588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-57580800-d323-4bcc-af9c-cb0cb13c86d2 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Getting quotas for user dd4a8243797d4325a439b6505b3285e2 and project d3a1be057dcf480ab85b8303d283ab39. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:21.268961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:21.270165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:21.280970 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57580800-d323-4bcc-af9c-cb0cb13c86d2 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.504129 Oct 03 14:37:21.282582 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 636/1267] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:37:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 512 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:37:21.289881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:21.297624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:21.298811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:21.304085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:21.305023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:21.305804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7398ce36-2f39-42bb-8679-123241a1fcc0 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Action: 'create', calling method: .version_select at 0x7fb234bbc310>, body: {"keypair": {"name": "tempest-keypair-373944519", "type": "ssh", "user_id": "1917b67c1baf4c5b8fda1a249a52c917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7JsjhmjsIE6XIFrwW4ltRgPT8ymhtnrDeWx446LUocieqXpWceOc9Lm8e68G7v7WUDxpbzb9nGQ2rMuKl4y6vbztvw6ttRzbfi/15SNA4D5UEH0FCiw7fysNo0UunrRw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:21.308737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:21.381639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7398ce36-2f39-42bb-8679-123241a1fcc0 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Getting quotas for project d3a1be057dcf480ab85b8303d283ab39. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:21.401334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7398ce36-2f39-42bb-8679-123241a1fcc0 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Getting quotas for user dd4a8243797d4325a439b6505b3285e2 and project d3a1be057dcf480ab85b8303d283ab39. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:21.404785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:21.499235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7398ce36-2f39-42bb-8679-123241a1fcc0 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.205975 Oct 03 14:37:21.500451 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 637/1268] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:37:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:37:21.511794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:21.512437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:21.528630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:21.530661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:21.535780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:21.536571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:21.537144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:21.537842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:21.826058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:21.844537 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2174cd61-4351-4603-9384-1b2852cde4fb tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.580053 Oct 03 14:37:21.847073 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 632/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:21 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:21.858484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0417804-6e26-4ee7-993e-f19a9436242a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230888dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:21.946068 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0417804-6e26-4ee7-993e-f19a9436242a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.097577 Oct 03 14:37:21.946869 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 633/1270] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:21 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:21.961050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3334b910-e44d-428d-a995-8fecf261c38b tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Calling method '.version_select at 0x7fb23084f5e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:21.988792 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3334b910-e44d-428d-a995-8fecf261c38b tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-568419762?user_id=1917b67c1baf4c5b8fda1a249a52c917" status: 200 len: 512 microversion: 2.10 time: 0.040608 Oct 03 14:37:21.989518 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 634/1271] 10.222.0.20 () {60 vars in 1337 bytes} [Mon Oct 3 14:37:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-568419762?user_id=1917b67c1baf4c5b8fda1a249a52c917 => generated 512 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:22.013107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25246444-7070-40fc-b84c-52e1dc1a842e tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Action: 'create', calling method: .version_select at 0x7fb2308395e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1318811546", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbCKiBwRK2/zwFtUHpcfzmdwA72AtpfKqngSyNsQq2pnY6Nnb8aDUr1JWtrhcz8q0w1i+3MlVhB41Ja8fKZ2a5xJ2ZloV7wOiONGnpfWfchXmqnLIDM6nAJURkYSMJU0g=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:22.077450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-25246444-7070-40fc-b84c-52e1dc1a842e tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Getting quotas for project d3a1be057dcf480ab85b8303d283ab39. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:22.093561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-25246444-7070-40fc-b84c-52e1dc1a842e tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Getting quotas for user dd4a8243797d4325a439b6505b3285e2 and project d3a1be057dcf480ab85b8303d283ab39. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:22.199358 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25246444-7070-40fc-b84c-52e1dc1a842e tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.199293 Oct 03 14:37:22.203955 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 635/1272] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:37:21 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 204 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:37:22.226387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5a6d14c-fc86-4ba7-aa19-8fbc040dadae tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Calling method '.version_select at 0x7fb2306665e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:22.242771 n-d-781139-2 devstack@n-api.service[128868]: WARNING oslo_db.sqlalchemy.utils [None req-d5a6d14c-fc86-4ba7-aa19-8fbc040dadae tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 14:37:22.266603 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5a6d14c-fc86-4ba7-aa19-8fbc040dadae tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=1917b67c1baf4c5b8fda1a249a52c917" status: 200 len: 724 microversion: 2.10 time: 0.056262 Oct 03 14:37:22.275283 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 636/1273] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 3 14:37:22 2022] GET /compute/v2.1/os-keypairs?user_id=1917b67c1baf4c5b8fda1a249a52c917 => generated 724 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:22.290911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e056819-0cf2-4f23-8a14-218f6ca24d6e tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Calling method '.version_select at 0x7fb2306cdb80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:22.366002 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6e056819-0cf2-4f23-8a14-218f6ca24d6e tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1318811546" status: 204 len: 0 microversion: 2.10 time: 0.086073 Oct 03 14:37:22.367259 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 637/1274] 10.222.0.20 () {60 vars in 1325 bytes} [Mon Oct 3 14:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1318811546 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:37:22.399275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72bcd68e-1373-490b-a46e-ebac573279f2 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Calling method '.version_select at 0x7fb23067d310>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:22.437223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72bcd68e-1373-490b-a46e-ebac573279f2 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-373944519?user_id=1917b67c1baf4c5b8fda1a249a52c917" status: 204 len: 0 microversion: 2.10 time: 0.063183 Oct 03 14:37:22.440195 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 638/1275] 10.222.0.20 () {60 vars in 1340 bytes} [Mon Oct 3 14:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-373944519?user_id=1917b67c1baf4c5b8fda1a249a52c917 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:37:22.458315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f222a35f-0730-468b-ad15-f5f39f8313a7 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] Calling method '.version_select at 0x7fb230697dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:22.506614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f222a35f-0730-468b-ad15-f5f39f8313a7 tempest-KeyPairsV210TestJSON-2049504665 tempest-KeyPairsV210TestJSON-2049504665-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-568419762?user_id=1917b67c1baf4c5b8fda1a249a52c917" status: 204 len: 0 microversion: 2.10 time: 0.060433 Oct 03 14:37:22.507799 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 639/1276] 10.222.0.20 () {60 vars in 1340 bytes} [Mon Oct 3 14:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-568419762?user_id=1917b67c1baf4c5b8fda1a249a52c917 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:37:22.652417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:22.674068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:22.676079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:22.679442 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2898fde-9601-4e21-ba78-9383033174ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 1.177141 Oct 03 14:37:22.685481 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 638/1277] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:21 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:22.872434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:22.873129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:22.903412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:22.943866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:22.956618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:22.966313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:22.973522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:22.991755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:23.035780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8297c45-ccd1-4908-8994-ce46aec14411 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2309f7280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:23.163898 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8297c45-ccd1-4908-8994-ce46aec14411 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.205373 Oct 03 14:37:23.165201 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 639/1278] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:22 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:23.516194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:23.522159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:23.529686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-693a9ec8-b238-40e0-97ae-6fe6a6e0b252 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1475 microversion: 2.1 time: 0.659686 Oct 03 14:37:23.530314 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 640/1279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:22 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1475 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:23.555757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1881231294", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "7be55281-ad35-4eae-94ba-a6119f0375cf"}, {"uuid": "1158316b-26fd-4b1c-b556-3a04c6f4c5b8"}, {"uuid": "7be55281-ad35-4eae-94ba-a6119f0375cf"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:23.728480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] validate_networks() for [('7be55281-ad35-4eae-94ba-a6119f0375cf', None, None, None, None, None), ('1158316b-26fd-4b1c-b556-3a04c6f4c5b8', None, None, None, None, None), ('7be55281-ad35-4eae-94ba-a6119f0375cf', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:37:24.019783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1af581d0-8fdf-4a75-be48-a3ca18d8252d tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Action: 'create', calling method: .version_select at 0x7fb230961700>, body: {"keypair": {"name": "tempest-keypair-103573507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJN94aUUecIhlf1HUzvu0iFwRnC+AgkZjEUNluvT2BRtRt/Ks5ykTcwfYO7xei+kv0Xr9Iq0kQLFzrO4o+YOflA3TgR76WioqaGZBcby59mSQBp96GRaJ9hz1h1Ok6vWlQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:24.066573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-1af581d0-8fdf-4a75-be48-a3ca18d8252d tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Getting quotas for project f36728d84c6446feabdceca993127991. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:24.076420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-1af581d0-8fdf-4a75-be48-a3ca18d8252d tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Getting quotas for user 740069ae6d7c4cb28c9314f8da05e6bc and project f36728d84c6446feabdceca993127991. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:24.175536 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1af581d0-8fdf-4a75-be48-a3ca18d8252d tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.895509 Oct 03 14:37:24.176795 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 640/1280] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:37:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:24.189170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:24.190755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:24.207077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:24.207983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:24.208654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:24.210586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:24.211799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:24.212481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:25.365206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:25.376091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:25.382223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:25.383485 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38e52900-0d0e-4646-b1cf-d2d450bd4024 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 1.205342 Oct 03 14:37:25.390449 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 641/1281] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:24 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:25.409609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86c712ef-1f0a-48ca-9de4-ca970fe70cd0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234ccf9d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:25.535242 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86c712ef-1f0a-48ca-9de4-ca970fe70cd0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.143549 Oct 03 14:37:25.536442 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 642/1282] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:25 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:25.541352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:25.550795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:25.571740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:25.572377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:25.572935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:25.576390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:25.577062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:25.577603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:26.353889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:26.367464 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de9ed354-768e-4621-89b7-2b48649c02a0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1474 microversion: 2.1 time: 0.829655 Oct 03 14:37:26.380769 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 643/1283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:25 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1474 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:26.419701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:26.420480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:26.436271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:26.438328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:26.442443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:26.443375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:26.443958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:26.444487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:27.259936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:27.279985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:27.282929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:27.290350 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8099df85-7a3f-4c32-9c14-9ff5161bd844 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1810 microversion: 2.25 time: 0.870441 Oct 03 14:37:27.291688 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 644/1284] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:26 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1810 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:37:27.307101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9cf89dd6-6c38-4a8a-a3d5-756a477c5661 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c411f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:27.421002 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9cf89dd6-6c38-4a8a-a3d5-756a477c5661 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.127849 Oct 03 14:37:27.422509 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 645/1285] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:27 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:27.437314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:27.438251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:27.465412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:27.467994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:27.468370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:27.476512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:27.478488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:27.481936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:27.788196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:27.798292 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1384e174-876e-42c4-ba08-aded239bb58a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1474 microversion: 2.1 time: 0.366021 Oct 03 14:37:27.799598 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 646/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:27 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1474 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:28.319017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:28.319989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:28.340413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:28.344757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:28.346724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:28.348020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:28.349850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:28.350750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:28.544831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:37:28.545396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:37:28.545815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:37:28.546497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:37:28.546983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:37:28.571478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:28.572013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:28.572737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:28.576431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:28.576918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:28.577379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:28.652398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Getting quotas for project c85df1411b734bcaa79e8b4cdda1fae9. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:28.675466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Getting quotas for user 7ab6b8853d4f460bb22b84d38bd8b4c6 and project c85df1411b734bcaa79e8b4cdda1fae9. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:28.722234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:37:28.727690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:37:28.774897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:28.803860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:28.813733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:28.816719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8b68b31-25ea-46f3-bafe-fc467ba51afd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1800 microversion: 2.25 time: 0.502756 Oct 03 14:37:28.831933 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 647/1287] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:28 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1800 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:28.845136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32804ab8-edc8-4e32-b21e-7d9a7cd30194 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234be9b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:28.916121 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-11cd7ae8-2390-403d-b1de-80d3ceb32fa6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.382508 Oct 03 14:37:28.917982 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 641/1288] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:37:28.928833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:28.931777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:28.954612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:28.956356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:28.957891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:28.958829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:28.960444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:28.962985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:28.996785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32804ab8-edc8-4e32-b21e-7d9a7cd30194 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.171360 Oct 03 14:37:29.005662 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 648/1289] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:28 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:29.023299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f574951f-0255-46e2-b857-6727a2c6dc41 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '.version_select at 0x7fb234be9280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:29.044791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f574951f-0255-46e2-b857-6727a2c6dc41 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:29.045467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f574951f-0255-46e2-b857-6727a2c6dc41 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:29.063444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f574951f-0255-46e2-b857-6727a2c6dc41 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:29.130819 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f574951f-0255-46e2-b857-6727a2c6dc41 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3210 microversion: 2.25 time: 0.122507 Oct 03 14:37:29.164489 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 649/1290] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 3 14:37:29 2022] GET /compute/v2.1/os-migrations => generated 3210 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:29.180161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c189bac9-835b-435a-bc27-26aad98b5671 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:29.182417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c189bac9-835b-435a-bc27-26aad98b5671 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:29.642433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c189bac9-835b-435a-bc27-26aad98b5671 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:29.659220 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c189bac9-835b-435a-bc27-26aad98b5671 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1213 microversion: 2.1 time: 0.492614 Oct 03 14:37:29.662677 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 650/1291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:29 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1213 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:29.671652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:29.681553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:29.684455 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-02dc8e93-3e04-4827-b168-a4375fd71c3b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1472 microversion: 2.1 time: 0.764697 Oct 03 14:37:29.685424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:29.688686 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 642/1292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:28 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:29.698247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-617fe55c-eb69-4cb1-a2ed-46060fb882b0 req-4824bba3-7665-4c94-bc02-7b19520da8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5d4472-5a15-4669-9f9c-abfad1afd9a8", "name": "network-vif-unplugged", "status": "completed", "tag": "6ed8a1bb-17a8-4a46-b317-c702126c5e6f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:29.705101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:29.707117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:29.707803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:29.711349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:29.713800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:29.715290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:29.719017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-617fe55c-eb69-4cb1-a2ed-46060fb882b0 req-4824bba3-7665-4c94-bc02-7b19520da8ac service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:29.719997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-617fe55c-eb69-4cb1-a2ed-46060fb882b0 req-4824bba3-7665-4c94-bc02-7b19520da8ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:29.720800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-617fe55c-eb69-4cb1-a2ed-46060fb882b0 req-4824bba3-7665-4c94-bc02-7b19520da8ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:29.737828 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-617fe55c-eb69-4cb1-a2ed-46060fb882b0 req-4824bba3-7665-4c94-bc02-7b19520da8ac service nova] Creating event network-vif-unplugged:6ed8a1bb-17a8-4a46-b317-c702126c5e6f for instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 on n-h2-781139-2 Oct 03 14:37:29.748663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-617fe55c-eb69-4cb1-a2ed-46060fb882b0 req-4824bba3-7665-4c94-bc02-7b19520da8ac service nova] Instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:37:29.758423 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-617fe55c-eb69-4cb1-a2ed-46060fb882b0 req-4824bba3-7665-4c94-bc02-7b19520da8ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067069 Oct 03 14:37:29.758855 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 643/1293] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:30.013893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76a16517-3833-4533-b7e8-be57ad013be0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23068a790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:30.106788 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76a16517-3833-4533-b7e8-be57ad013be0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.097428 Oct 03 14:37:30.107388 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 644/1294] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:30 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:30.688590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:30.690395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:30.704843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:30.705646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:30.707134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:30.710073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:30.710744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:30.712495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:30.763760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid c3ef74ed-5f46-4ff0-af09-071498ff108a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:37:30.887464 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-171d3ee4-daaf-44f3-bb2f-740fb340ce46 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 2418 microversion: 2.25 time: 1.206540 Oct 03 14:37:30.891958 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 651/1295] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:29 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 2418 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:30.914208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:30.915856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:30.960316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:30.962050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:30.962507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:30.969476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:30.975117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:30.986455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:30.994699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:31.020129 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3bd2f99-8b9e-4438-a0ff-6750816e9ab5 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1209 microversion: 2.1 time: 0.336218 Oct 03 14:37:31.053594 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 645/1296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:30 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1209 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:31.063409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:31.064047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:31.100638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.101607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.105553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:31.111289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.114708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.117607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:31.498001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid c3ef74ed-5f46-4ff0-af09-071498ff108a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:37:31.535977 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e7cd5f2-6d29-4374-9a41-fde5766b6244 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 2418 microversion: 2.25 time: 0.478101 Oct 03 14:37:31.537565 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 646/1297] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:37:31 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 2418 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:37:31.547634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f0c5e5d2-c711-4003-8de7-d751b6c60857 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230919a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:31.587286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:31.596313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8f4869b-371d-4555-8af9-45568455e95b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1469 microversion: 2.1 time: 0.702927 Oct 03 14:37:31.602996 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 652/1298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:30 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1469 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:31.633627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:31.634446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:31.662100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.662801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.667914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:31.669184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.672003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.676118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:31.677957 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f0c5e5d2-c711-4003-8de7-d751b6c60857 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.138324 Oct 03 14:37:31.678721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 647/1299] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:31 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:31.803606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:31.804834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:31.844357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.848037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.848341 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d67cb88a-6a5d-48a8-8de2-98dbfdc7ae76 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8/action" status: 204 len: 0 microversion: 2.1 time: 0.219182 Oct 03 14:37:31.849892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:31.853126 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 653/1300] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:37:31 2022] POST /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8/action => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:37:31.856225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.856712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.857176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:31.871491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:31.874897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:31.891528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.894597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.895228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:31.900310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:31.901211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:31.901800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:32.115198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lazy-loading 'services' on Instance uuid c3ef74ed-5f46-4ff0-af09-071498ff108a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:37:32.323176 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0d197ccf-bc3c-45ab-a328-fceb5dcad308 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments/7d7165c7-9071-4692-848c-e5ab50e2dba3" status: 202 len: 0 microversion: 2.25 time: 0.524129 Oct 03 14:37:32.324717 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 648/1301] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 3 14:37:31 2022] DELETE /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments/7d7165c7-9071-4692-848c-e5ab50e2dba3 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:32.342320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:32.343450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:32.373272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:32.377371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:32.378709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:32.382125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:32.387867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:32.397618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:32.807017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:32.821691 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-97bc71ef-b8f1-4947-89da-e9d6348e651d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1283 microversion: 2.1 time: 0.494514 Oct 03 14:37:32.822524 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 649/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:32 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1283 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:32.830693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:32.833516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:32.857410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:32.862046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:32.862697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:32.863626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:32.866494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:32.867156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:32.893410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:32.906135 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd6aa6ef-5e79-4870-860a-5760e9f54e15 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1469 microversion: 2.1 time: 1.046206 Oct 03 14:37:32.923453 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 654/1303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:31 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1469 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:32.928802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f58cf48-384f-4803-a81b-11fbb789c349 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2309d5280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:32.944107 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6039fd0-d65c-48fd-bf82-39d55a590c72 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120329 Oct 03 14:37:32.949274 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 650/1304] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:32 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:33.043472 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f58cf48-384f-4803-a81b-11fbb789c349 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.118387 Oct 03 14:37:33.049262 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 655/1305] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:32 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:33.525306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-282163302", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7401a17f-a5b8-4d6b-9341-4f10e6ed367e"}], "security_groups": [{"name": "tempest-securitygroup--169705831"}], "key_name": "tempest-keypair-103573507", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:33.909567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] validate_networks() for [('7401a17f-a5b8-4d6b-9341-4f10e6ed367e', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:37:34.082378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb28e735-254f-4aee-b0e8-6c999079e517 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Calling method '.version_select at 0x7fb234be9430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:34.237626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:34.287458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb28e735-254f-4aee-b0e8-6c999079e517 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7" status: 200 len: 371 microversion: 2.1 time: 0.618464 Oct 03 14:37:34.289212 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 656/1306] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:37:33 2022] GET /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7 => generated 371 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:34.309457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:34.310481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:34.349882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:34.351136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:34.353350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:34.358168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:34.360478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:34.361205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:34.412334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:34.840032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:34.850537 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbb4f0d2-c25e-4525-aa48-22b1a45ccc7b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1313 microversion: 2.1 time: 0.557583 Oct 03 14:37:34.851947 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 657/1307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:34 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:34.888725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:34.889669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:34.902600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:34.903545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:34.904223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:34.905640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:34.907814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:34.908611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.036632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Getting quotas for project f36728d84c6446feabdceca993127991. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:35.055170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Getting quotas for user 740069ae6d7c4cb28c9314f8da05e6bc and project f36728d84c6446feabdceca993127991. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:35.079372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:37:35.080118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:37:35.080747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:37:35.081456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:37:35.082066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:37:35.093864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.094607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.095200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.096126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.096757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.097513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.119271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Getting quotas for project f36728d84c6446feabdceca993127991. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:35.129694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Getting quotas for user 740069ae6d7c4cb28c9314f8da05e6bc and project f36728d84c6446feabdceca993127991. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:35.149458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:37:35.152323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:37:35.245617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:35.252611 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7e3d2e2-7e79-4bc0-a4fd-aeadf5bbb313 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.731862 Oct 03 14:37:35.257211 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 651/1308] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:37:33 2022] POST /compute/v2.1/servers => generated 408 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:37:35.260470 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67af3c0b-d379-4fd8-9c7c-fe4c4960d86b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1469 microversion: 2.1 time: 0.407156 Oct 03 14:37:35.272042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:35.282960 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 658/1309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:34 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:35.282960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4163874-c1b7-4c8b-a429-78478d239fe1 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23096fca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:35.294183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:35.303570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.304518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.305647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.306992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.307634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.308410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.362491 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4163874-c1b7-4c8b-a429-78478d239fe1 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.087847 Oct 03 14:37:35.363393 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 659/1310] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:35 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:35.379607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Action: 'update', calling method: .version_select at 0x7fb234be9430>, body: {"quota_set": {"ram": "5120"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:35.380345 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6b88e6f-038e-405b-ab5f-ebb31df43d29 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.121414 Oct 03 14:37:35.382916 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 652/1311] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:35 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:35.395617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-062be7f2-50af-4d31-b3bb-f37b710ff89a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:35.400727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-062be7f2-50af-4d31-b3bb-f37b710ff89a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:35.420554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:35.551922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.557184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.557767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.558699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.566714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.567555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.664246 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-672a691d-92e8-4e92-9c29-ba34632b59f3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7" status: 200 len: 328 microversion: 2.1 time: 0.299527 Oct 03 14:37:35.667773 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 660/1312] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:37:35 2022] PUT /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7 => generated 328 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:35.682415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe6d19ff-884b-4278-baae-ca3ef9916346 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:35.689157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-062be7f2-50af-4d31-b3bb-f37b710ff89a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:35.698337 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-062be7f2-50af-4d31-b3bb-f37b710ff89a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1276 microversion: 2.1 time: 0.311285 Oct 03 14:37:35.698931 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 653/1313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:35 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:35.707943 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe6d19ff-884b-4278-baae-ca3ef9916346 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7" status: 202 len: 0 microversion: 2.1 time: 0.029732 Oct 03 14:37:35.708758 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 661/1314] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:37:35 2022] DELETE /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:37:35.725876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-933f7857-c731-4a9c-adbf-2e1370669ffe tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Calling method '.version_select at 0x7fb2308399d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:35.882482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:35.884054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:35.936606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.937893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.942423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:35.947973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:35.953793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:35.971814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:36.014971 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-933f7857-c731-4a9c-adbf-2e1370669ffe tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7" status: 200 len: 371 microversion: 2.1 time: 0.298504 Oct 03 14:37:36.015654 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 654/1315] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:37:35 2022] GET /compute/v2.1/os-quota-sets/f55c74e2ed8e454e8a163ea10c4a83b7 => generated 371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:37:36.303231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:36.306521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:36.323266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:36.324371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:36.325596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:36.329448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:36.330365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:36.333133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:36.873764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:36.960892 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-698fce48-6172-41f6-9c7b-7131a776eb6a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1461 microversion: 2.1 time: 0.665122 Oct 03 14:37:37.024334 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 655/1316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:36 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1461 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:37.061281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d48a80af-5c64-4b3c-a366-06dca817005f tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Calling method '.version_select at 0x7fb2306a6f70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:37.104859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:37.127465 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38f5679c-f2ec-450b-9c7f-4bb649944f0e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1313 microversion: 2.1 time: 1.246821 Oct 03 14:37:37.134602 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 662/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:35 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1313 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:37.157982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61949448-7cf1-4778-a241-867371baa5d7 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bbc3a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:37.238806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61949448-7cf1-4778-a241-867371baa5d7 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.102762 Oct 03 14:37:37.239402 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 663/1318] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:37 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:37.254468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:37.261185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:37.283588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:37.286049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:37.286479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:37.290255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:37.290791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:37.291244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:37.376641 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e538118-d995-4ebb-8938-c05fb52f4890 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125801 Oct 03 14:37:37.377578 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 664/1319] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:37 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:37.387537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:37.392451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:37.406279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:37.409096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:37.412810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:37.413994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:37.415573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:37.416177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:37.553601 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d48a80af-5c64-4b3c-a366-06dca817005f tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.523140 Oct 03 14:37:37.554418 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 656/1320] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:37:37 2022] GET /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a/defaults => generated 371 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:37.587845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:37.593670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:37.605085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:37.618575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:37.619650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:37.629291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:37.630337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:37.632715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:37.877224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:37.915487 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b83aae0d-4f16-41d9-b520-9ce848fcac26 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1272 microversion: 2.1 time: 0.533624 Oct 03 14:37:37.916338 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 665/1321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:37 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1272 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:37.933792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e43b24aa-78b7-4cd0-afb7-afbe297ab859 req-fd7241d9-fabe-4a28-a75f-cf9e81c664c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5d4472-5a15-4669-9f9c-abfad1afd9a8", "name": "network-vif-plugged", "status": "completed", "tag": "6ed8a1bb-17a8-4a46-b317-c702126c5e6f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:37.964197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e43b24aa-78b7-4cd0-afb7-afbe297ab859 req-fd7241d9-fabe-4a28-a75f-cf9e81c664c2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:37.964887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e43b24aa-78b7-4cd0-afb7-afbe297ab859 req-fd7241d9-fabe-4a28-a75f-cf9e81c664c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:37.965554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e43b24aa-78b7-4cd0-afb7-afbe297ab859 req-fd7241d9-fabe-4a28-a75f-cf9e81c664c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.000355 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e43b24aa-78b7-4cd0-afb7-afbe297ab859 req-fd7241d9-fabe-4a28-a75f-cf9e81c664c2 service nova] Creating event network-vif-plugged:6ed8a1bb-17a8-4a46-b317-c702126c5e6f for instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 on n-h2-781139-2 Oct 03 14:37:38.034919 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e43b24aa-78b7-4cd0-afb7-afbe297ab859 req-fd7241d9-fabe-4a28-a75f-cf9e81c664c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116885 Oct 03 14:37:38.037461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 666/1322] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:38.060313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:38.063326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:38.090947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.091794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.092484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.093703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.094373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.095027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.243337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:38.261229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0258800c-457f-40a8-b7e2-275219997e44 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1461 microversion: 2.1 time: 0.687358 Oct 03 14:37:38.265833 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 657/1323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:37 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1461 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:38.283330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:38.284610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:38.308327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.309392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.310223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.311432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.312375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.313316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.453381 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2131f9b-0264-4d7d-b955-5e530f4dfaa5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1810 microversion: 2.1 time: 0.411790 Oct 03 14:37:38.458273 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 667/1324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:38 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1810 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:38.464740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Action: 'update', calling method: .version_select at 0x7fb2309d5280>, body: {"quota_set": {"ram": "5120"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:38.638655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.639460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.640209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.641184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.641863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.642510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.708395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13da6b1d-81b0-4f0b-a8e8-bf6b71f911bc tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522" status: 200 len: 328 microversion: 2.1 time: 0.248706 Oct 03 14:37:38.709805 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 668/1325] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:37:38 2022] PUT /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522 => generated 328 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:38.714787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33c08379-aa46-483c-a943-1a0b01bbec73 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234ccf9d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:38.754380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:38.768154 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4443a1f-cf40-46ec-ad59-58d94fe3eec2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1334 microversion: 2.1 time: 0.500594 Oct 03 14:37:38.768776 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 658/1326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:38 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1334 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:38.773598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36fba34c-a88b-4479-86c8-cc65d659bbe1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'create', calling method: .version_select at 0x7fb23068a280>, body: {"keypair": {"name": "tempest-keypair-1473765627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoCrHXXjgWTA9lS9qFnCbeIPXjCdMGste9M8nGXc/ZiZr6C/CSUNvPtFT33+p6PrfAiAceETEsl7E2Qb1CfjteQJLgkZCUAClF1/UluIJE1o1C/IL4sgaZSGy7TWOhEPA=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:38.826154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-36fba34c-a88b-4479-86c8-cc65d659bbe1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for project adcd764080de463c8416d98168a9ee94. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:38.838773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-36fba34c-a88b-4479-86c8-cc65d659bbe1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for user 7415ca24b92d4ba193b3f6762d4196b3 and project adcd764080de463c8416d98168a9ee94. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:38.866774 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33c08379-aa46-483c-a943-1a0b01bbec73 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1412 microversion: 2.1 time: 0.154749 Oct 03 14:37:38.867289 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 669/1327] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:38 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:38.893684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:38.901034 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36fba34c-a88b-4479-86c8-cc65d659bbe1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131175 Oct 03 14:37:38.904484 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 659/1328] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:37:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:38.907434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:38.915594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:38.927110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.928529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.928746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.930028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.931068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.931552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.933500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.934427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.935817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.938187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:38.938329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:38.941861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:38.997456 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fa8feff-829f-424f-9d5e-695fa8fe5293 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.091574 Oct 03 14:37:39.006556 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 660/1329] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:37:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:39.012795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Calling method '.version_select at 0x7fb23067d9d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:39.039598 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5eb109e-b96b-4733-9bcb-7a0eaa1313e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158780 Oct 03 14:37:39.040294 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 670/1330] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:38 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:39.067130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:39.067752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:39.080298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.081122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.081736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.083992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.088424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.088424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.165190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.165665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.166098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.166810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.168115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.168955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.201050 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d5198dd-5f4b-4e1f-800d-e8a660f0b49d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522/detail" status: 200 len: 916 microversion: 2.1 time: 0.192919 Oct 03 14:37:39.216684 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 661/1331] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:37:39 2022] GET /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522/detail => generated 916 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:39.362050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:39.374901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab917b8a-a16f-460d-aee1-9d59f2021c04 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1334 microversion: 2.1 time: 0.321403 Oct 03 14:37:39.386123 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 671/1332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:39 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1334 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:39.508828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Action: 'update', calling method: .version_select at 0x7fb2306a6f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:39.635669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.636239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.638439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.639381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.639841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.649780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.714325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.715228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.716862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.718506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.719331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.720099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.802780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:39.817665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:39.851436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.855107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.857512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.859295 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-491e00a3-0cd3-4d55-b190-b091dec1a0f9 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522?user_id=40e0cd3861b946d5854144408289ed35" status: 200 len: 328 microversion: 2.1 time: 0.358167 Oct 03 14:37:39.864703 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 662/1333] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:39 2022] PUT /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522?user_id=40e0cd3861b946d5854144408289ed35 => generated 328 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:39.868293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:39.868853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:39.874656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:39.879196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fdf6f5bc-71f3-4b6b-a0a9-19c770339c6d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Calling method '.version_select at 0x7fb23083ac10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:40.062840 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fdf6f5bc-71f3-4b6b-a0a9-19c770339c6d tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522?user_id=40e0cd3861b946d5854144408289ed35" status: 200 len: 370 microversion: 2.1 time: 0.189425 Oct 03 14:37:40.063761 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 663/1334] 10.222.0.20 () {58 vars in 1323 bytes} [Mon Oct 3 14:37:39 2022] GET /compute/v2.1/os-quota-sets/51eae98c727047708e166bac26d57522?user_id=40e0cd3861b946d5854144408289ed35 => generated 370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:40.069509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2f4128df-fdca-481c-858d-6249a749aecb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2306d1e50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:40.163939 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2f4128df-fdca-481c-858d-6249a749aecb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1421 microversion: 2.1 time: 0.098835 Oct 03 14:37:40.173391 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 664/1335] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:40 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1421 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:40.437952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d0687558-c44d-4220-a1a7-23a4c3659df7"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:40.443319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:40.453911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:40.459787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:40.461945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:40.463703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:40.466383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:40.467795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:40.470080 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e0031ba-3c67-41b3-a479-2c54c9f7e49c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.672056 Oct 03 14:37:40.470759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:40.473280 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 672/1336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:39 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:40.489547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:40.495659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:40.522798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:40.523371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:40.523803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:40.524554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:40.525072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:40.525502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:40.623446 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64df20f8-2699-41d9-b6b4-aaf584c9563c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.148875 Oct 03 14:37:40.632105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] HTTP exception thrown: Volume d0687558-c44d-4220-a1a7-23a4c3659df7 could not be found. Oct 03 14:37:40.636495 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 673/1337] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:40 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Request method failure captured: Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments/49f28207-2133-438d-b2c2-4d8afa4b8840 HTTP/1.1 Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 74 Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvNfOyMLJo4MC1sJccVbJGp1P8zQcHD88bthEes4TRU226AJ8TKCd4twuSz6R584URYu9pdk_8RjJLyYDvpMX1CfH9kzKBnb4wslrNP_srd-GEN6Kg4fvIB2NkoN7ytSap2BmH4knKIM8RqeFCcGO56L-wLqX8NjRfGC_6jCMWl46iw Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c503bde49e064e5d81029c39e62c0cff Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesAdminNegativeTest-215936794 Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:37:40.641206 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c503bde49e064e5d81029c39e62c0cff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c503bde49e064e5d81029c39e62c0cff", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c503bde49e064e5d81029c39e62c0cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c503bde49e064e5d81029c39e62c0cff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesAdminNegativeTest-215936794 Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c503bde49e064e5d81029c39e62c0cff Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-215936794 Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesAdminNegativeTest-215936794-project-admin Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 790822986b964728a45641b7dd173187 Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesAdminNegativeTest-215936794-project-admin Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: {"volumeAttachment": {"volumeId": "d0687558-c44d-4220-a1a7-23a4c3659df7"}} Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:37:40.642825 n-d-781139-2 devstack@n-api.service[128868]: exception: Volume d0687558-c44d-4220-a1a7-23a4c3659df7 could not be found. Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': '2ab23598-1a23-485b-ab9f-bb59994dc62b', 'id': '49f28207-2133-438d-b2c2-4d8afa4b8840', 'body': {'volumeAttachment': {'volumeId': 'd0687558-c44d-4220-a1a7-23a4c3659df7'}}} Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:37:40.643870 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0687558-c44d-4220-a1a7-23a4c3659df7 could not be found. (HTTP 404) (Request-ID: req-5b03e63f-56f1-495b-b42c-d5a5e8ad11ed) Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:37:40.645079 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0687558-c44d-4220-a1a7-23a4c3659df7 could not be found. Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:37:40.646313 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume d0687558-c44d-4220-a1a7-23a4c3659df7 could not be found. Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0687558-c44d-4220-a1a7-23a4c3659df7 could not be found. Oct 03 14:37:40.651272 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:37:40.656861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-239f0136-db12-4b3c-9ddb-baa606a95181 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bbc550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:40.659074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Returning 400 to user: Volume d0687558-c44d-4220-a1a7-23a4c3659df7 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:37:40.660608 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-528ae626-f964-442d-ad6b-01d4915f4953 tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments/49f28207-2133-438d-b2c2-4d8afa4b8840" status: 400 len: 107 microversion: 2.1 time: 0.494378 Oct 03 14:37:40.662246 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 665/1338] 10.222.0.20 () {60 vars in 1433 bytes} [Mon Oct 3 14:37:40 2022] PUT /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments/49f28207-2133-438d-b2c2-4d8afa4b8840 => generated 107 bytes in 497 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:37:40.688101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:40.688744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:40.722626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:40.730606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:40.731122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:40.731898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:40.732382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:40.732808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:40.759162 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-239f0136-db12-4b3c-9ddb-baa606a95181 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 200 len: 1421 microversion: 2.1 time: 0.121309 Oct 03 14:37:40.759602 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 674/1339] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:37:40 2022] GET /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 1421 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:40.784519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76306966-8c9b-43de-bbe6-496287a88d76 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Calling method '.version_select at 0x7fb234bbcaf0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:41.205827 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76306966-8c9b-43de-bbe6-496287a88d76 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.445127 Oct 03 14:37:41.206459 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 675/1340] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:37:40 2022] GET /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a/defaults => generated 371 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:41.219966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:41.224833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33a43b9b-eceb-48fb-92db-62f20d3b4b78 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c41d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:41.233595 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc0503b9-b1e8-4b47-a9a9-bc2d08e92458 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1401 microversion: 2.1 time: 0.570059 Oct 03 14:37:41.234866 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 666/1341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:40 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1401 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:41.260374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:41.260818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:41.275223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:41.275716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:41.276165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:41.276892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:41.277380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:41.277807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:41.477600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lazy-loading 'services' on Instance uuid 2ab23598-1a23-485b-ab9f-bb59994dc62b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:37:41.481812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:41.582550 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4986d284-9556-462e-a45f-e3f0190cf232 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments/49f28207-2133-438d-b2c2-4d8afa4b8840" status: 202 len: 0 microversion: 2.1 time: 0.334473 Oct 03 14:37:41.584962 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 667/1342] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 14:37:41 2022] DELETE /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments/49f28207-2133-438d-b2c2-4d8afa4b8840 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:37:41.600249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Action: 'update', calling method: .version_select at 0x7fb2309cbaf0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:41.745299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:41.747443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:41.747953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:41.748760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:41.750017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:41.750976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.010180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:42.146304 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb3e4a94-cf86-4423-beaf-22cde774e319 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a" status: 200 len: 329 microversion: 2.1 time: 0.560053 Oct 03 14:37:42.154433 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 668/1343] 10.222.0.20 () {60 vars in 1263 bytes} [Mon Oct 3 14:37:41 2022] PUT /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a => generated 329 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:42.154433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-01554bdf-a0bb-46fd-8da8-0a1e3b2f1039 req-ab1534e4-75bc-4469-a0bb-ddc58425d1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "tag": "e50611b3-f873-464a-80e4-0537277f70d6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:42.170926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-01554bdf-a0bb-46fd-8da8-0a1e3b2f1039 req-ab1534e4-75bc-4469-a0bb-ddc58425d1cb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.171534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-01554bdf-a0bb-46fd-8da8-0a1e3b2f1039 req-ab1534e4-75bc-4469-a0bb-ddc58425d1cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.172255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-01554bdf-a0bb-46fd-8da8-0a1e3b2f1039 req-ab1534e4-75bc-4469-a0bb-ddc58425d1cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.186360 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-01554bdf-a0bb-46fd-8da8-0a1e3b2f1039 req-ab1534e4-75bc-4469-a0bb-ddc58425d1cb service nova] Creating event network-changed:e50611b3-f873-464a-80e4-0537277f70d6 for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:37:42.192480 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-01554bdf-a0bb-46fd-8da8-0a1e3b2f1039 req-ab1534e4-75bc-4469-a0bb-ddc58425d1cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043807 Oct 03 14:37:42.193561 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 669/1344] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:42.200335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:42.201955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:42.216690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.217315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.218413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.222768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.223439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.223950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.345136 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33a43b9b-eceb-48fb-92db-62f20d3b4b78 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 204 len: 0 microversion: 2.1 time: 1.137033 Oct 03 14:37:42.346429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 676/1345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:41 2022] DELETE /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:42.352658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:42.356579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:42.365346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.366163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.366795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.368407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.369113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.369886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.418390 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-492766e2-c7ad-4d17-9b6d-7521c92922dc tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070532 Oct 03 14:37:42.424478 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 677/1346] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:42 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:42.431018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:42.433898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:42.441226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.441975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.442630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.443594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.444643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.445308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.482390 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fee6778b-dde7-4be8-8d61-9c6961645329 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056450 Oct 03 14:37:42.483659 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 678/1347] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:42 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:37:42.491404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Action: 'update', calling method: .version_select at 0x7fb234bfaca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:42.509448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:42.531625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63130e8c-e76e-4daf-af54-f0d4df3832d3 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.336725 Oct 03 14:37:42.533538 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 670/1348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:42 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:42.564027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:42.567546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:42.580249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.580784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.581198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.581906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.582353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.582774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.607752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.608245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.608758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.609546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:42.610007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:42.610444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:42.880456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=2,nova_api:UPDATE=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:43.183770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acae4551-680d-46b0-b09c-0a162b95cda3 tempest-QuotasAdminTestJSON-1473386402 tempest-QuotasAdminTestJSON-1473386402-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a" status: 200 len: 329 microversion: 2.1 time: 0.697517 Oct 03 14:37:43.184661 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 679/1349] 10.222.0.20 () {60 vars in 1263 bytes} [Mon Oct 3 14:37:42 2022] PUT /compute/v2.1/os-quota-sets/be4990040c354103bae55b50df68453a => generated 329 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:43.238574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:43.251525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:43.294944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.301033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.302096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.304328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.307628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.313267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.369416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:43.381662 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de66a415-53c8-4c8a-b102-8ca23099ec3a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1401 microversion: 2.1 time: 0.831950 Oct 03 14:37:43.382287 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 671/1350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:42 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1401 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:43.433894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:43.436586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:43.447998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:37:43.456557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.457088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.458766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.461656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.462292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.463089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.552217 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-869dced3-5e64-4537-9856-2178b2920b90 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123253 Oct 03 14:37:43.554982 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 672/1351] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:43 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:37:43.571741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "262df903-4013-448c-8e4c-ed8e47b5af0f", "device": "/dev/xvdb"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:43.579072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:43.595920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.598699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.600082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.603425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.603919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.604360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.644253 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78a9afe1-4825-4489-a6f8-33fa7966d0d5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 204 len: 0 microversion: 2.1 time: 0.456429 Oct 03 14:37:43.645418 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 680/1352] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:37:43 2022] DELETE /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:43.659851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:43.678151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:43.694787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.695804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.696679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.697913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.702416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.703130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.805915 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bea12012-5bec-421b-a7a8-f1b23f744395 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.158920 Oct 03 14:37:43.806714 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 681/1353] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:37:43 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a/os-volume_attachments => generated 25 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:43.822245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:43.824391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:43.862024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.862528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.862970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.865574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:43.868300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:43.868760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:43.875221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:44.534867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:44.548697 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcd66aae-2369-4094-a44d-6f1bbaae23e7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.732639 Oct 03 14:37:44.549966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 682/1354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:43 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:44.558889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a8dba9a4-7e18-42aa-aff6-182d5de85cab req-868244cc-9ea8-4078-9717-b37164e67a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906e2b64-19c2-4e64-b53b-037cbbf0f202", "name": "network-vif-unplugged", "status": "completed", "tag": "db205e77-fa49-4cdb-ad12-92c89e857fd7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:44.570732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a8dba9a4-7e18-42aa-aff6-182d5de85cab req-868244cc-9ea8-4078-9717-b37164e67a42 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:44.571508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a8dba9a4-7e18-42aa-aff6-182d5de85cab req-868244cc-9ea8-4078-9717-b37164e67a42 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:44.572194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a8dba9a4-7e18-42aa-aff6-182d5de85cab req-868244cc-9ea8-4078-9717-b37164e67a42 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:44.586199 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a8dba9a4-7e18-42aa-aff6-182d5de85cab req-868244cc-9ea8-4078-9717-b37164e67a42 service nova] Creating event network-vif-unplugged:db205e77-fa49-4cdb-ad12-92c89e857fd7 for instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 on n-h1-781139-2 Oct 03 14:37:44.591923 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a8dba9a4-7e18-42aa-aff6-182d5de85cab req-868244cc-9ea8-4078-9717-b37164e67a42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038511 Oct 03 14:37:44.598140 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 683/1355] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:44.605352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8540da2d-8aa0-49f3-95b7-5ce870f295ab req-dce38f1c-d681-4a9e-9d90-1383d91e72df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b94561-f82e-42a5-a65d-a72196430b24", "tag": "c5071db3-457b-4caf-8492-19d98ed16219"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:44.617681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8540da2d-8aa0-49f3-95b7-5ce870f295ab req-dce38f1c-d681-4a9e-9d90-1383d91e72df service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:44.618998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8540da2d-8aa0-49f3-95b7-5ce870f295ab req-dce38f1c-d681-4a9e-9d90-1383d91e72df service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:44.619590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8540da2d-8aa0-49f3-95b7-5ce870f295ab req-dce38f1c-d681-4a9e-9d90-1383d91e72df service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:44.641165 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8540da2d-8aa0-49f3-95b7-5ce870f295ab req-dce38f1c-d681-4a9e-9d90-1383d91e72df service nova] Creating event network-changed:c5071db3-457b-4caf-8492-19d98ed16219 for instance 58b94561-f82e-42a5-a65d-a72196430b24 on n-h2-781139-2 Oct 03 14:37:44.653293 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8540da2d-8aa0-49f3-95b7-5ce870f295ab req-dce38f1c-d681-4a9e-9d90-1383d91e72df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053162 Oct 03 14:37:44.656251 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 684/1356] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:44.684367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1367873636", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "1073fcc1-d3cc-4166-a49d-07b433f3c7e5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:44.763711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] validate_networks() for [('1073fcc1-d3cc-4166-a49d-07b433f3c7e5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:37:45.477010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2d4c0e9b-9235-44e9-8cdb-7c0b0d2acc36 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "POST /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.920335 Oct 03 14:37:45.478144 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 673/1357] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:37:43 2022] POST /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 194 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:45.487659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-9de23075-c2b9-4836-83ea-c31e9a1377ce req-aed9ede2-4bd9-4e2e-ac01-fc5e0c2cec39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "tag": "920e8756-9b64-42f1-b31e-0378fc2a09af"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:45.519158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9de23075-c2b9-4836-83ea-c31e9a1377ce req-aed9ede2-4bd9-4e2e-ac01-fc5e0c2cec39 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.522203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9de23075-c2b9-4836-83ea-c31e9a1377ce req-aed9ede2-4bd9-4e2e-ac01-fc5e0c2cec39 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.524433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9de23075-c2b9-4836-83ea-c31e9a1377ce req-aed9ede2-4bd9-4e2e-ac01-fc5e0c2cec39 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.548573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:37:45.549124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:37:45.549560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:37:45.552391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:37:45.552585 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-9de23075-c2b9-4836-83ea-c31e9a1377ce req-aed9ede2-4bd9-4e2e-ac01-fc5e0c2cec39 service nova] Creating event network-changed:920e8756-9b64-42f1-b31e-0378fc2a09af for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:37:45.552900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:37:45.557442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-9de23075-c2b9-4836-83ea-c31e9a1377ce req-aed9ede2-4bd9-4e2e-ac01-fc5e0c2cec39 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077613 Oct 03 14:37:45.558554 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 674/1358] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:45.566396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.567065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.567927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.568884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.569531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.570389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.575188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:45.576122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:45.591683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:45.598332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for user e62b7df215b144de94e02cd1e01f6f21 and project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:45.600287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.604524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.605022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.608172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.610730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.611834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.613856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:37:45.616446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:37:45.674329 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0819b06d-e5cd-46fc-9596-6c0055b538aa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016382 Oct 03 14:37:45.675708 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 685/1359] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:37:45.680983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:45.683573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:45.690934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.691653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.692395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.693299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.693932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.694652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.738542 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f79205b-c973-439b-a930-c1d6876768f8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061421 Oct 03 14:37:45.739135 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 686/1360] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:45 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:45.747864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf2dd7fe-0b4e-42d9-b9aa-4facc52d6438 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '.version_select at 0x7fb234c570d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:45.752778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2dd7fe-0b4e-42d9-b9aa-4facc52d6438 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.753318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2dd7fe-0b4e-42d9-b9aa-4facc52d6438 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.753746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf2dd7fe-0b4e-42d9-b9aa-4facc52d6438 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.767645 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf2dd7fe-0b4e-42d9-b9aa-4facc52d6438 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2722 microversion: 2.1 time: 0.027014 Oct 03 14:37:45.778612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 687/1361] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:37:45 2022] GET /compute/v2.1/os-migrations => generated 2722 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:45.786838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:45.787684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:45.794557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.795273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.795890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:45.796833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:45.797503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:45.798084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:46.074911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:46.085987 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f52969e1-cc27-420f-9c79-95f1bd0689c8 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1401 microversion: 2.1 time: 0.525907 Oct 03 14:37:46.093574 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 675/1362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:45 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1401 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:46.105842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a531a2d4-a67e-433e-8f8c-74fb0015844b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:46.114334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a531a2d4-a67e-433e-8f8c-74fb0015844b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:46.335195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a531a2d4-a67e-433e-8f8c-74fb0015844b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:46.344964 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a531a2d4-a67e-433e-8f8c-74fb0015844b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1208 microversion: 2.1 time: 0.248787 Oct 03 14:37:46.367222 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 676/1363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:46 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1208 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:46.380066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f547c083-e0e1-4d0c-ad15-3d4488e2556c tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:46.404310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f547c083-e0e1-4d0c-ad15-3d4488e2556c tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029805 Oct 03 14:37:46.414889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 677/1364] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:37:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:46.446042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a3f96ba0-468d-4fd6-8071-f25815756774 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1039115261", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:46.534017 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a3f96ba0-468d-4fd6-8071-f25815756774 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.109573 Oct 03 14:37:46.534776 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 678/1365] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Oct 3 14:37:46 2022] POST /compute/v2.1/flavors => generated 499 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:46.541192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:46.548077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ec6d5d5-baee-4620-b19e-4399e4f053de tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:46.552955 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a4bb07b-359a-4f49-b454-51d5264b4e8f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.772703 Oct 03 14:37:46.554144 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 688/1366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:45 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:46.563163 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ec6d5d5-baee-4620-b19e-4399e4f053de tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019295 Oct 03 14:37:46.563906 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 679/1367] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 3 14:37:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:37:46.753215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:46.755792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:46.774161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:46.775384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:46.776232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:46.782017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:46.782736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:46.783297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-842414133", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:46.785536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:46.890168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:37:46.903911 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f668c5d-a540-4975-bfa3-2a4b968db389 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153006 Oct 03 14:37:46.907720 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 689/1368] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:46 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:47.130015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:47.134043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:47.160821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:47.162423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:47.162868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:47.166002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:47.177503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:47.178039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:47.661813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:47.680177 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9bd73142-2ee6-4771-8406-de12147b182f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1401 microversion: 2.1 time: 0.564172 Oct 03 14:37:47.680796 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 690/1369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:47 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1401 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:47.698838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ed34b6bf-1f26-498b-be22-4da5fd4faf15 req-7395de8b-201c-46d5-b39e-363527af90f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906e2b64-19c2-4e64-b53b-037cbbf0f202", "name": "network-vif-deleted", "tag": "db205e77-fa49-4cdb-ad12-92c89e857fd7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:47.744587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed34b6bf-1f26-498b-be22-4da5fd4faf15 req-7395de8b-201c-46d5-b39e-363527af90f9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:47.745395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed34b6bf-1f26-498b-be22-4da5fd4faf15 req-7395de8b-201c-46d5-b39e-363527af90f9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:47.746941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed34b6bf-1f26-498b-be22-4da5fd4faf15 req-7395de8b-201c-46d5-b39e-363527af90f9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:47.801626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ed34b6bf-1f26-498b-be22-4da5fd4faf15 req-7395de8b-201c-46d5-b39e-363527af90f9 service nova] Creating event network-vif-deleted:db205e77-fa49-4cdb-ad12-92c89e857fd7 for instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 on n-h1-781139-2 Oct 03 14:37:47.816709 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ed34b6bf-1f26-498b-be22-4da5fd4faf15 req-7395de8b-201c-46d5-b39e-363527af90f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132835 Oct 03 14:37:47.821903 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 691/1370] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:47.847115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:47.848374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:47.866755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:47.869174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:47.870619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:47.872270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:47.874403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:47.875514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.008238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:37:48.016400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:37:48.017126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:37:48.017689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:37:48.019956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:37:48.059741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.061002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.085862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.086968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.088498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.088955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.122125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:48.132627 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b5848ee-f9a7-4142-81a1-bf49372b2a77 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1268 microversion: 2.1 time: 0.309113 Oct 03 14:37:48.148780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:48.152287 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 692/1371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:47 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1268 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:48.161509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:48.162491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:48.170629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.172654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.173811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.174862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.175588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.176228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.181302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for user 7415ca24b92d4ba193b3f6762d4196b3 and project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:48.231102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:37:48.233777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:37:48.338739 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ec41948-c4aa-47ca-9807-949a85f6d2a3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560711 Oct 03 14:37:48.339533 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 680/1372] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:37:48.347486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-15d32977-f918-4e24-9dd6-bbc1e424a4b2 req-295dda52-bd18-4013-90c0-1b8b73c3afa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "tag": "d0e82546-ec5a-4a6c-bc17-55a6f2e65b02"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:48.375810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-15d32977-f918-4e24-9dd6-bbc1e424a4b2 req-295dda52-bd18-4013-90c0-1b8b73c3afa8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.393207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-15d32977-f918-4e24-9dd6-bbc1e424a4b2 req-295dda52-bd18-4013-90c0-1b8b73c3afa8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.394407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-15d32977-f918-4e24-9dd6-bbc1e424a4b2 req-295dda52-bd18-4013-90c0-1b8b73c3afa8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.436361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:48.448687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-15d32977-f918-4e24-9dd6-bbc1e424a4b2 req-295dda52-bd18-4013-90c0-1b8b73c3afa8 service nova] Creating event network-changed:d0e82546-ec5a-4a6c-bc17-55a6f2e65b02 for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:37:48.461783 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46d8e91b-280a-43bd-ba05-436538007e79 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.305617 Oct 03 14:37:48.464460 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 693/1373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:48 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:48.470429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-15d32977-f918-4e24-9dd6-bbc1e424a4b2 req-295dda52-bd18-4013-90c0-1b8b73c3afa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129572 Oct 03 14:37:48.473223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 681/1374] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:48.485956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec3582da-6f00-4451-8eff-3bcc42d26f82 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:48.487727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ec3582da-6f00-4451-8eff-3bcc42d26f82 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:48.498466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:48.505059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:48.518102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.518606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.519032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.520008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.520618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.521078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.559712 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dbe0229-eae8-4ad6-8ebe-e4e46d66a9d1 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076545 Oct 03 14:37:48.560621 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 694/1375] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:48 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:48.656706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ec3582da-6f00-4451-8eff-3bcc42d26f82 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:48.666130 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec3582da-6f00-4451-8eff-3bcc42d26f82 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1278 microversion: 2.1 time: 0.190209 Oct 03 14:37:48.666782 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 682/1376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:48 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:48.719791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:48.720259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:48.727148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.727804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.729128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.729990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:48.730743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:48.731369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:48.935724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:48.952406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99b84213-4f03-4d4c-8298-b32989ca7aa1 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1401 microversion: 2.1 time: 0.240295 Oct 03 14:37:48.953222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 695/1377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:48 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1401 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:49.164063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:49.164755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:49.174792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f3d6ddf5-8569-4814-8a6b-03fc357bb938 req-8961c926-0db1-4eca-a7f2-04ac65c7a914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b94561-f82e-42a5-a65d-a72196430b24", "name": "network-vif-plugged", "status": "completed", "tag": "c5071db3-457b-4caf-8492-19d98ed16219"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:49.193790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.198170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3d6ddf5-8569-4814-8a6b-03fc357bb938 req-8961c926-0db1-4eca-a7f2-04ac65c7a914 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.198987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.199600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.200827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.201464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.208178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.210544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3d6ddf5-8569-4814-8a6b-03fc357bb938 req-8961c926-0db1-4eca-a7f2-04ac65c7a914 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.211178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3d6ddf5-8569-4814-8a6b-03fc357bb938 req-8961c926-0db1-4eca-a7f2-04ac65c7a914 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.266100 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f3d6ddf5-8569-4814-8a6b-03fc357bb938 req-8961c926-0db1-4eca-a7f2-04ac65c7a914 service nova] Creating event network-vif-plugged:c5071db3-457b-4caf-8492-19d98ed16219 for instance 58b94561-f82e-42a5-a65d-a72196430b24 on n-h2-781139-2 Oct 03 14:37:49.274852 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f3d6ddf5-8569-4814-8a6b-03fc357bb938 req-8961c926-0db1-4eca-a7f2-04ac65c7a914 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106936 Oct 03 14:37:49.280422 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 696/1378] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:37:49.443579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:49.453643 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-02d68223-3247-40d9-b520-d23b1973ea47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1266 microversion: 2.1 time: 0.293808 Oct 03 14:37:49.459508 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 683/1379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:49 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:49.487718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:49.488546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:49.516539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.519304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.520620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.521588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.524267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.525813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.574293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:49.577529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:49.589174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.590063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.590723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.591813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.593319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.593933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.645955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b106452d-ba22-414b-9ab6-5e7e7ad5979c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076827 Oct 03 14:37:49.647144 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 684/1380] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:49 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:37:49.703848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:49.704896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:49.711506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.713248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.720836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.721806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.722425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:49.723385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:49.900530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:49.927233 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f7f5515-79b3-42bf-95b8-7b105dd087de tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.444505 Oct 03 14:37:49.932582 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 697/1381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:49 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:49.965728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:49.976831 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07a8ee5a-a7ca-45f7-8971-b732a1f10e3d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1274 microversion: 2.1 time: 0.285559 Oct 03 14:37:49.977108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:49.977910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:49.981999 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 685/1382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:49 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:49.994225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:49.994732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:50.001031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:50.002041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:50.002550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:50.002990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:50.282711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:50.294018 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-889be18c-12d2-455e-96b5-52f00287d7d2 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1401 microversion: 2.1 time: 0.320907 Oct 03 14:37:50.312159 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 698/1383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:49 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1401 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:50.487598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:50.489340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:50.511763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:50.512590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:50.513744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:50.517970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:50.518443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:50.531352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:50.920647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1386092674", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:50.921489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:50.942296 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0f93f1d-8efb-4b3e-991a-83504d8566bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1308 microversion: 2.1 time: 0.458790 Oct 03 14:37:50.943172 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 686/1384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:50 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:50.956649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:50.959908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:50.971851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:50.973305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.011565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.012445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.018213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.021143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.091948 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ace1a7e8-0f86-48bb-8932-69db3b72edb3 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147637 Oct 03 14:37:51.094885 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 687/1385] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:50 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:51.102114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:51.106190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:51.124543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.126245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.128662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.131198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.133626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.135565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.345540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:37:51.652129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:51.661065 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa9d45f0-c219-42b2-92d7-723864719ab2 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.564824 Oct 03 14:37:51.661662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 688/1386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:51 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:51.676031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:51.677036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:51.686369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.687293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.687983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.688950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.689636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.690286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.761631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:37:51.763589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:37:51.764291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:37:51.765104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:37:51.765856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:37:51.777730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=73 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:51.780435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.781534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.782251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.783658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.784299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.784897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.793571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:51.803637 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e5a308a-e58d-4e88-b2b4-0e772dfe4ae2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1338 microversion: 2.1 time: 0.131506 Oct 03 14:37:51.804245 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 689/1387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:51 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:51.821871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:51.822944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:51.828330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Getting quotas for project 58652a1d00b6495889e5f3f3bdc5135f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:51.833731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.834210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.834656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.835372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:51.835835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:51.836263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:51.838962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Getting quotas for user 25594ab5f62f44c2a0de8754f120b169 and project 58652a1d00b6495889e5f3f3bdc5135f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:51.882017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:37:51.884379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:37:51.897041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=8,nova_api:INSERT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:51.940757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c85d4c71-4836-421b-b080-982e0abfc39f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351984 Oct 03 14:37:51.942612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 699/1388] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:37:51.970415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac94bee4-be3c-4165-b224-a5747261078d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:51.971596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac94bee4-be3c-4165-b224-a5747261078d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:52.062800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac94bee4-be3c-4165-b224-a5747261078d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:52.074081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac94bee4-be3c-4165-b224-a5747261078d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1223 microversion: 2.1 time: 0.123914 Oct 03 14:37:52.074696 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 700/1389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:51 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:52.089548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:52.090169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:52.102301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.102806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.103466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.104193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.104912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.105541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.182928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:52.204245 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2143422c-472b-4251-91ce-03a720300978 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1589 microversion: 2.1 time: 0.395646 Oct 03 14:37:52.204893 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 690/1390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:51 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1589 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:52.212507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:52.217028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:52.240357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.244179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.246745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.249005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.252332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.255708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.274457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:52.284705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f48c78f-1f3d-46fb-be33-69cc49d72a5f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1308 microversion: 2.1 time: 0.203733 Oct 03 14:37:52.292581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:52.298316 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 701/1391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:52 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:52.308805 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac225a79-de91-412b-aeb9-0374c255a616 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102536 Oct 03 14:37:52.309268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:52.310250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:52.310787 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 691/1392] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:37:52 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:37:52.335542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.336043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.336484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.337230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.337683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.338106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.488411 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47ec3656-6f80-47b9-bd9c-557c69e0e98f tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188518 Oct 03 14:37:52.497893 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 702/1393] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:37:52 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:52.637418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1089483645", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c51dc43f-a678-400c-ac70-0fe299e232d0"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:52.693519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:52.694225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:52.707025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.708075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.708766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.714368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:52.722305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:52.725506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:52.804123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] validate_networks() for [('c51dc43f-a678-400c-ac70-0fe299e232d0', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:37:53.203077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:53.227253 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9076712f-0199-49de-91cc-4c89abe606aa tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.538798 Oct 03 14:37:53.231391 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 703/1394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:52 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:53.252845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6e46e0e9-80c6-491f-aeef-b26abf5f6137 req-4ebae098-9513-4aad-b09b-6ebebe4dd4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4388889a-755e-4663-b75c-84220b9d8fb1", "tag": "26221873-2abe-488a-ad63-83dfa6fedeee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:53.282032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6e46e0e9-80c6-491f-aeef-b26abf5f6137 req-4ebae098-9513-4aad-b09b-6ebebe4dd4e8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:53.285098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6e46e0e9-80c6-491f-aeef-b26abf5f6137 req-4ebae098-9513-4aad-b09b-6ebebe4dd4e8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:53.292215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6e46e0e9-80c6-491f-aeef-b26abf5f6137 req-4ebae098-9513-4aad-b09b-6ebebe4dd4e8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:53.320970 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6e46e0e9-80c6-491f-aeef-b26abf5f6137 req-4ebae098-9513-4aad-b09b-6ebebe4dd4e8 service nova] Creating event network-changed:26221873-2abe-488a-ad63-83dfa6fedeee for instance 4388889a-755e-4663-b75c-84220b9d8fb1 on n-h2-781139-2 Oct 03 14:37:53.331474 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6e46e0e9-80c6-491f-aeef-b26abf5f6137 req-4ebae098-9513-4aad-b09b-6ebebe4dd4e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098314 Oct 03 14:37:53.332971 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 704/1395] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:53.341106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:53.343260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:53.354848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:53.355726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:53.356813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:53.357761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:53.359008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:53.361037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:53.387323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:54.191278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:54.210266 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6927d2a-7e80-4a32-b9c2-625238cf28c0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1338 microversion: 2.1 time: 0.875670 Oct 03 14:37:54.218434 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 705/1396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:53 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1338 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:54.229586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:54.234039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:54.252854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.256169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.257662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:54.263884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.265726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.267416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:54.386378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:37:54.386947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:37:54.387520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:37:54.388288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:37:54.388700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:37:54.394689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=91 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:54.405322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.406086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.412103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:54.413138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.413755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.414351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:54.458293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Getting quotas for project 86217b1343254b55bf90b9240aba1332. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:37:54.469229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Getting quotas for user ce74b5279d524df88e5e84b20b920261 and project 86217b1343254b55bf90b9240aba1332. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:37:54.505110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:37:54.508289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:37:54.564160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:54.574197 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b30dee9f-5ddb-4f49-b34f-b2c8eadb279e tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1275 microversion: 2.1 time: 0.354238 Oct 03 14:37:54.575029 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 706/1397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:54 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1275 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:54.584632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:54.589927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:54.601018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.601521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.601949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:54.602658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.603149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.603515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:54.638943 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8989c8c9-9958-4c75-a4b6-5ef40a70c894 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.010151 Oct 03 14:37:54.649691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 692/1398] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:37:54.667260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:54.668365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:54.687956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.688724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.689403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:54.690285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:54.691052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:54.691639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:55.075327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:55.088500 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e3d0d57-021e-498f-8f97-2044400eb465 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1308 microversion: 2.1 time: 0.504959 Oct 03 14:37:55.095893 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 707/1399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:54 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:55.105149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a4e4c67-bf77-4b2d-8405-b01907d4d074 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:55.105758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a4e4c67-bf77-4b2d-8405-b01907d4d074 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:55.272197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:55.287534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4bf86592-ddf6-4b9d-a1bd-9994b028f340 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.634701 Oct 03 14:37:55.291538 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 693/1400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:54 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:55.305494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:55.309505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:55.333543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:55.335119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:55.338691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:55.344107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:55.345788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:55.350390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:55.436748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a4e4c67-bf77-4b2d-8405-b01907d4d074 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:55.447400 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a4e4c67-bf77-4b2d-8405-b01907d4d074 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1218 microversion: 2.1 time: 0.349847 Oct 03 14:37:55.465812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 708/1401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:55 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1218 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:55.607435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:55.608825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:55.622951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:55.623807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:55.624596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:55.629061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:55.629809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:55.630461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:55.840977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:55.851781 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3931d093-f99c-4fce-a83a-91f1b5e276fd tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1281 microversion: 2.1 time: 0.249721 Oct 03 14:37:55.858211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 709/1402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:55 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1281 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:56.050989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:56.060069 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-596388a3-7f2c-49af-b2c4-1ceed728d4c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1336 microversion: 2.1 time: 0.766386 Oct 03 14:37:56.076369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 694/1403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:55 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1336 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:56.119774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:56.120396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:56.146581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.157157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.157630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:56.158400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.158857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.165262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:56.320124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:56.320516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:56.329248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.330060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.330176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:56.330840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.331330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.342181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:56.753088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:56.761400 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-583595dd-9b49-4dbf-9ea2-c8510fc55cd3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1308 microversion: 2.1 time: 0.653940 Oct 03 14:37:56.770977 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 710/1404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:56 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:56.781469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:56.789999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:56.811422 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6a18f9d3-cafd-40d3-9bef-c33fe67f7bb6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.495251 Oct 03 14:37:56.813000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:56.830013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 695/1405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:56 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:56.840697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.862391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.863205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:56.864105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.864676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.865227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:56.880246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:56.881105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:56.884177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:56.893928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.894690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.895332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:56.896224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:56.900958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:56.901430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:57.225301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:57.243965 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b9b5e5a-6a6b-4518-a77e-41ced5f42119 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1278 microversion: 2.1 time: 0.471255 Oct 03 14:37:57.244903 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 711/1406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:56 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1278 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:57.257346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:57.257994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:57.274457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:57.274955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:57.275401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:57.276119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:57.276584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:57.277033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:57.350836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:57.366053 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59d35aad-c723-443b-a48a-7d117eff1098 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1281 microversion: 2.1 time: 0.490115 Oct 03 14:37:57.368950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 696/1407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:56 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1281 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:57.693679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:57.695699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:57.713733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:57.715402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:57.716643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:57.719470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:57.720200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:57.722184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:57.910772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:57.927861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce3f2991-7334-44e9-9905-25ea0abbd415 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.680364 Oct 03 14:37:57.945011 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 712/1408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:57 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:57.951268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4fa4ad06-1089-4114-8eed-1535c0e2a8ce req-c360d0ea-2856-4b08-ad2b-8d42bacebcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b94561-f82e-42a5-a65d-a72196430b24", "tag": "c5071db3-457b-4caf-8492-19d98ed16219"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:58.014554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4fa4ad06-1089-4114-8eed-1535c0e2a8ce req-c360d0ea-2856-4b08-ad2b-8d42bacebcb8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:58.015449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4fa4ad06-1089-4114-8eed-1535c0e2a8ce req-c360d0ea-2856-4b08-ad2b-8d42bacebcb8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:58.026678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4fa4ad06-1089-4114-8eed-1535c0e2a8ce req-c360d0ea-2856-4b08-ad2b-8d42bacebcb8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:58.062525 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4fa4ad06-1089-4114-8eed-1535c0e2a8ce req-c360d0ea-2856-4b08-ad2b-8d42bacebcb8 service nova] Creating event network-changed:c5071db3-457b-4caf-8492-19d98ed16219 for instance 58b94561-f82e-42a5-a65d-a72196430b24 on n-h2-781139-2 Oct 03 14:37:58.096747 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4fa4ad06-1089-4114-8eed-1535c0e2a8ce req-c360d0ea-2856-4b08-ad2b-8d42bacebcb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158464 Oct 03 14:37:58.100123 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 713/1409] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:58.113205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:58.113935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:58.135764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:58.151055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:58.153604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:58.156300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:58.158246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:58.160551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:58.530385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:58.547890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7aa7047a-3162-4003-ad78-a70098b2695a tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1589 microversion: 2.1 time: 0.859466 Oct 03 14:37:58.552881 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 697/1410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:57 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1589 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:58.566865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:58.570541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:58.621419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:58.633387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:58.634935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:58.636258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:58.639607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:58.641281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:58.723030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:58.731599 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9234da7-34a2-4af9-873a-e1ce7273108d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1308 microversion: 2.1 time: 0.630160 Oct 03 14:37:58.736016 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 714/1411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:58 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1308 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:58.746736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:58.747392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:58.762042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:58.762567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:58.765623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:58.766473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:58.766954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:58.769098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:59.441976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:59.454759 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45d22d54-673b-4151-b6a8-47b6d829808a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.900378 Oct 03 14:37:59.468969 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 698/1412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:58 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:59.468969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:59.473485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:59.491651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:59.492157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:59.492598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:59.493416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:59.493878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:59.494310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:59.573986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:59.590742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47b83124-4773-46ce-984c-b2f9cb62fcb6 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1276 microversion: 2.1 time: 0.850069 Oct 03 14:37:59.606532 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 715/1413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:58 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1276 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:59.621101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:59.622228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:59.629593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:59.630580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:59.631405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:59.632293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:59.633241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:59.633824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:59.736863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:37:59.750101 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-81e5165d-2036-4d25-81d8-330f84c321ef tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1281 microversion: 2.1 time: 0.292452 Oct 03 14:37:59.753707 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 699/1414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:59 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:37:59.764613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-19c83261-109d-44fe-8b1a-b73881e6f3ca req-be7715a4-5d83-489f-bec0-079a85898336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31e21b53-e336-4990-b573-9cced61076bc", "tag": "0441cd47-154d-4303-8bbd-2ec0d338c773"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:37:59.793784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-19c83261-109d-44fe-8b1a-b73881e6f3ca req-be7715a4-5d83-489f-bec0-079a85898336 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:59.794832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-19c83261-109d-44fe-8b1a-b73881e6f3ca req-be7715a4-5d83-489f-bec0-079a85898336 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:59.796739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-19c83261-109d-44fe-8b1a-b73881e6f3ca req-be7715a4-5d83-489f-bec0-079a85898336 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:59.812164 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-19c83261-109d-44fe-8b1a-b73881e6f3ca req-be7715a4-5d83-489f-bec0-079a85898336 service nova] Creating event network-changed:0441cd47-154d-4303-8bbd-2ec0d338c773 for instance 31e21b53-e336-4990-b573-9cced61076bc on n-h1-781139-2 Oct 03 14:37:59.820678 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-19c83261-109d-44fe-8b1a-b73881e6f3ca req-be7715a4-5d83-489f-bec0-079a85898336 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064308 Oct 03 14:37:59.822003 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 700/1415] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:37:59.831043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:37:59.831890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:37:59.846313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:59.847734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:59.848863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:37:59.850727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:37:59.851442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:37:59.852097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:00.187755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:00.198624 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a680e119-02bd-42ec-b073-3c8e3cc197cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1308 microversion: 2.1 time: 0.375143 Oct 03 14:38:00.215457 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 701/1416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:59 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:00.225179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7534afb8-2cad-4ddb-aad4-e70595d87b0f req-deba84be-5dbf-4634-86b1-7da9d64398d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388889a-755e-4663-b75c-84220b9d8fb1", "name": "network-vif-plugged", "status": "completed", "tag": "26221873-2abe-488a-ad63-83dfa6fedeee"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:00.236402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7534afb8-2cad-4ddb-aad4-e70595d87b0f req-deba84be-5dbf-4634-86b1-7da9d64398d5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:00.237436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7534afb8-2cad-4ddb-aad4-e70595d87b0f req-deba84be-5dbf-4634-86b1-7da9d64398d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:00.238987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7534afb8-2cad-4ddb-aad4-e70595d87b0f req-deba84be-5dbf-4634-86b1-7da9d64398d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:00.252705 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7534afb8-2cad-4ddb-aad4-e70595d87b0f req-deba84be-5dbf-4634-86b1-7da9d64398d5 service nova] Creating event network-vif-plugged:26221873-2abe-488a-ad63-83dfa6fedeee for instance 4388889a-755e-4663-b75c-84220b9d8fb1 on n-h2-781139-2 Oct 03 14:38:00.258751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7534afb8-2cad-4ddb-aad4-e70595d87b0f req-deba84be-5dbf-4634-86b1-7da9d64398d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042353 Oct 03 14:38:00.259846 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 702/1417] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:00.311879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:00.324954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5dd3c719-6622-420d-8755-8354f153fbf3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.710363 Oct 03 14:38:00.326327 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 716/1418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:37:59 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:00.480625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:00.481545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:00.497693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:00.497961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:00.498400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:00.499337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:00.499798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:00.500401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:00.619934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:00.620543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:00.629629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:00.634014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:00.634729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:00.636309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:00.638166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:00.640029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:00.991880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:01.002214 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b76ec66a-f487-4063-9f80-726b8062f6ee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.526074 Oct 03 14:38:01.003533 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 703/1419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:00 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:01.009290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:01.010089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:01.019617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:01.020104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:01.020534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:01.021276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:01.021720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:01.022135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:01.078315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:01.086781 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bba1da58-4fa8-4413-a3a7-cb76b87db7b4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.471074 Oct 03 14:38:01.088428 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 717/1420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:00 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:01.209982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:01.224027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:01.224566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:01.227595 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ec06726-4f30-4756-aa7d-f4dde3801d2b tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.222649 Oct 03 14:38:01.228737 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 704/1421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:01 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:01.233184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:01.233661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:01.234127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:01.234793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:01.235298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:01.235726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:01.350524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:01.351129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:01.369065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:01.372046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:01.372982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:01.374327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:01.374997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:01.375596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:01.534981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:01.544762 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb1ea5bb-821f-4129-aba6-ccbaa5a148b9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.199232 Oct 03 14:38:01.546278 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 705/1422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:01 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:01.576086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:01.584756 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcb43124-8eac-49e6-b636-aa9cb716fbf0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1308 microversion: 2.1 time: 0.365278 Oct 03 14:38:01.585689 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 718/1423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:01 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:02.029743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:02.030619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:02.042353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.043101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.043874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.049330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.049864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.050302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.115114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:02.117912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:02.121749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.129278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.137399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.138415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.142439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.143317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.143790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.287082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:02.298826 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-60834010-27fa-48d0-8739-2bfd38a65d04 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.273107 Oct 03 14:38:02.303393 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 706/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:02 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:02.308436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:02.309504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:02.316292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.317285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.318174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.319284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.319893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.320461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.483969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:02.491480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:02.500297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ace682c4-9669-4661-9b82-88ffb822932d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.394670 Oct 03 14:38:02.503118 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 719/1425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:02 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:02.507886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b3f7b559-ef19-47c0-9ab2-1371fcd96794 req-475e592f-c949-4456-bb5a-bcef41e32db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da28c37-a7dd-41d0-9a85-c6f9d89cca56", "tag": "10a43a3f-fcad-4fca-8c64-38090f40a607"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:02.514815 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d8b26f86-7203-47b3-8a94-99be8b0a1b7c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.209959 Oct 03 14:38:02.529793 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 707/1426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:02 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:02.539428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3f7b559-ef19-47c0-9ab2-1371fcd96794 req-475e592f-c949-4456-bb5a-bcef41e32db6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.540378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3f7b559-ef19-47c0-9ab2-1371fcd96794 req-475e592f-c949-4456-bb5a-bcef41e32db6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.541060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3f7b559-ef19-47c0-9ab2-1371fcd96794 req-475e592f-c949-4456-bb5a-bcef41e32db6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.554921 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b3f7b559-ef19-47c0-9ab2-1371fcd96794 req-475e592f-c949-4456-bb5a-bcef41e32db6 service nova] Creating event network-changed:10a43a3f-fcad-4fca-8c64-38090f40a607 for instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 on n-h2-781139-2 Oct 03 14:38:02.569164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:02.570010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:02.573136 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b3f7b559-ef19-47c0-9ab2-1371fcd96794 req-475e592f-c949-4456-bb5a-bcef41e32db6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068428 Oct 03 14:38:02.574132 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 720/1427] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:02.579398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.579884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.580331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.581064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.581684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.582113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.615276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:02.616611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:02.625907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.626379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.626943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.627807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.628258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.628709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.733588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:02.747848 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d88af12-bec2-4df8-9ce1-aa638f5ae4f9 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.181399 Oct 03 14:38:02.747848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 708/1428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:02 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:02.929352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-16e9e01a-7451-4fa2-8034-eb8f87b0a3df req-d90294a5-dc96-4247-8f1e-86e4ebb0441c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "name": "network-vif-plugged", "status": "completed", "tag": "e50611b3-f873-464a-80e4-0537277f70d6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:02.943416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-16e9e01a-7451-4fa2-8034-eb8f87b0a3df req-d90294a5-dc96-4247-8f1e-86e4ebb0441c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:02.943905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-16e9e01a-7451-4fa2-8034-eb8f87b0a3df req-d90294a5-dc96-4247-8f1e-86e4ebb0441c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:02.944979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-16e9e01a-7451-4fa2-8034-eb8f87b0a3df req-d90294a5-dc96-4247-8f1e-86e4ebb0441c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:02.963978 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-16e9e01a-7451-4fa2-8034-eb8f87b0a3df req-d90294a5-dc96-4247-8f1e-86e4ebb0441c service nova] Creating event network-vif-plugged:e50611b3-f873-464a-80e4-0537277f70d6 for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:38:02.973013 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-16e9e01a-7451-4fa2-8034-eb8f87b0a3df req-d90294a5-dc96-4247-8f1e-86e4ebb0441c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048021 Oct 03 14:38:02.974801 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 709/1429] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:03.327346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:03.328351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:03.337315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.338367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.339102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.340186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.340977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.341648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.357338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:03.369905 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c8e45d0-5e30-466b-a76e-b4906cb0fdce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1488 microversion: 2.1 time: 0.761636 Oct 03 14:38:03.373959 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 721/1430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:02 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1488 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:03.384075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.399466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36a452ea-050b-4ab9-b005-468dfb7a2c7e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:03.409095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36a452ea-050b-4ab9-b005-468dfb7a2c7e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.409589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36a452ea-050b-4ab9-b005-468dfb7a2c7e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.410022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36a452ea-050b-4ab9-b005-468dfb7a2c7e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.501566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36a452ea-050b-4ab9-b005-468dfb7a2c7e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:38:03.601503 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36a452ea-050b-4ab9-b005-468dfb7a2c7e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.203415 Oct 03 14:38:03.610592 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 722/1431] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:38:03 2022] POST /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:03.618369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:03.619680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:03.630470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.631042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.631550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.632451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.633167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.633665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.659718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.789679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:03.804036 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fff1f626-f699-4910-afdf-0d86818ce1bf tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.481492 Oct 03 14:38:03.825118 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 710/1432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:03 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:03.829465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:03.830458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:03.847710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.848131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.848675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.850178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.851913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.853469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.878551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:03.888336 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba787b43-91f1-4f42-a69d-4b2fb9c6548f tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.274340 Oct 03 14:38:03.888336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 723/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:03 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:03.896235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:03.896851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:03.910400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.910890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.911334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:03.912136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:03.912765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:03.913207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:04.067502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:04.076842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-281ae94c-28df-45c4-b7b9-572e6347072c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.188807 Oct 03 14:38:04.077751 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 724/1434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:03 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:04.084049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:04.084945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:04.092757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:04.093576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:04.094250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:04.095025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:04.095545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:04.096043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:04.154563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:04.165942 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2f78e87b-980d-4a74-8d74-6d267c727cc6 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.346773 Oct 03 14:38:04.167833 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 711/1435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:03 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:04.249935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:04.258911 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43d464a6-7d40-49cf-aec8-7bdeb1154549 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.179876 Oct 03 14:38:04.259500 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 725/1436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:04 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:04.592734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=19 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:04.593737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:04.677195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a73df6f6-5463-4dc4-a41f-314f8fc56c36 req-a8f42892-91bd-4c8b-9161-29ff376d7fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637082d0-3db6-40a4-a5b7-476769dfac46", "tag": "dbd4e369-fc08-4be0-992b-e780a84e5482"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:04.699768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a73df6f6-5463-4dc4-a41f-314f8fc56c36 req-a8f42892-91bd-4c8b-9161-29ff376d7fae service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:04.700543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a73df6f6-5463-4dc4-a41f-314f8fc56c36 req-a8f42892-91bd-4c8b-9161-29ff376d7fae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:04.701505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a73df6f6-5463-4dc4-a41f-314f8fc56c36 req-a8f42892-91bd-4c8b-9161-29ff376d7fae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:04.717779 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a73df6f6-5463-4dc4-a41f-314f8fc56c36 req-a8f42892-91bd-4c8b-9161-29ff376d7fae service nova] Creating event network-changed:dbd4e369-fc08-4be0-992b-e780a84e5482 for instance 637082d0-3db6-40a4-a5b7-476769dfac46 on n-h2-781139-2 Oct 03 14:38:04.724724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a73df6f6-5463-4dc4-a41f-314f8fc56c36 req-a8f42892-91bd-4c8b-9161-29ff376d7fae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137996 Oct 03 14:38:04.726360 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 712/1437] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:04.835203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:04.836250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:04.850025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:04.851776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:04.853380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:04.860342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:04.861002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:04.861540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:04.924486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:04.926741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:04.947328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:04.948968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:04.962417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:04.963615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:04.964204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:04.967450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.168253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:05.180617 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cac943b-53a6-4b94-85ff-935c3c017f8e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.350090 Oct 03 14:38:05.183104 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 726/1438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:04 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:05.188186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:05.189125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:05.195887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.196633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.197264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.198218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.199008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.200333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.209644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:05.220128 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76b21b78-a1bf-41a5-a6df-97767e5c1e8c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.310568 Oct 03 14:38:05.221823 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 713/1439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:04 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:05.226946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-cd52c8b2-b95b-4279-9925-36fc09117e1c req-9368c6a7-3c7c-45a4-99e7-f5881408c5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "name": "network-vif-plugged", "status": "completed", "tag": "d0e82546-ec5a-4a6c-bc17-55a6f2e65b02"}, {"server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "name": "network-vif-plugged", "status": "completed", "tag": "920e8756-9b64-42f1-b31e-0378fc2a09af"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:05.240035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cd52c8b2-b95b-4279-9925-36fc09117e1c req-9368c6a7-3c7c-45a4-99e7-f5881408c5c9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.240778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cd52c8b2-b95b-4279-9925-36fc09117e1c req-9368c6a7-3c7c-45a4-99e7-f5881408c5c9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.241502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cd52c8b2-b95b-4279-9925-36fc09117e1c req-9368c6a7-3c7c-45a4-99e7-f5881408c5c9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.378351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:05.388093 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a09acd3b-b5e4-4ccd-bdc3-798c42d556be tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.203343 Oct 03 14:38:05.389308 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 727/1440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:05 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:05.396837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:05.397865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:05.409414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.409914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.410532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.411079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.411634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.412115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.440952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=9 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:05.495973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-cd52c8b2-b95b-4279-9925-36fc09117e1c req-9368c6a7-3c7c-45a4-99e7-f5881408c5c9 service nova] Creating event network-vif-plugged:d0e82546-ec5a-4a6c-bc17-55a6f2e65b02 for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:38:05.496741 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-cd52c8b2-b95b-4279-9925-36fc09117e1c req-9368c6a7-3c7c-45a4-99e7-f5881408c5c9 service nova] Creating event network-vif-plugged:920e8756-9b64-42f1-b31e-0378fc2a09af for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:38:05.502714 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-cd52c8b2-b95b-4279-9925-36fc09117e1c req-9368c6a7-3c7c-45a4-99e7-f5881408c5c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.279480 Oct 03 14:38:05.503653 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 714/1441] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:05.508856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:05.509608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:05.516342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.516848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.517315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.518017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.518470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.518895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.568621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:05.576842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1e960d4-3f5f-4f14-ac17-cd341a1eff8d tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.186105 Oct 03 14:38:05.578082 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 728/1442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:05 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:05.692133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:05.701696 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2dd7c101-af97-4b89-a992-2b486dcc96d7 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.196693 Oct 03 14:38:05.702350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 715/1443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:05 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:05.901097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:05.901715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:05.908631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.909225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.909593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:05.910397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:05.910882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:05.911344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.136896 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec650d2e-7845-4acf-99ab-2c3834b86b9e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1856 microversion: 2.1 time: 0.239626 Oct 03 14:38:06.138298 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 729/1444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:05 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1856 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:06.160459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-781139-2", "block_migration": true, "disk_over_commit": false}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:06.163529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:06.170817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.171130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.174180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.175214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.175852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.176485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.203696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:06.204743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:06.220301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.220875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.222632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.223378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.223842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.224476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.227001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lazy-loading 'flavor' on Instance uuid 1cf0cae3-a215-4491-bcc9-6ce278351274 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:06.241477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Going to try to live migrate instance to n-h2-781139-2 {{(pid=128868) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:38:06.524035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:06.532655 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3921ef7b-9016-4260-9a0b-32c00d364196 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1355 microversion: 2.1 time: 0.332785 Oct 03 14:38:06.546654 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 730/1445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:06 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1355 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:06.555418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:06.556642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:06.563112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.563912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.564566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.565632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.566422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.567168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.828969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:06.841078 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2521f84-0eca-40ca-9528-494d628cdbc5 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.292419 Oct 03 14:38:06.842154 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 731/1446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:06 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:06.849010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:06.849365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:06.868673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.871403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.875807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:06.876715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:06.878147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:06.878839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.119982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:07.128947 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2b7a22e-8756-4d20-a23b-9a2a1e77af17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.285113 Oct 03 14:38:07.130211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 732/1447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:06 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:07.136609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:07.137156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:07.144519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.145401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.146015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.146899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.147507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.148099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.398741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:07.409408 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d457fff-dcc0-4b43-9cdc-07be074d9df8 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.277941 Oct 03 14:38:07.424733 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 733/1448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:07 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:07.429970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:07.432372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:07.439973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.440702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.441332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.442181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.442779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.443448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.739238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:07.753662 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-933c4147-ca84-400f-bd40-abf131ca7183 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.327193 Oct 03 14:38:07.755621 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 734/1449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:07 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:07.771812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:07.772510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:07.779310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.779978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.780602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.781410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.781934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.782422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.823718 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e983964-ca65-4871-95d3-1de620a396ee tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/action" status: 202 len: 0 microversion: 2.1 time: 1.666922 Oct 03 14:38:07.825216 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 716/1450] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:38:06 2022] POST /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/action => generated 0 bytes in 1669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:07.830577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-aa1da52b-da51-430d-b29c-c7e3cf26249d req-1efe417a-4f96-429c-9fab-e9f45d356b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e21b53-e336-4990-b573-9cced61076bc", "name": "network-vif-plugged", "status": "completed", "tag": "0441cd47-154d-4303-8bbd-2ec0d338c773"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:07.848202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa1da52b-da51-430d-b29c-c7e3cf26249d req-1efe417a-4f96-429c-9fab-e9f45d356b16 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.849552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa1da52b-da51-430d-b29c-c7e3cf26249d req-1efe417a-4f96-429c-9fab-e9f45d356b16 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.850755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa1da52b-da51-430d-b29c-c7e3cf26249d req-1efe417a-4f96-429c-9fab-e9f45d356b16 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.868423 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-aa1da52b-da51-430d-b29c-c7e3cf26249d req-1efe417a-4f96-429c-9fab-e9f45d356b16 service nova] Creating event network-vif-plugged:0441cd47-154d-4303-8bbd-2ec0d338c773 for instance 31e21b53-e336-4990-b573-9cced61076bc on n-h1-781139-2 Oct 03 14:38:07.875772 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-aa1da52b-da51-430d-b29c-c7e3cf26249d req-1efe417a-4f96-429c-9fab-e9f45d356b16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048785 Oct 03 14:38:07.876644 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 717/1451] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:07.884198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:07.885310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:07.894960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.895865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.896475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.898016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:07.898631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:07.899983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:07.992733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:08.015004 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbdf86a7-b000-4c31-88f9-17225718c7a7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1805 microversion: 2.1 time: 0.257948 Oct 03 14:38:08.017068 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 735/1452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:07 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1805 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:08.029725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:08.029725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:08.029725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.029725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.030254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.030869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.031556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.032189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.155124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:08.174024 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51f260b9-56fe-47b2-84cc-f97ad914049e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.295748 Oct 03 14:38:08.181920 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 718/1453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:07 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:08.195849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:08.200822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:08.211793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.212293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.212728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.213488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.213945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.214360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.273429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8ca5cb7-1eaf-4a99-b4d3-611e3cd102d6 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf/ips" status: 200 len: 218 microversion: 2.1 time: 0.087819 Oct 03 14:38:08.274562 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 719/1454] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:38:08 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf/ips => generated 218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:08.280117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:08.281037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:08.289226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.289944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.290367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.291074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.291509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.292244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.368509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:08.379879 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca8a0803-4ac0-4648-8380-5a9130f3827e tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.361641 Oct 03 14:38:08.380720 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 736/1455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:08 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:08.389419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:08.394425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:08.407421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.410158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.411003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.411899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.412513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.413242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.469751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:38:08.488883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:08.503533 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a0f7412-6714-4799-b028-139fbcbfdf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.227593 Oct 03 14:38:08.508674 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 720/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:08 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:08.510401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:08.511199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:08.518021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.518737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.519344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.520219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.520835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.521430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.586736 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47c27177-cf2f-4eb5-b916-83e8aec43b14 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 204 len: 0 microversion: 2.1 time: 0.203630 Oct 03 14:38:08.588052 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 737/1457] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:38:08 2022] DELETE /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:08.600657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:08.602684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:08.610045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.610640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.611152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.611954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.612470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.612982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.631741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:08.678380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:08.686918 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7b9a484-9b4e-48fe-a641-38c88bb30d36 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.180164 Oct 03 14:38:08.687717 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 721/1458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:08 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:08.778658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:08.779417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:08.786195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.786865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.787392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.788193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:08.788742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:08.789316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:08.910034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:08.925356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-809d53a9-0ca1-49c1-8184-0a52ee953092 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1811 microversion: 2.1 time: 0.329853 Oct 03 14:38:08.926259 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 738/1459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:08 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1811 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:08.988888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:09.001161 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9e77d86-bc38-4ba6-98b7-6ae631b0908c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.226289 Oct 03 14:38:09.002088 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 722/1460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:08 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:09.208837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:09.209510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:09.216852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.219137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.219737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.220713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.221345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.221846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.402926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:09.403549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:09.404134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:09.410904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.411400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.411838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.412547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.414090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2960fc2a-31d4-4414-a43f-558a81e316b0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.209110 Oct 03 14:38:09.415192 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 739/1461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:09 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:09.425468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.425923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.530253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:09.531108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:09.538124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.539436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.540179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.541158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.541815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.542480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.603746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:09.625946 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-48c6b113-6f57-44ed-89bf-615ba370054d tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.226190 Oct 03 14:38:09.626858 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 723/1462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:09 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:09.710034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:09.710648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:09.717766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.717766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.718217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.718941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:09.719395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:09.719822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:09.940452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:09.955126 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bd134c0f-ec2e-4fb4-9991-42f224f89026 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.248718 Oct 03 14:38:09.964054 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 724/1463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:09 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:09.976344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-458d975b-f938-448e-a091-92890db7ac72 req-6a14ffd8-9edc-475c-b2fb-4e7b8838b0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637082d0-3db6-40a4-a5b7-476769dfac46", "name": "network-vif-plugged", "status": "completed", "tag": "dbd4e369-fc08-4be0-992b-e780a84e5482"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:10.011011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-458d975b-f938-448e-a091-92890db7ac72 req-6a14ffd8-9edc-475c-b2fb-4e7b8838b0a2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.013647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-458d975b-f938-448e-a091-92890db7ac72 req-6a14ffd8-9edc-475c-b2fb-4e7b8838b0a2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.015097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-458d975b-f938-448e-a091-92890db7ac72 req-6a14ffd8-9edc-475c-b2fb-4e7b8838b0a2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.044631 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-458d975b-f938-448e-a091-92890db7ac72 req-6a14ffd8-9edc-475c-b2fb-4e7b8838b0a2 service nova] Creating event network-vif-plugged:dbd4e369-fc08-4be0-992b-e780a84e5482 for instance 637082d0-3db6-40a4-a5b7-476769dfac46 on n-h2-781139-2 Oct 03 14:38:10.050574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-458d975b-f938-448e-a091-92890db7ac72 req-6a14ffd8-9edc-475c-b2fb-4e7b8838b0a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084246 Oct 03 14:38:10.052076 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 725/1464] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:10.060822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:10.062730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:10.085993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.086601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.087110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.087910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.088495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.089127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.131729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:10.145602 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3fc7e0b-001c-4fbe-b2d2-f007d8020129 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.620197 Oct 03 14:38:10.172640 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 740/1465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:09 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:10.179872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:10.186704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:10.199848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.200341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.200778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.207123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.207706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.208324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.347141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:10.357191 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b64c94f-a7d2-45f5-8c33-6858e434636b tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1811 microversion: 2.1 time: 0.303695 Oct 03 14:38:10.374937 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 726/1466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:10 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1811 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:10.438772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:10.439676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:10.448024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.449089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.450694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.451756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.452373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.453288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.456277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:10.464344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9eec203a-1fbe-4e40-bd6e-ee42b9155244 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1378 microversion: 2.1 time: 0.290335 Oct 03 14:38:10.464958 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 741/1467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:10 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1378 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:10.596897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:10.608010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b10bda8-1b54-4c20-9c55-f5a43e3d9d21 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.173943 Oct 03 14:38:10.608822 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 727/1468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:10 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:10.652209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:10.653690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:10.663075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.664324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.665431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.666516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.667003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.667435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.805279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:10.813886 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfaede7b-366b-4e80-b30d-0ef614bfa6a8 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1318 microversion: 2.1 time: 0.167994 Oct 03 14:38:10.825012 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 742/1469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:10 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:10.979843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:10.980773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:10.987828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.988317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.988755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.989472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:10.989916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:10.990575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:10.993810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:11.173302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:11.173861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:11.181496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:11.197093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.197975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.198854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.199844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.200588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.200969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.263410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:11.273366 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fa7f8e43-143d-4d33-aa24-9db001502f57 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.297421 Oct 03 14:38:11.289006 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 728/1470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:10 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:11.384714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:11.385374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:11.399866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.400372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.400818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.401572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.402032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.402462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.438451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:11.448912 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95f6cbe9-75a9-4e95-b6e0-e427f9038825 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.280264 Oct 03 14:38:11.453615 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 743/1471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:11 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:11.468867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-79e0add7-969e-447d-948d-42e061174823 req-42f94c8b-7cf1-4f2b-970d-b38cbd906b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "name": "network-vif-deleted", "tag": "e50611b3-f873-464a-80e4-0537277f70d6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:11.503272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-79e0add7-969e-447d-948d-42e061174823 req-42f94c8b-7cf1-4f2b-970d-b38cbd906b3e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.503752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-79e0add7-969e-447d-948d-42e061174823 req-42f94c8b-7cf1-4f2b-970d-b38cbd906b3e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.504182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-79e0add7-969e-447d-948d-42e061174823 req-42f94c8b-7cf1-4f2b-970d-b38cbd906b3e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.535802 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-79e0add7-969e-447d-948d-42e061174823 req-42f94c8b-7cf1-4f2b-970d-b38cbd906b3e service nova] Creating event network-vif-deleted:e50611b3-f873-464a-80e4-0537277f70d6 for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:38:11.544420 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-79e0add7-969e-447d-948d-42e061174823 req-42f94c8b-7cf1-4f2b-970d-b38cbd906b3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089272 Oct 03 14:38:11.546605 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 744/1472] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:11.568791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:11.569860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:11.576406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.577252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.589755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.590872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.591595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.595402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.778806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:11.787806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f51a2abd-46ca-4621-b857-02de84a942b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1528 microversion: 2.1 time: 0.239781 Oct 03 14:38:11.791444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:11.800279 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb9bc67a-586f-4e48-a7d1-55e3a517d157 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1790 microversion: 2.1 time: 0.421116 Oct 03 14:38:11.801199 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 745/1473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:11 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1528 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:11.821485 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 729/1474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:11 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1790 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:11.826418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1870702929", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3bec1a14-e895-4900-8f12-af133bd5e217"}], "block_device_mapping_v2": [{"uuid": "f14cdab7-195b-4fb8-bc17-2e87e136f8a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:11.845193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:11.846233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:11.853337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.856144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.856830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.870869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:11.871792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:11.872444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:11.934538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] validate_networks() for [('3bec1a14-e895-4900-8f12-af133bd5e217', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:38:12.165643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:12.174683 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6d438519-558a-4c45-9725-e1b74ea81731 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.350681 Oct 03 14:38:12.175434 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 730/1475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:11 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:12.187485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:12.188812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:12.216622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.217326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.217871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.218616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.219068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.219491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.421855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:38:12.425115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:38:12.426470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:38:12.426909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:38:12.427318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:38:12.441063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.441551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.441992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.442720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.443237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.443666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.463372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:38:12.469282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Getting quotas for user 19b2b042d70a426989bb5dc6b986b7c5 and project f0f5e47f71fc4494aa8ed6354736216f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:38:12.478317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:12.492952 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a62c7b71-45c2-468f-9186-0eab33d3f032 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1528 microversion: 2.1 time: 0.316351 Oct 03 14:38:12.495885 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 731/1476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:12 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1528 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:12.522629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:12.523276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:12.529656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.530431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.531149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.533113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.533816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.534404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.539857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:38:12.542502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f14cdab7-195b-4fb8-bc17-2e87e136f8a8',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:38:12.699975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a71efd77-4ca1-4b01-947a-dde7c4d315e7 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.897142 Oct 03 14:38:12.700753 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 746/1477] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:38:12.706015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b0ecfba3-2a06-403a-9924-e2ef31c66740 req-e9451194-efba-4948-ae76-83b49d00ff78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da28c37-a7dd-41d0-9a85-c6f9d89cca56", "name": "network-vif-plugged", "status": "completed", "tag": "10a43a3f-fcad-4fca-8c64-38090f40a607"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:12.717791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b0ecfba3-2a06-403a-9924-e2ef31c66740 req-e9451194-efba-4948-ae76-83b49d00ff78 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.718058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b0ecfba3-2a06-403a-9924-e2ef31c66740 req-e9451194-efba-4948-ae76-83b49d00ff78 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.718438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b0ecfba3-2a06-403a-9924-e2ef31c66740 req-e9451194-efba-4948-ae76-83b49d00ff78 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.744006 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b0ecfba3-2a06-403a-9924-e2ef31c66740 req-e9451194-efba-4948-ae76-83b49d00ff78 service nova] Creating event network-vif-plugged:10a43a3f-fcad-4fca-8c64-38090f40a607 for instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 on n-h2-781139-2 Oct 03 14:38:12.755893 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b0ecfba3-2a06-403a-9924-e2ef31c66740 req-e9451194-efba-4948-ae76-83b49d00ff78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049181 Oct 03 14:38:12.757397 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 747/1478] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:12.768699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:12.770003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:12.782089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.782823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.783880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.804812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.805352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.805799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.877043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:12.903405 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-afc2ec71-258b-4cee-814e-7b8032c969d4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1508 microversion: 2.1 time: 0.390201 Oct 03 14:38:12.908962 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 732/1479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:12 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:12.930328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:12.931762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:12.970552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.971062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.971499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:12.972290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:12.972749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:12.973219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.248719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.258350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2dbce3ba-fa03-4f0a-9f6a-f02b4805be9f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.344868 Oct 03 14:38:13.259212 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 733/1480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:12 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:13.265723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b2b1dca-79d8-4a82-acba-dc8a35706717 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:13.289633 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b2b1dca-79d8-4a82-acba-dc8a35706717 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a" status: 202 len: 0 microversion: 2.1 time: 0.029019 Oct 03 14:38:13.291030 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 734/1481] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:38:13 2022] DELETE /compute/v2.1/flavors/e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:13.299801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98774c08-0807-4427-b1e8-4232cdb4bb7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:13.300767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-98774c08-0807-4427-b1e8-4232cdb4bb7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:13.425497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98774c08-0807-4427-b1e8-4232cdb4bb7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.429013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.442643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98774c08-0807-4427-b1e8-4232cdb4bb7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.442916 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-adf49dcc-2f61-4671-9cf6-2a80c1f2b914 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.683436 Oct 03 14:38:13.444437 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 748/1482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:12 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:13.448787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98774c08-0807-4427-b1e8-4232cdb4bb7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.450219 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98774c08-0807-4427-b1e8-4232cdb4bb7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1104 microversion: 2.25 time: 0.157619 Oct 03 14:38:13.454979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:13.454979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:13.465192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.465550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 735/1483] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:13 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1104 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:13.466941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.467921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.469915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.471695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.472692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.473435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:13.475853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:13.493622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.498639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.499477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.500500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.501870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.502472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.513877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.514677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.515203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.515937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lazy-loading 'fault' on Instance uuid 77133fdd-86ee-4775-a2c4-558bf95fa5bf {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:13.584249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.597110 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a9427d8-d888-441d-889d-d051c8063eee tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 200 len: 1303 microversion: 2.1 time: 0.150761 Oct 03 14:38:13.598617 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 749/1484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:13 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:13.604707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1096ce8-a99a-4100-8da5-3329b0cbcc86 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:13.660211 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1096ce8-a99a-4100-8da5-3329b0cbcc86 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059873 Oct 03 14:38:13.660822 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 750/1485] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:38:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:13.667973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-136683ef-468d-42da-b5f7-4083744c0756 req-4c251a48-ef5f-40a8-843f-806c17cf8ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "name": "network-vif-deleted", "tag": "920e8756-9b64-42f1-b31e-0378fc2a09af"}, {"server_uuid": "77133fdd-86ee-4775-a2c4-558bf95fa5bf", "name": "network-vif-deleted", "tag": "d0e82546-ec5a-4a6c-bc17-55a6f2e65b02"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:13.698071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-136683ef-468d-42da-b5f7-4083744c0756 req-4c251a48-ef5f-40a8-843f-806c17cf8ca9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.698553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-136683ef-468d-42da-b5f7-4083744c0756 req-4c251a48-ef5f-40a8-843f-806c17cf8ca9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.698979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-136683ef-468d-42da-b5f7-4083744c0756 req-4c251a48-ef5f-40a8-843f-806c17cf8ca9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.735970 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-136683ef-468d-42da-b5f7-4083744c0756 req-4c251a48-ef5f-40a8-843f-806c17cf8ca9 service nova] Creating event network-vif-deleted:920e8756-9b64-42f1-b31e-0378fc2a09af for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:38:13.736809 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-136683ef-468d-42da-b5f7-4083744c0756 req-4c251a48-ef5f-40a8-843f-806c17cf8ca9 service nova] Creating event network-vif-deleted:d0e82546-ec5a-4a6c-bc17-55a6f2e65b02 for instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf on n-h1-781139-2 Oct 03 14:38:13.743922 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-136683ef-468d-42da-b5f7-4083744c0756 req-4c251a48-ef5f-40a8-843f-806c17cf8ca9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079329 Oct 03 14:38:13.744911 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 751/1486] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:13.751188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:13.753775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:13.763163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.763792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.764883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.765854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:13.766477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:13.766993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:13.855239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.869402 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f7b9470-c0d1-4ffa-bf05-bb084f0bcca8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.400960 Oct 03 14:38:13.883089 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 736/1487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:13 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:13.908305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:13.915857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Old instance type tempest-test_resize_flavor_-1039115261, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 14:38:13.923404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:38:13.923830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:38:13.924311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:38:13.924832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:38:13.925264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:38:14.038622 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c6c3869-3fa1-4e05-afb1-6077342c5247 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc/action" status: 202 len: 0 microversion: 2.1 time: 0.292372 Oct 03 14:38:14.039790 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 752/1488] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:38:13 2022] POST /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:14.047686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:14.048301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:14.064046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.064539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.065013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.065724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.066367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.066836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.319946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:14.321518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:14.344508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.348259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.348494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.349779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.349979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.351752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.388620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:14.399222 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07120b5c-1fc8-491a-9230-7a5dfa257b6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1537 microversion: 2.1 time: 0.354430 Oct 03 14:38:14.399222 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 737/1489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:14 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1537 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:14.468487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:14.469586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:14.479862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.481061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.483979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.485916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.487412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.488185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.671557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:14.683109 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cdae00d-d658-44a3-919d-cc94319b79b2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.368804 Oct 03 14:38:14.697289 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 753/1490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:14 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:14.708867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:14.709839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:14.725736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.726489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.727421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.734184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.735048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.735815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.759145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:14.772152 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b46deefc-dcac-461d-91c1-4b8a1a2c39a2 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1323 microversion: 2.1 time: 0.308187 Oct 03 14:38:14.802754 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 738/1491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:14 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:14.816358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:14.817567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:14.830638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.840270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.843915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:14.844393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.846644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.849371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.851817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.855749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:14.858935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:14.860330 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cce504d-fac7-4c19-9ea2-02ef35c9a20a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1233 microversion: 2.25 time: 0.164438 Oct 03 14:38:14.861536 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 754/1492] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:14 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1233 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:14.896232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:14.897196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:14.901678 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] HTTP exception thrown: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Request method failure captured: Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf HTTP/1.1 Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvOcwkKX1Mn5j49iujcun7UKQJGimVm9TXo_pS2aH-_tL1KpwyK_sqNnowD1JGF3RQyAKWkEoWTez8m7Tj8uGJLTEiaar9Q3WlC9qSznNpcnYSb6iKsMdeA5InkPftuJS7RG4SGLXtLh_6jaAC2gVbQhlnbwd4PLiFiNZRBqcg52gfs Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:38:14.914661 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85df1411b734bcaa79e8b4cdda1fae9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestMultiNic-481073722 Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestMultiNic-481073722-project Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 7ab6b8853d4f460bb22b84d38bd8b4c6 Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestMultiNic-481073722-project Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:38:14.916641 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '77133fdd-86ee-4775-a2c4-558bf95fa5bf'} Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:14.917660 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:38:14.919564 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:14.921747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.921747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.923182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.924024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:14.925395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Returning 404 to user: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:14.925531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:14.926612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:14.927684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50ae71b0-812c-4dea-b40a-5c8c0b464121 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 404 len: 111 microversion: 2.1 time: 0.115428 Oct 03 14:38:14.930813 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 739/1493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:14 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:15.222754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:15.231208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-986e8f50-fa31-43a2-b0e8-f66f808126aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.339053 Oct 03 14:38:15.232058 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 755/1494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:14 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:15.422548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:15.423433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:15.435076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:15.435669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:15.436145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:15.437004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:15.437337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:15.437729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:15.709536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:15.711277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:15.725895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:15.726707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:15.727210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:15.727996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:15.728535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:15.729267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:15.790256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:15.819381 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25036c0d-a4ed-4cd9-b7b8-e51deeaec6f3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1537 microversion: 2.1 time: 0.400961 Oct 03 14:38:15.820734 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 740/1495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:15 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1537 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:15.826392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:15.827252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:15.835396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:15.837149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:15.837771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:15.839335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:15.840874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:15.856362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.279065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:16.295391 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0fcd6a7e-76c2-4804-939e-8b200ffc3222 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1472 microversion: 2.1 time: 0.471963 Oct 03 14:38:16.296442 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 741/1496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:15 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:16.309583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:16.312269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:16.318992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.329237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.330854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.331877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.334329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.335029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.336357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.487858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:16.504039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:16.506444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:16.507850 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-531cfa5b-04a4-4372-baaf-316510c67d4c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1251 microversion: 2.25 time: 0.207350 Oct 03 14:38:16.511675 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 742/1497] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:16 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1251 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:16.517699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "245f78c1-983f-4fdd-b980-e703a6e0f3e2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:16.520320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:16.537186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.540269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.540720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.542125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.542792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.543229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.613815 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] HTTP exception thrown: Volume 5affdb21-133b-4f9a-b477-7d96c3bafc20 could not be found. Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Request method failure captured: Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46/os-volume_attachments/5affdb21-133b-4f9a-b477-7d96c3bafc20 HTTP/1.1 Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 74 Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvNfOyMLJo4MC1sJccVbJGp1P8zQcHD88bthEes4TRU226AJ8TKCd4twuSz6R584URYu9pdk_8RjJLyYDvpMX1CfH9kzKBnb4wslrNP_srd-GEN6Kg4fvIB2NkoN7ytSap2BmH4knKIM8RqeFCcGO56L-wLqX8NjRfGC_6jCMWl46iw Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c503bde49e064e5d81029c39e62c0cff Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesAdminNegativeTest-215936794 Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:38:16.625388 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c503bde49e064e5d81029c39e62c0cff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c503bde49e064e5d81029c39e62c0cff", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c503bde49e064e5d81029c39e62c0cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c503bde49e064e5d81029c39e62c0cff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesAdminNegativeTest-215936794 Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c503bde49e064e5d81029c39e62c0cff Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-215936794 Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesAdminNegativeTest-215936794-project-admin Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 790822986b964728a45641b7dd173187 Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesAdminNegativeTest-215936794-project-admin Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: {"volumeAttachment": {"volumeId": "245f78c1-983f-4fdd-b980-e703a6e0f3e2"}} Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:38:16.627066 n-d-781139-2 devstack@n-api.service[128868]: exception: Volume 5affdb21-133b-4f9a-b477-7d96c3bafc20 could not be found. Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': '637082d0-3db6-40a4-a5b7-476769dfac46', 'id': '5affdb21-133b-4f9a-b477-7d96c3bafc20', 'body': {'volumeAttachment': {'volumeId': '245f78c1-983f-4fdd-b980-e703a6e0f3e2'}}} Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:38:16.627933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5affdb21-133b-4f9a-b477-7d96c3bafc20 could not be found. (HTTP 404) (Request-ID: req-4391bb7a-4855-447f-a45e-bd3ee559b1bd) Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:38:16.629561 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5affdb21-133b-4f9a-b477-7d96c3bafc20 could not be found. Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:16.631018 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5affdb21-133b-4f9a-b477-7d96c3bafc20 could not be found. Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5affdb21-133b-4f9a-b477-7d96c3bafc20 could not be found. Oct 03 14:38:16.632462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.637308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] Returning 404 to user: Volume 5affdb21-133b-4f9a-b477-7d96c3bafc20 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:16.638859 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9fe7063a-71aa-48c6-8484-ce0829ceac3b tempest-VolumesAdminNegativeTest-215936794 tempest-VolumesAdminNegativeTest-215936794-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46/os-volume_attachments/5affdb21-133b-4f9a-b477-7d96c3bafc20" status: 404 len: 109 microversion: 2.1 time: 0.125962 Oct 03 14:38:16.642903 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 743/1498] 10.222.0.20 () {60 vars in 1433 bytes} [Mon Oct 3 14:38:16 2022] PUT /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46/os-volume_attachments/5affdb21-133b-4f9a-b477-7d96c3bafc20 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:16.652184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:16.652810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:16.653524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:16.670700 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8907f67c-ee8a-417b-bc53-ddad7f637ba2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.965447 Oct 03 14:38:16.677922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.683090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.683911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.685142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.685784 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 756/1499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:15 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:16.687731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.688573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.692884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:16.693345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:16.700236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.701211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.701816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.702788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.703393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.704154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.709111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.741445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Request method failure captured: Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56/diagnostics HTTP/1.1 Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvO9fOcRf07tJn8ujzLBx3TcJW9ILNHJAMRBeDED2Wpor2slsewFcHuNVl0hNxyGdDWBhIOBL0-6w9lyZ5mV2gZlCBQG2_zejobnVXpgb2V9x729VHhQL6gwETxccZpq2JCXLs-LKt__QQ6hoNCSS_GkZbeAni8aA-bVEhi1QOmUmNM Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 58652a1d00b6495889e5f3f3bdc5135f Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1508278001 Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:38:16.743339 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/58652a1d00b6495889e5f3f3bdc5135f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_58652a1d00b6495889e5f3f3bdc5135f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58652a1d00b6495889e5f3f3bdc5135f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58652a1d00b6495889e5f3f3bdc5135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1508278001 Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 58652a1d00b6495889e5f3f3bdc5135f Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1508278001 Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerDiagnosticsNegativeTest-1508278001-project Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 25594ab5f62f44c2a0de8754f120b169 Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1508278001-project Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:38:16.744726 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': '0da28c37-a7dd-41d0-9a85-c6f9d89cca56'} Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:38:16.752158 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:16.753564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:16.756307 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf79e3c3-fe56-4dea-8d1e-4ce841b98f6f tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.057633 Oct 03 14:38:16.756307 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 757/1500] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:38:16 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56/diagnostics => generated 117 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:16.760702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:16.765521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:16.780008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.784695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.785192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.794377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:16.794957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:16.795400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:16.871592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:38:17.063948 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d04e378-bb27-4829-b975-8003f0409537 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 204 len: 0 microversion: 2.1 time: 0.310062 Oct 03 14:38:17.066821 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 758/1501] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:38:16 2022] DELETE /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:17.073729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:17.074724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:17.081921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.082676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.083303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.084180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.084794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.085408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.196618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:17.210790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4de4894-2b34-4be4-ac5a-e6ccc64cea64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.566202 Oct 03 14:38:17.213274 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 744/1502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:16 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:17.224117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:17.226401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:17.244286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.244794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.245268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.246009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.246468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.246904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.535819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:17.550385 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95be102a-a2d4-4d27-8f81-a50d3fa94552 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1537 microversion: 2.1 time: 0.481767 Oct 03 14:38:17.550993 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 759/1503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:17 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1537 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:17.574782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:17.575393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:17.595524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.596287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.596912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.597813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.602978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.603435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.630742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:17.642624 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f92d54db-8a9e-41ae-9b46-a3c954acbd40 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1478 microversion: 2.1 time: 0.428133 Oct 03 14:38:17.645605 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 745/1504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:17 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1478 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:17.695966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:17.696502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:17.707597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.709776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.710309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.711041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:17.711501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:17.711930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:17.844234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:17.899893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:17.901895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:17.905525 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50b4f143-4032-4a4e-8d32-c930f65c063c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1293 microversion: 2.25 time: 0.334557 Oct 03 14:38:17.906459 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 760/1505] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:17 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1293 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:18.086189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:18.098717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dee6d4bc-8cbd-4cbe-9955-6c970ca20d1f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.406782 Oct 03 14:38:18.102973 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 746/1506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:17 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:18.238529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:18.239894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:18.254643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:18.263591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:18.265402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:18.266827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:18.269844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:18.270397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:18.560319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:18.570288 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-890fdbe5-07b9-41da-ac20-c7ea61e96274 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.337322 Oct 03 14:38:18.577951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:18.579406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:18.580114 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 761/1507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:18 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:18.591042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:18.592723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:18.593437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:18.594621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:18.595703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:18.596336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:18.675702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:18.676329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:18.689823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:18.690327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:18.690764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:18.691477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:18.691927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:18.692347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:18.988830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:19.019943 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-419e3b4f-699e-42f3-8c3c-43e044e2989a tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1478 microversion: 2.1 time: 0.348219 Oct 03 14:38:19.038698 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 762/1508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:18 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1478 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:19.054104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:19.054896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:19.069566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.074217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.074909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.075811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.076571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.077250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.415322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:19.418215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:19.430862 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51940259-2696-4e25-a8a1-d700cc962d54 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.855242 Oct 03 14:38:19.448975 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 747/1509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:18 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:19.449093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:19.456422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:19.457489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:19.460389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:19.463198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:19.464643 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8e2005b-8d19-4d9a-a35b-45b70ec0d464 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1293 microversion: 2.25 time: 0.422720 Oct 03 14:38:19.465472 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 763/1510] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:19 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1293 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:19.467947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.468647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.469254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.470375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.471392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.471915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.473431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2beb0d98-d70e-45d7-a800-afa2f51fc7ab req-09f2c2ac-b258-490a-bf2d-2897a043ecf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da28c37-a7dd-41d0-9a85-c6f9d89cca56", "name": "network-vif-deleted", "tag": "10a43a3f-fcad-4fca-8c64-38090f40a607"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:19.485314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2beb0d98-d70e-45d7-a800-afa2f51fc7ab req-09f2c2ac-b258-490a-bf2d-2897a043ecf8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.486031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2beb0d98-d70e-45d7-a800-afa2f51fc7ab req-09f2c2ac-b258-490a-bf2d-2897a043ecf8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.486647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2beb0d98-d70e-45d7-a800-afa2f51fc7ab req-09f2c2ac-b258-490a-bf2d-2897a043ecf8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.507409 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2beb0d98-d70e-45d7-a800-afa2f51fc7ab req-09f2c2ac-b258-490a-bf2d-2897a043ecf8 service nova] Creating event network-vif-deleted:10a43a3f-fcad-4fca-8c64-38090f40a607 for instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 on n-h2-781139-2 Oct 03 14:38:19.522042 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2beb0d98-d70e-45d7-a800-afa2f51fc7ab req-09f2c2ac-b258-490a-bf2d-2897a043ecf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054602 Oct 03 14:38:19.525910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 764/1511] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:19.599062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:19.599825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:19.615548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.633264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.633889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.634663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.635130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.635552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.878177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:19.879556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:19.891944 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2761252f-10bd-4381-9ecf-0ebb8ab52985 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.442563 Oct 03 14:38:19.893847 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 748/1512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:19 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:19.906068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f79cea1b-1222-4d6a-b884-72b92154553d req-a1265335-cfad-4ea7-996c-d8b07e149072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78c44ad-428f-4712-a350-05c9b2047751", "tag": "f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:19.927597 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d97f834-69b8-4fad-be40-e39706d6f4ef tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.332506 Oct 03 14:38:19.928082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f79cea1b-1222-4d6a-b884-72b92154553d req-a1265335-cfad-4ea7-996c-d8b07e149072 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:19.929268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f79cea1b-1222-4d6a-b884-72b92154553d req-a1265335-cfad-4ea7-996c-d8b07e149072 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:19.930896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f79cea1b-1222-4d6a-b884-72b92154553d req-a1265335-cfad-4ea7-996c-d8b07e149072 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:19.943120 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 765/1513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:19 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:19.947062 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f79cea1b-1222-4d6a-b884-72b92154553d req-a1265335-cfad-4ea7-996c-d8b07e149072 service nova] Creating event network-changed:f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9 for instance c78c44ad-428f-4712-a350-05c9b2047751 on n-h1-781139-2 Oct 03 14:38:19.954442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f79cea1b-1222-4d6a-b884-72b92154553d req-a1265335-cfad-4ea7-996c-d8b07e149072 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057667 Oct 03 14:38:19.955818 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 749/1514] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:20.053055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:20.054260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:20.060990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.061658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.068324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.069159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.069641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.070096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.160669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.161711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.162435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.163687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lazy-loading 'fault' on Instance uuid 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:20.260201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25594ab5f62f44c2a0de8754f120b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58652a1d00b6495889e5f3f3bdc5135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:20.276515 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-224d8c2d-2f74-4841-bbc9-2db8dbc5e4a5 tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 200 len: 1313 microversion: 2.1 time: 0.227280 Oct 03 14:38:20.277396 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 766/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:20 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:20.460752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:20.461793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:20.477553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.479932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.480616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.486898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.487689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.488410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.494919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:20.496358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:20.510455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.513161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.513856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.514843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.516815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.518754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.830993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:20.843484 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-39832f40-b6e0-4184-b12b-8e3257e5e8d1 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.387125 Oct 03 14:38:20.844120 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 750/1516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:20 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:20.917690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:20.917690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:20.936232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.939655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.940245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:20.942328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:20.944173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:20.944634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.250397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:21.256816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:21.265789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:21.269560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:21.270944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5116c201-280d-4b97-9cd1-b96a1ae748cb tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1293 microversion: 2.25 time: 0.781593 Oct 03 14:38:21.274102 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b0faa394-83f3-4763-8684-f5e9710bc9bc tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.359112 Oct 03 14:38:21.275387 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 751/1517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:20 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:21.286267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:21.287170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:21.288715 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 767/1518] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:20 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1293 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:21.295688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:21.296618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:21.304324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.304918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.305465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.306217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.309741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.310336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.323052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.323554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.324203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.325119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.325732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.326459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.378472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:38:21.570902 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-619e16c4-e4b1-47af-b39e-76dd2d9d9cef tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 204 len: 0 microversion: 2.1 time: 0.278616 Oct 03 14:38:21.572292 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 768/1519] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:38:21 2022] DELETE /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:21.578542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:21.580772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] [instance: 0da28c37-a7dd-41d0-9a85-c6f9d89cca56] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:21.610055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.613741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.614464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.615420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.616029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.616833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.650142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:21.654682 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] HTTP exception thrown: Instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 could not be found. Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Request method failure captured: Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 HTTP/1.1 Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvO9fOcRf07tJn8ujzLBx3TcJW9ILNHJAMRBeDED2Wpor2slsewFcHuNVl0hNxyGdDWBhIOBL0-6w9lyZ5mV2gZlCBQG2_zejobnVXpgb2V9x729VHhQL6gwETxccZpq2JCXLs-LKt__QQ6hoNCSS_GkZbeAni8aA-bVEhi1QOmUmNM Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 58652a1d00b6495889e5f3f3bdc5135f Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1508278001 Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:38:21.656461 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/58652a1d00b6495889e5f3f3bdc5135f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_58652a1d00b6495889e5f3f3bdc5135f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58652a1d00b6495889e5f3f3bdc5135f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/58652a1d00b6495889e5f3f3bdc5135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1508278001 Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 58652a1d00b6495889e5f3f3bdc5135f Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1508278001 Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerDiagnosticsNegativeTest-1508278001-project Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 25594ab5f62f44c2a0de8754f120b169 Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1508278001-project Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 could not be found. Oct 03 14:38:21.657865 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '0da28c37-a7dd-41d0-9a85-c6f9d89cca56'} Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 could not be found. Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:21.659063 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 could not be found. Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 could not be found. Oct 03 14:38:21.660325 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:21.663222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] Returning 404 to user: Instance 0da28c37-a7dd-41d0-9a85-c6f9d89cca56 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:21.664248 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c3ea816-ee08-41ad-9ad2-db5648df1b1c tempest-ServerDiagnosticsNegativeTest-1508278001 tempest-ServerDiagnosticsNegativeTest-1508278001-project] 10.222.0.20 "GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56" status: 404 len: 111 microversion: 2.1 time: 0.090408 Oct 03 14:38:21.666028 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 769/1520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:21 2022] GET /compute/v2.1/servers/0da28c37-a7dd-41d0-9a85-c6f9d89cca56 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:21.671747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:21.672555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:21.678355 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1bea1b2f-069b-4bb8-a569-acf8c5dcc07f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.392101 Oct 03 14:38:21.681505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.682191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.682774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.683677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.684474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.685068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.691292 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 752/1521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:21 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:21.868507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:21.869726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:21.878925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.879414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.879848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:21.880558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:21.881036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:21.881625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:22.019630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:22.035660 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecc99193-847f-42b0-a455-faf93080bc40 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1514 microversion: 2.1 time: 0.366887 Oct 03 14:38:22.036706 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 770/1522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:21 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:22.094215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:22.105934 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb148a18-6ffc-437f-aa5d-53e1dc3119b6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.241302 Oct 03 14:38:22.108805 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 753/1523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:21 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:22.299225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:22.299802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:22.300587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:22.301262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:22.310690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:22.316031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:22.316536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:22.316994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:22.317120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:22.317678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:22.317818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:22.318590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:22.318742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:22.319052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:22.319307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:22.319839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:22.454137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.479206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.594283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:22.597570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.610065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:22.615764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:22.620222 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb299829-a115-44ab-98f3-08717a560157 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1293 microversion: 2.25 time: 0.325977 Oct 03 14:38:22.620954 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 771/1524] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:22 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1293 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:22.710733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:22.711680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:22.722990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:22.723621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:22.725767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:22.726905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:22.727633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:22.729769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:22.748203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:22.762416 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70ee09cf-bca5-479b-9b2e-fe91a78b5222 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.466106 Oct 03 14:38:22.767439 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 754/1525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:22 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:23.016066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2096349330", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "9e7b99a4-9d28-420f-99cc-271aae085f7f"}, {"uuid": "fc6c7a50-1f76-472e-bed3-511daf9dfa86"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:23.075439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:23.088141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a30274b-5969-4b56-af75-5ff348a4cfd0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.381207 Oct 03 14:38:23.089518 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 772/1526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:22 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:23.094554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:23.095807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:23.120070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] validate_networks() for [('9e7b99a4-9d28-420f-99cc-271aae085f7f', None, None, None, None, None), ('fc6c7a50-1f76-472e-bed3-511daf9dfa86', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:38:23.137107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:23.137974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:23.140079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:23.140866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:23.141381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:23.141808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:23.434759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:23.619749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:23.636098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad6cfdfc-8428-4bf1-a139-83c63c31e6be tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1514 microversion: 2.1 time: 0.545218 Oct 03 14:38:23.639321 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 773/1527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:23 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:23.644648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:23.647542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:23.669683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:23.670569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:23.671202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:23.672371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:23.673578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:23.674182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.301963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:24.311249 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5ea61a4-03b2-4f7b-8041-cb2144a2eacd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.670143 Oct 03 14:38:24.312422 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 774/1528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:23 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:24.325432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:24.328357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:24.348488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.349268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.349869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.350786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.351924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.353241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.620192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:38:24.621196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:38:24.621728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:38:24.622147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:38:24.622777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:38:24.634655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.636190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.636658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.637900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.638433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.638928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.664153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Getting quotas for project c85df1411b734bcaa79e8b4cdda1fae9. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:38:24.671021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Getting quotas for user 7ab6b8853d4f460bb22b84d38bd8b4c6 and project c85df1411b734bcaa79e8b4cdda1fae9. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:38:24.687483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:38:24.690347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:38:24.761548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff809b17-5402-4084-b52a-102a33bc2dac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.754101 Oct 03 14:38:24.763422 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 755/1529] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:38:24.768545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:24.769788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:24.775339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:24.778696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.779439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.780041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.780955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.781675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.782911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.791097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:24.806986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:24.818650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb010751-dc66-460b-b68b-32ad8feca110 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.504723 Oct 03 14:38:24.834655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 775/1530] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:24 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:24.863489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:24.865931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:24.879648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:24.881352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.881851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.882293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.883021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.896400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.896961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.947062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:24.957562 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6495d1e-1e0b-4100-a986-4288dcc61c97 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.192705 Oct 03 14:38:24.958974 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 756/1531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:24 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:24.964793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:24.965794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:24.985329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.985980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.986692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:24.987547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:24.988103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:24.988648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:25.130954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:25.145127 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d80b7de0-a218-4e6e-ae91-791ead2e37e4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1472 microversion: 2.1 time: 0.184470 Oct 03 14:38:25.161223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 757/1532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:24 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:25.161223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ae7165c2-693f-4949-b92d-af21ef32d2a0 req-1ad36a83-cae0-4541-a3bb-138edff0ebab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf0cae3-a215-4491-bcc9-6ce278351274", "name": "network-vif-unplugged", "status": "completed", "tag": "d2339708-7bad-42a0-938d-9ef9e761a731"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:25.162104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ae7165c2-693f-4949-b92d-af21ef32d2a0 req-1ad36a83-cae0-4541-a3bb-138edff0ebab service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:25.164421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ae7165c2-693f-4949-b92d-af21ef32d2a0 req-1ad36a83-cae0-4541-a3bb-138edff0ebab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:25.165076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ae7165c2-693f-4949-b92d-af21ef32d2a0 req-1ad36a83-cae0-4541-a3bb-138edff0ebab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:25.181095 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ae7165c2-693f-4949-b92d-af21ef32d2a0 req-1ad36a83-cae0-4541-a3bb-138edff0ebab service nova] Creating event network-vif-unplugged:d2339708-7bad-42a0-938d-9ef9e761a731 for instance 1cf0cae3-a215-4491-bcc9-6ce278351274 on n-h1-781139-2 Oct 03 14:38:25.194000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ae7165c2-693f-4949-b92d-af21ef32d2a0 req-1ad36a83-cae0-4541-a3bb-138edff0ebab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045715 Oct 03 14:38:25.199035 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 758/1533] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:25.210338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53733b67-9fdc-48b1-b72d-596e7e1db7ca tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:25.211401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53733b67-9fdc-48b1-b72d-596e7e1db7ca tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:25.291905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53733b67-9fdc-48b1-b72d-596e7e1db7ca tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:25.306539 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53733b67-9fdc-48b1-b72d-596e7e1db7ca tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1213 microversion: 2.1 time: 0.105939 Oct 03 14:38:25.307151 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 759/1534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:25 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:25.346997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:25.348026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:25.363937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:25.371695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:25.372149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:25.373373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:25.373838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:25.374263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:25.691456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:25.701872 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-872fff52-d7ca-40da-ab83-5e15259f1d92 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.855250 Oct 03 14:38:25.721476 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 776/1535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:24 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:25.732616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:25.743959 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6a6ebcfd-1314-46ca-afad-a75a758b3322 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.404863 Oct 03 14:38:25.744564 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 760/1536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:25 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:25.850767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:25.851377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:25.875118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:25.875671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:25.876206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:25.876892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:25.877375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:25.877795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:25.993910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:25.994649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:26.004544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.006343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.007815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.013226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.014291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.015565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.164457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:26.179106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:26.181890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:26.183321 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-309c0e52-98ba-475c-a34b-ceb61e873964 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.336574 Oct 03 14:38:26.186438 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 777/1537] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:25 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:26.203977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:26.206112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:26.222423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.223740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.224274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.225953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.226529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.227196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.263585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.264504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.265186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.265824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lazy-loading 'fault' on Instance uuid 637082d0-3db6-40a4-a5b7-476769dfac46 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:26.311856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:26.333111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:26.333973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d62ad214-d31d-4b45-ac26-892b6fd22fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.349130 Oct 03 14:38:26.345705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68cb2fc3-bc46-4969-8e63-ac6cd9a44364 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 200 len: 1308 microversion: 2.1 time: 0.157459 Oct 03 14:38:26.346328 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 778/1538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:26 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:26.356564 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 761/1539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:25 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:26.370805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:26.371764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:26.378759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.380208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.380991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.382133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.383269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.383864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.470999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:26.480632 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2bb3796c-ff11-4ce8-89d2-99d24f4ba24f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1209 microversion: 2.1 time: 0.122697 Oct 03 14:38:26.484968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 779/1540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:26 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:26.728124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:26.728734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:26.736691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.737406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.737629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.738332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.738787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.739197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.770224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:26.770842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:26.779557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.780050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.780485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.785684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:26.786383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:26.786983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:26.975170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:26.986494 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae8dc921-170b-4018-9448-73d4c5a62a7b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.220865 Oct 03 14:38:26.987663 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 780/1541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:26 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:26.990795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:27.010975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-15a6930b-becb-483f-a976-0ea4f93ff24d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.286622 Oct 03 14:38:27.014945 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 762/1542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:26 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:27.126395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.130014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.130508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.130950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.131683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.132134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.132565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.157387 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5001452b-c739-4886-9c07-f8badb788938 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.168416 Oct 03 14:38:27.157983 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 781/1543] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:38:26 2022] GET /compute/v2.1/os-services => generated 944 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:27.170937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.174883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.175461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.175909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.176646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.177136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.177545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.205569 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-78f6536c-3d96-4fcc-b27f-3d8a28f6ac04 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037936 Oct 03 14:38:27.205797 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 763/1544] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:38:27.211041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.211843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:27.218937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.219430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.219854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.220526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.220959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.221106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.221447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.224830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.225436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.226114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.227112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.227672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.228190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.255573 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd3052f1-7820-465a-aedf-b0513e343dd0 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039688 Oct 03 14:38:27.256205 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 764/1545] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:27.269333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.273736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.274265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.274705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.275443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.275896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.276321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.305769 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd8fa916-3362-4513-8069-b38d1e9e9150 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-781139-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.039753 Oct 03 14:38:27.306408 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 765/1546] 10.222.0.20 () {58 vars in 1194 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/os-services?host=n-d-781139-2&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:38:27.322446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.326678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.327166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.327617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.328358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.329124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.329443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.357800 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e00c50e-3163-4f1c-8155-3198c8ca4482 tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039003 Oct 03 14:38:27.365267 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 766/1547] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:27.370760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.371384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:27.377875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.378420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.378858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.379756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.380373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.380800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.399808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:27.414261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:27.416769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:27.418747 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eab5102e-408d-4061-a72b-db4b5ef7be7e tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.211639 Oct 03 14:38:27.420319 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 782/1548] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:27.441976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.446588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.447297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.447999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.449312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.449983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.450525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.478795 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9789e34f-dbe4-49ed-bbb5-f382f2de75dd tempest-ServicesAdminNegativeTestJSON-119868381 tempest-ServicesAdminNegativeTestJSON-119868381-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.056787 Oct 03 14:38:27.481255 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 783/1549] 10.222.0.20 () {58 vars in 1198 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:38:27.493307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.494241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 637082d0-3db6-40a4-a5b7-476769dfac46] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:27.505699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.506492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.507090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.508539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.509398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.509972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.527985 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] HTTP exception thrown: Instance 637082d0-3db6-40a4-a5b7-476769dfac46 could not be found. Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Request method failure captured: Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 HTTP/1.1 Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNXj7wpgGDN0QVZojvnI-ILUJaIbtb8v0G3gtg7aPFs4BGUMUb5s3EQnzWDmvCQBIPlUgEKsbQXoQk5xINf_HSWN0OMewiV-rV053mXOIQ_3HwDwDXZ7LxL2Cil-N_erl0IuLjDFvIyq8v_-aoTEsynK9stb0rH_vxHN-kU4pVLdLs Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 86217b1343254b55bf90b9240aba1332 Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesAdminNegativeTest-562670654 Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:38:27.531107 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86217b1343254b55bf90b9240aba1332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86217b1343254b55bf90b9240aba1332", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86217b1343254b55bf90b9240aba1332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86217b1343254b55bf90b9240aba1332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesAdminNegativeTest-562670654 Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 86217b1343254b55bf90b9240aba1332 Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-562670654 Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesAdminNegativeTest-562670654-project Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ce74b5279d524df88e5e84b20b920261 Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesAdminNegativeTest-562670654-project Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 637082d0-3db6-40a4-a5b7-476769dfac46 could not be found. Oct 03 14:38:27.533170 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '637082d0-3db6-40a4-a5b7-476769dfac46'} Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637082d0-3db6-40a4-a5b7-476769dfac46 could not be found. Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:27.534182 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637082d0-3db6-40a4-a5b7-476769dfac46 could not be found. Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637082d0-3db6-40a4-a5b7-476769dfac46 could not be found. Oct 03 14:38:27.535972 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.538988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Returning 404 to user: Instance 637082d0-3db6-40a4-a5b7-476769dfac46 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:27.540303 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcfde1de-2c4a-4a8d-8064-4a4b197b4882 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46" status: 404 len: 111 microversion: 2.1 time: 0.055663 Oct 03 14:38:27.541312 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 784/1550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/servers/637082d0-3db6-40a4-a5b7-476769dfac46 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:27.551175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-046769a9-78a1-4489-bc48-6a24cab56ae1 req-125d15d4-ae22-4cf9-80a1-c9610625bf6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637082d0-3db6-40a4-a5b7-476769dfac46", "name": "network-vif-deleted", "tag": "dbd4e369-fc08-4be0-992b-e780a84e5482"}, {"name": "network-changed", "server_uuid": "1cf0cae3-a215-4491-bcc9-6ce278351274", "tag": "d2339708-7bad-42a0-938d-9ef9e761a731"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:27.564609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-046769a9-78a1-4489-bc48-6a24cab56ae1 req-125d15d4-ae22-4cf9-80a1-c9610625bf6e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.565243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-046769a9-78a1-4489-bc48-6a24cab56ae1 req-125d15d4-ae22-4cf9-80a1-c9610625bf6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.565765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-046769a9-78a1-4489-bc48-6a24cab56ae1 req-125d15d4-ae22-4cf9-80a1-c9610625bf6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.580099 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-046769a9-78a1-4489-bc48-6a24cab56ae1 req-125d15d4-ae22-4cf9-80a1-c9610625bf6e service nova] Creating event network-vif-deleted:dbd4e369-fc08-4be0-992b-e780a84e5482 for instance 637082d0-3db6-40a4-a5b7-476769dfac46 on n-h2-781139-2 Oct 03 14:38:27.581490 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-046769a9-78a1-4489-bc48-6a24cab56ae1 req-125d15d4-ae22-4cf9-80a1-c9610625bf6e service nova] Creating event network-changed:d2339708-7bad-42a0-938d-9ef9e761a731 for instance 1cf0cae3-a215-4491-bcc9-6ce278351274 on n-h1-781139-2 Oct 03 14:38:27.592652 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-046769a9-78a1-4489-bc48-6a24cab56ae1 req-125d15d4-ae22-4cf9-80a1-c9610625bf6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046321 Oct 03 14:38:27.595172 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 785/1551] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:27.595579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:27.604845 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a0677f31-1231-4b0d-8237-313f75745511 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.238243 Oct 03 14:38:27.606197 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 767/1552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:27.623888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.624533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:27.632413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.633327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.633713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.634916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:27.635431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:27.636107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:27.766173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:27.778134 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6184e731-2491-4b1d-9cce-257ab946c746 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1271 microversion: 2.1 time: 0.169538 Oct 03 14:38:27.788909 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 768/1553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:27.792988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33d67067-3dc8-421a-95da-ac40334b5dba tempest-ServicesAdminNegativeTestJSON-859568545 tempest-ServicesAdminNegativeTestJSON-859568545-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:27.797595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33d67067-3dc8-421a-95da-ac40334b5dba tempest-ServicesAdminNegativeTestJSON-859568545 tempest-ServicesAdminNegativeTestJSON-859568545-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '56930f8912b64536b319717a6279acd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731d269ff2594d9b81a3a46e4ec2d302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33d67067-3dc8-421a-95da-ac40334b5dba tempest-ServicesAdminNegativeTestJSON-859568545 tempest-ServicesAdminNegativeTestJSON-859568545-project] Request method failure captured: Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvPhg2MYyuQiHt9VndYwQcLEWCj-ltUP4DnXAgVTfsaImOVSOqV3Aq4jYXACuW5JYn66PWYyLR19cVCNDfcDaU8twOf0DsiNnn3HAM7wDzbNAL93eF-JLaiDnuhkCtVAzdgkFL9alNvvkNeC_EfBNTTpQfhhIPzBNmbpJsVG5LO-0dI Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 731d269ff2594d9b81a3a46e4ec2d302 Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-859568545 Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:38:27.799683 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/731d269ff2594d9b81a3a46e4ec2d302"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_731d269ff2594d9b81a3a46e4ec2d302", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/731d269ff2594d9b81a3a46e4ec2d302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/731d269ff2594d9b81a3a46e4ec2d302"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-859568545 Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 731d269ff2594d9b81a3a46e4ec2d302 Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-859568545 Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServicesAdminNegativeTestJSON-859568545-project Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 56930f8912b64536b319717a6279acd8 Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-859568545-project Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 14:38:27.801387 n-d-781139-2 devstack@n-api.service[128869]: action_args: {} Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:38:27.802354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 14:38:27.804046 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:27.805682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33d67067-3dc8-421a-95da-ac40334b5dba tempest-ServicesAdminNegativeTestJSON-859568545 tempest-ServicesAdminNegativeTestJSON-859568545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:27.805682 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33d67067-3dc8-421a-95da-ac40334b5dba tempest-ServicesAdminNegativeTestJSON-859568545 tempest-ServicesAdminNegativeTestJSON-859568545-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.204320 Oct 03 14:38:27.806061 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 786/1554] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:38:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 210 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:28.012070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:28.013432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:28.022152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.022843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.023766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.033890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.034542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.036664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:28.037161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.037521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:28.049544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.050092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.050538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.061530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.062319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.063004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.273141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:28.294684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a389afa1-8cf8-40c4-9666-33f42d71d015 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.287046 Oct 03 14:38:28.297305 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 769/1555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:28 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:28.315379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:28.326898 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-928c80af-cb28-407f-9e8c-3fbe4d67108d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.294533 Oct 03 14:38:28.328285 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 787/1556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:28 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:28.448977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:28.450076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:28.457038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.457776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.460498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.461281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.461755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.462225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.479229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:28.628958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:28.629750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:28.642695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.645928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.648452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.649450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.651271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.653849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.919701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:28.931180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:28.933093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:28.935586 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d994530-2ce7-466e-b3c9-dfd1b60c80ad tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.493345 Oct 03 14:38:28.937544 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 770/1557] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:28 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:28.943306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:28.945212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:28.953841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.954803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.955455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:28.956418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:28.957296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:28.958053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:29.020034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:29.029023 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f48089d9-52ae-4c2c-9c04-ea4651b17e85 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.404854 Oct 03 14:38:29.043746 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 788/1558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:28 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:29.137253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:29.146142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63f11ef5-50ae-4d27-9419-5f858d16cce7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1313 microversion: 2.1 time: 0.207307 Oct 03 14:38:29.146764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 771/1559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:28 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:29.334984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:29.335616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:29.351564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:29.352286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:29.359101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:29.361778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:29.365181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:29.365555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:29.365719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:29.366273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:29.366407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:29.366755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:29.367186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:29.367302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:29.369253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:29.371043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:29.567057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:29.578153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cea3cfe7-0b26-4292-8149-4c9f425efeed tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.230505 Oct 03 14:38:29.594709 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 772/1560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:29 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:29.656594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:29.682835 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ece9575-c8cf-4196-ae0e-713f888d30d8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.366949 Oct 03 14:38:29.685584 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 789/1561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:29 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:29.966848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:29.967418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:29.976383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:29.979764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:29.980382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:29.981306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:29.981762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:29.982247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.054732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:30.056557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:30.066131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.071962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.072430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.073298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.081544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.082078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.136179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:30.147674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:30.149177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:30.150343 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff2e2a72-1e93-47c8-87a7-5c2ad6050978 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.187586 Oct 03 14:38:30.158491 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 773/1562] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:29 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:30.177914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:30.178557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:30.199437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.199937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.200373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.201183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.201791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.202221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.397157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:30.407592 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb863688-2fbd-4ad4-96c1-17136e11e7d0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.239812 Oct 03 14:38:30.413785 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 774/1563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:30 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:30.574871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:30.589259 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f14317d6-4380-4e3d-a420-37ff91e09300 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.538895 Oct 03 14:38:30.590466 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 790/1564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:30 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:30.602894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:30.603634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:30.613496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.614157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.614752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.615635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.616557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.617387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.711619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:30.712238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:30.719651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.720379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.720989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.722066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.722669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.723240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.800763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:30.815087 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fcddff0e-83ba-4d6e-b201-21c3f09cdce8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.215983 Oct 03 14:38:30.816265 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 775/1565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:30 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:30.865772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d6b0cdbc-943a-4619-9bb4-88df31c4539c req-fef684ae-fe74-4d65-82e7-cd8436e02192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b727e6-8fa6-4da7-82c9-72083504f60d", "tag": "d4ce351c-e67c-46b2-9ad8-e83f023e9914"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:30.883943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d6b0cdbc-943a-4619-9bb4-88df31c4539c req-fef684ae-fe74-4d65-82e7-cd8436e02192 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:30.884436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d6b0cdbc-943a-4619-9bb4-88df31c4539c req-fef684ae-fe74-4d65-82e7-cd8436e02192 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:30.884843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d6b0cdbc-943a-4619-9bb4-88df31c4539c req-fef684ae-fe74-4d65-82e7-cd8436e02192 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:30.911387 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d6b0cdbc-943a-4619-9bb4-88df31c4539c req-fef684ae-fe74-4d65-82e7-cd8436e02192 service nova] Creating event network-changed:d4ce351c-e67c-46b2-9ad8-e83f023e9914 for instance a7b727e6-8fa6-4da7-82c9-72083504f60d on n-h2-781139-2 Oct 03 14:38:30.921242 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d6b0cdbc-943a-4619-9bb4-88df31c4539c req-fef684ae-fe74-4d65-82e7-cd8436e02192 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059414 Oct 03 14:38:30.925538 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 776/1566] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:38:31.050650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:31.053187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:31.061832 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f21197c3-c3a7-4f50-954d-de8f3b15f50c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.355547 Oct 03 14:38:31.063173 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 791/1567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:30 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:31.123448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9f57d382-fd3b-444c-9abf-ac1c661135d7 tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:31.132159 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9f57d382-fd3b-444c-9abf-ac1c661135d7 tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.190075 Oct 03 14:38:31.132907 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 777/1568] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:38:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:31.176194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:31.177069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:31.183254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.184716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.185513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:31.186402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.187018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.187600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:31.433184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:31.434328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:31.449281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.450035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.455479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:31.456300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.458481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.459102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:31.565692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:31.573997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:31.575498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:31.576851 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8f62819-eb0e-40ff-83d2-836e7c9b9955 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.404582 Oct 03 14:38:31.577458 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 792/1569] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:31 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:31.626737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:31.627605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:31.640896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.641686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.642269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:31.643140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.643749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.644326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:31.699691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:31.711415 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2aeb84c8-017f-4680-9c36-ee2fc877377a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.283715 Oct 03 14:38:31.712017 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 778/1570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:31 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:31.789680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5857fc8-acaa-4b63-80a7-0bd85f324aef tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-90973454", "imageRef": "f3745be1-3723-46d5-8d35-bb3ea27b788c", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:31.849515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-c5857fc8-acaa-4b63-80a7-0bd85f324aef tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:38:31.931316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:31.945433 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db838af4-c3fd-4409-a01b-d85fece2c831 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.337288 Oct 03 14:38:31.946056 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 793/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:31 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:31.963765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:31.964956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:31.971716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.972404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.974276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:31.975159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:31.975764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:31.976357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.067431 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c5857fc8-acaa-4b63-80a7-0bd85f324aef tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5857fc8-acaa-4b63-80a7-0bd85f324aef tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] Request method failure captured: Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 141 Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvPmtByG2nOvT4ShanNQJtjtBeI2uE4O-2pBCCR8PbAjhHyDOac5F0EVhNbmEBnre1iGtvIcFYBJGx5X9BFgUdg6opbcUQ-9fLvZ309Y414PqXXxsMR44WDkCIwzWFZNq1QeXfZbFlM6tSYmYgeA3jsDUdXJKwtDBdesOwdcyYStw1A Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a64a7fc6efcd4043af1e74a1ee1fe12b Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FlavorsV2NegativeTest-1295482537 Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:38:32.069335 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a64a7fc6efcd4043af1e74a1ee1fe12b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a64a7fc6efcd4043af1e74a1ee1fe12b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a64a7fc6efcd4043af1e74a1ee1fe12b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a64a7fc6efcd4043af1e74a1ee1fe12b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FlavorsV2NegativeTest-1295482537 Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a64a7fc6efcd4043af1e74a1ee1fe12b Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1295482537 Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FlavorsV2NegativeTest-1295482537-project Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 35f0f2129fe24abbafe970bc716cc92f Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FlavorsV2NegativeTest-1295482537-project Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-90973454", "imageRef": "f3745be1-3723-46d5-8d35-bb3ea27b788c", "flavorRef": "452"}} Oct 03 14:38:32.070730 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: exception: Flavor's memory is too small for requested image. Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-90973454', 'imageRef': 'f3745be1-3723-46d5-8d35-bb3ea27b788c', 'flavorRef': '452'}}} Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:32.071528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:32.072851 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:32.074189 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:32.074189 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:32.074189 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:38:32.074189 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:38:32.074189 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 03 14:38:32.074189 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:32.076562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5857fc8-acaa-4b63-80a7-0bd85f324aef tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:32.077503 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5857fc8-acaa-4b63-80a7-0bd85f324aef tempest-FlavorsV2NegativeTest-1295482537 tempest-FlavorsV2NegativeTest-1295482537-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.291989 Oct 03 14:38:32.078340 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 779/1572] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:38:31 2022] POST /compute/v2.1/servers => generated 93 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 03 14:38:32.085364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:32.086073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:32.092149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:32.094072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.095263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.095917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.096991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.097683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.098151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.129967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:38:32.254299 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12eb32ef-4811-4d82-bd5b-a82727ae736c tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 204 len: 0 microversion: 2.1 time: 0.174568 Oct 03 14:38:32.255397 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 780/1573] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:38:32 2022] DELETE /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:32.271044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:32.271722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:32.278845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.279526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.283361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.285389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.286518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.287112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.299150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.313781 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91e35381-13d6-440d-ae3e-842b2d9d962f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.356805 Oct 03 14:38:32.315064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 794/1574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:31 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:32.326755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:32.329677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:32.350872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.351392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.351827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.352570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.353172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.353458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.486778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.497804 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1639c422-bfa2-4585-867b-8db7c751971e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.236116 Oct 03 14:38:32.503173 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 781/1575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:32 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:32.570822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.580032 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-214ee0b5-b645-46e2-b82d-7843c0f977c4 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1684 microversion: 2.1 time: 0.263753 Oct 03 14:38:32.581352 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 795/1576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:32 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1684 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:32.606816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:32.607950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:32.615103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.615996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.616658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.617631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.618503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.619350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.735706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:32.736618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:32.743494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.743975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.744419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.745165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.745624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.746056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.790284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.802011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.803832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.805830 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d583093a-ac99-4c65-9a25-888e524b70c8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.203343 Oct 03 14:38:32.807468 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 782/1577] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:32 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:32.878781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:32.885030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.886908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Searching by: {'deleted': False, 'project_id': 'f36728d84c6446feabdceca993127991'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:38:32.896342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.897165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.897781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.898678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:32.899136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:32.899557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:32.942040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:32.952723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a72fabf5-5664-4b33-b145-934f8824526a tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.222291 Oct 03 14:38:32.968513 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 796/1578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:32 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:32.989447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-31cd44a1-2f8f-4b12-adf3-5d8bb8445ee6 req-dd250291-c41e-4820-9d9a-2da57a2f9f26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b727e6-8fa6-4da7-82c9-72083504f60d", "tag": "e160f679-9ba7-48a3-b16c-7675bafdd277"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:32.994130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:38:33.014948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31cd44a1-2f8f-4b12-adf3-5d8bb8445ee6 req-dd250291-c41e-4820-9d9a-2da57a2f9f26 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.015658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31cd44a1-2f8f-4b12-adf3-5d8bb8445ee6 req-dd250291-c41e-4820-9d9a-2da57a2f9f26 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.016256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-31cd44a1-2f8f-4b12-adf3-5d8bb8445ee6 req-dd250291-c41e-4820-9d9a-2da57a2f9f26 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.031365 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-31cd44a1-2f8f-4b12-adf3-5d8bb8445ee6 req-dd250291-c41e-4820-9d9a-2da57a2f9f26 service nova] Creating event network-changed:e160f679-9ba7-48a3-b16c-7675bafdd277 for instance a7b727e6-8fa6-4da7-82c9-72083504f60d on n-h2-781139-2 Oct 03 14:38:33.036473 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-31cd44a1-2f8f-4b12-adf3-5d8bb8445ee6 req-dd250291-c41e-4820-9d9a-2da57a2f9f26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066384 Oct 03 14:38:33.040788 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 797/1579] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:33.047352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.048369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:33.055761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.056570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.057455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.058508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.059328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.060307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.061312 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e3738b8c-0edf-49fa-a8f5-16bab441bd2b tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.189815 Oct 03 14:38:33.070451 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 783/1580] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:38:32 2022] GET /compute/v2.1/servers => generated 339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:33.075957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.081304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:33.082121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Searching by: {'deleted': False, 'project_id': 'f36728d84c6446feabdceca993127991'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:38:33.087463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.087951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.088391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.089168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.089688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.090118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.123127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:38:33.212631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:33.220169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.220955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.221587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.237999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:33.246025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99c278c9-ea81-4e43-9e2d-cb7644b04e58 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.203770 Oct 03 14:38:33.246884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 798/1581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:33.338782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.340120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:33.347859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.348651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.349266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.350132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.350784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.351361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.403807 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36f3c2e6-c2af-4ac1-b592-40f630910e01 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.331978 Oct 03 14:38:33.404959 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 784/1582] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:33.443357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6a14cb1-604a-412d-8182-fe76c4ecbd3d tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.457704 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6a14cb1-604a-412d-8182-fe76c4ecbd3d tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032163 Oct 03 14:38:33.458730 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 785/1583] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:38:33.523405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:33.526833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.527458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:33.535904 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc7f30ee-335a-469c-a9c6-18a2cc297aab tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.200816 Oct 03 14:38:33.536771 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 799/1584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:33.537751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.538255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.538697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.539415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.539868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.540298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.606293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.607433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:33.618602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.619808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.620413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.621488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.622170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.628287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.757993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:33.777411 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1d0a273-1b87-44f0-a449-f8d39ab3068e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.254615 Oct 03 14:38:33.790784 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 786/1585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:33.836357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.837074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:33.845634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.846123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.846560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.847581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.848241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.849829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.885781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:33.903230 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f18515a-a205-4d54-98da-a71b5b2e451a tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1684 microversion: 2.1 time: 0.295383 Oct 03 14:38:33.917110 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 800/1586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1684 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:33.977347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:33.977973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:33.993294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.995138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.995607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:33.997072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:33.997818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:33.998304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.027211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:34.030996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:34.042409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:34.046100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:34.048425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b3ef8488-1895-433b-9b85-a8c1882471fe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.217357 Oct 03 14:38:34.051620 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 787/1587] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:34.139620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:34.140524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:34.156418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.157686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.159580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.160593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.161477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.162267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.236390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:38:34.409512 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-513fb009-32ed-4622-acf0-f1fafff8a612 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 204 len: 0 microversion: 2.1 time: 0.274355 Oct 03 14:38:34.410419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 788/1588] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:38:34 2022] DELETE /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:34.416052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:34.416760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:34.423396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.423884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.424328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.425081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.425665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.426083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.515640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:34.527018 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf37fe2a-09ba-4607-bedf-eaa791dc8dd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.553804 Oct 03 14:38:34.531121 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 801/1589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:33 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:34.536327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:34.536965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:34.549130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.549633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.550070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.553728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.557722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.560581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.610259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:34.625675 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-97738ec0-acbf-4ab1-99cc-02f5a524442d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1498 microversion: 2.1 time: 0.214014 Oct 03 14:38:34.626677 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 789/1590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:34 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:34.631778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:34.632677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:34.639580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.640103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.640770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.641804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.642454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.643076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.874590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:34.884494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-479a65ff-3aca-46ac-ac60-bf9885751756 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.256487 Oct 03 14:38:34.885244 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 790/1591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:34 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:34.890695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:34.891597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:34.898250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.899106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.899992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.900976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.901621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.902226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.941178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:34.953875 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d92bae7-4f76-4ca3-9b76-3de94ceb6eba tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1714 microversion: 2.1 time: 0.421163 Oct 03 14:38:34.954512 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 802/1592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:34 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1714 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:34.959844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:34.960720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:34.967242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.967762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.968193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:34.969290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:34.969910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:34.970519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:35.181369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:35.191875 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a487da2d-e881-4568-82b3-8ac5e17f3946 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1684 microversion: 2.1 time: 0.235149 Oct 03 14:38:35.194196 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 803/1593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:34 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1684 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:35.213595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:35.214562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:35.224508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:35.226140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:35.227927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:35.229194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:35.229989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:35.230747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:35.517917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:35.529031 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36ff4b42-652c-4c47-a740-53d945a6d416 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1542 microversion: 2.1 time: 0.642219 Oct 03 14:38:35.530043 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 791/1594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:34 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1542 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:35.555959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:35.556785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:35.568808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:35.571077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:35.571791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:35.573057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:35.578736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:35.579714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.023176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:36.032349 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-838e5808-b9c7-4956-917d-8dd336a3fecc tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.481104 Oct 03 14:38:36.045637 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 792/1595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:35 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:36.049111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:36.055089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:36.056236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:36.064230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.064995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.065921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.066114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:36.066976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.067576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.068151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.069058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:36.071786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f102d97-976a-41bc-a003-221cfc891706 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.872190 Oct 03 14:38:36.089125 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 804/1596] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:35 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:36.272085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-897fdef9-5d57-4829-9538-b0fceeecb270 req-912dbb81-10d8-40a6-a7ee-1f3a828e1b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78c44ad-428f-4712-a350-05c9b2047751", "name": "network-vif-plugged", "status": "completed", "tag": "f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:36.281986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-897fdef9-5d57-4829-9538-b0fceeecb270 req-912dbb81-10d8-40a6-a7ee-1f3a828e1b0b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.282460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-897fdef9-5d57-4829-9538-b0fceeecb270 req-912dbb81-10d8-40a6-a7ee-1f3a828e1b0b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.282880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-897fdef9-5d57-4829-9538-b0fceeecb270 req-912dbb81-10d8-40a6-a7ee-1f3a828e1b0b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.308598 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-897fdef9-5d57-4829-9538-b0fceeecb270 req-912dbb81-10d8-40a6-a7ee-1f3a828e1b0b service nova] Creating event network-vif-plugged:f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9 for instance c78c44ad-428f-4712-a350-05c9b2047751 on n-h1-781139-2 Oct 03 14:38:36.314170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-897fdef9-5d57-4829-9538-b0fceeecb270 req-912dbb81-10d8-40a6-a7ee-1f3a828e1b0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223641 Oct 03 14:38:36.318964 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 805/1597] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:36.325302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:36.326470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:36.333504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.334305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.334955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.335869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.336514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.337161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.687190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:36.706356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6139badb-ba70-484f-8203-2b4cf829130a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 200 len: 1475 microversion: 2.1 time: 0.655369 Oct 03 14:38:36.707811 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 793/1598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:36 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 1475 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:36.720070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:36.720685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:36.736686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.744384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.745294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.746201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:36.746374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.746686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.747298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.764717 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07be20e7-60a2-43d2-a053-345b632c7540 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.444169 Oct 03 14:38:36.765810 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 806/1599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:36 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:36.774610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:36.775528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:36.801942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.802435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.802876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.803588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.804247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.804999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.861177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:36.861934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:36.862529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:36.863142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lazy-loading 'fault' on Instance uuid 2ab23598-1a23-485b-ab9f-bb59994dc62b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:37.020665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce74b5279d524df88e5e84b20b920261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86217b1343254b55bf90b9240aba1332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:37.030724 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee829b1f-4b68-4084-8dff-23b28cee9266 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 200 len: 1332 microversion: 2.1 time: 0.263668 Oct 03 14:38:37.031939 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 807/1600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:36 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 1332 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:37.036830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6cfc4d4c-9858-4862-a4e6-45d4e2bd6053 req-5cd3d654-92e0-4990-9205-2bf201df4cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab23598-1a23-485b-ab9f-bb59994dc62b", "name": "network-vif-deleted", "tag": "42aa44f3-eff3-471b-ac4e-7a6ed884c45b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:37.048506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6cfc4d4c-9858-4862-a4e6-45d4e2bd6053 req-5cd3d654-92e0-4990-9205-2bf201df4cb7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.049550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6cfc4d4c-9858-4862-a4e6-45d4e2bd6053 req-5cd3d654-92e0-4990-9205-2bf201df4cb7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.050653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6cfc4d4c-9858-4862-a4e6-45d4e2bd6053 req-5cd3d654-92e0-4990-9205-2bf201df4cb7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.063799 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6cfc4d4c-9858-4862-a4e6-45d4e2bd6053 req-5cd3d654-92e0-4990-9205-2bf201df4cb7 service nova] Creating event network-vif-deleted:42aa44f3-eff3-471b-ac4e-7a6ed884c45b for instance 2ab23598-1a23-485b-ab9f-bb59994dc62b on n-h2-781139-2 Oct 03 14:38:37.069728 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6cfc4d4c-9858-4862-a4e6-45d4e2bd6053 req-5cd3d654-92e0-4990-9205-2bf201df4cb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036420 Oct 03 14:38:37.070617 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 808/1601] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:37.077410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:37.078407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:37.085471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.085955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.086387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.087267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.087912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.088331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.283252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:37.309375 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d80e9282-2a55-4030-8011-e346ae66c021 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1714 microversion: 2.1 time: 0.587506 Oct 03 14:38:37.313992 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 794/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:36 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1714 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:37.330354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1644905963"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:37.337866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:37.350020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.351463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.355173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.356237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.357376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.360442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.423351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:37.432757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5b1c4e4-b635-47ce-afd5-c37ccd758b96 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1541 microversion: 2.1 time: 0.360741 Oct 03 14:38:37.437922 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 809/1603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:37 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1541 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:37.448848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:37.456944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:37.478077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.482741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.486908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.487536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.488440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.492581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.493061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.504210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.793798 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe51f30d-0bde-4907-ba34-5f577a39fe06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.475376 Oct 03 14:38:37.795816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 795/1604] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:38:37 2022] POST /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:38:37.816313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:37.817505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:37.826166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.826975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.827598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.829260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:37.829783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:37.830244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:37.999528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:38.011196 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc3e476e-166f-433f-829b-86d747ad236d tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.572074 Oct 03 14:38:38.012953 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 810/1605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:37 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:38.023482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:38.032567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:38.039213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.041624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.042344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.043332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.044085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.044811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.453212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:38.463763 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b138e1c6-f531-4352-a38d-32f7e8689d90 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.449320 Oct 03 14:38:38.489195 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 811/1606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:38 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:38.498918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68def9d9-7a0b-4a22-94b0-624576a02f36 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234a878b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:38.553379 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68def9d9-7a0b-4a22-94b0-624576a02f36 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.062415 Oct 03 14:38:38.555203 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 812/1607] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:38 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:38.567272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:38.568436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] [instance: 2ab23598-1a23-485b-ab9f-bb59994dc62b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:38.574737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.575250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.576596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.577386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.577902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.578339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.596960 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] HTTP exception thrown: Instance 2ab23598-1a23-485b-ab9f-bb59994dc62b could not be found. Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Request method failure captured: Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b HTTP/1.1 Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNXj7wpgGDN0QVZojvnI-ILUJaIbtb8v0G3gtg7aPFs4BGUMUb5s3EQnzWDmvCQBIPlUgEKsbQXoQk5xINf_HSWN0OMewiV-rV053mXOIQ_3HwDwDXZ7LxL2Cil-N_erl0IuLjDFvIyq8v_-aoTEsynK9stb0rH_vxHN-kU4pVLdLs Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 86217b1343254b55bf90b9240aba1332 Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesAdminNegativeTest-562670654 Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:38:38.598724 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86217b1343254b55bf90b9240aba1332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86217b1343254b55bf90b9240aba1332", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86217b1343254b55bf90b9240aba1332"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86217b1343254b55bf90b9240aba1332"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesAdminNegativeTest-562670654 Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 86217b1343254b55bf90b9240aba1332 Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-562670654 Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesAdminNegativeTest-562670654-project Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ce74b5279d524df88e5e84b20b920261 Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesAdminNegativeTest-562670654-project Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 2ab23598-1a23-485b-ab9f-bb59994dc62b could not be found. Oct 03 14:38:38.600506 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '2ab23598-1a23-485b-ab9f-bb59994dc62b'} Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab23598-1a23-485b-ab9f-bb59994dc62b could not be found. Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:38.601482 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab23598-1a23-485b-ab9f-bb59994dc62b could not be found. Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab23598-1a23-485b-ab9f-bb59994dc62b could not be found. Oct 03 14:38:38.603041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:38:38.605292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Returning 404 to user: Instance 2ab23598-1a23-485b-ab9f-bb59994dc62b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:38.607806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d29ac10-5992-4b21-b2b6-283ba27fb4ba tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b" status: 404 len: 111 microversion: 2.1 time: 0.050162 Oct 03 14:38:38.608917 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 813/1608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:38 2022] GET /compute/v2.1/servers/2ab23598-1a23-485b-ab9f-bb59994dc62b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:38.613831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:38.614681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:38.622283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.623522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.624151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.625083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.625695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.627032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.699111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:38.708329 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88310b02-0e61-4261-b086-8ace4cd40a95 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1647 microversion: 2.1 time: 0.098190 Oct 03 14:38:38.709626 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 814/1609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:38 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1647 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:38.714909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:38.715572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:38.722913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.723639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.724377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.725282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:38.725899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:38.726531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:38.821548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:38.848516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:38.853864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:38.857942 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46488a1e-5bde-4ea8-aea7-e2be25c47ee0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 1.060435 Oct 03 14:38:38.869898 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 796/1610] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:37 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:38.876962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e1446109-6a07-4dad-9f65-230e5bcf5c56 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] Calling method '.version_select at 0x7fb2309baa60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:38.909313 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e1446109-6a07-4dad-9f65-230e5bcf5c56 tempest-VolumesAdminNegativeTest-562670654 tempest-VolumesAdminNegativeTest-562670654-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252763527" status: 202 len: 0 microversion: 2.1 time: 0.047608 Oct 03 14:38:38.911890 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 797/1611] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:38:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252763527 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:38.916069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:38.926085 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1be131e5-d380-4ddd-abe5-30025000dcfd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1473 microversion: 2.1 time: 0.215053 Oct 03 14:38:38.929642 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 815/1612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:38 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:39.059649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:39.061716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:39.076408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.077033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.077690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.078528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.079276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.079927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.197618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6243eb5b-eee3-4b92-b96b-3409eeaa222e req-07ee5722-1417-4a86-aa0e-5c1a3450126c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b94561-f82e-42a5-a65d-a72196430b24", "name": "network-vif-deleted", "tag": "c5071db3-457b-4caf-8492-19d98ed16219"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:39.216856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6243eb5b-eee3-4b92-b96b-3409eeaa222e req-07ee5722-1417-4a86-aa0e-5c1a3450126c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.217637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6243eb5b-eee3-4b92-b96b-3409eeaa222e req-07ee5722-1417-4a86-aa0e-5c1a3450126c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.222447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6243eb5b-eee3-4b92-b96b-3409eeaa222e req-07ee5722-1417-4a86-aa0e-5c1a3450126c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.247323 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6243eb5b-eee3-4b92-b96b-3409eeaa222e req-07ee5722-1417-4a86-aa0e-5c1a3450126c service nova] Creating event network-vif-deleted:c5071db3-457b-4caf-8492-19d98ed16219 for instance 58b94561-f82e-42a5-a65d-a72196430b24 on n-h2-781139-2 Oct 03 14:38:39.265552 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6243eb5b-eee3-4b92-b96b-3409eeaa222e req-07ee5722-1417-4a86-aa0e-5c1a3450126c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168658 Oct 03 14:38:39.266895 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 816/1613] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:39.490631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:39.513260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:39.514014 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-672bd8bf-f2ed-4bf0-a7e7-c58e0d082cd8 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.479882 Oct 03 14:38:39.514739 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 798/1614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:39 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:39.515410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:39.534589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.535098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.537211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.538192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.539981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.540778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.571923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7990f744-1548-4d40-a682-7675a12076d0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a1aa60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:39.666648 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7990f744-1548-4d40-a682-7675a12076d0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.097312 Oct 03 14:38:39.669849 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 799/1615] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:39 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:39.734407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:39.735647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:39.745090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:39.754433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.756003 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f33e849-d66b-43e7-9109-2bfefe2a9800 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.266661 Oct 03 14:38:39.769185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.769185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.769185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.769185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.769565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.772815 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 817/1616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:39 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:39.784959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4898a8fd-188a-4a09-bf9e-2b7eb238b8e6 req-eac2b26d-7752-49d1-8d22-726416de670b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e21b53-e336-4990-b573-9cced61076bc", "name": "network-vif-unplugged", "status": "completed", "tag": "0441cd47-154d-4303-8bbd-2ec0d338c773"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:39.817095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4898a8fd-188a-4a09-bf9e-2b7eb238b8e6 req-eac2b26d-7752-49d1-8d22-726416de670b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.819008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4898a8fd-188a-4a09-bf9e-2b7eb238b8e6 req-eac2b26d-7752-49d1-8d22-726416de670b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.820710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4898a8fd-188a-4a09-bf9e-2b7eb238b8e6 req-eac2b26d-7752-49d1-8d22-726416de670b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.853986 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4898a8fd-188a-4a09-bf9e-2b7eb238b8e6 req-eac2b26d-7752-49d1-8d22-726416de670b service nova] Creating event network-vif-unplugged:0441cd47-154d-4303-8bbd-2ec0d338c773 for instance 31e21b53-e336-4990-b573-9cced61076bc on n-h1-781139-2 Oct 03 14:38:39.886228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-4898a8fd-188a-4a09-bf9e-2b7eb238b8e6 req-eac2b26d-7752-49d1-8d22-726416de670b service nova] Instance 31e21b53-e336-4990-b573-9cced61076bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:38:39.906853 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4898a8fd-188a-4a09-bf9e-2b7eb238b8e6 req-eac2b26d-7752-49d1-8d22-726416de670b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132298 Oct 03 14:38:39.908602 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 818/1617] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:39.915532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:39.916471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:39.924800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.926301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.926978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:39.927982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:39.928652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:39.929289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:40.125875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:40.136054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:40.139540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:40.141053 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49e36a81-d025-411e-a017-b2a41bbddcdc tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1281 microversion: 2.25 time: 0.231047 Oct 03 14:38:40.141814 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 819/1618] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:39 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:40.167386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:40.168504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:40.175891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:40.176742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:40.177384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:40.178483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:40.179114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:40.179716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:40.232252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:40.247084 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-efc9a296-02d8-4a86-bb0e-61dfeace4c62 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1361 microversion: 2.1 time: 0.516974 Oct 03 14:38:40.260960 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 800/1619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:39 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:40.421279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:40.453090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89d29bd1-b9eb-4c7e-9345-b2eeb7113c84 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1473 microversion: 2.1 time: 0.281965 Oct 03 14:38:40.455088 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 820/1620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:40 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1473 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:40.542328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:40.542654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:40.549896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:40.550822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:40.551332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:40.552115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:40.552634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:40.553155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:40.686610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-652362f5-0fd3-4ee6-9537-27e2dd9c3358 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234af5c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:40.774530 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-652362f5-0fd3-4ee6-9537-27e2dd9c3358 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.092765 Oct 03 14:38:40.776076 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 821/1621] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:40 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:40.790154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:40.791241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:40.807131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:40.808485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:40.809186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:40.810771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:40.812108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:40.813803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:40.993057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:41.004971 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f041fc0c-b79c-4734-8c5a-08fc84766d3e tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.467389 Oct 03 14:38:41.005705 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 801/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:40 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:41.109199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:41.118763 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ebc2bb3e-aa94-4ed7-856c-5800c9182e1e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.341346 Oct 03 14:38:41.119622 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 822/1623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:40 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:41.278310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:41.279238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:41.289888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:41.290391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:41.290827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:41.296311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:41.296905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:41.297395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:41.394080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:41.394764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:41.395356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:41.396354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lazy-loading 'fault' on Instance uuid 58b94561-f82e-42a5-a65d-a72196430b24 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:41.470524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740069ae6d7c4cb28c9314f8da05e6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f36728d84c6446feabdceca993127991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:41.471258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:41.472091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:41.488406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:41.489217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:41.489896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:41.490845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:41.491504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:41.492039 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07c6d119-3af7-4734-8a5e-355c2a761918 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 200 len: 1366 microversion: 2.1 time: 0.223219 Oct 03 14:38:41.492360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:41.509123 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 823/1624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:41 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:41.509123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:41.509751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:41.534057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.537243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:41.538981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:41.539934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:41.546400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:41.549045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:41.550345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:41.904885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:41.914993 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c65ba1b-9e50-4b60-8dee-926f03e235bd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1473 microversion: 2.1 time: 0.417879 Oct 03 14:38:41.929039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 824/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:41 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1473 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:41.934885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4116e368-9d82-405a-88ca-436b3065c703 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234af5c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:42.023129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4116e368-9d82-405a-88ca-436b3065c703 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.105716 Oct 03 14:38:42.025991 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 825/1626] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:41 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:42.033067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7ba310a0-b0a6-482d-a68c-53ded01c970a req-c4a9d382-e677-401b-a4de-4c50b311b569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388889a-755e-4663-b75c-84220b9d8fb1", "name": "network-vif-plugged", "status": "completed", "tag": "26221873-2abe-488a-ad63-83dfa6fedeee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:42.050385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7ba310a0-b0a6-482d-a68c-53ded01c970a req-c4a9d382-e677-401b-a4de-4c50b311b569 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.051478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7ba310a0-b0a6-482d-a68c-53ded01c970a req-c4a9d382-e677-401b-a4de-4c50b311b569 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.052039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7ba310a0-b0a6-482d-a68c-53ded01c970a req-c4a9d382-e677-401b-a4de-4c50b311b569 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.073994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7ba310a0-b0a6-482d-a68c-53ded01c970a req-c4a9d382-e677-401b-a4de-4c50b311b569 service nova] Creating event network-vif-plugged:26221873-2abe-488a-ad63-83dfa6fedeee for instance 4388889a-755e-4663-b75c-84220b9d8fb1 on n-h2-781139-2 Oct 03 14:38:42.079171 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7ba310a0-b0a6-482d-a68c-53ded01c970a req-c4a9d382-e677-401b-a4de-4c50b311b569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051501 Oct 03 14:38:42.080448 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 826/1627] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:42.086428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:42.087906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:42.102121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.102121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.102121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.103306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.103768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.104481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.227266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:42.246851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:42.255530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:42.259314 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-078b3681-782b-4b37-a4c4-83f39d5d24a8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1477 microversion: 2.25 time: 1.090365 Oct 03 14:38:42.265880 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 802/1628] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:41 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1477 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:42.287109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:42.288053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:42.307025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.310741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.311493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.312433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.314326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.314919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.370963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:42.448116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:42.461577 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e56524a9-5579-4a88-964b-cc83a6297cd4 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.375971 Oct 03 14:38:42.462375 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 827/1629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:42 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:42.475251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:42.478852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:42.495733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.499352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.499921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.501789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.504493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.505255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.670896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:42.700483 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f01255d8-d487-463c-aaff-9ba6a0e40a2b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1715 microversion: 2.1 time: 0.430921 Oct 03 14:38:42.703625 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 803/1630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:42 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1715 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:42.716032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:42.719591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] [instance: 58b94561-f82e-42a5-a65d-a72196430b24] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:42.733500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.734586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.735102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.737654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.738595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.740400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.783822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] HTTP exception thrown: Instance 58b94561-f82e-42a5-a65d-a72196430b24 could not be found. Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Request method failure captured: Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 HTTP/1.1 Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvOi5r6isPeVeFvuoIJIEYBTySeTfl3_h3k9mH48LBaihqbrxOmcb1fuCo3jWQNlFSvRp3fw4uTYucpigZZmkKzX6nfjdL7qSR3sM2gFeMOPnPDONtDScB_lY8RGS7pEv1xaGX6gfmQY1BJvA9yvQS4pdDmQ5z3N-4STw_dMdLDEXkc Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f36728d84c6446feabdceca993127991 Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestManualDisk-550367340 Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:38:42.786142 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f36728d84c6446feabdceca993127991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f36728d84c6446feabdceca993127991", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36728d84c6446feabdceca993127991"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f36728d84c6446feabdceca993127991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestManualDisk-550367340 Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f36728d84c6446feabdceca993127991 Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestManualDisk-550367340 Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestManualDisk-550367340-project Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 740069ae6d7c4cb28c9314f8da05e6bc Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestManualDisk-550367340-project Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 58b94561-f82e-42a5-a65d-a72196430b24 could not be found. Oct 03 14:38:42.787933 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '58b94561-f82e-42a5-a65d-a72196430b24'} Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b94561-f82e-42a5-a65d-a72196430b24 could not be found. Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:38:42.788976 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b94561-f82e-42a5-a65d-a72196430b24 could not be found. Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b94561-f82e-42a5-a65d-a72196430b24 could not be found. Oct 03 14:38:42.790497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:38:42.795948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Returning 404 to user: Instance 58b94561-f82e-42a5-a65d-a72196430b24 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:38:42.797534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9ae8921-35f7-4fe1-9f5c-137a84911558 tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24" status: 404 len: 111 microversion: 2.1 time: 0.092420 Oct 03 14:38:42.799553 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 804/1631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:42 2022] GET /compute/v2.1/servers/58b94561-f82e-42a5-a65d-a72196430b24 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:38:42.809343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d69a60f-d24f-4a96-b1ee-e9fa03c2b44e tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] Calling method '.version_select at 0x7fb2309e6700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:42.847793 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d69a60f-d24f-4a96-b1ee-e9fa03c2b44e tempest-ServersTestManualDisk-550367340 tempest-ServersTestManualDisk-550367340-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-103573507" status: 202 len: 0 microversion: 2.1 time: 0.042635 Oct 03 14:38:42.848798 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 805/1632] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 14:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-103573507 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:42.941947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:42.943049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:42.956399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.960685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.961448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:42.962675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:42.963490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:42.965627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:43.098207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=14 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.188750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid c78c44ad-428f-4712-a350-05c9b2047751 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:43.211177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.217742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51eef42b-31c4-41e2-9977-b45738107d9c tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1970 microversion: 2.25 time: 0.751541 Oct 03 14:38:43.226203 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 828/1633] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:42 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1970 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:43.232787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-832b6010-0dc2-4fc0-b4c4-3fb8260de088 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230439ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:43.317957 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-832b6010-0dc2-4fc0-b4c4-3fb8260de088 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.090671 Oct 03 14:38:43.318582 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 829/1634] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:43 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:43.338119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:43.338765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:43.355926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:43.356499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:43.358925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:43.360864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:43.361378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:43.363668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:43.692803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid c78c44ad-428f-4712-a350-05c9b2047751 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:43.711198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66dae466-5db5-45da-bb7e-605925547b08 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1970 microversion: 2.25 time: 0.379799 Oct 03 14:38:43.732951 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 830/1635] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:43 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1970 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:43.737066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:43.737066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:43.747542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:43.748079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:43.748494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:43.754899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:43.755393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:43.755836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:43.821610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:43.837046 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e52583e-382c-4d34-93a9-da29e5809fc4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1470 microversion: 2.1 time: 0.894901 Oct 03 14:38:43.838102 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 806/1636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:42 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1470 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:43.848278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:43.849344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:43.876607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:43.881865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:43.885473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:43.886464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:43.887021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:43.888120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.229820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:44.243371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc39645c-61e2-44d8-b847-1425f361bab0 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.515742 Oct 03 14:38:44.263457 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 831/1637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:43 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:44.280669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:44.290383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:44.297555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.298048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.298483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.299235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.299672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.304459 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bd0cb39a-7703-4df7-b9f5-55a48cee29f2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1705 microversion: 2.1 time: 0.464890 Oct 03 14:38:44.308506 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 807/1638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:43 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1705 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:44.320313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:44.321523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:44.329562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.337430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.338191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.338839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.349760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.350536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.351156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.369552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:44.411165 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c60a866-4c28-4e61-bdcd-98315b6182ef tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.144582 Oct 03 14:38:44.419539 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 832/1639] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 3 14:38:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:38:44.424235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c41c4f57-5e13-4939-b6d2-34473df9e965 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c4c670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:44.466313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.466804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.467245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.468435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.469190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.469622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.501459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c41c4f57-5e13-4939-b6d2-34473df9e965 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.085313 Oct 03 14:38:44.510731 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 833/1640] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:44 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:44.524279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8389a20d-0bb3-44d4-950e-93350930aef9 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '.version_select at 0x7fb234bbcaf0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:44.533456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8389a20d-0bb3-44d4-950e-93350930aef9 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.534251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8389a20d-0bb3-44d4-950e-93350930aef9 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.534886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8389a20d-0bb3-44d4-950e-93350930aef9 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.538667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:38:44.558787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8389a20d-0bb3-44d4-950e-93350930aef9 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3496 microversion: 2.1 time: 0.046611 Oct 03 14:38:44.559476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for user 7415ca24b92d4ba193b3f6762d4196b3 and project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:38:44.564704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 834/1641] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:38:44 2022] GET /compute/v2.1/os-migrations => generated 3496 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:44.577074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-781139-2", "block_migration": "auto"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:44.579653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:44.597451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.597948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.598383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.599129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.599542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.599963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.662189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'flavor' on Instance uuid c78c44ad-428f-4712-a350-05c9b2047751 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:44.693531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Going to try to live migrate instance to n-h2-781139-2 {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:38:44.893947 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b8aa7d2-bb4e-4523-ac1a-9c4cd98021b2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc/action" status: 202 len: 0 microversion: 2.1 time: 0.583467 Oct 03 14:38:44.896311 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 808/1642] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:38:44 2022] POST /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:44.932432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:44.933619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:44.953125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.953940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.955696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:44.957863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:44.960591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:44.962572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:45.600586 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-20ede8bf-7c44-48d9-b50c-5167a7b3a20c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1856 microversion: 2.1 time: 0.698973 Oct 03 14:38:45.602224 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 809/1643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:44 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1856 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:45.615071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:45.615689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:45.638985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:45.642602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:45.643437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:45.645375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:45.647135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:45.649621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:46.429996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:46.442990 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fa179575-2743-47a9-baef-82e9c184d07c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1469 microversion: 2.1 time: 0.838481 Oct 03 14:38:46.447144 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 810/1644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:45 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1469 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:46.454068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:46.454683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:46.472145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:46.472643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:46.473105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:46.473831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:46.474300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:46.474725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:46.848896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:46.858208 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52c39d5c-a867-4ec2-abc4-2d63698161ed tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.409890 Oct 03 14:38:46.877439 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 811/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:46 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:46.896172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd8ee793-d7f3-4198-a106-9140639e7cb9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230968040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:46.976754 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd8ee793-d7f3-4198-a106-9140639e7cb9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.097698 Oct 03 14:38:46.977990 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 812/1646] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:46 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:46.992020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:46.993041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:47.000569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:47.001449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:47.002107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:47.003027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:47.003747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:47.004384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:47.456875 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90d2c77d-3d75-4ea4-bdae-854998f035f5 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1856 microversion: 2.1 time: 0.474062 Oct 03 14:38:47.458684 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 813/1647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:46 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1856 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:47.477019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1aee1a38-2c65-445c-8570-a32718e535f8 req-5a7cd351-9aed-4408-9310-fcce0f8ef45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b727e6-8fa6-4da7-82c9-72083504f60d", "name": "network-vif-plugged", "status": "completed", "tag": "d4ce351c-e67c-46b2-9ad8-e83f023e9914"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:47.509058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1aee1a38-2c65-445c-8570-a32718e535f8 req-5a7cd351-9aed-4408-9310-fcce0f8ef45c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:47.509811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1aee1a38-2c65-445c-8570-a32718e535f8 req-5a7cd351-9aed-4408-9310-fcce0f8ef45c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:47.517709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1aee1a38-2c65-445c-8570-a32718e535f8 req-5a7cd351-9aed-4408-9310-fcce0f8ef45c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:47.548119 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1aee1a38-2c65-445c-8570-a32718e535f8 req-5a7cd351-9aed-4408-9310-fcce0f8ef45c service nova] Creating event network-vif-plugged:d4ce351c-e67c-46b2-9ad8-e83f023e9914 for instance a7b727e6-8fa6-4da7-82c9-72083504f60d on n-h2-781139-2 Oct 03 14:38:47.558461 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1aee1a38-2c65-445c-8570-a32718e535f8 req-5a7cd351-9aed-4408-9310-fcce0f8ef45c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096167 Oct 03 14:38:47.559926 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 814/1648] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:47.568079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:47.569789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:47.578022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:47.580894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:47.582414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:47.583094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:47.584119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:47.584787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:47.585500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:48.271698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:48.285092 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d2cfab0-52e6-4b1a-8699-95077c566804 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1469 microversion: 2.1 time: 0.723626 Oct 03 14:38:48.286314 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 815/1649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:47 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1469 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:48.309297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:48.310448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:48.317482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:48.318406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:48.319004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:48.319928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:48.320552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:48.321003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:48.423486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lazy-loading 'services' on Instance uuid 1cf0cae3-a215-4491-bcc9-6ce278351274 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:38:48.526148 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cee1433b-091c-40cb-a39e-ab93b697a648 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments/262df903-4013-448c-8e4c-ed8e47b5af0f" status: 202 len: 0 microversion: 2.1 time: 0.226737 Oct 03 14:38:48.527969 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 816/1650] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 14:38:48 2022] DELETE /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments/262df903-4013-448c-8e4c-ed8e47b5af0f => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:38:48.539630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:48.540556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:48.548446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:48.549242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:48.549832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:48.551076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:48.551687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:48.552266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:48.823635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:48.845880 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a0e9f02c-34c6-4967-9b24-b3c451428846 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.313932 Oct 03 14:38:48.863063 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 817/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:48 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:48.874159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-495ef0b1-801f-4b15-a2ce-04dc24f6e95c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230968040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:48.969266 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-495ef0b1-801f-4b15-a2ce-04dc24f6e95c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.072482 Oct 03 14:38:48.969266 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 818/1652] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:48 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:49.062340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-977663366", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:49.099770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-806cceef-75bc-486d-a3c4-4ac709c356b3 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751/action" status: 202 len: 0 microversion: 2.25 time: 4.533910 Oct 03 14:38:49.104742 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 835/1653] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:38:44 2022] POST /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751/action => generated 0 bytes in 4539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:49.118862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:49.125612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:49.141488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:49.142308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:49.143728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:49.145393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:49.146199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:49.147668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:49.179862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] validate_networks() for [('a76ca716-dc16-4a11-bbe2-ea03340c8d7a', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:38:49.252509 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7dff5cfb-a23a-4016-9a57-80b86919e5f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142535 Oct 03 14:38:49.253216 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 836/1654] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:38:49 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:49.275134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:49.275771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:49.284054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:49.284481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:49.296447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:49.297504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:49.298003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:49.298516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:50.600239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:38:50.602274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:38:50.603124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:38:50.603777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:38:50.604412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:38:50.625446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:50.626356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:50.627201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:50.628209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:50.630665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:50.631208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:50.665321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Getting quotas for project 1118fb2e9d1a4ad0af213b85620e1cc0. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:38:50.672660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Getting quotas for user 2dbd6bbae7c44725b8a1dadcd8c788e4 and project 1118fb2e9d1a4ad0af213b85620e1cc0. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:38:50.692731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:38:50.696956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:38:50.750581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:50.760883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:50.774269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:50.779261 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01cd66aa-6426-442c-97ca-bee76b08a8ed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 1.516169 Oct 03 14:38:50.779917 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 837/1655] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:49 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:50.807043 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2399d41-8ca4-43e6-8c4a-2df32a24dc72 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.863791 Oct 03 14:38:50.813123 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 819/1656] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:38:50.816756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:50.817622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:50.834623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e21b53-e336-4990-b573-9cced61076bc", "name": "network-vif-plugged", "status": "completed", "tag": "0441cd47-154d-4303-8bbd-2ec0d338c773"}, {"server_uuid": "a7b727e6-8fa6-4da7-82c9-72083504f60d", "name": "network-vif-plugged", "status": "completed", "tag": "e160f679-9ba7-48a3-b16c-7675bafdd277"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:50.854124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:50.854912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:50.858201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:50.860080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:50.860728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:50.864277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:50.903462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:50.913117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:50.916387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:50.969747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] Creating event network-vif-plugged:0441cd47-154d-4303-8bbd-2ec0d338c773 for instance 31e21b53-e336-4990-b573-9cced61076bc on n-h1-781139-2 Oct 03 14:38:50.988856 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] Creating event network-vif-plugged:e160f679-9ba7-48a3-b16c-7675bafdd277 for instance a7b727e6-8fa6-4da7-82c9-72083504f60d on n-h2-781139-2 Oct 03 14:38:51.008679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] Instance 31e21b53-e336-4990-b573-9cced61076bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:38:51.079174 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-55fcc216-8838-4ceb-b0b8-3910e53643fe req-17cebe08-1c16-4fb6-84b1-9bbc21cda805 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.264525 Oct 03 14:38:51.079933 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 820/1657] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:51.096706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:51.134271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:51.161721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:51.163036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:51.165236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:51.168347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:51.171745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:51.176539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:51.771021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:51.799425 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cb6ee88-0f6e-4abb-9d5e-dc16aef11a39 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1469 microversion: 2.1 time: 0.992512 Oct 03 14:38:51.800585 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 838/1658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:50 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1469 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:51.822843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c1d99c6-360d-400c-b69d-ff35e341d272 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bbc8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:51.932173 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c1d99c6-360d-400c-b69d-ff35e341d272 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.126630 Oct 03 14:38:51.934589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 839/1659] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:51 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:51.943526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:51.947928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:51.949892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:51.953965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:51.977679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:51.977940 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d20c6ccd-a85b-4ba5-ae79-19e802617933 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.878369 Oct 03 14:38:51.978395 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 821/1660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:51 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:51.981331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:51.982086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:51.983403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:51.985211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:51.986077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:51.999752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7333ef83-0168-44aa-8fec-4312b4923854 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:52.000686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7333ef83-0168-44aa-8fec-4312b4923854 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:52.138496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8de824b5-beff-4960-a64f-45b60baf2442 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201028 Oct 03 14:38:52.147178 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 840/1661] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:38:51 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:52.162417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:52.165058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:52.189643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:52.191662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:52.192647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:52.196086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:52.198038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:52.199102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:52.202742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7333ef83-0168-44aa-8fec-4312b4923854 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:52.220059 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7333ef83-0168-44aa-8fec-4312b4923854 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1223 microversion: 2.1 time: 0.239123 Oct 03 14:38:52.220683 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 822/1662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:51 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1223 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:52.828268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:52.829731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:52.840950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:52.847439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:52.850982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:52.854910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:52.857424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:52.861437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:52.868703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:52.883520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:52.885328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:52.890428 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89f3fcd9-f49f-4dc6-a851-ff6ee43785d5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.741261 Oct 03 14:38:52.892252 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 841/1663] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:52 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:52.950668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-838b0d8d-694b-427e-947b-eeca678181f2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234ccf4c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:53.060627 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-838b0d8d-694b-427e-947b-eeca678181f2 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.114340 Oct 03 14:38:53.062492 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 842/1664] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:52 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:53.067404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:53.085395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:53.112138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.114472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.115093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:53.116018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.117468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.121656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:53.160152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:53.185506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aae5dfcf-4df1-414d-b5dd-b1612000c66f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1469 microversion: 2.1 time: 0.357704 Oct 03 14:38:53.191525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 823/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:52 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:53.218029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:53.230174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:53.270102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.274098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.274626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:53.279953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.283912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.286545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:53.435525 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c49ce902-2d98-4967-a504-ec2565540276 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242685 Oct 03 14:38:53.443013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 824/1666] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:38:53 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:53.504164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:53.504774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:53.523689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.524432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.530010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:53.535108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.535796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.536402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:53.648636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:53.658503 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a06fd4c1-1d4a-432b-87cf-790764ede59f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1219 microversion: 2.1 time: 0.213969 Oct 03 14:38:53.662077 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 825/1667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:53 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1219 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:53.813365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:53.827302 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e3112dd-6fa2-4647-bcca-1cc532738472 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1334 microversion: 2.1 time: 0.763491 Oct 03 14:38:53.831613 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 843/1668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:53 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1334 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:53.918556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:53.919605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:53.932350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.933170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.933783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:53.936875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:53.940393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:53.941179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:54.077292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f9cad47-253b-4633-97de-4931b7c1f351 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c4c430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:54.175090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f9cad47-253b-4633-97de-4931b7c1f351 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.101693 Oct 03 14:38:54.186775 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 844/1669] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:54 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:54.218103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:54.218733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:54.227046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:54.227732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:54.228153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:54.228913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:54.229447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:54.229854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:54.276858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:54.288133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:54.293692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:54.297842 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2f27ddb-75d2-4e63-8289-939de36ac1b2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.383484 Oct 03 14:38:54.298650 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 826/1670] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:53 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:54.347708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:54.448030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:54.455468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:54.476395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:54.477271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:54.479859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:54.481118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:54.481824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:54.490364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:54.625636 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4316398c-d6e9-4782-95b4-aa85da652659 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174936 Oct 03 14:38:54.628117 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 827/1671] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:38:54 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:54.688334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:54.689521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:54.711521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:54.714212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:54.717870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:54.720281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:54.726889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:54.728642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:54.974731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:54.993639 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42475790-3742-428a-8509-0a7491e89b6d tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1275 microversion: 2.1 time: 0.309424 Oct 03 14:38:55.008951 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 828/1672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:54 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1275 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:55.023732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:55.026729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:55.040721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:55.041945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:55.042880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:55.044662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:55.045453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:55.046506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:55.586222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:55.600472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4d183c2-675b-4c5e-a130-9903fc3ecc84 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1669 microversion: 2.1 time: 0.590374 Oct 03 14:38:55.602446 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 829/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:55 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1669 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:55.610934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b5814e3-c874-49e1-bce6-fa166f332aa0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2311441f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:55.712889 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b5814e3-c874-49e1-bce6-fa166f332aa0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.109102 Oct 03 14:38:55.729140 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 830/1674] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:55 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:55.748895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:55.755674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:55.775004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:55.775533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:55.779280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:55.782349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:55.787067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:55.787067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:55.828152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:55.843308 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0cccc3b8-cde8-4dce-b53f-bb50ccce1f8b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1469 microversion: 2.1 time: 1.629369 Oct 03 14:38:55.846753 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 845/1675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:54 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1469 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:55.862957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:55.864375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:55.911934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:55.913900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:55.916034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:55.920284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:55.921399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:55.922891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.008666 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f64d5ac2-dd27-47ac-b266-883b61285b35 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d/ips" status: 200 len: 179 microversion: 2.1 time: 0.159091 Oct 03 14:38:56.014379 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 846/1676] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:38:55 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d/ips => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:56.024079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:56.027429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:56.067259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.068795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.069681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.071303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.073224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.074191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.178155 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be2ad1ea-5ec8-4e4d-b9be-ca770e2ceb8b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161141 Oct 03 14:38:56.182418 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 847/1677] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:38:56 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:56.193605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:56.195929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:56.211119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.219359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.221578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.227032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.227882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.228602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.559698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:56.571548 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6842c746-6e18-418f-84e6-e8463bcaada6 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1293 microversion: 2.1 time: 0.385633 Oct 03 14:38:56.592073 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 848/1678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:56 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1293 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:56.597648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:56.598288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:56.605731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.606317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.606749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.608126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.608593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.609042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.643399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:38:56.698481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:56.710575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:56.713884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:56.720361 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bede5c89-e78f-4300-94de-5232db925805 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.982764 Oct 03 14:38:56.741961 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 831/1679] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:55 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:56.754396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-09108272-94fd-4ea3-b7a9-7f7dbd6ae42f req-6c9197f1-5300-44e3-aba7-e8053731ce01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e21b53-e336-4990-b573-9cced61076bc", "name": "network-vif-unplugged", "status": "completed", "tag": "0441cd47-154d-4303-8bbd-2ec0d338c773"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:38:56.784635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-09108272-94fd-4ea3-b7a9-7f7dbd6ae42f req-6c9197f1-5300-44e3-aba7-e8053731ce01 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.788006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-09108272-94fd-4ea3-b7a9-7f7dbd6ae42f req-6c9197f1-5300-44e3-aba7-e8053731ce01 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.788690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-09108272-94fd-4ea3-b7a9-7f7dbd6ae42f req-6c9197f1-5300-44e3-aba7-e8053731ce01 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.817539 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6916e879-c566-49c9-83db-1c0eb766f5cd tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 204 len: 0 microversion: 2.1 time: 0.223647 Oct 03 14:38:56.818357 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-09108272-94fd-4ea3-b7a9-7f7dbd6ae42f req-6c9197f1-5300-44e3-aba7-e8053731ce01 service nova] Creating event network-vif-unplugged:0441cd47-154d-4303-8bbd-2ec0d338c773 for instance 31e21b53-e336-4990-b573-9cced61076bc on n-h1-781139-2 Oct 03 14:38:56.818994 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 849/1680] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:38:56 2022] DELETE /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:56.837039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c31387a-628e-471c-b3f9-99c0b8bdbc2f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234bb30d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:56.840409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-09108272-94fd-4ea3-b7a9-7f7dbd6ae42f req-6c9197f1-5300-44e3-aba7-e8053731ce01 service nova] Instance 31e21b53-e336-4990-b573-9cced61076bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:38:56.867804 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-09108272-94fd-4ea3-b7a9-7f7dbd6ae42f req-6c9197f1-5300-44e3-aba7-e8053731ce01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123966 Oct 03 14:38:56.870018 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 832/1681] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:56.886400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:56.887621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:56.902111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.907084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.912640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.918155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.919015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.919691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.935881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c31387a-628e-471c-b3f9-99c0b8bdbc2f tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.110420 Oct 03 14:38:56.936822 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 850/1682] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:56 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:56.951454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:56.954012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:56.961474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.962266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.962902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:56.963803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:56.964447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:56.965107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:57.677272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:57.683889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:57.691787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-616c33e7-649e-4d17-b85e-fb56cda21e0b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1535 microversion: 2.1 time: 0.752199 Oct 03 14:38:57.692745 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 851/1683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:56 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1535 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:57.704169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:57.707504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:57.727412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:57.728266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:57.735916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:57.736803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:57.737526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:57.738046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:57.806522 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a726715-ff62-46d7-9bee-83c8cbba98b4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112414 Oct 03 14:38:57.807586 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 852/1684] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:38:57 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:57.816778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:57.821791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:57.836210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:57.837212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:57.838314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:57.839311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:57.839988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:57.840705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:57.849687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:57.866293 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c74ee681-2a7e-44cc-af98-9be5ae59ea39 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1675 microversion: 2.1 time: 0.994696 Oct 03 14:38:57.887723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 833/1685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:56 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1675 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:57.903746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:57.907766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:57.940573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:57.944488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:57.947842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:57.950533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:57.954713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:57.956830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:58.162054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:58.171379 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8ca1023-cd3b-48a2-a7ae-87d222a28992 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1281 microversion: 2.1 time: 0.362595 Oct 03 14:38:58.188671 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 853/1686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:57 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1281 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:58.193814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d13b3093-3793-44f7-a572-c8e2d3cd34b9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234a87700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:58.290189 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d13b3093-3793-44f7-a572-c8e2d3cd34b9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.100080 Oct 03 14:38:58.298502 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 854/1687] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:58 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:58.716754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:58.717566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:58.731158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:58.731975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:58.736205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:58.737146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:58.740785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:58.741495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:58.973773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:58.985973 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-167b6a41-83c3-4dbc-b7ee-3bd7ebc75c68 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1535 microversion: 2.1 time: 0.274088 Oct 03 14:38:58.987520 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 855/1688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:58 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1535 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:58.998784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:59.001433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:59.017793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:59.018561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:59.019156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:59.020167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:59.020785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:59.021469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:59.078828 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9992f69b-0c7a-4532-8006-026a9284fa73 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089880 Oct 03 14:38:59.080138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 856/1689] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:38:58 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:38:59.085062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:59.086149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:59.093864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:59.094551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:59.095147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:59.096048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:59.096771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:59.097640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:59.476123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:59.487373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:59.496888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:59.498765 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9035b84f-1096-4be8-a714-b19c7bdbd275 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 1.603708 Oct 03 14:38:59.499613 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 834/1690] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:38:57 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:38:59.504371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:59.511173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:38:59.516624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:59.530450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:59.532416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:59.532416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:59.532416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:38:59.532768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:38:59.533085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:38:59.538689 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f70a6324-11b4-4635-8f35-a5548447a33f tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1675 microversion: 2.1 time: 0.457011 Oct 03 14:38:59.539303 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 857/1691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:59 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1675 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:59.544090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f1e6caa-b346-4daa-86ea-3d89b696b5b5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234ccf280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:38:59.626021 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f1e6caa-b346-4daa-86ea-3d89b696b5b5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.085574 Oct 03 14:38:59.638000 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 858/1692] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:38:59 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:59.751665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:38:59.769742 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-248e80ce-c4ff-4c1b-a68d-b199614dd55c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1281 microversion: 2.1 time: 0.268808 Oct 03 14:38:59.770951 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 835/1693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:38:59 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:00.021205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:00.022005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:00.030236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.031077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.031776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.032603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.033299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.033956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.092579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:00.094956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:00.109957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.110818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.111563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.112330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.112808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.113241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.175549 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7456560c-ad27-4b1c-b963-04dd1bc0c1a5 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087414 Oct 03 14:39:00.182505 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 836/1694] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:39:00 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:39:00.412293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:00.427387 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a15dd9b-ccda-4777-a853-0f194b347e23 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1535 microversion: 2.1 time: 0.411896 Oct 03 14:39:00.430964 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 859/1695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:00 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1535 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:00.534858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:00.535466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:00.547511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.549608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.550105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.550856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.551290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.554958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.567525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:00.569557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:00.586760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.587998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.589841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.593605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:00.595450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:00.597088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:00.675070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:01.301779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:01.312204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:01.330596 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc690af4-38ed-469e-af11-fca7ded3bd0c tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1654 microversion: 2.1 time: 0.768215 Oct 03 14:39:01.353646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:01.359575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:01.360186 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 860/1696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:00 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1654 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:01.403208 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3695df7e-8bb4-41b3-a44f-46b1cd2159f1 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.871856 Oct 03 14:39:01.416367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 837/1697] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:00 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:01.431276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d78a1ea-11a1-40ba-a607-94f553a28b74 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234c41b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:01.439328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:01.442446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:01.482203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:01.483085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:01.487013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:01.493974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:01.494603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:01.495112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:01.530331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d78a1ea-11a1-40ba-a607-94f553a28b74 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1412 microversion: 2.1 time: 0.162023 Oct 03 14:39:01.536541 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 861/1698] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:01 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1412 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:01.546628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-008c8f8a-eca8-4a21-8fc2-3e8844f0c519 req-39f29c89-7317-47ef-a2b1-ce2c9f66b96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b727e6-8fa6-4da7-82c9-72083504f60d", "name": "network-vif-deleted", "tag": "d4ce351c-e67c-46b2-9ad8-e83f023e9914"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:01.619371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-008c8f8a-eca8-4a21-8fc2-3e8844f0c519 req-39f29c89-7317-47ef-a2b1-ce2c9f66b96d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:01.619857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-008c8f8a-eca8-4a21-8fc2-3e8844f0c519 req-39f29c89-7317-47ef-a2b1-ce2c9f66b96d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:01.620290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-008c8f8a-eca8-4a21-8fc2-3e8844f0c519 req-39f29c89-7317-47ef-a2b1-ce2c9f66b96d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:01.681835 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-008c8f8a-eca8-4a21-8fc2-3e8844f0c519 req-39f29c89-7317-47ef-a2b1-ce2c9f66b96d service nova] Creating event network-vif-deleted:d4ce351c-e67c-46b2-9ad8-e83f023e9914 for instance a7b727e6-8fa6-4da7-82c9-72083504f60d on n-h2-781139-2 Oct 03 14:39:01.697786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-008c8f8a-eca8-4a21-8fc2-3e8844f0c519 req-39f29c89-7317-47ef-a2b1-ce2c9f66b96d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157953 Oct 03 14:39:01.706621 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 862/1699] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:01.720988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:01.721841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:01.744959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:01.746877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:01.748854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:01.749850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:01.751828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:01.752885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:02.213134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.395156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:02.452145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b17c113-6268-461b-85a9-41f622b10d3e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1535 microversion: 2.1 time: 0.735613 Oct 03 14:39:02.474031 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 863/1700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:01 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1535 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:02.483743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:02.485661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:02.495940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:02.496870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:02.497500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:02.498529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:02.499157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:02.499772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:03.049791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ab6b8853d4f460bb22b84d38bd8b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85df1411b734bcaa79e8b4cdda1fae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:03.059877 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1efe309b-fc56-4219-9034-7b0ffa5d1851 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 200 len: 1496 microversion: 2.1 time: 0.582607 Oct 03 14:39:03.063503 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 864/1701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:02 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 1496 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:03.078670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:03.084906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:03.107063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:03.107589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:03.108036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:03.110457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:03.112489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:03.112964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:03.167639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:03.193520 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d03b2e4-1929-4b89-a817-acb156213d15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 1.771208 Oct 03 14:39:03.194193 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 838/1702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:01 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:03.231535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ddcd54c-a7cd-40c1-bc49-30f36b839839 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23058c4c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:05.797844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:05.818017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:05.824725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:05.827449 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c214b15a-253b-4d96-8af6-e1d5df04e66a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 2.758940 Oct 03 14:39:05.833138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 865/1703] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:03 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:05.847622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f7c73dec-8260-4cfe-ac71-10b58ed5aaf3 req-f8a417c1-c98d-4034-b384-01b7e8af93b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b727e6-8fa6-4da7-82c9-72083504f60d", "name": "network-vif-unplugged", "status": "completed", "tag": "e160f679-9ba7-48a3-b16c-7675bafdd277"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:05.876167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f7c73dec-8260-4cfe-ac71-10b58ed5aaf3 req-f8a417c1-c98d-4034-b384-01b7e8af93b8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:05.876678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f7c73dec-8260-4cfe-ac71-10b58ed5aaf3 req-f8a417c1-c98d-4034-b384-01b7e8af93b8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:05.877647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f7c73dec-8260-4cfe-ac71-10b58ed5aaf3 req-f8a417c1-c98d-4034-b384-01b7e8af93b8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:05.916238 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f7c73dec-8260-4cfe-ac71-10b58ed5aaf3 req-f8a417c1-c98d-4034-b384-01b7e8af93b8 service nova] Creating event network-vif-unplugged:e160f679-9ba7-48a3-b16c-7675bafdd277 for instance a7b727e6-8fa6-4da7-82c9-72083504f60d on n-h2-781139-2 Oct 03 14:39:05.933484 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f7c73dec-8260-4cfe-ac71-10b58ed5aaf3 req-f8a417c1-c98d-4034-b384-01b7e8af93b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098551 Oct 03 14:39:05.937399 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 866/1704] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:05.952874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:05.954552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:05.968112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:05.970880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:05.971524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:05.976551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:05.977256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:05.979035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:06.493915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:06.513273 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eccf5aa8-f9a0-4bd7-9f1e-19f31515a375 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1528 microversion: 2.1 time: 0.569848 Oct 03 14:39:06.523292 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 867/1705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:05 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1528 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:06.545211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-73a3e7de-114c-49d2-a6b9-191d9d6f0ca4 req-c3a4b14d-580a-4e1b-873c-395feb9db43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b727e6-8fa6-4da7-82c9-72083504f60d", "name": "network-vif-deleted", "tag": "e160f679-9ba7-48a3-b16c-7675bafdd277"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:06.575687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-73a3e7de-114c-49d2-a6b9-191d9d6f0ca4 req-c3a4b14d-580a-4e1b-873c-395feb9db43b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:06.576801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-73a3e7de-114c-49d2-a6b9-191d9d6f0ca4 req-c3a4b14d-580a-4e1b-873c-395feb9db43b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:06.577547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-73a3e7de-114c-49d2-a6b9-191d9d6f0ca4 req-c3a4b14d-580a-4e1b-873c-395feb9db43b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:06.633454 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-73a3e7de-114c-49d2-a6b9-191d9d6f0ca4 req-c3a4b14d-580a-4e1b-873c-395feb9db43b service nova] Creating event network-vif-deleted:e160f679-9ba7-48a3-b16c-7675bafdd277 for instance a7b727e6-8fa6-4da7-82c9-72083504f60d on n-h2-781139-2 Oct 03 14:39:06.646581 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-73a3e7de-114c-49d2-a6b9-191d9d6f0ca4 req-c3a4b14d-580a-4e1b-873c-395feb9db43b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117778 Oct 03 14:39:06.649738 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 868/1706] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:06.665056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:06.666200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:06.685915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:06.690099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:06.690837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:06.695776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:06.696658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:06.700064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:06.736075 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] HTTP exception thrown: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Request method failure captured: Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d HTTP/1.1 Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvOcwkKX1Mn5j49iujcun7UKQJGimVm9TXo_pS2aH-_tL1KpwyK_sqNnowD1JGF3RQyAKWkEoWTez8m7Tj8uGJLTEiaar9Q3WlC9qSznNpcnYSb6iKsMdeA5InkPftuJS7RG4SGLXtLh_6jaAC2gVbQhlnbwd4PLiFiNZRBqcg52gfs Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:06.747227 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85df1411b734bcaa79e8b4cdda1fae9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7ab6b8853d4f460bb22b84d38bd8b4c6 Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:06.749569 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a7b727e6-8fa6-4da7-82c9-72083504f60d'} Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:06.750433 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:06.753203 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:06.758015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Returning 404 to user: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:06.759909 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f315a65-2312-4130-950d-97a2cfe956c7 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 404 len: 111 microversion: 2.1 time: 0.108707 Oct 03 14:39:06.765015 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 869/1707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:06 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:39:06.775559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:06.776662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:06.795218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:06.796065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:06.797312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:06.798650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:06.800530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:06.801242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:07.734895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:07.748540 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8544e2d2-5017-471a-855a-7a8646a16dec tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 0.980829 Oct 03 14:39:07.751479 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 870/1708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:06 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:07.763203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:07.765670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:07.785213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:07.788103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:07.789078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:07.790000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:07.791839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:07.793636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:08.254845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:08.272694 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ff0d2f4-7810-4c66-9ac6-4c3ca4fe6f56 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1528 microversion: 2.1 time: 0.518571 Oct 03 14:39:08.275830 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 871/1709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:07 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1528 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:08.301510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:08.305432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:08.343060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:08.369674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:08.371416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:08.384581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:08.385248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:08.398206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:08.965233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:08.979123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:08.985056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:08.986687 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cac975ca-9b5d-4b09-ab31-93fe3aa8c3f4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.709486 Oct 03 14:39:08.989077 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 872/1710] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:08 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:09.006273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b2dbc0c7-f264-4402-aca0-25e794c58e8a req-c7171d05-7b80-4867-9a59-9877750c2920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e21b53-e336-4990-b573-9cced61076bc", "name": "network-vif-plugged", "status": "completed", "tag": "0441cd47-154d-4303-8bbd-2ec0d338c773"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:09.048072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2dbc0c7-f264-4402-aca0-25e794c58e8a req-c7171d05-7b80-4867-9a59-9877750c2920 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:09.049719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2dbc0c7-f264-4402-aca0-25e794c58e8a req-c7171d05-7b80-4867-9a59-9877750c2920 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:09.050390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2dbc0c7-f264-4402-aca0-25e794c58e8a req-c7171d05-7b80-4867-9a59-9877750c2920 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:09.127427 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b2dbc0c7-f264-4402-aca0-25e794c58e8a req-c7171d05-7b80-4867-9a59-9877750c2920 service nova] Creating event network-vif-plugged:0441cd47-154d-4303-8bbd-2ec0d338c773 for instance 31e21b53-e336-4990-b573-9cced61076bc on n-h1-781139-2 Oct 03 14:39:09.147741 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b2dbc0c7-f264-4402-aca0-25e794c58e8a req-c7171d05-7b80-4867-9a59-9877750c2920 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151658 Oct 03 14:39:09.150553 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 873/1711] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:09.159468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c3027b9-5c40-46ef-833c-7c5bd056f2db tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5c3027b9-5c40-46ef-833c-7c5bd056f2db tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] HTTP exception thrown: Flavor e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a could not be found. Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c3027b9-5c40-46ef-833c-7c5bd056f2db tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Request method failure captured: Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/flavors/e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a HTTP/1.1 Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvM3KhV0HEXlMNmOMn2yynL3_4XSVX5dEG1QsaRpGyXd9NyXlH2TxfiU2WDn15xOtcQlpnpzNej9XnIwAu0QKVv0jvZrQIkg-er9qxOy-1TR7Yg8WDuizh2H3kvEvdP3QR_p6Bwm2OBhNg6UX5JTZrwSZAwCskK5xPh44d9zZsSli9M Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8af1a3826336420dae7fc63cff307355 Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-MigrationsAdminTest-433163805 Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:39:09.188741 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8af1a3826336420dae7fc63cff307355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8af1a3826336420dae7fc63cff307355", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af1a3826336420dae7fc63cff307355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af1a3826336420dae7fc63cff307355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-MigrationsAdminTest-433163805 Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8af1a3826336420dae7fc63cff307355 Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MigrationsAdminTest-433163805 Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-MigrationsAdminTest-433163805-project-admin Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 318c6060cbf44cc78496927ef499297f Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-MigrationsAdminTest-433163805-project-admin Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: exception: Flavor e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a could not be found. Oct 03 14:39:09.218741 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a'} Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a could not be found. Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:09.221819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a could not be found. Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a could not be found. Oct 03 14:39:09.223918 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:09.225510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c3027b9-5c40-46ef-833c-7c5bd056f2db tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Returning 404 to user: Flavor e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:09.225510 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c3027b9-5c40-46ef-833c-7c5bd056f2db tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a" status: 404 len: 109 microversion: 2.1 time: 0.036136 Oct 03 14:39:09.225510 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 874/1712] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:39:09 2022] DELETE /compute/v2.1/flavors/e35bd7c8-d5c3-43a7-95c4-52eef6be4e5a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:39:09.225510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c86b7a23-a012-4acc-b9e1-678340769f31 req-ba7c40a2-b08e-4312-ba17-0225ca429622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c", "tag": "c1847700-d232-42c8-a049-ef3bbcdad333"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:09.246813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c86b7a23-a012-4acc-b9e1-678340769f31 req-ba7c40a2-b08e-4312-ba17-0225ca429622 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:09.247366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c86b7a23-a012-4acc-b9e1-678340769f31 req-ba7c40a2-b08e-4312-ba17-0225ca429622 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:09.247659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c86b7a23-a012-4acc-b9e1-678340769f31 req-ba7c40a2-b08e-4312-ba17-0225ca429622 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:09.291149 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c86b7a23-a012-4acc-b9e1-678340769f31 req-ba7c40a2-b08e-4312-ba17-0225ca429622 service nova] Creating event network-changed:c1847700-d232-42c8-a049-ef3bbcdad333 for instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c on n-h1-781139-2 Oct 03 14:39:09.303363 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c86b7a23-a012-4acc-b9e1-678340769f31 req-ba7c40a2-b08e-4312-ba17-0225ca429622 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111295 Oct 03 14:39:09.304171 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 875/1713] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:09.323486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:09.324250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:09.354248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:09.355027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:09.355542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:09.356481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:09.356969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:09.357400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:09.414327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:09.913359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:09.921936 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f6ebf4d-db0c-4ca2-bf6c-3b366c17f994 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 0.607620 Oct 03 14:39:09.925645 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 876/1714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:09 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:09.937105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-148139082", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:10.775006 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ddcd54c-a7cd-40c1-bc49-30f36b839839 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1421 microversion: 2.1 time: 7.562716 Oct 03 14:39:10.775937 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 839/1715] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:03 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1421 bytes in 7581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:10.788088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:10.790100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:10.792063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:39:10.803123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:10.803734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:10.805653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:10.806787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:10.807593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:10.808164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:11.145290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:11.186022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:11.195255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:11.198936 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff766a09-e208-470a-9e72-5d6237b7229c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.421723 Oct 03 14:39:11.223761 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 840/1716] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:10 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:11.246756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50da4170-4046-4702-9b65-7595a9c1d565 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230ded160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:11.332345 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50da4170-4046-4702-9b65-7595a9c1d565 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 200 len: 1421 microversion: 2.1 time: 0.100971 Oct 03 14:39:11.334182 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 841/1717] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:11 2022] GET /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:11.349177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:11.351325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:11.368342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:11.370222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:11.371573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:11.374781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:11.377563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:11.378129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:11.732605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:39:11.733414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:39:11.734115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:39:11.734821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:39:11.735489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:39:11.739249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.765909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:11.766773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:11.767473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:11.769124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:11.770316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:11.770932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:11.802067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:11.814508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Getting quotas for user 7415ca24b92d4ba193b3f6762d4196b3 and project adcd764080de463c8416d98168a9ee94. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:11.847538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:39:11.851203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:39:11.981133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02fd71ea-4bec-4a05-a3c7-8f1483a69074 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.047925 Oct 03 14:39:11.989669 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 877/1718] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:39:12.008375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4571d371-972c-4785-b5dd-67b4674bfadd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234ccf550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:12.962114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:12.967741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.997154 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4c2ee065-7dcb-4634-93e9-056f72032a15 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 1.646148 Oct 03 14:39:12.998645 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 842/1719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:11 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:13.003990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fd9a79a-ae7f-4723-a887-a2f350abe853 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:13.010374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9fd9a79a-ae7f-4723-a887-a2f350abe853 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:13.202332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9fd9a79a-ae7f-4723-a887-a2f350abe853 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:13.211130 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9fd9a79a-ae7f-4723-a887-a2f350abe853 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1212 microversion: 2.1 time: 0.211014 Oct 03 14:39:13.231877 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 843/1720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:12 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1212 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:13.240272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:13.240899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:13.260234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.263178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.263645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.265467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.273813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.274441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.575066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4571d371-972c-4785-b5dd-67b4674bfadd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 204 len: 0 microversion: 2.1 time: 1.582938 Oct 03 14:39:13.576635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 878/1721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:11 2022] DELETE /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 0 bytes in 1586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:13.582904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:13.584679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:13.605991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.610085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.610769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.612365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.613747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.614928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.648953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:13.654404 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] HTTP exception thrown: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Request method failure captured: Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d HTTP/1.1 Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvOcwkKX1Mn5j49iujcun7UKQJGimVm9TXo_pS2aH-_tL1KpwyK_sqNnowD1JGF3RQyAKWkEoWTez8m7Tj8uGJLTEiaar9Q3WlC9qSznNpcnYSb6iKsMdeA5InkPftuJS7RG4SGLXtLh_6jaAC2gVbQhlnbwd4PLiFiNZRBqcg52gfs Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:13.659023 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85df1411b734bcaa79e8b4cdda1fae9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7ab6b8853d4f460bb22b84d38bd8b4c6 Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.661159 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a7b727e6-8fa6-4da7-82c9-72083504f60d'} Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:13.662256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.664342 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.666662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:13.669932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:13.670719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Returning 404 to user: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:13.673396 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1906bdce-d707-40f8-adf8-42d01241ee77 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 404 len: 111 microversion: 2.1 time: 0.095058 Oct 03 14:39:13.673570 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b21ca2fc-58e7-4336-b8f9-500d213bd878 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.440209 Oct 03 14:39:13.674144 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 844/1722] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:13 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:13.675799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 879/1723] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:39:13 2022] DELETE /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:39:13.693456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:13.694433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: a7b727e6-8fa6-4da7-82c9-72083504f60d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:13.707500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:13.707996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:13.717718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.721134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.724166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.725767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.727321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.727864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.728324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.728453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.731486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.733401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.734097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.734540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.764384 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] HTTP exception thrown: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Request method failure captured: Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d HTTP/1.1 Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvOcwkKX1Mn5j49iujcun7UKQJGimVm9TXo_pS2aH-_tL1KpwyK_sqNnowD1JGF3RQyAKWkEoWTez8m7Tj8uGJLTEiaar9Q3WlC9qSznNpcnYSb6iKsMdeA5InkPftuJS7RG4SGLXtLh_6jaAC2gVbQhlnbwd4PLiFiNZRBqcg52gfs Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:13.770775 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85df1411b734bcaa79e8b4cdda1fae9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7ab6b8853d4f460bb22b84d38bd8b4c6 Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.772344 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a7b727e6-8fa6-4da7-82c9-72083504f60d'} Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:13.773239 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. Oct 03 14:39:13.775463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.777138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Returning 404 to user: Instance a7b727e6-8fa6-4da7-82c9-72083504f60d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:13.777338 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de36fe41-9920-46fd-9807-d301909725c9 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d" status: 404 len: 111 microversion: 2.1 time: 0.095089 Oct 03 14:39:13.784327 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 880/1724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:13 2022] GET /compute/v2.1/servers/a7b727e6-8fa6-4da7-82c9-72083504f60d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:39:13.797764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:13.799014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:13.814212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.815902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.818131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.821106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.822164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.823962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.825890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:39:13.857764 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] HTTP exception thrown: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Request method failure captured: Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf HTTP/1.1 Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvOcwkKX1Mn5j49iujcun7UKQJGimVm9TXo_pS2aH-_tL1KpwyK_sqNnowD1JGF3RQyAKWkEoWTez8m7Tj8uGJLTEiaar9Q3WlC9qSznNpcnYSb6iKsMdeA5InkPftuJS7RG4SGLXtLh_6jaAC2gVbQhlnbwd4PLiFiNZRBqcg52gfs Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:13.861473 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85df1411b734bcaa79e8b4cdda1fae9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7ab6b8853d4f460bb22b84d38bd8b4c6 Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:13.863012 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '77133fdd-86ee-4775-a2c4-558bf95fa5bf'} Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:13.863829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:13.865248 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:13.867630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Returning 404 to user: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:13.867630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce5369ed-1370-4b2d-adb5-65d1690245ac tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "DELETE /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 404 len: 111 microversion: 2.1 time: 0.076636 Oct 03 14:39:13.867630 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 881/1725] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:39:13 2022] DELETE /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:39:13.888469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:13.889130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] [instance: 77133fdd-86ee-4775-a2c4-558bf95fa5bf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:13.939669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.941385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.941789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:13.944282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:13.945587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:13.947492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:14.032772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] HTTP exception thrown: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Request method failure captured: Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf HTTP/1.1 Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvOcwkKX1Mn5j49iujcun7UKQJGimVm9TXo_pS2aH-_tL1KpwyK_sqNnowD1JGF3RQyAKWkEoWTez8m7Tj8uGJLTEiaar9Q3WlC9qSznNpcnYSb6iKsMdeA5InkPftuJS7RG4SGLXtLh_6jaAC2gVbQhlnbwd4PLiFiNZRBqcg52gfs Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:14.039533 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c85df1411b734bcaa79e8b4cdda1fae9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c85df1411b734bcaa79e8b4cdda1fae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c85df1411b734bcaa79e8b4cdda1fae9 Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestMultiNic-481073722 Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7ab6b8853d4f460bb22b84d38bd8b4c6 Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestMultiNic-481073722-project Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:14.041040 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '77133fdd-86ee-4775-a2c4-558bf95fa5bf'} Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:14.042935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. Oct 03 14:39:14.044666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:14.048155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] Returning 404 to user: Instance 77133fdd-86ee-4775-a2c4-558bf95fa5bf could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:14.049724 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a8a54eb-016e-48da-93ee-76e4f5edb604 tempest-ServersTestMultiNic-481073722 tempest-ServersTestMultiNic-481073722-project] 10.222.0.20 "GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf" status: 404 len: 111 microversion: 2.1 time: 0.176313 Oct 03 14:39:14.050864 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 882/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:13 2022] GET /compute/v2.1/servers/77133fdd-86ee-4775-a2c4-558bf95fa5bf => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:39:14.057681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:14.059174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:14.067231 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-044393b9-845c-40ca-aeb7-6e70b0779e30 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 204 len: 0 microversion: 2.1 time: 0.391465 Oct 03 14:39:14.070674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:14.071451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:14.084146 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 845/1727] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:39:13 2022] DELETE /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:14.097169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:14.098343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:14.099643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:14.100442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:14.239403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:14.241476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:14.281066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:14.283944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:14.284482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:14.285218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:14.285685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:14.289336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:14.442086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:14.455506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-169b7aba-e6e9-429b-8637-41b78eb2e443 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1272 microversion: 2.1 time: 0.224493 Oct 03 14:39:14.458023 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 846/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:14 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:39:14.467817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-178737174", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "1073fcc1-d3cc-4166-a49d-07b433f3c7e5"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:14.593778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:14.596244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] validate_networks() for [('1073fcc1-d3cc-4166-a49d-07b433f3c7e5', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:39:14.605850 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-800aa6b6-97da-449c-aa0a-542c43dfa5e8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 0.551879 Oct 03 14:39:14.608330 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 883/1729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:14 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:14.710173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:14.710891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:14.724957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:14.725750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:14.726240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:14.730259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:14.731635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:14.734188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:15.108478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:15.123053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:15.127194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:15.131488 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08905a9d-c93b-4272-ba88-2317e3d1668c tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.426815 Oct 03 14:39:15.140745 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 884/1730] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:14 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:15.490562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:15.491229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:15.506881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:15.507378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:15.507822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:15.512708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:15.513393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:15.516839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:15.692833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:15.710046 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81f59cbe-7836-4cae-a253-3f4f08df69a6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1272 microversion: 2.1 time: 0.223222 Oct 03 14:39:15.713651 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 885/1731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:15 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:15.725096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:15.727412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:15.745934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:15.748538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:15.749400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:15.751682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:15.753896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:15.754658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:15.925566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:39:15.927068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:39:15.927795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:39:15.928501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:39:15.929758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:39:15.943996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:15.944814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:15.947040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:15.948147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:15.949165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:15.949890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:15.971781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:15.979157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for user e62b7df215b144de94e02cd1e01f6f21 and project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:15.995486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:39:15.999134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:39:16.081265 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ac52aa9-3048-43e9-83e9-23449549cf8e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621670 Oct 03 14:39:16.093530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 847/1732] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:39:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:39:16.226715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:16.240523 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44db903b-9fad-4285-aed0-5526e539f6d1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 0.524698 Oct 03 14:39:16.260566 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 886/1733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:15 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:16.278334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e62f74f9-9468-480d-89b5-1de27796d7ec tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:16.280452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e62f74f9-9468-480d-89b5-1de27796d7ec tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:16.388865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f259e903-9d9b-4570-914e-bd9cf74f85eb tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Action: 'create', calling method: .version_select at 0x7fb231190a60>, body: {"keypair": {"name": "tempest-keypair-1036701109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrNmyt3H2QZLsDeQAp4F62UzRP0W1bAKoeEb2Ti3olczHa/I7NUjLgC03b/bJ54WRSBmtJ3mvpeeIjs4C+IiXPL1PhzyRu6xneDE22Vi48s+2NBoi8Lwxg1QI63qMlejg=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:16.421351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f259e903-9d9b-4570-914e-bd9cf74f85eb tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:16.423763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:16.436072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f259e903-9d9b-4570-914e-bd9cf74f85eb tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for user e65edfc21bfe462aa0729009763d3997 and project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:16.501521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f259e903-9d9b-4570-914e-bd9cf74f85eb tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.406556 Oct 03 14:39:16.502402 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 848/1734] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:16.513499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:16.514432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:16.540304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:16.540847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:16.541339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:16.549845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:16.550535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:16.552598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:16.556555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e62f74f9-9468-480d-89b5-1de27796d7ec tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:16.575556 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e62f74f9-9468-480d-89b5-1de27796d7ec tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1207 microversion: 2.1 time: 0.312525 Oct 03 14:39:16.578640 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 887/1735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:16 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1207 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:16.592961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4bb9f395-54cf-4bbc-8da1-35b6ef7cc832 req-ee490b82-e65c-4870-a0d5-4d8c73439862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388889a-755e-4663-b75c-84220b9d8fb1", "name": "network-vif-unplugged", "status": "completed", "tag": "26221873-2abe-488a-ad63-83dfa6fedeee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:16.616251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bb9f395-54cf-4bbc-8da1-35b6ef7cc832 req-ee490b82-e65c-4870-a0d5-4d8c73439862 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:16.620159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bb9f395-54cf-4bbc-8da1-35b6ef7cc832 req-ee490b82-e65c-4870-a0d5-4d8c73439862 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:16.622830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bb9f395-54cf-4bbc-8da1-35b6ef7cc832 req-ee490b82-e65c-4870-a0d5-4d8c73439862 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:16.655319 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4bb9f395-54cf-4bbc-8da1-35b6ef7cc832 req-ee490b82-e65c-4870-a0d5-4d8c73439862 service nova] Creating event network-vif-unplugged:26221873-2abe-488a-ad63-83dfa6fedeee for instance 4388889a-755e-4663-b75c-84220b9d8fb1 on n-h2-781139-2 Oct 03 14:39:16.670613 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4bb9f395-54cf-4bbc-8da1-35b6ef7cc832 req-ee490b82-e65c-4870-a0d5-4d8c73439862 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083942 Oct 03 14:39:16.671781 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 888/1736] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:16.677236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46f961bb-df0c-4018-8a8d-24a0ba4c9b28 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb230961430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:16.699167 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46f961bb-df0c-4018-8a8d-24a0ba4c9b28 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1036701109" status: 200 len: 498 microversion: 2.1 time: 0.025869 Oct 03 14:39:16.707115 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 889/1737] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 14:39:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1036701109 => generated 498 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:16.712797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4750ae07-2df7-413f-85b5-65051639d0f2 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb231313f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:16.748103 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4750ae07-2df7-413f-85b5-65051639d0f2 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036701109" status: 202 len: 0 microversion: 2.1 time: 0.039397 Oct 03 14:39:16.749915 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 890/1738] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036701109 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:16.769026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:16.780128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:16.811612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:16.812192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:16.813941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:16.818352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:16.822135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:16.822835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:17.331513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:17.340597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:17.342394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:17.343868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04046a15-66e0-4207-888c-db9a9008690b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.840483 Oct 03 14:39:17.376630 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 849/1739] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:16 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:17.383445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-843149c4-afd9-438e-90c6-c61187bdb982 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Action: 'create', calling method: .version_select at 0x7fb230978820>, body: {"keypair": {"name": "tempest-keypair-1977180173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8X8bznoSXq7SVNeC9YJM+1E374umARN/bA25UF+82rosLMGt0z1Un94XMW4t+42X2pB0sydwGEgKyuYV0uk0CWhfPVmeRsug9o4DFAcRVFrbmE31Z6Nb3oJ0L2wnJWFw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:17.399159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:17.408333 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-208c0fb1-2cf5-4bf8-a888-3f24035afc30 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1270 microversion: 2.1 time: 0.651015 Oct 03 14:39:17.421743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 891/1740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:16 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1270 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:17.433929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:17.434548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:17.456578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:17.457095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:17.457528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:17.458241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:17.458687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:17.459104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:17.463376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-843149c4-afd9-438e-90c6-c61187bdb982 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:17.471082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-843149c4-afd9-438e-90c6-c61187bdb982 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for user e65edfc21bfe462aa0729009763d3997 and project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:17.557521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-843149c4-afd9-438e-90c6-c61187bdb982 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179532 Oct 03 14:39:17.560269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 850/1741] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:17.588392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5848e1d8-94c3-43df-9d3e-1119c0b71252 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb230ccd550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:17.656407 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5848e1d8-94c3-43df-9d3e-1119c0b71252 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977180173" status: 202 len: 0 microversion: 2.1 time: 0.088143 Oct 03 14:39:17.657724 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 851/1742] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:39:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977180173 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:17.666177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:17.667046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:17.674805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:17.675726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:17.676586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:17.682794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:17.683677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:17.685599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:17.827703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:17.840753 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bf408c29-492e-4136-a41c-baa907389bef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1259 microversion: 2.1 time: 0.179607 Oct 03 14:39:17.845349 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 852/1743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:17 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:17.853720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-387eaed8-740a-49ed-b4f2-9f4abd1f9cdd tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Action: 'create', calling method: .version_select at 0x7fb23058c310>, body: {"keypair": {"name": "tempest-keypair-871621770", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:17.912575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-387eaed8-740a-49ed-b4f2-9f4abd1f9cdd tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:17.931354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-387eaed8-740a-49ed-b4f2-9f4abd1f9cdd tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for user e65edfc21bfe462aa0729009763d3997 and project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:17.977034 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-387eaed8-740a-49ed-b4f2-9f4abd1f9cdd tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.129533 Oct 03 14:39:17.979088 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 853/1744] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:17 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:17.993202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bcc1dcf1-075c-4e1d-887b-6d0de2a70d71 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb231508ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:18.044378 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bcc1dcf1-075c-4e1d-887b-6d0de2a70d71 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-871621770" status: 202 len: 0 microversion: 2.1 time: 0.059138 Oct 03 14:39:18.045096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 854/1745] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 14:39:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-871621770 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:39:18.058936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-96c37527-38c0-4c69-8cad-419a79dd03e8 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Action: 'create', calling method: .version_select at 0x7fb2310dddc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1946004227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9/BbcapisP1U3owYig2ljN5L9V+Pr8LsDmF0CAMWhzr7F4+/X5amHO6x14kwuoc8VBtk0cMCrJyvtLmkJ5ICZCVabAUsnV41U1BEU8vqUo2XRB0IEfKy6U41ErD2b9fw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:18.108789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-96c37527-38c0-4c69-8cad-419a79dd03e8 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:18.115060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:18.138782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-96c37527-38c0-4c69-8cad-419a79dd03e8 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for user e65edfc21bfe462aa0729009763d3997 and project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:18.157034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac799941-35e3-41eb-b8ec-92a4325ee1a0 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 0.730104 Oct 03 14:39:18.159478 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 892/1746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:17 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:18.216754 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-96c37527-38c0-4c69-8cad-419a79dd03e8 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.160589 Oct 03 14:39:18.219733 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 855/1747] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:39:18.234995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b147d9de-50d1-4e33-bf35-f5b23a923a48 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Action: 'create', calling method: .version_select at 0x7fb2309c1820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1353134013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEMROOYE0090uM/Ahgcam6P4OZWZQsFN/DOXT+lBwPCaU1w1x8hDSjqTB6k51udZ5MQybHOx3ra6pf8T1+hUd34IwQs5rT4JO1yrSi2xDX++yGUAzfePA1SHb+j5lge1A=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:18.285971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b147d9de-50d1-4e33-bf35-f5b23a923a48 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:18.300863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b147d9de-50d1-4e33-bf35-f5b23a923a48 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for user e65edfc21bfe462aa0729009763d3997 and project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:18.366250 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b147d9de-50d1-4e33-bf35-f5b23a923a48 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.136610 Oct 03 14:39:18.369548 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 893/1748] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:18.375476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:18.376384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:18.383388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c24bfa63-8eb7-4f35-8014-2f9f8262de0d tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Action: 'create', calling method: .version_select at 0x7fb23096f700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-729246090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMKxSckGuO5O1EQkgHVjtYylPBJ9cytx2rYOFlfOGs4fLRCFwMZK39/lUM882zoeFRkCLxlTDRBkIt9kroYtyJdE2sENBgoPni1kucqGVcMV04hj8G1VKWaovsx31S+dA=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:18.395152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:18.396105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:18.397096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:18.399215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:18.400220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:18.400981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:18.432110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c24bfa63-8eb7-4f35-8014-2f9f8262de0d tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:18.453466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c24bfa63-8eb7-4f35-8014-2f9f8262de0d tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Getting quotas for user e65edfc21bfe462aa0729009763d3997 and project 6990bfbcedf649859d0642719eecf22d. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:18.495056 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c24bfa63-8eb7-4f35-8014-2f9f8262de0d tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.116172 Oct 03 14:39:18.496120 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 894/1749] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:39:18.503601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:18.504588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:18.514768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:18.515693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:18.516361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:18.517463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:18.518207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:18.518842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:18.744576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:18.759992 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07b0b6e1-9f3d-4692-888c-954ea7cc4a80 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1270 microversion: 2.1 time: 0.262195 Oct 03 14:39:18.760646 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 895/1750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:18 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1270 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:18.812071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb6c7770-7097-4401-a7cb-54daa018c5a7 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb234bbc040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:18.832096 n-d-781139-2 devstack@n-api.service[128869]: WARNING oslo_db.sqlalchemy.utils [None req-eb6c7770-7097-4401-a7cb-54daa018c5a7 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 14:39:18.851413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb6c7770-7097-4401-a7cb-54daa018c5a7 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.058689 Oct 03 14:39:18.858620 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 896/1751] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:39:18 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:18.863617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8b60cec4-b4a9-4027-bb02-ce6b13cc2a52 req-6b03485c-db78-4592-b664-f7a35f8094cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78c44ad-428f-4712-a350-05c9b2047751", "name": "network-vif-unplugged", "status": "completed", "tag": "f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:18.887153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b60cec4-b4a9-4027-bb02-ce6b13cc2a52 req-6b03485c-db78-4592-b664-f7a35f8094cb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:18.887728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b60cec4-b4a9-4027-bb02-ce6b13cc2a52 req-6b03485c-db78-4592-b664-f7a35f8094cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:18.888157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b60cec4-b4a9-4027-bb02-ce6b13cc2a52 req-6b03485c-db78-4592-b664-f7a35f8094cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:18.922517 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8b60cec4-b4a9-4027-bb02-ce6b13cc2a52 req-6b03485c-db78-4592-b664-f7a35f8094cb service nova] Creating event network-vif-unplugged:f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9 for instance c78c44ad-428f-4712-a350-05c9b2047751 on n-h1-781139-2 Oct 03 14:39:18.938011 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8b60cec4-b4a9-4027-bb02-ce6b13cc2a52 req-6b03485c-db78-4592-b664-f7a35f8094cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082682 Oct 03 14:39:18.938634 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 897/1752] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:18.949858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:18.952875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0496cd67-1318-46c6-99fb-cf7774bbbf85 req-efb22f7e-84dd-488c-b57e-160890c479b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4388889a-755e-4663-b75c-84220b9d8fb1", "name": "network-vif-deleted", "tag": "26221873-2abe-488a-ad63-83dfa6fedeee"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:18.962922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:18.967757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:18.970899 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-261a032c-4bdb-47a7-b236-241068b7a575 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.602508 Oct 03 14:39:18.984967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 856/1753] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:18 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:39:18.985227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0496cd67-1318-46c6-99fb-cf7774bbbf85 req-efb22f7e-84dd-488c-b57e-160890c479b4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:18.985227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0496cd67-1318-46c6-99fb-cf7774bbbf85 req-efb22f7e-84dd-488c-b57e-160890c479b4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:18.985227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0496cd67-1318-46c6-99fb-cf7774bbbf85 req-efb22f7e-84dd-488c-b57e-160890c479b4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:18.985501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-59e1bf51-39e6-42a1-92b5-acc79a8d9865 req-113f7fd7-eb01-4923-baeb-d5e619da14de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c", "name": "network-vif-plugged", "status": "completed", "tag": "c1847700-d232-42c8-a049-ef3bbcdad333"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:19.007572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-59e1bf51-39e6-42a1-92b5-acc79a8d9865 req-113f7fd7-eb01-4923-baeb-d5e619da14de service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:19.008773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-59e1bf51-39e6-42a1-92b5-acc79a8d9865 req-113f7fd7-eb01-4923-baeb-d5e619da14de service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:19.013278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-59e1bf51-39e6-42a1-92b5-acc79a8d9865 req-113f7fd7-eb01-4923-baeb-d5e619da14de service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:19.031899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0496cd67-1318-46c6-99fb-cf7774bbbf85 req-efb22f7e-84dd-488c-b57e-160890c479b4 service nova] Creating event network-vif-deleted:26221873-2abe-488a-ad63-83dfa6fedeee for instance 4388889a-755e-4663-b75c-84220b9d8fb1 on n-h2-781139-2 Oct 03 14:39:19.043851 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-59e1bf51-39e6-42a1-92b5-acc79a8d9865 req-113f7fd7-eb01-4923-baeb-d5e619da14de service nova] Creating event network-vif-plugged:c1847700-d232-42c8-a049-ef3bbcdad333 for instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c on n-h1-781139-2 Oct 03 14:39:19.045661 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0496cd67-1318-46c6-99fb-cf7774bbbf85 req-efb22f7e-84dd-488c-b57e-160890c479b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105609 Oct 03 14:39:19.048451 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 898/1754] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:19.058881 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-59e1bf51-39e6-42a1-92b5-acc79a8d9865 req-113f7fd7-eb01-4923-baeb-d5e619da14de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082693 Oct 03 14:39:19.060958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68d40919-a6b0-4d91-a4f9-a8118222c7da tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb234c4c0d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:19.062353 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 857/1755] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:19.077940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:19.079269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:19.096219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:19.098458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:19.102014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:19.103218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:19.103925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:19.105444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:19.110800 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68d40919-a6b0-4d91-a4f9-a8118222c7da tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-729246090" status: 202 len: 0 microversion: 2.1 time: 0.060325 Oct 03 14:39:19.116974 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 899/1756] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-729246090 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:19.142734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3ab43e9-0e97-443d-9537-8e30261fd314 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb234af5b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:19.207923 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3ab43e9-0e97-443d-9537-8e30261fd314 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1353134013" status: 202 len: 0 microversion: 2.1 time: 0.078232 Oct 03 14:39:19.212161 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 900/1757] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 3 14:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1353134013 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:19.218242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:19.220607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:19.243659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:19.245422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:19.245962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:19.246698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:19.247150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:19.247567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:19.370672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:19.384429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e57ba7d-f2c2-4b20-a0b6-e4a412d62598 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1265 microversion: 2.1 time: 0.320270 Oct 03 14:39:19.385206 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 858/1758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:19 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:19.414151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42c5a832-2b10-4de0-90f0-cf133374de45 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] Calling method '.version_select at 0x7fb230ee0670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:19.459305 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42c5a832-2b10-4de0-90f0-cf133374de45 tempest-KeyPairsV2TestJSON-953600432 tempest-KeyPairsV2TestJSON-953600432-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1946004227" status: 202 len: 0 microversion: 2.1 time: 0.053207 Oct 03 14:39:19.460375 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 859/1759] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 3 14:39:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1946004227 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:19.799154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:19.799785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:19.812973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:19.813316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:19.819644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:19.820680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:19.821191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:19.821805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:19.840886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:19.854536 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c807b6cf-954d-4e0b-86a4-18af51e20abb tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 0.639899 Oct 03 14:39:19.861623 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 901/1760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:19 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:20.017320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:20.018306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:20.032157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:20.033482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:20.038189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:20.040161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:20.041596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:20.042230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:20.667268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:20.698732 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-38d43f2b-25ec-49bf-81e3-777ce8d241a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1312 microversion: 2.1 time: 0.901327 Oct 03 14:39:20.705105 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 860/1761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:19 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1312 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:20.710856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:20.732483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:20.741933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:20.743669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:20.746644 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75008b19-efba-42f7-85d1-dc81943a6226 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.734882 Oct 03 14:39:20.751318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:20.752884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 902/1762] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:20 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:20.768607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:20.769388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:20.772512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:20.775054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:20.776067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:20.778979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:20.888036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:20.889146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:20.906617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:20.907186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:20.907682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:20.908640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:20.909281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:20.909870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:21.202310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:21.219637 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d5ac426-8e11-47c0-b45b-d7b1a698ac2e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1265 microversion: 2.1 time: 0.503301 Oct 03 14:39:21.224380 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 861/1763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:20 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1265 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:21.236712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-2b32d15b-df16-4c15-b391-0fa8d504d3fe req-587bafb5-8763-43b7-bbbe-189b3e3576fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78c44ad-428f-4712-a350-05c9b2047751", "tag": "f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:21.289105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2b32d15b-df16-4c15-b391-0fa8d504d3fe req-587bafb5-8763-43b7-bbbe-189b3e3576fb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:21.294079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2b32d15b-df16-4c15-b391-0fa8d504d3fe req-587bafb5-8763-43b7-bbbe-189b3e3576fb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:21.294913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2b32d15b-df16-4c15-b391-0fa8d504d3fe req-587bafb5-8763-43b7-bbbe-189b3e3576fb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:21.357774 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-2b32d15b-df16-4c15-b391-0fa8d504d3fe req-587bafb5-8763-43b7-bbbe-189b3e3576fb service nova] Creating event network-changed:f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9 for instance c78c44ad-428f-4712-a350-05c9b2047751 on n-h1-781139-2 Oct 03 14:39:21.374759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:21.383385 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-2b32d15b-df16-4c15-b391-0fa8d504d3fe req-587bafb5-8763-43b7-bbbe-189b3e3576fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154506 Oct 03 14:39:21.383618 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-321aa7bf-8459-4119-8ea9-e23f6a837cc1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1323 microversion: 2.1 time: 0.500162 Oct 03 14:39:21.384797 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 862/1764] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:21.387151 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 903/1765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:20 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1323 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:39:21.744650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:21.746084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:21.779776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:21.780378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:21.785126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:21.785882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:21.787210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.789429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:21.792243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:21.793587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:21.795277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:21.795998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:21.797379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:21.801296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:21.802477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:21.803397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:21.803998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:22.159888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:22.176201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:22.179905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:22.184453 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-82e2ccc3-34e1-4760-b8d4-e7c27ce89744 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.409672 Oct 03 14:39:22.202909 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 904/1766] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:21 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:39:22.252323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:22.253099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:22.275844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:22.277586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:22.278818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:22.279653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:22.281715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:22.282929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:22.610560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:22.622465 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69e63b63-4b75-417f-9045-ea66020f8ded tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1307 microversion: 2.1 time: 0.376045 Oct 03 14:39:22.626519 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 905/1767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:22 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:22.631762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:22.632598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:22.649608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:22.650557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:22.651204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:22.652814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:22.653586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:22.654219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:22.916442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:22.926544 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-adc9f4e3-f9b3-4b2e-9ffe-fc1ef04a91b2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1518 microversion: 2.1 time: 0.297881 Oct 03 14:39:22.927469 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 906/1768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:22 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:22.949640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-973509b1-2fd3-4864-bdf0-a11b40977ec4 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'create', calling method: .version_select at 0x7fb234af5790>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:22.959689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:22.968818 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e8d7a524-c535-41dc-83a2-834fa3fd35ad tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1312 microversion: 2.1 time: 1.244440 Oct 03 14:39:22.970174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 863/1769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:21 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1312 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:23.213189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:23.214491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:23.223739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:23.224839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:23.225947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:23.226862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:23.227563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:23.228151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:24.241893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:24.260843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:24.266307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:24.270125 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6a98e9d9-3fb9-4fd5-9e38-826ae25bd124 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 1.060502 Oct 03 14:39:24.273017 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 864/1770] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:23 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:24.280295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:24.281467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:24.289607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:24.290455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:24.291728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:24.292807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:24.294860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:24.295561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:25.571476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:25.581486 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-86a651f7-ae44-4d92-924b-0d3b3a4e8861 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1307 microversion: 2.1 time: 1.306663 Oct 03 14:39:25.585583 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 865/1771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:24 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1307 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:25.596740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-77c32600-2daa-439a-97a8-c7104fae118a req-bbf61b31-f253-479e-8f65-a64843cf9b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a011620-a90d-4d52-a7b6-5bec3e47d444", "tag": "ef579db2-bbe0-4153-88ce-b0eb95ade16b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:25.626661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-77c32600-2daa-439a-97a8-c7104fae118a req-bbf61b31-f253-479e-8f65-a64843cf9b66 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:25.627274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-77c32600-2daa-439a-97a8-c7104fae118a req-bbf61b31-f253-479e-8f65-a64843cf9b66 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:25.627805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-77c32600-2daa-439a-97a8-c7104fae118a req-bbf61b31-f253-479e-8f65-a64843cf9b66 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:25.644896 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-77c32600-2daa-439a-97a8-c7104fae118a req-bbf61b31-f253-479e-8f65-a64843cf9b66 service nova] Creating event network-changed:ef579db2-bbe0-4153-88ce-b0eb95ade16b for instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 on n-h2-781139-2 Oct 03 14:39:25.651010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-77c32600-2daa-439a-97a8-c7104fae118a req-bbf61b31-f253-479e-8f65-a64843cf9b66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063763 Oct 03 14:39:25.653532 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 866/1772] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:25.666757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:25.669862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:25.685054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:25.685633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:25.687230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:25.688068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:25.691193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:25.691707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:25.961948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.057580 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-973509b1-2fd3-4864-bdf0-a11b40977ec4 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.111682 Oct 03 14:39:26.071743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 907/1773] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:39:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:26.076272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:26.077128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:26.089245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:26.090804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:26.091249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:26.096342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:26.096956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:26.097595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:26.151472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.596702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:26.626622 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba5632be-0beb-4e1d-acc6-7cc6bdaa4949 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1312 microversion: 2.1 time: 0.969547 Oct 03 14:39:26.630028 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 867/1774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:25 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1312 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:26.841127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:26.858952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:26.867954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:26.873816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62073c03-71ce-4581-b08a-2f25f379883c tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb230a01ca0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCmtuVJhP4c7zKw2M4gJDCEvzuHN9wRY2vgysvFm3IpIXfcqn1+X5/k7Uyu44roE+mskwNCq/2PNQyxqF3o5Ro5o2gFaOUjCq3kahGrztS6CgoSh14WTkEqE1n2dlyg5Q=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:26.874666 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aafe784c-0f7c-4cba-9152-c2db4dccb6e2 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.814287 Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62073c03-71ce-4581-b08a-2f25f379883c tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 257 Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:39:26.882261 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:39:26.883868 n-d-781139-2 devstack@n-api.service[128868]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCmtuVJhP4c7zKw2M4gJDCEvzuHN9wRY2vgysvFm3IpIXfcqn1+X5/k7Uyu44roE+mskwNCq/2PNQyxqF3o5Ro5o2gFaOUjCq3kahGrztS6CgoSh14WTkEqE1n2dlyg5Q=="}} Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCmtuVJhP4c7zKw2M4gJDCEvzuHN9wRY2vgysvFm3IpIXfcqn1+X5/k7Uyu44roE+mskwNCq/2PNQyxqF3o5Ro5o2gFaOUjCq3kahGrztS6CgoSh14WTkEqE1n2dlyg5Q=='}}} Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:26.884721 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:26.886140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:39:26.888160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:39:26.889554 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 03 14:39:26.889554 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:26.890541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62073c03-71ce-4581-b08a-2f25f379883c tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:26.891412 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 908/1775] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:26 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:26.896652 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-62073c03-71ce-4581-b08a-2f25f379883c tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.264032 Oct 03 14:39:26.902706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-721ce474-3f09-40a5-a913-5b321d85d3b8 req-603e3dd5-111c-46d7-ad3c-7108124680c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:26.905458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 868/1776] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:26 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:39:26.913526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.916220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-721ce474-3f09-40a5-a913-5b321d85d3b8 req-603e3dd5-111c-46d7-ad3c-7108124680c0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:26.917288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-721ce474-3f09-40a5-a913-5b321d85d3b8 req-603e3dd5-111c-46d7-ad3c-7108124680c0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:26.917967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-721ce474-3f09-40a5-a913-5b321d85d3b8 req-603e3dd5-111c-46d7-ad3c-7108124680c0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:26.925764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-554601074", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:26.960168 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-721ce474-3f09-40a5-a913-5b321d85d3b8 req-603e3dd5-111c-46d7-ad3c-7108124680c0 service nova] Creating event network-changed:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h2-781139-2 Oct 03 14:39:26.970727 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-721ce474-3f09-40a5-a913-5b321d85d3b8 req-603e3dd5-111c-46d7-ad3c-7108124680c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077701 Oct 03 14:39:26.976121 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 909/1777] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:26.990356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:26.992892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:27.037580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:27.039363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:27.040050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:27.041026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:27.041721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:27.042438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:27.120129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] validate_networks() for [('a76ca716-dc16-4a11-bbe2-ea03340c8d7a', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:39:27.491691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:27.501066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-479eafc0-7d1d-4b4e-8e48-f5926f6db468 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1307 microversion: 2.1 time: 0.522459 Oct 03 14:39:27.502289 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 910/1778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:26 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1307 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:27.507584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a406ee0d-4282-4586-8da0-081d55f8735b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb2309c1550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-450135731", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:27.553344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a406ee0d-4282-4586-8da0-081d55f8735b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:27.559441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a406ee0d-4282-4586-8da0-081d55f8735b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for user 23f1402aa7e1444d9512dbbdbae539cd and project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:27.598467 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a406ee0d-4282-4586-8da0-081d55f8735b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a406ee0d-4282-4586-8da0-081d55f8735b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 2166 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-450135731", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:39:27.611957 n-d-781139-2 devstack@n-api.service[128869]: exception: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-450135731', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:27.617171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a406ee0d-4282-4586-8da0-081d55f8735b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a406ee0d-4282-4586-8da0-081d55f8735b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.111315 Oct 03 14:39:27.628400 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 911/1779] 10.222.0.20 () {60 vars in 1160 bytes} [Mon Oct 3 14:39:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:39:27.809709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-817008201", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "7877a73c-1b04-43e7-a6e7-105e448c1162"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:27.944864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] validate_networks() for [('7877a73c-1b04-43e7-a6e7-105e448c1162', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:39:28.166646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=24 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:29.013724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:39:29.014150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:39:29.014630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:39:29.015151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:39:29.015722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:39:29.037453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.039326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.040636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.044917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.045762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.046507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.119466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Getting quotas for project 1118fb2e9d1a4ad0af213b85620e1cc0. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:29.132041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Getting quotas for user 2dbd6bbae7c44725b8a1dadcd8c788e4 and project 1118fb2e9d1a4ad0af213b85620e1cc0. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:29.158746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:39:29.159362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:39:29.159847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:39:29.160709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:39:29.161204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:39:29.163696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:39:29.166384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:39:29.181999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.184211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.185185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.188002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.189437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.190354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.265799 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e2b1d6a-84e4-4fb3-a8d7-0d97406a9bfd tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.358736 Oct 03 14:39:29.266600 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 869/1780] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:39:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:39:29.273590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-662a7370-2a5f-4772-a785-e3bda218069e tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb2312ca940>, body: {"keypair": {"name": "tempest-keypair-846616898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUslUjPGnR51PbMI6/GYkf5Em7lKkau3VzdKQ9EXWJSlY+LmNJnUie4+NPUYZpLe21/xdBc1Z9u8B4wStfGgh1D6iA2CqKH/w+BMvTy4vinzNy4bVvFm2CofaRxsQWHIw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:29.282657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Getting quotas for project 7bfd2cb85d9c4983a86823d7b267d66f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:29.298706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:29.306106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-662a7370-2a5f-4772-a785-e3bda218069e tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:29.315523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Getting quotas for user ca91b4c2c303476b870b879e712ba2a4 and project 7bfd2cb85d9c4983a86823d7b267d66f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:29.328855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-662a7370-2a5f-4772-a785-e3bda218069e tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for user 23f1402aa7e1444d9512dbbdbae539cd and project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:29.361770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:39:29.369852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:39:29.376176 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-662a7370-2a5f-4772-a785-e3bda218069e tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107935 Oct 03 14:39:29.378530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 870/1781] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:29.395873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:29.395873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:29.430363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.430871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.431341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.432087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.432550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.433746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.485543 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d39e291d-5f26-41b2-afa8-02f741ebae91 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.867386 Oct 03 14:39:29.487452 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 912/1782] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:39:29.496500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:29.504036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:29.504719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:29.538692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.539194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.539643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.540369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.543930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.545411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.749258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:29.759968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:29.763378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:29.766736 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e60a10e6-ee90-40b2-afd0-75d7bde3d6db tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.276504 Oct 03 14:39:29.768021 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 913/1783] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:29 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:29.773778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:29.774673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:29.794152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.794403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.798887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:29.801655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:29.802100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:29.805667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:30.027481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:30.051686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4e1706f1-16ac-43bc-9819-1f0381c37210 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1312 microversion: 2.1 time: 0.668067 Oct 03 14:39:30.052866 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 871/1784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:29 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1312 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:30.064874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-938e9c05-8aad-43f8-88bd-9260f0ab5a78 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:30.065545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-938e9c05-8aad-43f8-88bd-9260f0ab5a78 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:30.109802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:30.125950 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b05d0f5e-3e27-497f-9454-99adacf50e52 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1307 microversion: 2.1 time: 0.356312 Oct 03 14:39:30.140961 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 914/1785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:29 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:30.142453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5ac77f9-5ce3-420f-af73-b7f61d7d1f52 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb2309f34c0>, body: {"keypair": {"name": "tempest-keypair-846616898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWROhPeDRVfWRPxkEvLnq9C7iaccn+pBjJJdY+AiNdIj7fJYVqusYxkcxIpcqhOeYgJl5Jtpvr+IBJrfcId6JCra6YWYIgUpmC3mLrnfo7S2Y3ow7d9Khzd486GLpGH2A=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:30.163886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b5ac77f9-5ce3-420f-af73-b7f61d7d1f52 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:30.170825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b5ac77f9-5ce3-420f-af73-b7f61d7d1f52 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for user 23f1402aa7e1444d9512dbbdbae539cd and project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:30.207490 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b5ac77f9-5ce3-420f-af73-b7f61d7d1f52 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] HTTP exception thrown: Key pair 'tempest-keypair-846616898' already exists. Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5ac77f9-5ce3-420f-af73-b7f61d7d1f52 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 272 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: {"keypair": {"name": "tempest-keypair-846616898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWROhPeDRVfWRPxkEvLnq9C7iaccn+pBjJJdY+AiNdIj7fJYVqusYxkcxIpcqhOeYgJl5Jtpvr+IBJrfcId6JCra6YWYIgUpmC3mLrnfo7S2Y3ow7d9Khzd486GLpGH2A=="}} Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: exception: Key pair 'tempest-keypair-846616898' already exists. Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-846616898', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWROhPeDRVfWRPxkEvLnq9C7iaccn+pBjJJdY+AiNdIj7fJYVqusYxkcxIpcqhOeYgJl5Jtpvr+IBJrfcId6JCra6YWYIgUpmC3mLrnfo7S2Y3ow7d9Khzd486GLpGH2A=='}}} Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '23f1402aa7e1444d9512dbbdbae539cd-tempest-keypair-846616898' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 03 14:39:30.223545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi session.flush() Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result.read() Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 03 14:39:30.235673 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '23f1402aa7e1444d9512dbbdbae539cd-tempest-keypair-846616898' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 3, 14, 39, 30, 193713), 'updated_at': None, 'name': 'tempest-keypair-846616898', 'user_id': '23f1402aa7e1444d9512dbbdbae539cd', 'fingerprint': 'ca:6d:17:91:c2:05:19:f2:ca:cf:a4:ef:31:ca:0c:eb', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWROhPeDRVfWRPxkEvLnq9C7iaccn+pBjJJdY+AiNdIj7fJYVqusYxkcxIpcqhOeYgJl5Jtpvr+IBJrfcId6JCra6YWYIgUpmC3mLrnfo7S2Y3ow7d9Khzd486GLpGH2A==', 'type': 'ssh'}] Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi keypair.create() Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._create() Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-846616898' already exists. Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 03 14:39:30.245567 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-846616898' already exists. Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-846616898' already exists. Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5ac77f9-5ce3-420f-af73-b7f61d7d1f52 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 409 to user: Key pair 'tempest-keypair-846616898' already exists. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5ac77f9-5ce3-420f-af73-b7f61d7d1f52 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.096300 Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 915/1786] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:30 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5ad4358-1113-4335-9c96-b4f9fe2f565e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:30.251785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5ad4358-1113-4335-9c96-b4f9fe2f565e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:30.254194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-938e9c05-8aad-43f8-88bd-9260f0ab5a78 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:30.265539 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-938e9c05-8aad-43f8-88bd-9260f0ab5a78 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1223 microversion: 2.1 time: 0.209314 Oct 03 14:39:30.266648 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 872/1787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:30 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1223 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:30.279043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3fa50cb1-d026-4dd5-b615-2a0223d85568 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Calling method '.version_select at 0x7fb2309cb8b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:30.343387 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3fa50cb1-d026-4dd5-b615-2a0223d85568 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-846616898" status: 202 len: 0 microversion: 2.1 time: 0.074750 Oct 03 14:39:30.344432 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 873/1788] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 14:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-846616898 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:30.359220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98538108-eeb3-45b2-bc5b-65515c7b18f6 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb2309683a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIL4bRBNAN46vyyPddpbDBS6MNG9pdbWJT9HTz90y8NX1l/C66X3lQFM3XVYGixffenek4RuD2n2j+E7ryL7/5rcyFCxv+cGiZymlF5fN0x969l1P1beaXCC+tx5WfMNA=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98538108-eeb3-45b2-bc5b-65515c7b18f6 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 247 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIL4bRBNAN46vyyPddpbDBS6MNG9pdbWJT9HTz90y8NX1l/C66X3lQFM3XVYGixffenek4RuD2n2j+E7ryL7/5rcyFCxv+cGiZymlF5fN0x969l1P1beaXCC+tx5WfMNA=="}} Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIL4bRBNAN46vyyPddpbDBS6MNG9pdbWJT9HTz90y8NX1l/C66X3lQFM3XVYGixffenek4RuD2n2j+E7ryL7/5rcyFCxv+cGiZymlF5fN0x969l1P1beaXCC+tx5WfMNA=='}}} Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '' Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:39:30.365947 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98538108-eeb3-45b2-bc5b-65515c7b18f6 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98538108-eeb3-45b2-bc5b-65515c7b18f6 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.013521 Oct 03 14:39:30.377942 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 874/1789] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:30 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:39:30.382648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2151ad3c-0919-4afc-b1a2-2e8b5121ee4b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb230a01e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-437663790", "public_key": " "}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:30.421759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2151ad3c-0919-4afc-b1a2-2e8b5121ee4b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:30.434259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2151ad3c-0919-4afc-b1a2-2e8b5121ee4b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for user 23f1402aa7e1444d9512dbbdbae539cd and project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:30.434485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5ad4358-1113-4335-9c96-b4f9fe2f565e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:30.449010 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5ad4358-1113-4335-9c96-b4f9fe2f565e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1217 microversion: 2.1 time: 0.216548 Oct 03 14:39:30.457590 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 916/1790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:30 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1217 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:30.500814 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-2151ad3c-0919-4afc-b1a2-2e8b5121ee4b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2151ad3c-0919-4afc-b1a2-2e8b5121ee4b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 94 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-437663790", "public_key": " "}} Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: exception: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-437663790', 'public_key': ' '}}} Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.506002 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.511990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.517169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2151ad3c-0919-4afc-b1a2-2e8b5121ee4b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:30.538271 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2151ad3c-0919-4afc-b1a2-2e8b5121ee4b tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.158551 Oct 03 14:39:30.540904 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 875/1791] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Oct 3 14:39:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 03 14:39:30.553883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a32d002-eda8-4d98-9ce7-9485ae6da012 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb234ccfaf0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZwN5JsJ1vPMIsvVgE92y8lQ3js/e3BTGk6cTVDQ6BjhETlIyxA1/pOvIHp9BYP8sDpswUeeeyqYMRIvf++VRUdeW/96hlvteO+hbmWliUVt/kgxSsgV9x4YAMCB/lulg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a32d002-eda8-4d98-9ce7-9485ae6da012 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 507 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZwN5JsJ1vPMIsvVgE92y8lQ3js/e3BTGk6cTVDQ6BjhETlIyxA1/pOvIHp9BYP8sDpswUeeeyqYMRIvf++VRUdeW/96hlvteO+hbmWliUVt/kgxSsgV9x4YAMCB/lulg=="}} Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZwN5JsJ1vPMIsvVgE92y8lQ3js/e3BTGk6cTVDQ6BjhETlIyxA1/pOvIHp9BYP8sDpswUeeeyqYMRIvf++VRUdeW/96hlvteO+hbmWliUVt/kgxSsgV9x4YAMCB/lulg=='}}} Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 03 14:39:30.558722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 03 14:39:30.562679 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.565183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a32d002-eda8-4d98-9ce7-9485ae6da012 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:30.568570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a32d002-eda8-4d98-9ce7-9485ae6da012 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018828 Oct 03 14:39:30.569621 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 917/1792] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:30 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:39:30.580342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3beb4f39-2523-42cc-8e18-b05b16937406 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Action: 'create', calling method: .version_select at 0x7fb2310ddd30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2017492149", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:30.616807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-3beb4f39-2523-42cc-8e18-b05b16937406 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:30.638228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-3beb4f39-2523-42cc-8e18-b05b16937406 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Getting quotas for user 23f1402aa7e1444d9512dbbdbae539cd and project 6fa2d4129b2a46a1b8caf9c466a61192. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:30.660702 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-3beb4f39-2523-42cc-8e18-b05b16937406 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3beb4f39-2523-42cc-8e18-b05b16937406 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 118 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2017492149", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: exception: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2017492149', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 03 14:39:30.662942 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 03 14:39:30.668634 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.672549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3beb4f39-2523-42cc-8e18-b05b16937406 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:30.673819 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3beb4f39-2523-42cc-8e18-b05b16937406 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.099242 Oct 03 14:39:30.674990 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 876/1793] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:39:30 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:39:30.687481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8088567a-2a28-4a70-92c4-d9c2890dd2c0 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Calling method '.version_select at 0x7fb2309c14c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:30.721145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8088567a-2a28-4a70-92c4-d9c2890dd2c0 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-783306256 not found for user 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8088567a-2a28-4a70-92c4-d9c2890dd2c0 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Request method failure captured: Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-783306256 HTTP/1.1 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQd4ClU4ddB-Z1JbKpT07Pa3-Gg5rUTf7kiyNqJAZl5A2dm-S1z34HX4qalFx4oAovjRHL-wAYya4iIR8T3WLe2wktgkkeCwnwRbuj_XHp_TEKAKl5-1dEGjFftJw919DPF7UhQP1i0C_2m8Tva4vdIIt5hIBRRDp5kaxM3z4ATYgs Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6fa2d4129b2a46a1b8caf9c466a61192", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6fa2d4129b2a46a1b8caf9c466a61192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6fa2d4129b2a46a1b8caf9c466a61192 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-652426554 Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-KeyPairsNegativeTestJSON-652426554-project Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: exception: Keypair tempest-keypair-non-existent-783306256 not found for user 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'tempest-keypair-non-existent-783306256'} Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-783306256 not found for user 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.723453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-783306256 not found for user 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-783306256 not found for user 23f1402aa7e1444d9512dbbdbae539cd Oct 03 14:39:30.728365 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:30.731580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8088567a-2a28-4a70-92c4-d9c2890dd2c0 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] Returning 404 to user: Keypair tempest-keypair-non-existent-783306256 not found for user 23f1402aa7e1444d9512dbbdbae539cd {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:30.732559 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8088567a-2a28-4a70-92c4-d9c2890dd2c0 tempest-KeyPairsNegativeTestJSON-652426554 tempest-KeyPairsNegativeTestJSON-652426554-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-783306256" status: 404 len: 144 microversion: 2.1 time: 0.052075 Oct 03 14:39:30.742851 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 918/1794] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 14:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-783306256 => generated 144 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:39:30.796560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:30.797597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:30.809968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:30.811810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:30.812754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:30.815660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:30.816373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:30.817442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.088798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:31.091464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:31.116451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.117458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.118226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.119309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.120124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.120848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.171968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:31.180950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:31.186563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:31.193619 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-97cd3c41-f792-446b-9a0e-b289002631a5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.396803 Oct 03 14:39:31.194666 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 877/1795] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:30 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:31.205585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:31.206205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:31.221771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.222557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.223170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.224613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.225353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.228315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.509884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:31.523890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:31.535349 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-16d9d375-c9a6-48d6-945b-29b8ed8e7e3d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1307 microversion: 2.1 time: 0.339167 Oct 03 14:39:31.553605 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b65ee2c7-60c7-497a-ab5d-254e461379e0 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1312 microversion: 2.1 time: 0.445803 Oct 03 14:39:31.554394 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 878/1796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:31 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:31.555359 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 919/1797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:31 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1312 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:31.564990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:31.566945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:31.568021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:31.568654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:31.578867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.579626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.580319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.581228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.581806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.582045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.582295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.582730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.582993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.583461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:31.589472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:31.590003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:31.725945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:31.758784 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-797692ce-6ece-476c-b976-2e5aedcdb3e2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1213 microversion: 2.1 time: 0.201252 Oct 03 14:39:31.778192 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 920/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:31 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1213 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:31.836240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:31.850143 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-505f5cda-ab7f-4b3e-82e6-b93384048d09 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1275 microversion: 2.1 time: 0.294509 Oct 03 14:39:31.851425 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 879/1799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:31 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:32.216323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-341a04be-a262-4111-ab17-e07ca844f7c2 req-26f18bd3-aa32-4300-a001-63d2b83c304f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a011620-a90d-4d52-a7b6-5bec3e47d444", "name": "network-vif-plugged", "status": "completed", "tag": "ef579db2-bbe0-4153-88ce-b0eb95ade16b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:32.243650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-341a04be-a262-4111-ab17-e07ca844f7c2 req-26f18bd3-aa32-4300-a001-63d2b83c304f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:32.247033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-341a04be-a262-4111-ab17-e07ca844f7c2 req-26f18bd3-aa32-4300-a001-63d2b83c304f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:32.248909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-341a04be-a262-4111-ab17-e07ca844f7c2 req-26f18bd3-aa32-4300-a001-63d2b83c304f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:32.263562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:32.269323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:32.289178 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-341a04be-a262-4111-ab17-e07ca844f7c2 req-26f18bd3-aa32-4300-a001-63d2b83c304f service nova] Creating event network-vif-plugged:ef579db2-bbe0-4153-88ce-b0eb95ade16b for instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 on n-h2-781139-2 Oct 03 14:39:32.319009 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-341a04be-a262-4111-ab17-e07ca844f7c2 req-26f18bd3-aa32-4300-a001-63d2b83c304f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107687 Oct 03 14:39:32.323831 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 921/1800] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:32.330191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:32.332722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:32.337518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:32.354905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:32.358844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:32.361429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:32.577598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:32.581789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:32.602826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:32.603470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:32.605678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:32.606708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:32.613316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:32.618262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:32.885656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:32.906465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:32.912859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:32.916411 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba59db4b-0c4a-45b0-b6a9-baa3f792eeed tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1487 microversion: 2.25 time: 0.693591 Oct 03 14:39:32.923959 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 880/1801] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:32 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1487 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:32.952328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:32.953304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:32.975115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:32.976109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:32.976900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:32.978235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:32.983062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:32.987116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:33.082748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:33.096974 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c4f1edc-755c-4c64-b980-486b95b72a5b tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1307 microversion: 2.1 time: 0.535768 Oct 03 14:39:33.117668 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 922/1802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:32 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1307 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:33.140953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:33.141616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:33.156897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:33.157931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:33.158475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:33.161129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:33.163859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:33.164641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:33.328279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:33.342797 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d022996-6369-4ee2-b73a-8409f915c91f tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1277 microversion: 2.1 time: 0.222690 Oct 03 14:39:33.345500 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 923/1803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:33 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:33.362220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:33.363065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:33.379380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:33.389163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:33.389666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:33.390104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:33.390823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:33.397011 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59045976-6769-4cab-9ea4-8371d66944f5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1312 microversion: 2.1 time: 0.467390 Oct 03 14:39:33.400507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:33.405242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:33.411499 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 881/1804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:32 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:33.545260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:33.559292 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29e4eb13-17f1-45bb-8242-31081f08f43b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1281 microversion: 2.1 time: 0.212308 Oct 03 14:39:33.560244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 924/1805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:33 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:33.947685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:33.949055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:33.960759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:33.963487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:33.965605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:33.966723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:33.970433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:33.970821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:34.132868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:34.134106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:34.155282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:34.156054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:34.156669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:34.157723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:34.158472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:34.159073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:34.501726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:34.516505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:34.521874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:34.524854 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fcaae018-1c5d-45f4-ba8e-d1cfe3c05550 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1477 microversion: 2.25 time: 0.582477 Oct 03 14:39:34.528126 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 882/1806] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:33 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1477 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:34.538692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:34.539311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:34.557774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:34.558272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:34.558886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:34.559784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:34.561158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:34.564390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:34.736273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:34.745933 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14973fe9-85c6-4569-9b5f-b750359dc4cb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1488 microversion: 2.1 time: 0.618013 Oct 03 14:39:34.750701 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 925/1807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:34 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1488 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:34.755891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6bd532dd-af30-48ed-a187-0246ef22ed92 req-47f288b4-7c79-4374-ba9d-fe0a14b579ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "name": "network-vif-plugged", "status": "completed", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:34.783587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6bd532dd-af30-48ed-a187-0246ef22ed92 req-47f288b4-7c79-4374-ba9d-fe0a14b579ee service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:34.785715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6bd532dd-af30-48ed-a187-0246ef22ed92 req-47f288b4-7c79-4374-ba9d-fe0a14b579ee service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:34.786190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6bd532dd-af30-48ed-a187-0246ef22ed92 req-47f288b4-7c79-4374-ba9d-fe0a14b579ee service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:34.836285 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6bd532dd-af30-48ed-a187-0246ef22ed92 req-47f288b4-7c79-4374-ba9d-fe0a14b579ee service nova] Creating event network-vif-plugged:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h2-781139-2 Oct 03 14:39:34.848305 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6bd532dd-af30-48ed-a187-0246ef22ed92 req-47f288b4-7c79-4374-ba9d-fe0a14b579ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095231 Oct 03 14:39:34.850117 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 926/1808] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:34.870859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:34.871868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:34.882682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:34.883716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:34.889075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:34.889841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:34.890316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:34.890742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:35.017300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:35.030259 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-75ab713a-8b97-44a6-9769-e63ac94939c8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1275 microversion: 2.1 time: 0.495486 Oct 03 14:39:35.031352 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 883/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:34 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1275 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:35.038573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09c314a1-d00d-4a2a-bedc-e9bf06d92528 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '.version_select at 0x7fb2309e6ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:35.042882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09c314a1-d00d-4a2a-bedc-e9bf06d92528 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:35.044203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09c314a1-d00d-4a2a-bedc-e9bf06d92528 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:35.045216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09c314a1-d00d-4a2a-bedc-e9bf06d92528 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:35.063328 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-09c314a1-d00d-4a2a-bedc-e9bf06d92528 tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 4468 microversion: 2.25 time: 0.030745 Oct 03 14:39:35.064580 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 884/1810] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 3 14:39:35 2022] GET /compute/v2.1/os-migrations => generated 4468 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:35.071350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:35.072727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:35.081264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:35.082114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:35.082778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:35.083690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:35.084723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:35.085981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:35.494065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:35.518343 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ef0817b-deb7-40f5-bd78-883abbbc97c3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.452279 Oct 03 14:39:35.525620 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 885/1811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:35 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:35.558653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:35.560165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:35.576301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:35.577176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:35.577898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:35.578837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:35.579507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:35.580149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:35.651198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lazy-loading 'flavor' on Instance uuid 1a011620-a90d-4d52-a7b6-5bec3e47d444 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:39:35.688661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:35.705510 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3969e871-d470-4803-84a3-0650e4f6ace5 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1312 microversion: 2.1 time: 0.853788 Oct 03 14:39:35.706385 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 927/1812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:34 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1312 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:35.711817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-152420175", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1de92605-c737-403e-8392-200d1d88069b"}], "block_device_mapping_v2": [{"uuid": "a385001a-90ca-4bf0-9069-d2be170dc81a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:35.861693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] validate_networks() for [('1de92605-c737-403e-8392-200d1d88069b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:39:35.887566 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b76026d-3c30-42b5-89ea-3f6823161583 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444/action" status: 202 len: 0 microversion: 2.1 time: 0.342706 Oct 03 14:39:35.890224 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 886/1813] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:39:35 2022] POST /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:35.900506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:35.901595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:35.909050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:35.910358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:35.910967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:35.912124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:35.912738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:35.913343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:36.281204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] Lazy-loading 'services' on Instance uuid c78c44ad-428f-4712-a350-05c9b2047751 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:39:36.308374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5ead40c-9b0f-4b82-84e5-dfc3168b22bf tempest-LiveAutoBlockMigrationV225Test-2095302494 tempest-LiveAutoBlockMigrationV225Test-2095302494-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1970 microversion: 2.25 time: 0.416608 Oct 03 14:39:36.310219 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 887/1814] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:35 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1970 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:36.514051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Calling method '.version_select at 0x7fb230a98280>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:36.528344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:36.529215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:36.529872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:36.530796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:36.531397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:36.532036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:36.579196 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4323b296-c949-4a81-925e-d609a1cb0c2b tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.267578 Oct 03 14:39:36.585236 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 888/1815] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 3 14:39:36 2022] GET /compute/v2.1/limits => generated 511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:36.590540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:36.591453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:36.611118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:36.611616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:36.612051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:36.612752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:36.613241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:36.613667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:36.747925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:39:36.751286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:39:36.752457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:39:36.753232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:39:36.755035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:39:36.771608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=33 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:36.774555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:36.775318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:36.776120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:36.777251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:36.778449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:36.779089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:36.799115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:36.804768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Getting quotas for user a91d62c6a8f04094b64c79e338b1dc49 and project 387637769447441dbf4d5df340ddecce. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:36.899770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:39:36.902227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a385001a-90ca-4bf0-9069-d2be170dc81a',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:39:36.955103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:36.962978 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-069fd9ca-7c9f-40e5-a398-2ab0c6ba3e2a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1496 microversion: 2.1 time: 0.376375 Oct 03 14:39:36.982765 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 889/1816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:36 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1496 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:36.991765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:36.992377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:37.025160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:37.025665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:37.026139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:37.026949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:37.027994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:37.028441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:37.189000 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ea8f57e-a5df-4f2e-8bb1-2a2ae09312c8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481263 Oct 03 14:39:37.191265 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 928/1817] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:39:37.205184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:37.221747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:37.233274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:37.233795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:37.234210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:37.235125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:37.236416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:37.237089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:37.271420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:39:37.391010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:37.408668 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-31a8e2fc-bee1-4f7d-957a-b68c40557066 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1317 microversion: 2.1 time: 0.423700 Oct 03 14:39:37.410138 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef90f8dd-bf41-4714-b392-1e89d5fa1bbe tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 204 len: 0 microversion: 2.25 time: 0.212068 Oct 03 14:39:37.410949 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 890/1818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:36 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:37.421264 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 929/1819] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:39:37 2022] DELETE /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:39:37.421486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:37.422118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:37.422318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1541464860", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:37.442230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:37.443791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:37.444246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:37.448139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:37.450161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:37.453291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:37.508344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:39:37.984980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:37.995752 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d2012d9-adbe-465e-b15e-fe0584ca581e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.581548 Oct 03 14:39:37.996335 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 891/1820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:37 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:38.013827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:38.014456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:38.038666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:38.039445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:38.040114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:38.041028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:38.041244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Getting quotas for project 1b5ca098b3b44ace96fc2ef4728c2524. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:38.041751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:38.042048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:38.045462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.048155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Getting quotas for user d4f2b0c6b29946289675675c3593d8af and project 1b5ca098b3b44ace96fc2ef4728c2524. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:38.053106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.074858 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Request method failure captured: Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 1752 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQm60ER948OzgU0J6rCv78Xjae459HP3D2uPRomshe1HP5Hn5tPu6IcYUcCCcL2Wowqmn9D6_RlM5k87HThcZef7GGvwxnbsd-KtYhswxioj4cmpairSK2-JBMuDsLEgKrjMyx3Odq5jxpO7i484ScYkI6XdGf38ImxpZWTfjO1apI Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 1b5ca098b3b44ace96fc2ef4728c2524 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1696841158 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1b5ca098b3b44ace96fc2ef4728c2524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1b5ca098b3b44ace96fc2ef4728c2524", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b5ca098b3b44ace96fc2ef4728c2524"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1b5ca098b3b44ace96fc2ef4728c2524"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1696841158 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 1b5ca098b3b44ace96fc2ef4728c2524 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1696841158 Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4f2b0c6b29946289675675c3593d8af Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1541464860", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:39:38.077718 n-d-781139-2 devstack@n-api.service[128869]: exception: Maximum number of metadata items exceeds 128 Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1541464860', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:38.080601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 03 14:39:38.084077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:39:38.086680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:38.087847 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f4f9eb6-8066-4cdf-86a9-99c406bad230 tempest-AbsoluteLimitsNegativeTestJSON-1696841158 tempest-AbsoluteLimitsNegativeTestJSON-1696841158-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.672786 Oct 03 14:39:38.089224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 930/1821] 10.222.0.20 () {60 vars in 1148 bytes} [Mon Oct 3 14:39:37 2022] POST /compute/v2.1/servers => generated 87 bytes in 676 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:39:38.096833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:38.097779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:38.105278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:38.106718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:38.107324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:38.108209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:38.108899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:38.109708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:38.319324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:38.329942 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a47d841e-d7a5-49c8-9eb9-1c042c498d1a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1102 microversion: 2.1 time: 0.239280 Oct 03 14:39:38.330556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 931/1822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:38 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1102 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:38.340751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:38.351461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:38.370761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:38.371250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:38.371986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:38.372950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:38.373612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:38.374120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:38.923441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:38.926857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.937225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:38.939889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:38.942809 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ebc847a7-22df-48f3-8373-0b2f968af03b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1483 microversion: 2.25 time: 0.605495 Oct 03 14:39:38.944105 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 932/1823] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:38 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1483 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:38.950412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f72fd6bf-b4b0-41b2-8093-9dea9875a63d req-f25df662-c7f2-4607-8a33-09c1f463e590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b8547b-d12f-474d-8e17-19364eb75441", "tag": "d6bba469-edef-483e-bd0a-e37d5559b8f0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:38.981901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f72fd6bf-b4b0-41b2-8093-9dea9875a63d req-f25df662-c7f2-4607-8a33-09c1f463e590 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:38.982910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f72fd6bf-b4b0-41b2-8093-9dea9875a63d req-f25df662-c7f2-4607-8a33-09c1f463e590 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:38.983538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f72fd6bf-b4b0-41b2-8093-9dea9875a63d req-f25df662-c7f2-4607-8a33-09c1f463e590 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:38.997363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:39.013562 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f72fd6bf-b4b0-41b2-8093-9dea9875a63d req-f25df662-c7f2-4607-8a33-09c1f463e590 service nova] Creating event network-changed:d6bba469-edef-483e-bd0a-e37d5559b8f0 for instance a6b8547b-d12f-474d-8e17-19364eb75441 on n-h2-781139-2 Oct 03 14:39:39.014665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03d91520-ccf3-4317-8021-151a44d9080b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1462 microversion: 2.1 time: 1.016986 Oct 03 14:39:39.018764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 892/1824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:37 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1462 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:39.029597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b6e7c0fd-b328-4649-aeaa-39c50515971c req-c64e3318-4f79-44d1-b949-015e38890a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86253b5-aa1f-4527-8b1b-22ed255e2949", "tag": "8931892f-f64a-46a3-bef9-3c736104fcd6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:39.035333 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f72fd6bf-b4b0-41b2-8093-9dea9875a63d req-f25df662-c7f2-4607-8a33-09c1f463e590 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089773 Oct 03 14:39:39.036498 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 933/1825] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:39.047977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:39.052386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:39.054836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b6e7c0fd-b328-4649-aeaa-39c50515971c req-c64e3318-4f79-44d1-b949-015e38890a84 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.057600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b6e7c0fd-b328-4649-aeaa-39c50515971c req-c64e3318-4f79-44d1-b949-015e38890a84 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.058636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b6e7c0fd-b328-4649-aeaa-39c50515971c req-c64e3318-4f79-44d1-b949-015e38890a84 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.068417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.068914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.070427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.071348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.075860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.076304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.087159 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b6e7c0fd-b328-4649-aeaa-39c50515971c req-c64e3318-4f79-44d1-b949-015e38890a84 service nova] Creating event network-changed:8931892f-f64a-46a3-bef9-3c736104fcd6 for instance f86253b5-aa1f-4527-8b1b-22ed255e2949 on n-h2-781139-2 Oct 03 14:39:39.110970 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b6e7c0fd-b328-4649-aeaa-39c50515971c req-c64e3318-4f79-44d1-b949-015e38890a84 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088819 Oct 03 14:39:39.111890 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 893/1826] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:39.120950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:39.132571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:39.156989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.157866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.158480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.159418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.162933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.163590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.529299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:39.537294 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d98fb0e-5c8a-4960-a9fe-8b533cd62c17 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 200 len: 1479 microversion: 2.1 time: 0.499137 Oct 03 14:39:39.542678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:39.556861 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b08d87c4-7f4f-4435-8131-5668caa5b8f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1317 microversion: 2.1 time: 0.443609 Oct 03 14:39:39.558323 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 894/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:39 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:39.560693 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 934/1828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:39 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 1479 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:39.565653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:39.566986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:39.567123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:39.567621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:39.580143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.581756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.582402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.583412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.585282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.585675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.586217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.586669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.586871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.587407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.594574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.599048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.857831 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f344e784-bc7a-4610-bbd2-66d11d14154f tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1613 microversion: 2.1 time: 0.295564 Oct 03 14:39:39.869110 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 935/1829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:39 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1613 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:39.879474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:39.880719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:39.888628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.889427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.889940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.890605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:39.891500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:39.891932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:39.972673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:39.985973 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa7198c9-dd86-493d-8ce1-7c5431ca9f5a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1168 microversion: 2.1 time: 0.126114 Oct 03 14:39:39.989168 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 936/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:39 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1168 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:39.993388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:40.016867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-895024013"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:40.018332 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87019cf8-1842-4b4d-b52c-448a4fa344c2 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.453206 Oct 03 14:39:40.019485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:40.020478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 895/1831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:39 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:40.026588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:40.027848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:40.028761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:40.029756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:40.030539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:40.031176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:40.052906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:40.053755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:40.074813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:40.075310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:40.075780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:40.076506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:40.076981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:40.077697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:40.212114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '318c6060cbf44cc78496927ef499297f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af1a3826336420dae7fc63cff307355', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:40.213306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] flavor_id is None. Assuming migration. {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 14:39:40.219921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 14:39:40.560141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f794757c-04c0-492b-9cd1-0da25c6e02bb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444/action" status: 202 len: 0 microversion: 2.1 time: 0.569300 Oct 03 14:39:40.572082 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 937/1832] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:39:39 2022] POST /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:39:40.578708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:40.583337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:40.601190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:40.602731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:40.604730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:40.610331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:40.611407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:40.612443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:40.980688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:40.997424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:40.997971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:41.002143 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87efc174-4b55-4ab1-9981-93be65c01ef5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1266 microversion: 2.25 time: 0.436130 Oct 03 14:39:41.028586 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 938/1833] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:40 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1266 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:41.047479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99d9d629-2316-4370-af43-2bb965639ae0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a0f4c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:41.091844 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a1da49d1-c06a-4cc2-b11f-e9a2f8ecc0b0 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce/action" status: 202 len: 0 microversion: 2.1 time: 1.044400 Oct 03 14:39:41.093705 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 896/1834] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:39:40 2022] POST /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce/action => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:39:41.116081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:41.119818 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99d9d629-2316-4370-af43-2bb965639ae0 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.088250 Oct 03 14:39:41.120743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:41.120898 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 939/1835] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:41 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:41.131202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:41.136943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:41.141581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.143812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.151333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.151896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.152372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.153138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.155179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.155498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.156611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.159700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.161077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.163369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.384166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:41.394340 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10314404-16cb-4d03-8262-7eed90afffe0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1168 microversion: 2.1 time: 0.272348 Oct 03 14:39:41.409983 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 940/1836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:41 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1168 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:41.422781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:41.423666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:41.430826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.431640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.432507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.433534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.434323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.434995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.667083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:41.676963 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44d57b07-126d-4278-89d9-0bbd6eb0eeab tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.264291 Oct 03 14:39:41.687686 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 941/1837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:41 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:41.706237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:41.709338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:41.725872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.726568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.727104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.729116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.730182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.732041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:41.918748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:41.946418 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f44e2abb-5521-4476-8182-9c24f6409321 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1317 microversion: 2.1 time: 0.848315 Oct 03 14:39:41.950792 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 897/1838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:41 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:41.962177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-96f2d4b8-682c-411f-a7b9-10193fddbec9 req-ded50afa-6b0e-4d4f-95c3-2f5ce63154c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78c44ad-428f-4712-a350-05c9b2047751", "name": "network-vif-deleted", "tag": "f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:41.983430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-96f2d4b8-682c-411f-a7b9-10193fddbec9 req-ded50afa-6b0e-4d4f-95c3-2f5ce63154c1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:41.984229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-96f2d4b8-682c-411f-a7b9-10193fddbec9 req-ded50afa-6b0e-4d4f-95c3-2f5ce63154c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:41.985150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-96f2d4b8-682c-411f-a7b9-10193fddbec9 req-ded50afa-6b0e-4d4f-95c3-2f5ce63154c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:42.001408 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-96f2d4b8-682c-411f-a7b9-10193fddbec9 req-ded50afa-6b0e-4d4f-95c3-2f5ce63154c1 service nova] Creating event network-vif-deleted:f087e67a-9dab-4b6c-8d1f-7f600ff6c4c9 for instance c78c44ad-428f-4712-a350-05c9b2047751 on n-h2-781139-2 Oct 03 14:39:42.010442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-96f2d4b8-682c-411f-a7b9-10193fddbec9 req-ded50afa-6b0e-4d4f-95c3-2f5ce63154c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057704 Oct 03 14:39:42.014182 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 898/1839] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:42.040416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:42.044958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:42.068284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:42.071851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:42.072441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:42.073391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:42.075937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:42.080378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:42.152045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:42.169422 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f464ed91-925a-4c8b-bf81-5e8a1d185da6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1471 microversion: 2.1 time: 0.478471 Oct 03 14:39:42.169927 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 942/1840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:41 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1471 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:42.187922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8ca3c4a-a0c6-4e23-85ef-1df4bdf6bf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2309f3f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:42.241409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:42.258310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:42.263808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:42.266779 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f87977dc-b386-4877-98bd-3531988b7dec tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1266 microversion: 2.25 time: 0.236676 Oct 03 14:39:42.285653 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8ca3c4a-a0c6-4e23-85ef-1df4bdf6bf06 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.114009 Oct 03 14:39:42.286515 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 943/1841] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:42 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:42.286875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 899/1842] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:42 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:42.424795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:42.425396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:42.436176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:42.439619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:42.440405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:42.441480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:42.442114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:42.446233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:42.711438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:42.712054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:42.720307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:42.720792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:42.721259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:42.721969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:42.722418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:42.722836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:43.657218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:43.675620 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-19c6c9f6-8208-4b48-9359-e137f5cb4e83 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.967164 Oct 03 14:39:43.692814 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 900/1843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:42 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:39:43.697935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:43.699453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:43.706874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:43.707665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:43.709099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:43.710141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:43.710771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:43.711414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:44.240756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:44.257046 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c11ec263-a025-484d-8d49-1c5243c60772 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 1.834451 Oct 03 14:39:44.258437 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 944/1844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:42 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:44.279506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:44.280418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:44.288496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:44.291847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:44.293050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:44.294998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:44.296918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:44.299627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:44.697615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:44.713606 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74cd1aa6-14c8-4018-80ff-2a976d07e5a8 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1471 microversion: 2.1 time: 0.437827 Oct 03 14:39:44.714740 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 945/1845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:44 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:44.727692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b92fbbb9-b302-4c6f-8240-6d8ece2b202a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230fc6940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:44.731232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:44.742757 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-854a6388-6d98-4643-b36f-363d23d4c146 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1317 microversion: 2.1 time: 1.048858 Oct 03 14:39:44.752741 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 901/1846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:43 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1317 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:44.765030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:44.780149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:44.786764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:44.787263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:44.787706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:44.788418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:44.788982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:44.789334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:44.810111 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b92fbbb9-b302-4c6f-8240-6d8ece2b202a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.092231 Oct 03 14:39:44.810966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 946/1847] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:44 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:44.822201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:44.825176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:44.845362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:44.845947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:44.846449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:44.847373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:44.847894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:44.849607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:44.990713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:45.020386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:45.021879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:45.023064 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5411144-acfb-475b-8303-1368a9d3b06a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1266 microversion: 2.25 time: 0.267413 Oct 03 14:39:45.049065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 902/1848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:44 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:45.064200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-4ee0edc9-9ff8-4329-b3aa-67c8ee2f5094 req-7a8faeef-49e1-4f09-8ddf-2ee16025298f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b8547b-d12f-474d-8e17-19364eb75441", "name": "network-vif-plugged", "status": "completed", "tag": "d6bba469-edef-483e-bd0a-e37d5559b8f0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:45.093790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4ee0edc9-9ff8-4329-b3aa-67c8ee2f5094 req-7a8faeef-49e1-4f09-8ddf-2ee16025298f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:45.094593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4ee0edc9-9ff8-4329-b3aa-67c8ee2f5094 req-7a8faeef-49e1-4f09-8ddf-2ee16025298f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:45.095634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4ee0edc9-9ff8-4329-b3aa-67c8ee2f5094 req-7a8faeef-49e1-4f09-8ddf-2ee16025298f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:45.126854 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4ee0edc9-9ff8-4329-b3aa-67c8ee2f5094 req-7a8faeef-49e1-4f09-8ddf-2ee16025298f service nova] Creating event network-vif-plugged:d6bba469-edef-483e-bd0a-e37d5559b8f0 for instance a6b8547b-d12f-474d-8e17-19364eb75441 on n-h2-781139-2 Oct 03 14:39:45.134777 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-4ee0edc9-9ff8-4329-b3aa-67c8ee2f5094 req-7a8faeef-49e1-4f09-8ddf-2ee16025298f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082968 Oct 03 14:39:45.148618 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 903/1849] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:45.282328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:45.283188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:45.299676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:45.299940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:45.300567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:45.301520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:45.309808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:45.314627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:45.922532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:45.931483 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de58b06a-aa45-46e2-ada2-4126370fa1cc tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 0.653911 Oct 03 14:39:45.937714 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 904/1850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:45 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:39:45.950642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:45.951689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:45.965820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:45.968105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:45.970138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:45.970917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:45.971930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:45.973488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:45.974979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:46.118946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:46.128526 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9708b1c-152d-4433-8e48-9c40c2dd2c9b tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 1.314583 Oct 03 14:39:46.133696 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 947/1851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:44 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:46.148270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:46.154061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:46.168000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:46.171357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:46.172719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:46.174917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:46.181396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:46.183397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:46.526575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=22 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:46.565284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:46.630663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:46.644264 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9989b816-b11f-42e9-af38-c1e1473208ec tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1471 microversion: 2.1 time: 0.705050 Oct 03 14:39:46.662234 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 905/1852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:45 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:46.662651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:46.662651 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b93a241a-2d80-4494-af61-4ee8da05d24b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1317 microversion: 2.1 time: 0.526869 Oct 03 14:39:46.667785 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 948/1853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:46 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:46.683053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9274d9ba-eb5d-4008-9f91-8672d050614e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2310dd430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:46.689669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:46.690466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:46.702252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:46.703636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:46.704576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:46.705981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:46.707883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:46.709181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:46.797859 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9274d9ba-eb5d-4008-9f91-8672d050614e tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.140783 Oct 03 14:39:46.798532 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 906/1854] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:46 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:46.800263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:46.887449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:46.909236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:46.912387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:46.914626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50ecc8e4-5e63-4af2-8a54-c64b88072566 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1266 microversion: 2.25 time: 0.230824 Oct 03 14:39:46.915846 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 949/1855] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:46 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:46.963699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:46.964413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:46.985826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:46.986315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:46.986960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:46.987878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:46.988487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:46.989106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:47.159603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:47.160226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:47.171135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:47.171944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:47.172562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:47.181969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:47.182740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:47.183350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:47.528841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:47.540058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5512c45-7e36-4166-828b-28b94ae29ece tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 0.581330 Oct 03 14:39:47.541079 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 907/1856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:46 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:47.596563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-193dabf4-ad6e-4110-b1ef-e7628a6f8987 req-0df26434-51fc-4e4b-8b75-f1bcce175ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a669cbe-531f-4300-a7dd-e014baf44bf3", "tag": "0f57491e-aa97-4ff7-a32d-cd0ed03cd108"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:47.615970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-193dabf4-ad6e-4110-b1ef-e7628a6f8987 req-0df26434-51fc-4e4b-8b75-f1bcce175ab4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:47.616905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-193dabf4-ad6e-4110-b1ef-e7628a6f8987 req-0df26434-51fc-4e4b-8b75-f1bcce175ab4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:47.617615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-193dabf4-ad6e-4110-b1ef-e7628a6f8987 req-0df26434-51fc-4e4b-8b75-f1bcce175ab4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:47.642466 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-193dabf4-ad6e-4110-b1ef-e7628a6f8987 req-0df26434-51fc-4e4b-8b75-f1bcce175ab4 service nova] Creating event network-changed:0f57491e-aa97-4ff7-a32d-cd0ed03cd108 for instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 on n-h1-781139-2 Oct 03 14:39:47.656994 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-193dabf4-ad6e-4110-b1ef-e7628a6f8987 req-0df26434-51fc-4e4b-8b75-f1bcce175ab4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064714 Oct 03 14:39:47.665882 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 908/1857] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:39:47.671928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:47.686066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:47.693447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:47.694360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:47.695313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:47.696284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:47.697014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:47.697811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:47.898677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:47.909776 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3567c3f-d776-4e9d-af99-b5fa2e47d4a5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.753883 Oct 03 14:39:47.917713 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 950/1858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:47 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:47.927056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:47.927941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:47.941834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:47.945641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:47.946388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:47.947369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:47.948268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:47.951894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:48.061383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=9 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:48.641768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:48.674989 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fa7e1975-8917-4bca-895a-ce5c2c6d6bdd tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1471 microversion: 2.1 time: 1.007306 Oct 03 14:39:48.683415 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 909/1859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:47 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1471 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:48.704848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce0c49e1-54a9-45aa-b8ec-3457a1c30e27 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230ac2b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:48.782998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:48.785275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:48.805702 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e69a7248-a039-4465-b589-43ddfa8fff29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1508 microversion: 2.1 time: 0.886460 Oct 03 14:39:48.817869 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 951/1860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:47 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1508 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:48.817869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:48.817869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:48.834445 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce0c49e1-54a9-45aa-b8ec-3457a1c30e27 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.149169 Oct 03 14:39:48.837542 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 910/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:48 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:48.850399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:48.850935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:48.851449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:48.851920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:48.852960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:48.853814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:48.854601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:48.864869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:48.879710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:48.880996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:48.884262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:48.884262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:48.884262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:48.884262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:49.074962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:49.086917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:49.102168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:49.103686 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c58635b9-8d6f-4e2e-8a70-9c45706980cd tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 200 len: 1266 microversion: 2.25 time: 0.295897 Oct 03 14:39:49.107806 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 952/1862] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:48 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:39:49.113083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:49.116322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:49.143287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:49.144157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:49.144874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:49.145881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:49.149643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:49.150399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:49.668040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:49.677713 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b8ad6c5-b2b4-4017-8efe-efc9f3da35f8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1508 microversion: 2.1 time: 0.568468 Oct 03 14:39:49.683087 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 953/1863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:49 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:49.711403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:49.714806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:49.730352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:49.735045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:49.735499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:49.736388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:49.739631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:49.740079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:49.765981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:49.773198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.779461 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3cf0ddb-0b3c-4856-ae15-5e30a8c96b69 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 0.937659 Oct 03 14:39:49.785924 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 911/1864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:48 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:49.803885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-88e0dbc9-3b3b-417b-9e2f-a73cc889ec98 req-6b005f67-a03e-4ae8-962b-4a2a0c6a1250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a011620-a90d-4d52-a7b6-5bec3e47d444", "name": "network-vif-plugged", "status": "completed", "tag": "ef579db2-bbe0-4153-88ce-b0eb95ade16b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:49.858429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-88e0dbc9-3b3b-417b-9e2f-a73cc889ec98 req-6b005f67-a03e-4ae8-962b-4a2a0c6a1250 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:49.858906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-88e0dbc9-3b3b-417b-9e2f-a73cc889ec98 req-6b005f67-a03e-4ae8-962b-4a2a0c6a1250 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:49.859336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-88e0dbc9-3b3b-417b-9e2f-a73cc889ec98 req-6b005f67-a03e-4ae8-962b-4a2a0c6a1250 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:49.921648 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-88e0dbc9-3b3b-417b-9e2f-a73cc889ec98 req-6b005f67-a03e-4ae8-962b-4a2a0c6a1250 service nova] Creating event network-vif-plugged:ef579db2-bbe0-4153-88ce-b0eb95ade16b for instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 on n-h2-781139-2 Oct 03 14:39:49.957833 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-88e0dbc9-3b3b-417b-9e2f-a73cc889ec98 req-6b005f67-a03e-4ae8-962b-4a2a0c6a1250 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168330 Oct 03 14:39:49.961692 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 912/1865] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:50.002347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:50.002347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:50.028612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.029983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.033944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:50.034968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.035607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.036224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:50.339986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:50.350498 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1f6e124-fdbc-4842-bf47-0682e43f0b71 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.663856 Oct 03 14:39:50.351135 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 954/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:49 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:50.377961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:50.391051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:50.399388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.414307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.416103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:50.418474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.425635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.426698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:50.502235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:50.512242 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd11b3d7-9a67-4740-ab64-867c76c3b7f4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.549266 Oct 03 14:39:50.533401 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 913/1867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:49 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:50.538576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06d8ab2e-45fe-43bb-a197-ad8696df3480 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a5ee50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:50.700122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:39:50.700749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:39:50.701644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:39:50.703074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:39:50.703662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:39:50.718840 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06d8ab2e-45fe-43bb-a197-ad8696df3480 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.183589 Oct 03 14:39:50.728287 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 914/1868] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:50 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:50.746336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:50.751155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c78c44ad-428f-4712-a350-05c9b2047751] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:50.781824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.784215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.784907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:50.785869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.787677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.790706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:50.826479 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] HTTP exception thrown: Instance c78c44ad-428f-4712-a350-05c9b2047751 could not be found. Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Request method failure captured: Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 HTTP/1.1 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKxL-8mTKTQmJIZzkKV6hipQLnkz402oNiwAAGkI5bqjHYhbWnOBznBAIBaZSnApIbAfwkImuejemx_ZdvGCGf6rC1IiCWtQhQQFmeU6GtOXMpY3gFSmHraP8PNWD1fTSDftHukY90N2oulVSUR07XtW-z3g8waYfm2ArxLSUmYYGc Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f5e47f71fc4494aa8ed6354736216f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 19b2b042d70a426989bb5dc6b986b7c5 Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance c78c44ad-428f-4712-a350-05c9b2047751 could not be found. Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c78c44ad-428f-4712-a350-05c9b2047751'} Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78c44ad-428f-4712-a350-05c9b2047751 could not be found. Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78c44ad-428f-4712-a350-05c9b2047751 could not be found. Oct 03 14:39:50.828552 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78c44ad-428f-4712-a350-05c9b2047751 could not be found. Oct 03 14:39:50.834221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:39:50.838748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Returning 404 to user: Instance c78c44ad-428f-4712-a350-05c9b2047751 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:39:50.841079 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-57e3dca5-0eb9-4ce4-bd80-2a19b0555696 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751" status: 404 len: 111 microversion: 2.25 time: 0.109717 Oct 03 14:39:50.844527 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 915/1869] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:39:50 2022] GET /compute/v2.1/servers/c78c44ad-428f-4712-a350-05c9b2047751 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:39:50.892658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:50.908454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.910588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.921720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:50.922490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:50.922971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:50.923405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:51.072834 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb2dc0f8-6623-4f91-a926-cff183406c5e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "POST /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441/action" status: 202 len: 1110 microversion: 2.1 time: 0.696954 Oct 03 14:39:51.076005 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 955/1870] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:39:50 2022] POST /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441/action => generated 1110 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 14:39:51.105646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:51.106404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:51.129375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:51.129878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:51.130338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:51.131123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:51.131662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:51.132095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:51.277712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-705724078", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c2bddd9e-cf69-48be-83db-05063b7360e1"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:51.444710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] validate_networks() for [('c2bddd9e-cf69-48be-83db-05063b7360e1', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:39:52.132572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:52.143752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e24fcbe-9f8b-4fcf-8a58-e045a9a7ef12 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 1.066566 Oct 03 14:39:52.157580 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 956/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:51 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:52.165547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:52.166540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:52.184987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:52.186983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:52.187976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:52.188986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:52.189692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:52.190853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.061715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:39:53.062244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:39:53.062613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:39:53.063023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:39:53.063636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:39:53.087734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:53.088606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:53.092010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.093133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:53.096528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:53.097338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.131402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:53.141371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1ecc8f5-899d-409c-a41b-6f6aaf049516 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.982157 Oct 03 14:39:53.144959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Getting quotas for project ab4bc0de18ea43e7bc65f1f862a7d592. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:39:53.152082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Getting quotas for user 75f9d6a0213b45b786fb3950669cc78a and project ab4bc0de18ea43e7bc65f1f862a7d592. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:39:53.158088 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 957/1872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:52 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:53.164938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:53.165569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:53.179960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:39:53.184582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:39:53.203244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:53.215461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:53.218429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.225759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:53.226339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:53.226798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.248067 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7fd3008-b14c-4d07-b00b-8971248ab319 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.397759 Oct 03 14:39:53.249388 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 916/1873] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:39:53.255702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:53.256736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:53.264163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:53.266031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:53.266747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.267720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:53.268391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:53.269078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.689883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:53.699567 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ca39fc9-ae57-463f-8fc7-f67cb9ef11c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.448788 Oct 03 14:39:53.716403 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 917/1874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:53 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:53.730594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-041e63bf-dbf8-46b4-8e73-add587a64fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230919670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:53.876095 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-041e63bf-dbf8-46b4-8e73-add587a64fce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.156428 Oct 03 14:39:53.876794 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 918/1875] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:53 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:53.898049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-fd00fde5-2f0e-473c-84ef-1f80dd42b926 req-af6b8b39-85c0-4b85-b180-df85fe215273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86253b5-aa1f-4527-8b1b-22ed255e2949", "name": "network-vif-plugged", "status": "completed", "tag": "8931892f-f64a-46a3-bef9-3c736104fcd6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:53.957776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd00fde5-2f0e-473c-84ef-1f80dd42b926 req-af6b8b39-85c0-4b85-b180-df85fe215273 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:53.960895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd00fde5-2f0e-473c-84ef-1f80dd42b926 req-af6b8b39-85c0-4b85-b180-df85fe215273 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:53.965653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd00fde5-2f0e-473c-84ef-1f80dd42b926 req-af6b8b39-85c0-4b85-b180-df85fe215273 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:53.993277 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-fd00fde5-2f0e-473c-84ef-1f80dd42b926 req-af6b8b39-85c0-4b85-b180-df85fe215273 service nova] Creating event network-vif-plugged:8931892f-f64a-46a3-bef9-3c736104fcd6 for instance f86253b5-aa1f-4527-8b1b-22ed255e2949 on n-h2-781139-2 Oct 03 14:39:54.030836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-fd00fde5-2f0e-473c-84ef-1f80dd42b926 req-af6b8b39-85c0-4b85-b180-df85fe215273 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141281 Oct 03 14:39:54.059716 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 919/1876] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:39:54.089538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:54.093558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:54.110319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:54.114566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:54.117290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:54.122528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:54.126409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:54.129092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:54.452584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:54.476207 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de906252-e40b-48dd-aa81-246e66a98ed2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 0.410004 Oct 03 14:39:54.482554 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 920/1877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:54 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:54.496276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8e667f01-e6c6-47a8-95b0-310bfe3c1fc9 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:54.504710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8e667f01-e6c6-47a8-95b0-310bfe3c1fc9 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:54.614941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:54.633459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-089d8597-6b88-4a62-8883-570bb9982eb5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 1.473135 Oct 03 14:39:54.634756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 958/1878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:53 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:54.644325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:54.649777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:54.671173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:54.672170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:54.675537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:54.679940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:54.680687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:54.686515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:54.701193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8e667f01-e6c6-47a8-95b0-310bfe3c1fc9 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:54.715622 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8e667f01-e6c6-47a8-95b0-310bfe3c1fc9 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1216 microversion: 2.1 time: 0.224174 Oct 03 14:39:54.732958 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 921/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:54 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:54.753009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:54.753702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:54.775555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:54.775981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:54.776889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:54.777677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:54.778143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:54.780753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:55.126431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:55.141215 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b09079f-2bc4-4f59-a7c5-91e92855e36f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.417940 Oct 03 14:39:55.142395 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 922/1880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:54 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:55.147886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f6bc76d-b101-485b-ac9f-13933783a398 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230557160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:55.162385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:55.177321 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-661c98ea-6550-4290-9c92-ae45583c95f5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.540011 Oct 03 14:39:55.179499 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 959/1881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:54 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:55.247938 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f6bc76d-b101-485b-ac9f-13933783a398 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.104173 Oct 03 14:39:55.268371 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 923/1882] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:55 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:55.508989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:55.509617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:55.529066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:55.529577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:55.531268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:55.534919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:55.535429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:55.535878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:55.661467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:55.662123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:55.677168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:55.678887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:55.688705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:55.691818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:55.694473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:55.696127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:56.042884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:56.051130 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c216906d-cbaa-4be9-8cc6-1f8247411ff3 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1323 microversion: 2.1 time: 0.393729 Oct 03 14:39:56.069821 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 924/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:55 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1323 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:56.080827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:56.081834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:56.102975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:56.103752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:56.104291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:56.105355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:56.111650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:56.112220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:56.227227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:56.246145 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4362d3cc-9357-418d-9642-8d79b0c518f7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1268 microversion: 2.1 time: 0.174814 Oct 03 14:39:56.247392 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 925/1884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:56 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:56.252329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:56.259183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:56.271117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:56.275603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:56.276258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:56.277224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:56.277846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:56.278439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:56.303501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:56.313335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7169a49e-654d-46c8-9116-717328668222 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 0.814617 Oct 03 14:39:56.314521 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 960/1885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:55 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:56.324054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:56.325832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:56.338235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:56.344762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:56.347538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:56.349025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:56.352533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:56.354665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:56.914764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:56.939676 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1bf67080-1171-47a9-a819-f88b9b30c443 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.621930 Oct 03 14:39:56.986119 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 961/1886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:56 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:57.004242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03827ae5-1581-4e9f-8978-dd082a3e1ac7 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23096f160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:57.089122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:57.100508 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-901b6c9e-439b-4b16-a45f-9a64be82ae5d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.851831 Oct 03 14:39:57.105925 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 926/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:56 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:57.125927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:57.126556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:57.156491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:57.163054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:57.164750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:57.167510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:57.172705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:57.173471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:57.174048 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03827ae5-1581-4e9f-8978-dd082a3e1ac7 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.185709 Oct 03 14:39:57.184965 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 962/1888] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:56 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:57.273610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:57.274911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:57.296269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:57.301322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:57.302127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:57.303154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:57.309807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:57.315553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:57.669619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:57.683368 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de753d24-da35-420b-a577-5ed9e65fa77f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1274 microversion: 2.1 time: 0.413970 Oct 03 14:39:57.686508 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 963/1889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:57 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1274 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:57.692773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:57.694057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:57.722262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:57.723043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:57.723811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:57.724767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:57.725595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:57.726218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:57.942600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:57.956223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5dee3136-7382-4244-9c54-202b2c32ce05 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 200 len: 1518 microversion: 2.1 time: 0.848766 Oct 03 14:39:57.964513 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 927/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:57 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 1518 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:57.985812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:57.987499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:57.998891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:58.019566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:58.019566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:58.019566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:58.019566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:58.019566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:58.019566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:58.055042 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2e8076c-ae6a-4f84-96fc-4a95d0896a0e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 0.367054 Oct 03 14:39:58.073156 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 964/1891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:57 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:58.082437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'action', calling method: .version_select at 0x7fb232fe88b0>, body: {"addFloatingIp": {"address": "172.25.6.35"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:39:58.091278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:58.113781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:58.115723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:58.116618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:58.119751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:58.120470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:58.120917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:58.285172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:39:58.285629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquired lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:39:59.235746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:59.253591 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-141b093a-1098-40dd-962b-8769a8e99374 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 1.265487 Oct 03 14:39:59.265046 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 928/1892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:57 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:59.272235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:59.272235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:39:59.278106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:59.278969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:59.279623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:59.280786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:39:59.281699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:39:59.282343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:39:59.816599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:39:59.829688 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c31c480-2d03-4485-bd3b-0709773dade4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.572055 Oct 03 14:39:59.830281 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 929/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:39:59 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:59.835028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2a485680-671f-4f19-9fb3-1980036313d9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230d27670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:39:59.933223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2a485680-671f-4f19-9fb3-1980036313d9 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.100823 Oct 03 14:39:59.942065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 930/1894] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:39:59 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:00.107963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1006226666", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "becfb12c-e5af-4560-80c3-4794784e4ae3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:00.235877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:40:00.894806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:40:02.157455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:40:02.158004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:40:02.158223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:40:02.158854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:40:02.159441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:40:02.188025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:02.188785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:02.191723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:02.199019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:02.199771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:02.201629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:02.271575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:40:02.294998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:40:02.346659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:40:02.353252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:40:02.546977 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07638b8a-d61f-453f-86c6-98b4976ac916 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.603523 Oct 03 14:40:02.560174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 931/1895] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:39:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:40:02.590831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:02.594730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:02.643254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:02.645072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:02.645536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:02.646288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:02.656160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:02.658142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:03.504981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:03.520495 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94548a10-3979-4da3-b310-83631ec2d1b7 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1316 microversion: 2.1 time: 0.955507 Oct 03 14:40:03.538703 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 932/1896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:02 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1316 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:03.544309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:03.559920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:03.576364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:03.585213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:03.593458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:03.595481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:03.601138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:03.604876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:03.772678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Updating instance_info_cache with network_info: [{"id": "c1847700-d232-42c8-a049-ef3bbcdad333", "address": "fa:16:3e:64:7e:bf", "network": {"id": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-685002994-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1118fb2e9d1a4ad0af213b85620e1cc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1847700-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:40:03.813130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Releasing lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:40:03.814112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1b1aede-6e0b-48fb-bb03-366f990ec045 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action" status: 202 len: 0 microversion: 2.1 time: 5.739506 Oct 03 14:40:03.817589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 965/1897] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:39:58 2022] POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action => generated 0 bytes in 5744 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:40:03.830726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:03.839901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:03.856550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:03.859814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:03.862138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:03.863834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:03.877814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:03.878714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:03.925185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:04.302796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:04.312738 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-916daa19-c27d-47a0-8b45-47ca73bf6077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.493341 Oct 03 14:40:04.315799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 966/1898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:03 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:04.329893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:04.330820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:04.345583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:04.346344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:04.349742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:04.350727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:04.351503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:04.352104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:04.682063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:04.700435 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0e7d10b-6972-4821-bacc-f8d2bf5952c2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.381111 Oct 03 14:40:04.703429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 967/1899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:04 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:04.717289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4e048ef2-0d3e-4166-a225-5a28d737165f req-0b1ac5de-a199-490f-b5f0-10238f514b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c", "tag": "c1847700-d232-42c8-a049-ef3bbcdad333"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:04.748151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4e048ef2-0d3e-4166-a225-5a28d737165f req-0b1ac5de-a199-490f-b5f0-10238f514b0f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:04.750829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4e048ef2-0d3e-4166-a225-5a28d737165f req-0b1ac5de-a199-490f-b5f0-10238f514b0f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:04.752106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4e048ef2-0d3e-4166-a225-5a28d737165f req-0b1ac5de-a199-490f-b5f0-10238f514b0f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:04.773315 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4e048ef2-0d3e-4166-a225-5a28d737165f req-0b1ac5de-a199-490f-b5f0-10238f514b0f service nova] Creating event network-changed:c1847700-d232-42c8-a049-ef3bbcdad333 for instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c on n-h1-781139-2 Oct 03 14:40:04.783164 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4e048ef2-0d3e-4166-a225-5a28d737165f req-0b1ac5de-a199-490f-b5f0-10238f514b0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077681 Oct 03 14:40:04.784146 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 968/1900] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:04.791197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20a1daf8-a58d-471d-b2da-07ea1eb5fcfa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230c50160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:04.887759 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20a1daf8-a58d-471d-b2da-07ea1eb5fcfa tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.100545 Oct 03 14:40:04.889193 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 969/1901] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:04 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:04.894565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:04.895309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:04.912838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:04.913391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:04.913862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:04.914702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:04.915879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:04.915879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:05.091178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:05.100099 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4fad1a4d-b265-48c4-a695-0f35ed808152 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1245 microversion: 2.1 time: 0.209785 Oct 03 14:40:05.107284 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 970/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:04 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1245 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:05.127638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.35"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:05.140570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:05.160080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:05.160662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:05.161164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:05.161906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:05.168361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:05.172386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:05.299767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "refresh_cache-f86253b5-aa1f-4527-8b1b-22ed255e2949" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:40:05.300194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquired lock "refresh_cache-f86253b5-aa1f-4527-8b1b-22ed255e2949" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:40:05.674653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:05.690878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51d6b0d5-da8a-4e74-ad75-34837af65702 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1210 microversion: 2.1 time: 2.150644 Oct 03 14:40:05.691423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 933/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:03 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1210 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:05.715708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:05.716337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:05.722886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:05.723685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:05.724284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:05.728910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:05.736077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:05.739926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:06.180677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:06.191545 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-10656469-50e6-42f9-af22-c85c4fbf00e1 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1316 microversion: 2.1 time: 0.499042 Oct 03 14:40:06.194782 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 934/1904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:05 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:06.211463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:06.212317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:06.228364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:06.229159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:06.229762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:06.234402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:06.235148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:06.235750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:06.517861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:06.526590 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ba57e40-fd45-4993-9366-d9cc308cad8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.330156 Oct 03 14:40:06.532575 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 935/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:06 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:06.555695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-86b2835d-a2b5-4bed-b28d-10085cee2ffa req-a984992d-09b7-471c-bb00-7b59cd5bcb85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b527955b-b823-441d-a4bb-44a1d880daa0", "tag": "63b5bd68-d682-4ed9-9c82-e0d2b66eb1f7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:06.595080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86b2835d-a2b5-4bed-b28d-10085cee2ffa req-a984992d-09b7-471c-bb00-7b59cd5bcb85 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:06.601606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86b2835d-a2b5-4bed-b28d-10085cee2ffa req-a984992d-09b7-471c-bb00-7b59cd5bcb85 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:06.602057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86b2835d-a2b5-4bed-b28d-10085cee2ffa req-a984992d-09b7-471c-bb00-7b59cd5bcb85 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:06.659670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-86b2835d-a2b5-4bed-b28d-10085cee2ffa req-a984992d-09b7-471c-bb00-7b59cd5bcb85 service nova] Creating event network-changed:63b5bd68-d682-4ed9-9c82-e0d2b66eb1f7 for instance b527955b-b823-441d-a4bb-44a1d880daa0 on n-h1-781139-2 Oct 03 14:40:06.707098 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-86b2835d-a2b5-4bed-b28d-10085cee2ffa req-a984992d-09b7-471c-bb00-7b59cd5bcb85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166790 Oct 03 14:40:06.717613 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 936/1906] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:06.732440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:06.733548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:06.740443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:06.741572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:06.742197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:06.743121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:06.743793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:06.744402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:06.763007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:06.923418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:06.935428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6cac1de6-4e26-4283-93c4-91dbf9e8484f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.216323 Oct 03 14:40:06.937157 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 937/1907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:06 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:06.952997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-730ae12d-1371-42d0-b67b-befa9d4e8225 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a8df70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:07.021351 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-730ae12d-1371-42d0-b67b-befa9d4e8225 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.082896 Oct 03 14:40:07.022370 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 938/1908] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:06 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:07.028117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:07.029096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:07.036425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.037643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.038335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:07.039367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.040072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.040841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:07.139793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:07.151781 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c121f1e8-e465-420d-bc9f-35c081f3327e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1251 microversion: 2.1 time: 0.126063 Oct 03 14:40:07.166402 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 939/1909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:07 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1251 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:07.174432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:07.175262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:07.183710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.184437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.185171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:07.186568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.187264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.187936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:07.229536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:07.403967 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8995d60d-f9f2-47ae-b853-a6e139d8ea4a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 204 len: 0 microversion: 2.25 time: 0.236027 Oct 03 14:40:07.404693 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 940/1910] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:40:07 2022] DELETE /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:40:07.413325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:07.413760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:07.426210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.426709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.427058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:07.427753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.428220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.428739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:07.630942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:07.640209 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-843a9399-6716-444a-b40a-c682f43f1ccf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.231607 Oct 03 14:40:07.641426 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 941/1911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:07 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:07.647639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:07.647809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:07.653984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.654470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.654914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:07.655760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:07.656223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:07.656781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:08.000484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:08.020647 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d61a6355-50b5-4009-bb15-8acf04f5d972 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1316 microversion: 2.1 time: 0.378043 Oct 03 14:40:08.022226 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 942/1912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:07 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:08.030775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:08.031411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:08.059960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:08.059960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:08.059960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:08.060904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:08.060904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:08.061750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:08.685550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:08.703498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:08.705111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:08.706435 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-961c0d6c-ab41-4bfe-a9ea-3144d8faf720 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1728 microversion: 2.25 time: 0.683209 Oct 03 14:40:08.707097 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 943/1913] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:08 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1728 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:08.735959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:08.739843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:08.750654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:08.762991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:08.764013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:08.764896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:08.765938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:08.766607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:08.767264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.064597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:09.076724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6da85abb-acc6-4923-a941-999ad0b3a091 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.354478 Oct 03 14:40:09.096369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 944/1914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:08 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:09.116139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:09.116672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:09.145931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.147977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.148614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.150437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.151178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.151818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.379592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:09.390196 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d8582c78-3f7a-454a-9ff0-7f1647b09100 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.296952 Oct 03 14:40:09.391639 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 945/1915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:09 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:09.396751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e250dc6c-d48e-429a-9388-427d307ed5dd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23067db80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:09.468442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e250dc6c-d48e-429a-9388-427d307ed5dd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.074939 Oct 03 14:40:09.477081 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 946/1916] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:09 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:09.483113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:09.483331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:09.489896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.495028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.495484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.496250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.496717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.497172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.703984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:09.722090 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3886ab27-482f-4517-aab1-894498b7e84c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.243796 Oct 03 14:40:09.733363 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 947/1917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:09 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:09.743445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:09.744163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:09.750506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.750990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.751444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.752156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.752615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.753057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.879524 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.network.neutron [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] re-assign floating IP 172.25.6.35 from instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c Oct 03 14:40:09.937717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:09.949388 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4ff762d-a172-481a-8fff-38e0ef37edb9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.214708 Oct 03 14:40:09.950284 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 948/1918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:09 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:09.955574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:09.960228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:09.975322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:40:09.992491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.994875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.995356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:09.996092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:09.996553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:09.997014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:10.219967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:10.232475 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4bb61004-b6e3-4282-8b82-b04d334d5c3f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1316 microversion: 2.1 time: 0.280580 Oct 03 14:40:10.233536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 949/1919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:09 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:10.242360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-65c06365-792a-4fc6-a6c0-76a16b913bba req-fdc8917b-4c7a-4813-b6da-5f60b787f806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c", "tag": "c1847700-d232-42c8-a049-ef3bbcdad333"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:10.258794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-65c06365-792a-4fc6-a6c0-76a16b913bba req-fdc8917b-4c7a-4813-b6da-5f60b787f806 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:10.259356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-65c06365-792a-4fc6-a6c0-76a16b913bba req-fdc8917b-4c7a-4813-b6da-5f60b787f806 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:10.259968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-65c06365-792a-4fc6-a6c0-76a16b913bba req-fdc8917b-4c7a-4813-b6da-5f60b787f806 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:10.275244 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-65c06365-792a-4fc6-a6c0-76a16b913bba req-fdc8917b-4c7a-4813-b6da-5f60b787f806 service nova] Creating event network-changed:c1847700-d232-42c8-a049-ef3bbcdad333 for instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c on n-h1-781139-2 Oct 03 14:40:10.287096 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-65c06365-792a-4fc6-a6c0-76a16b913bba req-fdc8917b-4c7a-4813-b6da-5f60b787f806 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050935 Oct 03 14:40:10.290367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 950/1920] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:10.297336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:10.298808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:10.309229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:10.310363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:10.313278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:10.314394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:10.314958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:10.315454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:10.553615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:10.563886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:10.571074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:10.577178 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-44889ae9-4312-4775-a5b0-1c203d84bd7a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1728 microversion: 2.25 time: 0.285449 Oct 03 14:40:10.578530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 951/1921] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:10 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1728 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:10.584695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:10.585580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:10.598669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:10.599459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:10.600297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:10.601380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:10.601951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:10.602467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:10.798269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:10.822428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-944cbd8c-cb6b-4ce6-8291-33deac9290ec tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.242665 Oct 03 14:40:10.834510 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 952/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:10 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:10.847449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:10.849055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:10.858516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:10.860460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:10.861230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:10.871896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:10.875011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:10.875780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:11.075572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:11.090172 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b59ebab4-8564-415c-bfd3-5ce091994276 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1476 microversion: 2.1 time: 0.250454 Oct 03 14:40:11.092240 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 953/1923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:10 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:11.101309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1fc6f709-e31d-4cb3-a8da-71a53fa932f3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a8d160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:11.178339 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1fc6f709-e31d-4cb3-a8da-71a53fa932f3 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.084763 Oct 03 14:40:11.196874 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 954/1924] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:11 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:11.206989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:11.210288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:11.223661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:11.227043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:11.227780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:11.229509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:11.233774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:11.235110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:11.319029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Updating instance_info_cache with network_info: [{"id": "c1847700-d232-42c8-a049-ef3bbcdad333", "address": "fa:16:3e:64:7e:bf", "network": {"id": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-685002994-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1118fb2e9d1a4ad0af213b85620e1cc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1847700-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:40:11.336181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:40:11.894219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:11.915006 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f049541a-4fd2-4d59-b7df-4a4e020be215 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.716460 Oct 03 14:40:11.934661 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 955/1925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:11 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:11.943380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:11.945273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:11.960746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:11.968066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:11.970349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:11.972474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:11.975068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:11.975704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:11.988851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:12.227643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:12.326944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=14 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:12.639384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:12.655847 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4fdd98ae-aaab-44be-a2a3-b2719f82e358 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.725159 Oct 03 14:40:12.657643 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 956/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:11 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:12.690483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:12.692304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:12.703309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:12.704093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:12.704740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:12.706482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:12.707166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:12.707786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:12.851383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Updating instance_info_cache with network_info: [{"id": "8931892f-f64a-46a3-bef9-3c736104fcd6", "address": "fa:16:3e:93:62:c1", "network": {"id": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-685002994-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1118fb2e9d1a4ad0af213b85620e1cc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8931892f-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:40:12.873229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Releasing lock "refresh_cache-f86253b5-aa1f-4527-8b1b-22ed255e2949" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:40:12.874795 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df4205fb-5fe1-4f8a-a260-5efddb48beb1 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949/action" status: 202 len: 0 microversion: 2.1 time: 7.766067 Oct 03 14:40:12.875614 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 971/1927] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:05 2022] POST /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949/action => generated 0 bytes in 7767 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:40:12.890476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:12.901719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:12.935504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=80 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:12.940795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:12.943914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:12.945529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:12.946536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:12.950473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:12.951167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:12.989633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:13.005784 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d0fa2c8-168d-4159-8479-030432ba91cf tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1316 microversion: 2.1 time: 0.342227 Oct 03 14:40:13.006996 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 957/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:12 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:13.021967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:13.022899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:13.033562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.034280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.034922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.035838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.036447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.037138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.040954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.041823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.042562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.043023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lazy-loading 'fault' on Instance uuid c3ef74ed-5f46-4ff0-af09-071498ff108a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:13.095440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:13.107531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:13.111775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:13.113006 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6595517e-eac9-47bc-b2d0-737be1776cc8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 200 len: 1372 microversion: 2.25 time: 0.235568 Oct 03 14:40:13.113577 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 972/1929] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:12 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:13.120676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:13.121645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:13.128271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.129235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.129754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.130539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.131075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.131707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.256257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:13.266264 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53bb8cfa-aae0-40db-9786-7032a365e6b3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.257980 Oct 03 14:40:13.274193 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 958/1930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:13 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:13.283899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17355083-07f4-4a4e-96bc-ddfd28f9677a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23067d040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:13.333674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:13.346657 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ac4d42b-811e-492e-b3b1-50bbe6b87ed4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1475 microversion: 2.1 time: 0.230053 Oct 03 14:40:13.347752 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 973/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:13 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1475 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:13.353336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86253b5-aa1f-4527-8b1b-22ed255e2949", "tag": "8931892f-f64a-46a3-bef9-3c736104fcd6"}, {"name": "network-changed", "server_uuid": "ce43e55f-6e1c-432f-800c-901fb82d1cfd", "tag": "5da747a3-7eb2-4c7e-bc19-6a1a57538615"}, {"server_uuid": "c3ef74ed-5f46-4ff0-af09-071498ff108a", "name": "network-vif-deleted", "tag": "32956cd1-1afd-4280-8f68-d4ffe4f4afb7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:13.368171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.369083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.369558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.374502 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17355083-07f4-4a4e-96bc-ddfd28f9677a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1437 microversion: 2.1 time: 0.098795 Oct 03 14:40:13.387444 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] Creating event network-changed:8931892f-f64a-46a3-bef9-3c736104fcd6 for instance f86253b5-aa1f-4527-8b1b-22ed255e2949 on n-h2-781139-2 Oct 03 14:40:13.387957 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] Creating event network-changed:5da747a3-7eb2-4c7e-bc19-6a1a57538615 for instance ce43e55f-6e1c-432f-800c-901fb82d1cfd on n-h2-781139-2 Oct 03 14:40:13.388515 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] Creating event network-vif-deleted:32956cd1-1afd-4280-8f68-d4ffe4f4afb7 for instance c3ef74ed-5f46-4ff0-af09-071498ff108a on n-h1-781139-2 Oct 03 14:40:13.398396 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 959/1932] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:13 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1437 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:13.402585 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9b6a708b-dc2b-46c8-8f09-ad0e923b9882 req-157d8438-f37c-4084-8d01-7f56e7e3ffa0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.053455 Oct 03 14:40:13.403387 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 974/1933] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:13.414020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:13.415144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:13.417851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'action', calling method: .version_select at 0x7fb232fe89d0>, body: {"removeFloatingIp": {"address": "172.25.6.35"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:13.440692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.441719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.442420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.445382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.446256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.448461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.800439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:13.808600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.809048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.809491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.810205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.810689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.811118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.825538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:13.833603 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-597197eb-e28d-4ec7-ba6d-d4b76cc673b2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.424402 Oct 03 14:40:13.834565 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 975/1934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:13 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:13.839253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:13.839839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:13.845908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.846392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.846820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:13.847502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:13.847946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:13.848346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.295930 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] HTTP exception thrown: Floating IP 172.25.6.35 is not associated with instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c. Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Request method failure captured: Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action HTTP/1.1 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 48 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvP3xSvQyK_nT0Cjt1czmcKzeR2yuRoFIVGCxQ_mzkf68FwI35Wr28TVp5OQoeCi_Wo58bpJiSwN0Sb7j-h4QC4Ke3LWemDZI_HYQmjNZ6P3-w0R8gjWPNwNlK5kxOAMc2DIgkgm2DOqUNvNUWOwU2sQjKjqgi3-0nUVy-fszuMjHzY Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1118fb2e9d1a4ad0af213b85620e1cc0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2dbd6bbae7c44725b8a1dadcd8c788e4 Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: {"removeFloatingIp": {"address": "172.25.6.35"}} Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: exception: Floating IP 172.25.6.35 is not associated with instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c. Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c', 'body': {'removeFloatingIp': {'address': '172.25.6.35'}}} Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.35 is not associated with instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c. Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.35 is not associated with instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c. Oct 03 14:40:14.298712 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.304485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Returning 409 to user: Floating IP 172.25.6.35 is not associated with instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:14.304485 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f03db36-2a95-44f4-ad83-8caaacf4e151 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action" status: 409 len: 145 microversion: 2.1 time: 0.900441 Oct 03 14:40:14.306720 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 960/1935] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:13 2022] POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action => generated 145 bytes in 906 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:40:14.311885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:14.312475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:14.318985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.319771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.320211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.320934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.321479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.322166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.408686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:14.421142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9aaf9c9a-bdfd-43e4-8643-21cfecda8855 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.585545 Oct 03 14:40:14.440968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 976/1936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:13 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:14.446470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:14.450580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: c3ef74ed-5f46-4ff0-af09-071498ff108a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:14.458115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.458973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.459651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.461114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.461800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.462578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.476402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:14.480351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] HTTP exception thrown: Instance c3ef74ed-5f46-4ff0-af09-071498ff108a could not be found. Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Request method failure captured: Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a HTTP/1.1 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKxL-8mTKTQmJIZzkKV6hipQLnkz402oNiwAAGkI5bqjHYhbWnOBznBAIBaZSnApIbAfwkImuejemx_ZdvGCGf6rC1IiCWtQhQQFmeU6GtOXMpY3gFSmHraP8PNWD1fTSDftHukY90N2oulVSUR07XtW-z3g8waYfm2ArxLSUmYYGc Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f5e47f71fc4494aa8ed6354736216f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 19b2b042d70a426989bb5dc6b986b7c5 Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance c3ef74ed-5f46-4ff0-af09-071498ff108a could not be found. Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c3ef74ed-5f46-4ff0-af09-071498ff108a'} Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ef74ed-5f46-4ff0-af09-071498ff108a could not be found. Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ef74ed-5f46-4ff0-af09-071498ff108a could not be found. Oct 03 14:40:14.484096 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ef74ed-5f46-4ff0-af09-071498ff108a could not be found. Oct 03 14:40:14.500307 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:14.504490 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-19183c43-cbe2-4fab-87b5-e861ae22e128 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1316 microversion: 2.1 time: 0.178345 Oct 03 14:40:14.504490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 961/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:14 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:14.504490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:14.504490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:14.505207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Returning 404 to user: Instance c3ef74ed-5f46-4ff0-af09-071498ff108a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:14.505207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-368fbdec-59fa-49c1-9d47-b4da52b7d80a tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a" status: 404 len: 111 microversion: 2.25 time: 0.053564 Oct 03 14:40:14.505207 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 977/1938] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:14 2022] GET /compute/v2.1/servers/c3ef74ed-5f46-4ff0-af09-071498ff108a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:40:14.505689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.505689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.505689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.505689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.505689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.505689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.511468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'action', calling method: .version_select at 0x7fb232fe89d0>, body: {"removeFloatingIp": {"address": "172.25.6.35"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:14.853103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:14.860169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.860985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.861675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.862876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.863596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.864401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.959796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:14.969379 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5745761-7ed0-41b5-a77d-9bc95163b739 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.481301 Oct 03 14:40:14.970253 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 962/1939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:14 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:14.983948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:14.985119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:14.992488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.993443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.994385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:14.995634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:14.996155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:14.996618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:15.159197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:15.168205 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1dc34335-dced-46d4-82bb-722ffb9a7792 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1475 microversion: 2.1 time: 0.191434 Oct 03 14:40:15.168909 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 963/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:14 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:15.176424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a707d88c-c068-4cad-b0ee-d0c5bb9c3548 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb231190ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:15.230356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a707d88c-c068-4cad-b0ee-d0c5bb9c3548 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1446 microversion: 2.1 time: 0.059443 Oct 03 14:40:15.230911 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 964/1941] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:15 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1446 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:15.235921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5bbefa4-87d4-4ee6-801e-4f2f14041703 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '.version_select at 0x7fb2310ddf70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:15.259230 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5bbefa4-87d4-4ee6-801e-4f2f14041703 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-6568233" status: 204 len: 0 microversion: 2.25 time: 0.026695 Oct 03 14:40:15.261240 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 965/1942] 10.222.0.20 () {60 vars in 1253 bytes} [Mon Oct 3 14:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-6568233 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:40:15.269591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:15.270460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:15.278717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:15.279652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:15.280429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:15.281689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:15.282389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:15.283057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:15.385553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "refresh_cache-f86253b5-aa1f-4527-8b1b-22ed255e2949" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:40:15.386320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquired lock "refresh_cache-f86253b5-aa1f-4527-8b1b-22ed255e2949" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:40:15.491827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:15.501592 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ca4bd931-94ff-4d91-a338-373d955c559d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.239280 Oct 03 14:40:15.506483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 966/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:15 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:15.536682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a34671e4-2703-4757-851d-34a74de6fbeb req-7d52c694-cf10-46f2-9f29-1cf5b8f164df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b527955b-b823-441d-a4bb-44a1d880daa0", "name": "network-vif-plugged", "status": "completed", "tag": "63b5bd68-d682-4ed9-9c82-e0d2b66eb1f7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:15.547722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a34671e4-2703-4757-851d-34a74de6fbeb req-7d52c694-cf10-46f2-9f29-1cf5b8f164df service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:15.548484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a34671e4-2703-4757-851d-34a74de6fbeb req-7d52c694-cf10-46f2-9f29-1cf5b8f164df service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:15.549175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a34671e4-2703-4757-851d-34a74de6fbeb req-7d52c694-cf10-46f2-9f29-1cf5b8f164df service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:15.564836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a34671e4-2703-4757-851d-34a74de6fbeb req-7d52c694-cf10-46f2-9f29-1cf5b8f164df service nova] Creating event network-vif-plugged:63b5bd68-d682-4ed9-9c82-e0d2b66eb1f7 for instance b527955b-b823-441d-a4bb-44a1d880daa0 on n-h1-781139-2 Oct 03 14:40:15.570310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a34671e4-2703-4757-851d-34a74de6fbeb req-7d52c694-cf10-46f2-9f29-1cf5b8f164df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051305 Oct 03 14:40:15.571414 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 967/1944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:15.577849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7a45cf2-f861-460e-a5ff-5af5635e15eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb231190ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:15.664568 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7a45cf2-f861-460e-a5ff-5af5635e15eb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 200 len: 1446 microversion: 2.1 time: 0.089030 Oct 03 14:40:15.664568 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 968/1945] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:15 2022] GET /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 1446 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:15.680437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-796d3571-e78f-4dc8-b9c4-9ee629176ae9 req-605deeb7-7db7-4e1b-b1f4-3f6f6b4bc730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "name": "network-vif-unplugged", "status": "completed", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:15.704449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-796d3571-e78f-4dc8-b9c4-9ee629176ae9 req-605deeb7-7db7-4e1b-b1f4-3f6f6b4bc730 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:15.705312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-796d3571-e78f-4dc8-b9c4-9ee629176ae9 req-605deeb7-7db7-4e1b-b1f4-3f6f6b4bc730 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:15.705906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-796d3571-e78f-4dc8-b9c4-9ee629176ae9 req-605deeb7-7db7-4e1b-b1f4-3f6f6b4bc730 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:15.720028 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-796d3571-e78f-4dc8-b9c4-9ee629176ae9 req-605deeb7-7db7-4e1b-b1f4-3f6f6b4bc730 service nova] Creating event network-vif-unplugged:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h1-781139-2 Oct 03 14:40:15.727009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-796d3571-e78f-4dc8-b9c4-9ee629176ae9 req-605deeb7-7db7-4e1b-b1f4-3f6f6b4bc730 service nova] Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:40:15.745551 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-796d3571-e78f-4dc8-b9c4-9ee629176ae9 req-605deeb7-7db7-4e1b-b1f4-3f6f6b4bc730 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081147 Oct 03 14:40:15.746972 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 969/1946] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:15.753340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:15.754241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:15.763158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:15.763865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:15.764299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:15.765064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:15.765519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:15.765938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:16.042832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:16.052822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-791fed9e-8958-489b-a763-e04e14c778ea tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.304390 Oct 03 14:40:16.053504 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 970/1947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:15 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:16.058859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:16.059872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:16.074326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:16.075044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:16.075825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:16.078410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:16.079128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:16.079727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:16.262440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:16.270878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4f0c801-1df4-47a1-8da6-b9f7de3f779b tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1316 microversion: 2.1 time: 0.216075 Oct 03 14:40:16.272061 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 971/1948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:16 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:16.277069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c273f49-85f3-4e4d-ba40-66ac633d5591 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb23067d310>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:16.751888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:40:16.757515 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0c273f49-85f3-4e4d-ba40-66ac633d5591 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 204 len: 0 microversion: 2.1 time: 0.484131 Oct 03 14:40:16.758189 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 972/1949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:16 2022] DELETE /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:16.767081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:16.767971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:16.774124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:16.774703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:16.775107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:16.775823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:16.776472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:16.777102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:16.936900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:16.947556 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b7c7279-6590-4473-8d9f-2d32c9012c1e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.183768 Oct 03 14:40:16.948231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 973/1950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:16 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:16.953703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:16.954662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:16.963251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:16.964108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:16.964543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:16.965278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:16.965777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:16.966564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.119816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:17.130783 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e64de8b0-b887-4caf-a80b-a3bb4a592603 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1475 microversion: 2.1 time: 0.181077 Oct 03 14:40:17.131812 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 974/1951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:16 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1475 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:17.138119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:17.138868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:17.148480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.150011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.150658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.152125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.152267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.152677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.181426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:17.279634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6921b346-2408-44c2-9e2f-8d9581757ba8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "DELETE /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 204 len: 0 microversion: 2.25 time: 0.146152 Oct 03 14:40:17.280964 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 975/1952] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:40:17 2022] DELETE /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:40:17.288091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:17.289000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:17.296906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.297428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.298360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.299116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.299576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.300017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.463968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:17.473568 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2304f5ea-fcf8-497c-ba4e-5d72e2867711 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.191024 Oct 03 14:40:17.474304 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 976/1953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:17 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:17.480028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:17.480525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:17.487774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.488489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.489134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.489843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.490290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.490716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.507357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:17.523481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:17.612572 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52ff7d5d-f5ad-4cff-a8f4-459c0b5fe4bd tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 204 len: 0 microversion: 2.1 time: 0.135088 Oct 03 14:40:17.624950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 977/1954] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:17 2022] DELETE /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:17.631298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:17.631298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:17.645531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.646063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.653517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.657198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.660116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.661198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.736737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Updating instance_info_cache with network_info: [{"id": "8931892f-f64a-46a3-bef9-3c736104fcd6", "address": "fa:16:3e:93:62:c1", "network": {"id": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-685002994-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1118fb2e9d1a4ad0af213b85620e1cc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8931892f-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:40:17.758870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Releasing lock "refresh_cache-f86253b5-aa1f-4527-8b1b-22ed255e2949" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:40:17.761292 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34ad00a2-f394-42cd-8c3d-f5cfe6914977 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949/action" status: 202 len: 0 microversion: 2.1 time: 3.260366 Oct 03 14:40:17.764831 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 978/1955] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:14 2022] POST /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949/action => generated 0 bytes in 3263 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:40:17.770660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:17.771290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:17.780602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.781252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.781558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.782281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.782870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.783300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.887198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:17.895828 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e880ad09-de4d-4965-b068-72711f2b21db tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.275367 Oct 03 14:40:17.906876 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 978/1956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:17 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:17.915378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:17.916003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:17.922323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.923321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.923764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.924475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:17.924949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:17.925454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:17.994774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:18.003823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:18.005566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:18.006944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64fc0386-a6c6-4b96-83ca-d396740ea9d8 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1550 microversion: 2.25 time: 0.242178 Oct 03 14:40:18.016711 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 979/1957] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:17 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1550 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:18.021845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b9113084-aae9-4c0f-af4b-438b4f1aa2d8 req-0842b987-b516-4e99-810e-d57850c12554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a669cbe-531f-4300-a7dd-e014baf44bf3", "name": "network-vif-plugged", "status": "completed", "tag": "0f57491e-aa97-4ff7-a32d-cd0ed03cd108"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:18.032650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9113084-aae9-4c0f-af4b-438b4f1aa2d8 req-0842b987-b516-4e99-810e-d57850c12554 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.033644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9113084-aae9-4c0f-af4b-438b4f1aa2d8 req-0842b987-b516-4e99-810e-d57850c12554 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.034399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9113084-aae9-4c0f-af4b-438b4f1aa2d8 req-0842b987-b516-4e99-810e-d57850c12554 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.046991 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b9113084-aae9-4c0f-af4b-438b4f1aa2d8 req-0842b987-b516-4e99-810e-d57850c12554 service nova] Creating event network-vif-plugged:0f57491e-aa97-4ff7-a32d-cd0ed03cd108 for instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 on n-h1-781139-2 Oct 03 14:40:18.052548 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b9113084-aae9-4c0f-af4b-438b4f1aa2d8 req-0842b987-b516-4e99-810e-d57850c12554 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034300 Oct 03 14:40:18.054069 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 980/1958] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:18.059857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-296980146", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "1073fcc1-d3cc-4166-a49d-07b433f3c7e5"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:18.103376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:18.119807 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04fe7ad6-b33d-4eb6-b1f7-ca6c972e83b0 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1505 microversion: 2.1 time: 0.211582 Oct 03 14:40:18.120498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 979/1959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:17 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:18.122340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] validate_networks() for [('1073fcc1-d3cc-4166-a49d-07b433f3c7e5', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:40:18.128555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:18.131644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:18.139958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.140877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.141708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.143845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.144550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.145237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.195407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:18.359766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-323a1d29-79cf-4c48-87be-4b30b7d175da tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 204 len: 0 microversion: 2.1 time: 0.237784 Oct 03 14:40:18.365294 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 980/1960] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:18 2022] DELETE /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:18.368178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}, {"name": "network-changed", "server_uuid": "f86253b5-aa1f-4527-8b1b-22ed255e2949", "tag": "8931892f-f64a-46a3-bef9-3c736104fcd6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:18.381028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.381512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.381942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.417314 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] Creating event network-changed:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h1-781139-2 Oct 03 14:40:18.417975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] Creating event network-changed:8931892f-f64a-46a3-bef9-3c736104fcd6 for instance f86253b5-aa1f-4527-8b1b-22ed255e2949 on n-h2-781139-2 Oct 03 14:40:18.439651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:40:18.471385 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1206a116-5e92-47b6-b031-957055c97d89 req-c32065ff-c943-4cb0-ba19-a57d68cbabf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109092 Oct 03 14:40:18.472009 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 981/1961] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:18.480417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:18.481318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:18.487737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.488249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.488688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.489693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.490155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.490587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.734844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:18.743262 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b1382d5b-2716-4562-a5dc-f07fea49adc1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1515 microversion: 2.1 time: 0.269673 Oct 03 14:40:18.756753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:40:18.757217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:40:18.757690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:40:18.758104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:40:18.758711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:40:18.760019 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 982/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:18 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:18.765991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:18.766662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:18.773267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.773889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.774424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.775387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.775969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.776496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.778825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.779520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.779959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.782072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.782605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.783043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.813672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:18.813844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:40:18.814884 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e690bee3-bfb4-47aa-85f7-1baa52a7ed7c tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0/os-instance-actions/req-e7fd3008-b14c-4d07-b00b-8971248ab319" status: 200 len: 313 microversion: 2.1 time: 0.053824 Oct 03 14:40:18.815915 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 983/1963] 10.222.0.20 () {58 vars in 1419 bytes} [Mon Oct 3 14:40:18 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0/os-instance-actions/req-e7fd3008-b14c-4d07-b00b-8971248ab319 => generated 313 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:18.829537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:18.830076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Getting quotas for user e62b7df215b144de94e02cd1e01f6f21 and project f9df0f94aef14058908b1bdf602aafbc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:40:18.830558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:18.839009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.839588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.840091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.841998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.842154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.842683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.846854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:40:18.849551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:40:18.912532 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9336d7eb-0f59-4181-a252-fe1669a21562 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856868 Oct 03 14:40:18.919898 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 981/1964] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:40:18.925518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.35"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:18.928603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:18.937096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.937588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.938028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:18.939397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:18.939860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:18.940286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.007448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:40:19.008031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquired lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:40:19.060394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:19.069060 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-09a3ff31-1b31-4f22-9703-b21dd4f9138c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1473 microversion: 2.1 time: 0.251986 Oct 03 14:40:19.081189 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 984/1965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:18 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:19.081189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:19.081189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:19.082290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.082438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.082881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.083589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.084487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.084487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.294580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:19.309085 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-358cc8b1-d4a3-41a0-9939-f65f127f257e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.237275 Oct 03 14:40:19.325039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 985/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:19 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:19.330760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:19.333467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:19.341217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.342314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.343232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.344153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.344753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.345368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.472599 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3a9b7d31-2b88-4d46-806c-bb3843bfba89 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "POST /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0/action" status: 202 len: 0 microversion: 2.1 time: 0.153440 Oct 03 14:40:19.474040 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 986/1967] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:19 2022] POST /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:40:19.483539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:19.484659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:19.491469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.491998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.492506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.493713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.494336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.495109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.673360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:19.682361 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-62d9ac13-aeb8-478d-840f-b58ebd29b396 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.207043 Oct 03 14:40:19.682987 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 987/1968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:19 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:19.687835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:19.688444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:19.694460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.694940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.695760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.696439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.696593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.697101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.763969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:19.771672 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6fb915fb-4cc7-4dae-9cbb-a68bf6b928e8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1211 microversion: 2.1 time: 0.087720 Oct 03 14:40:19.772247 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 988/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:19 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:19.776873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-602956ff-a5c1-4aa5-8a96-690011425c75 req-b49f9210-8b9b-4d40-8e5a-a87dd7957d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "660e7ae4-72b0-4c44-8ece-82014c070066", "name": "network-vif-deleted", "tag": "81a132de-4f8c-4bc6-b575-447721adc30c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:19.786160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-602956ff-a5c1-4aa5-8a96-690011425c75 req-b49f9210-8b9b-4d40-8e5a-a87dd7957d88 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.787246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-602956ff-a5c1-4aa5-8a96-690011425c75 req-b49f9210-8b9b-4d40-8e5a-a87dd7957d88 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.787715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-602956ff-a5c1-4aa5-8a96-690011425c75 req-b49f9210-8b9b-4d40-8e5a-a87dd7957d88 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.798785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-602956ff-a5c1-4aa5-8a96-690011425c75 req-b49f9210-8b9b-4d40-8e5a-a87dd7957d88 service nova] Creating event network-vif-deleted:81a132de-4f8c-4bc6-b575-447721adc30c for instance 660e7ae4-72b0-4c44-8ece-82014c070066 on n-h1-781139-2 Oct 03 14:40:19.803571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-602956ff-a5c1-4aa5-8a96-690011425c75 req-b49f9210-8b9b-4d40-8e5a-a87dd7957d88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030214 Oct 03 14:40:19.804164 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 989/1970] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:19.809558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:19.810251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:19.813256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.817283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.817746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.818180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.818849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.819289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.819706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.884238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:19.886991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.894299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:19.895744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:19.896897 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74c1169e-f416-420b-9647-85bd5ce5ef97 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1332 microversion: 2.25 time: 0.091501 Oct 03 14:40:19.897530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 990/1971] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:19 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:19.903053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:19.903662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:19.910717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.911209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.911645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:19.912343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:19.912802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:19.913249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.045899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:20.053937 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07bc7370-db38-4656-a0b9-e930e3c4764a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1507 microversion: 2.1 time: 0.155281 Oct 03 14:40:20.054530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 991/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:19 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:20.059229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:20.059833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:20.065886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.066503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.066775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.067458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.067907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.068313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.200777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:20.210976 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76a3537b-6a2f-421a-8dba-50be83a4d688 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1533 microversion: 2.1 time: 0.155433 Oct 03 14:40:20.211628 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 992/1973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:20 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1533 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:20.217506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-476585f1-ed99-4a93-933a-d821bdd9b56c req-3e17f991-6c39-41db-8fde-24565346b82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce43e55f-6e1c-432f-800c-901fb82d1cfd", "name": "network-vif-plugged", "status": "completed", "tag": "5da747a3-7eb2-4c7e-bc19-6a1a57538615"}, {"server_uuid": "1a011620-a90d-4d52-a7b6-5bec3e47d444", "name": "network-vif-unplugged", "status": "completed", "tag": "ef579db2-bbe0-4153-88ce-b0eb95ade16b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:20.229153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-476585f1-ed99-4a93-933a-d821bdd9b56c req-3e17f991-6c39-41db-8fde-24565346b82e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.229631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-476585f1-ed99-4a93-933a-d821bdd9b56c req-3e17f991-6c39-41db-8fde-24565346b82e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.230059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-476585f1-ed99-4a93-933a-d821bdd9b56c req-3e17f991-6c39-41db-8fde-24565346b82e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.242957 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-476585f1-ed99-4a93-933a-d821bdd9b56c req-3e17f991-6c39-41db-8fde-24565346b82e service nova] Creating event network-vif-plugged:5da747a3-7eb2-4c7e-bc19-6a1a57538615 for instance ce43e55f-6e1c-432f-800c-901fb82d1cfd on n-h2-781139-2 Oct 03 14:40:20.243501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-476585f1-ed99-4a93-933a-d821bdd9b56c req-3e17f991-6c39-41db-8fde-24565346b82e service nova] Creating event network-vif-unplugged:ef579db2-bbe0-4153-88ce-b0eb95ade16b for instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 on n-h2-781139-2 Oct 03 14:40:20.250384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-476585f1-ed99-4a93-933a-d821bdd9b56c req-3e17f991-6c39-41db-8fde-24565346b82e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037331 Oct 03 14:40:20.251257 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 993/1974] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:20.256964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:20.257649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:20.264840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.265359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.265775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.266489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.266963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.267383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.308958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:40:20.417952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:20.428164 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80687ceb-93bb-406b-a78e-947bc8c0f68b tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1473 microversion: 2.1 time: 0.175711 Oct 03 14:40:20.430026 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 994/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:20 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:20.436306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:20.438249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:20.445692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.446566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.447092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.447870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.448383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.448916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.586432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:20.595490 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5bfad1c7-0d88-440b-9af7-5ad4c2a6742d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.163751 Oct 03 14:40:20.596287 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 995/1976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:20 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:20.600562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0a827571-1382-4bf0-9234-8db712047232 req-df5d127b-5c45-4c5c-896f-7f58e6cef844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c", "tag": "c1847700-d232-42c8-a049-ef3bbcdad333"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:20.615596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0a827571-1382-4bf0-9234-8db712047232 req-df5d127b-5c45-4c5c-896f-7f58e6cef844 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.616068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0a827571-1382-4bf0-9234-8db712047232 req-df5d127b-5c45-4c5c-896f-7f58e6cef844 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.616493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0a827571-1382-4bf0-9234-8db712047232 req-df5d127b-5c45-4c5c-896f-7f58e6cef844 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.628556 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0a827571-1382-4bf0-9234-8db712047232 req-df5d127b-5c45-4c5c-896f-7f58e6cef844 service nova] Creating event network-changed:c1847700-d232-42c8-a049-ef3bbcdad333 for instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c on n-h1-781139-2 Oct 03 14:40:20.635251 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0a827571-1382-4bf0-9234-8db712047232 req-df5d127b-5c45-4c5c-896f-7f58e6cef844 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037528 Oct 03 14:40:20.636527 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 996/1977] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:20.707096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:20.708858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:20.717684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.718331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.718881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.719699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.731787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.734218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.917197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:20.926600 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-473cea0e-1800-49ec-bbc0-9e05f32146a9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.223496 Oct 03 14:40:20.941888 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 997/1978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:20 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:20.942148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Updating instance_info_cache with network_info: [{"id": "c1847700-d232-42c8-a049-ef3bbcdad333", "address": "fa:16:3e:64:7e:bf", "network": {"id": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-685002994-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1118fb2e9d1a4ad0af213b85620e1cc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1847700-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:40:20.942299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:20.942299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:20.942299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.942299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.942299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.942299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.942907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.943009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Releasing lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:40:20.943127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.943478 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35002af5-d959-4904-b01e-fd26891dec9c tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action" status: 202 len: 0 microversion: 2.1 time: 2.022231 Oct 03 14:40:20.944284 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 982/1979] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:18 2022] POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action => generated 0 bytes in 2024 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:40:20.959578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:20.960578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:20.972357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.975412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.976065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:20.978534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:20.980161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:20.980792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.014731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4,nova_cell1:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:21.016035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:21.026976 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d872bed4-7571-4a54-80bc-4588fc315e79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1203 microversion: 2.1 time: 0.098302 Oct 03 14:40:21.046859 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 998/1980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:20 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1203 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:21.053292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42bcff76-1d01-404a-83bc-4558bf68898f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '.version_select at 0x7fb230839f70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:21.129372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:21.145648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:21.147715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:21.149365 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1639789f-b4d6-4814-bb20-068b0054519b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1332 microversion: 2.25 time: 0.203685 Oct 03 14:40:21.150711 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 983/1981] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:20 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1332 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:21.156044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:21.156986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:21.172188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.172999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.173627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.174573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.175330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.175916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.364494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42bcff76-1d01-404a-83bc-4558bf68898f tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/9a3406ee-1762-471a-93a2-74d91c43d7ed" status: 200 len: 183 microversion: 2.1 time: 0.316400 Oct 03 14:40:21.366495 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 999/1982] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:40:21 2022] GET /compute/v2.1/os-floating-ips/9a3406ee-1762-471a-93a2-74d91c43d7ed => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:21.372005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:21.373554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:21.380587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.381323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.382027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.382847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.383725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.384315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.523320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:21.532525 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ebdc027-3591-4b6f-b37f-42cd47559301 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1521 microversion: 2.1 time: 0.164655 Oct 03 14:40:21.533227 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1000/1983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:21 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:21.538309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.35"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:21.676358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:21.682812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.683296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.683738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.684436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.684884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.685344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.764348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:21.773200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ce0e7c8-c6aa-43e7-892e-efdcfabbfd4a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1507 microversion: 2.1 time: 0.621143 Oct 03 14:40:21.773771 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 984/1984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:21 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1507 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:21.778943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:21.779556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:21.786162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.786852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.787797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.788794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:21.789967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:21.790662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:21.888638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:40:21.889102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquired lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:40:22.032971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:22.044088 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fcf3648-5d58-44d4-aac3-f15a2117ea2a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1473 microversion: 2.1 time: 0.268848 Oct 03 14:40:22.060379 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 985/1985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:21 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1473 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:22.066514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:22.067131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:22.076306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.076862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.077537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.078311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.078969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.079445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.274307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:22.283261 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40b88527-2157-4a26-ab93-04741708ce82 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1293 microversion: 2.1 time: 0.236887 Oct 03 14:40:22.283820 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 986/1986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:22 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1293 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:22.295710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:22.296723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:22.304021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.304800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.305445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.306410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.307107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.307850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.549111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:22.558044 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65bb27ce-ae4f-4c74-8afa-5ca351f70eec tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1198 microversion: 2.1 time: 0.272757 Oct 03 14:40:22.558647 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 987/1987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:22 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1198 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:22.563396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:22.564007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:22.572408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.572893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.573374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.574083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.574680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.575115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.646247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:22.655225 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75f1a89e-e5ef-4e65-b2a7-16d63be8c13a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1259 microversion: 2.1 time: 0.095355 Oct 03 14:40:22.656027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 988/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:22 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1259 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:22.669497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:22.670118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:22.681551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.682046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.682480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.683373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.683806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.684373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.751212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:22.762299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:22.763781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:22.764991 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b12e33ce-bd6e-4193-a401-5c6956412485 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 200 len: 1332 microversion: 2.25 time: 0.107776 Oct 03 14:40:22.779547 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 989/1989] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:22 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:22.789522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:22.790537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:22.800795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.801415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.801862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:22.802656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:22.803114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:22.803740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:23.002116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:23.011637 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25e7f367-187f-4989-8967-2b55d9986c1a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1521 microversion: 2.1 time: 0.229783 Oct 03 14:40:23.027101 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 990/1990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:22 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:23.027101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-751a1795-a391-4011-b1a2-49aeb7b1bd8c req-2604606a-80ff-48ed-acf8-f72dca4f0d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a011620-a90d-4d52-a7b6-5bec3e47d444", "name": "network-vif-deleted", "tag": "ef579db2-bbe0-4153-88ce-b0eb95ade16b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:23.037227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-751a1795-a391-4011-b1a2-49aeb7b1bd8c req-2604606a-80ff-48ed-acf8-f72dca4f0d4b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:23.037717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-751a1795-a391-4011-b1a2-49aeb7b1bd8c req-2604606a-80ff-48ed-acf8-f72dca4f0d4b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:23.038153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-751a1795-a391-4011-b1a2-49aeb7b1bd8c req-2604606a-80ff-48ed-acf8-f72dca4f0d4b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:23.060251 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-751a1795-a391-4011-b1a2-49aeb7b1bd8c req-2604606a-80ff-48ed-acf8-f72dca4f0d4b service nova] Creating event network-vif-deleted:ef579db2-bbe0-4153-88ce-b0eb95ade16b for instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 on n-h2-781139-2 Oct 03 14:40:23.072889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-751a1795-a391-4011-b1a2-49aeb7b1bd8c req-2604606a-80ff-48ed-acf8-f72dca4f0d4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059018 Oct 03 14:40:23.077638 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 991/1991] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:23.089199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:23.089924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:23.106472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:23.107401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:23.108579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:23.109594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:23.110277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:23.111183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:23.780089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:23.814188 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f281d00e-2b52-4b3e-a176-df8e37581b8f tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1507 microversion: 2.1 time: 0.728274 Oct 03 14:40:23.826776 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 992/1992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:23 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:23.854254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:23.854889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:23.896612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:23.899130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:23.899789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:23.901043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:23.901524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:23.901954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:24.055385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Building network info cache for instance {{(pid=128868) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:40:24.177824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:24.187729 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5eaa3d2-e28a-480b-9b61-7e2ad224c287 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1470 microversion: 2.1 time: 0.359227 Oct 03 14:40:24.190852 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 993/1993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:23 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:24.196700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:24.205167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:24.214221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:24.215017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:24.215798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:24.217406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:24.218130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:24.219174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:24.634056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:24.657298 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fa9b53e-dd30-4967-881c-bb855dd54c72 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1474 microversion: 2.1 time: 0.464330 Oct 03 14:40:24.658976 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 994/1994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:24 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1474 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:24.666198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a4b32ad8-9257-4f32-9de8-7759e97e88a5 req-fc550393-2913-42b1-8dff-1d6345c87f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b8547b-d12f-474d-8e17-19364eb75441", "name": "network-vif-unplugged", "status": "completed", "tag": "d6bba469-edef-483e-bd0a-e37d5559b8f0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:24.685302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4b32ad8-9257-4f32-9de8-7759e97e88a5 req-fc550393-2913-42b1-8dff-1d6345c87f9c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:24.686103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4b32ad8-9257-4f32-9de8-7759e97e88a5 req-fc550393-2913-42b1-8dff-1d6345c87f9c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:24.687538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4b32ad8-9257-4f32-9de8-7759e97e88a5 req-fc550393-2913-42b1-8dff-1d6345c87f9c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:24.704136 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a4b32ad8-9257-4f32-9de8-7759e97e88a5 req-fc550393-2913-42b1-8dff-1d6345c87f9c service nova] Creating event network-vif-unplugged:d6bba469-edef-483e-bd0a-e37d5559b8f0 for instance a6b8547b-d12f-474d-8e17-19364eb75441 on n-h2-781139-2 Oct 03 14:40:24.712507 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a4b32ad8-9257-4f32-9de8-7759e97e88a5 req-fc550393-2913-42b1-8dff-1d6345c87f9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050846 Oct 03 14:40:24.713814 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 995/1995] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:24.719944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:24.720917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:24.730081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:24.730876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:24.732508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:24.733764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:24.734509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:24.735592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:24.980165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:24.990158 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72c38e19-4108-4315-b909-eb4159b2afd1 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1381 microversion: 2.1 time: 0.274690 Oct 03 14:40:24.994683 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 996/1996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:24 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1381 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:25.008607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:25.009861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:25.021100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.023087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.027059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.028088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.029566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.030870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.294015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:25.300092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Updating instance_info_cache with network_info: [{"id": "c1847700-d232-42c8-a049-ef3bbcdad333", "address": "fa:16:3e:64:7e:bf", "network": {"id": "a76ca716-dc16-4a11-bbe2-ea03340c8d7a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-685002994-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1118fb2e9d1a4ad0af213b85620e1cc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1847700-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128868) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:40:25.308482 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eae12cb6-98a8-4b94-81b6-32a61a035003 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1307 microversion: 2.1 time: 0.311170 Oct 03 14:40:25.309440 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 997/1997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:24 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:25.314274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3b2dec71-0fb3-44aa-90fe-8fe85481e36b req-9ab1b00a-5899-437c-86e7-cf8f764a7003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86253b5-aa1f-4527-8b1b-22ed255e2949", "name": "network-vif-deleted", "tag": "8931892f-f64a-46a3-bef9-3c736104fcd6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:25.325045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3b2dec71-0fb3-44aa-90fe-8fe85481e36b req-9ab1b00a-5899-437c-86e7-cf8f764a7003 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.325734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3b2dec71-0fb3-44aa-90fe-8fe85481e36b req-9ab1b00a-5899-437c-86e7-cf8f764a7003 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.326328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3b2dec71-0fb3-44aa-90fe-8fe85481e36b req-9ab1b00a-5899-437c-86e7-cf8f764a7003 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.328941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Releasing lock "refresh_cache-f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:40:25.329916 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9a56b4d1-76fa-48cd-ac81-6c36d9eae90e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action" status: 202 len: 0 microversion: 2.1 time: 3.795349 Oct 03 14:40:25.335167 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1001/1998] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:21 2022] POST /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c/action => generated 0 bytes in 3801 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:40:25.340850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:25.341585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: 660e7ae4-72b0-4c44-8ece-82014c070066] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:25.342079 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3b2dec71-0fb3-44aa-90fe-8fe85481e36b req-9ab1b00a-5899-437c-86e7-cf8f764a7003 service nova] Creating event network-vif-deleted:8931892f-f64a-46a3-bef9-3c736104fcd6 for instance f86253b5-aa1f-4527-8b1b-22ed255e2949 on n-h2-781139-2 Oct 03 14:40:25.347849 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3b2dec71-0fb3-44aa-90fe-8fe85481e36b req-9ab1b00a-5899-437c-86e7-cf8f764a7003 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036931 Oct 03 14:40:25.348499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.348869 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 998/1999] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:25.349373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.349828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.350535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.350986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.351447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.359573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:25.360569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:25.368194 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] HTTP exception thrown: Instance 660e7ae4-72b0-4c44-8ece-82014c070066 could not be found. Oct 03 14:40:25.368538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.369208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.369648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.370415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.370868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Request method failure captured: Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 HTTP/1.1 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvKxL-8mTKTQmJIZzkKV6hipQLnkz402oNiwAAGkI5bqjHYhbWnOBznBAIBaZSnApIbAfwkImuejemx_ZdvGCGf6rC1IiCWtQhQQFmeU6GtOXMpY3gFSmHraP8PNWD1fTSDftHukY90N2oulVSUR07XtW-z3g8waYfm2ArxLSUmYYGc Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f5e47f71fc4494aa8ed6354736216f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 19b2b042d70a426989bb5dc6b986b7c5 Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 660e7ae4-72b0-4c44-8ece-82014c070066 could not be found. Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '660e7ae4-72b0-4c44-8ece-82014c070066'} Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 660e7ae4-72b0-4c44-8ece-82014c070066 could not be found. Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 660e7ae4-72b0-4c44-8ece-82014c070066 could not be found. Oct 03 14:40:25.371216 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 660e7ae4-72b0-4c44-8ece-82014c070066 could not be found. Oct 03 14:40:25.377221 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:25.378007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.378965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Returning 404 to user: Instance 660e7ae4-72b0-4c44-8ece-82014c070066 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:25.380019 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b39452ec-c79c-41b0-a816-76554cc80de4 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066" status: 404 len: 111 microversion: 2.25 time: 0.043676 Oct 03 14:40:25.380780 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1002/2000] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:25 2022] GET /compute/v2.1/servers/660e7ae4-72b0-4c44-8ece-82014c070066 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:40:25.386179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:25.386957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:25.393649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.394369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.395043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.396677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.397422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.398391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.542714 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6858d54a-cea8-4c57-95cc-415246838974 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "POST /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce/action" status: 202 len: 0 microversion: 2.1 time: 0.160491 Oct 03 14:40:25.544684 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1003/2001] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:25 2022] POST /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:40:25.551169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-414140167", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:25.621346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:40:25.774143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:25.785207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b3eb597-6c88-4dca-b06e-84bfd08d8a41 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1521 microversion: 2.1 time: 0.434377 Oct 03 14:40:25.787147 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 999/2002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:25 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:25.794085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:25.794917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:25.802585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.803481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.804148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:25.805612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:25.806495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:25.808346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.077086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:26.092824 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b069f314-a9a5-477c-99fd-61988dede2c8 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1512 microversion: 2.1 time: 0.304011 Oct 03 14:40:26.093835 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1000/2003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:25 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:26.276511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:26.277163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:26.284281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.285092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.285961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.286706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.287327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.287902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:40:26.288045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.288327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:40:26.288967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:40:26.289408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:40:26.290478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:40:26.300157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.301459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.302084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.302974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.303581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.304291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.330718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:40:26.337053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:40:26.351275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:40:26.353744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: fb5e0271-ad7e-47f9-9c0c-740682c373e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:40:26.417536 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1747da41-0be6-4443-bd40-ce228584d20b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870904 Oct 03 14:40:26.418506 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1004/2004] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:40:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:40:26.423684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:26.424503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:26.431287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.432014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.432616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.433866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.434383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.434815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.465863 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] HTTP exception thrown: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Request method failure captured: Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 HTTP/1.1 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvP3xSvQyK_nT0Cjt1czmcKzeR2yuRoFIVGCxQ_mzkf68FwI35Wr28TVp5OQoeCi_Wo58bpJiSwN0Sb7j-h4QC4Ke3LWemDZI_HYQmjNZ6P3-w0R8gjWPNwNlK5kxOAMc2DIgkgm2DOqUNvNUWOwU2sQjKjqgi3-0nUVy-fszuMjHzY Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1118fb2e9d1a4ad0af213b85620e1cc0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2dbd6bbae7c44725b8a1dadcd8c788e4 Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f86253b5-aa1f-4527-8b1b-22ed255e2949'} Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:26.467640 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Returning 404 to user: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c62b6983-1d6f-478b-8672-d39fa0e303ff tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 404 len: 111 microversion: 2.1 time: 0.049413 Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1005/2005] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:26 2022] DELETE /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:26.475766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:26.480870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.481375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.481803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.482490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.482933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.483349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.513127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:26.537326 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dffb310d-0afb-43fc-96d2-fb53f0994f3d tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1532 microversion: 2.1 time: 0.442190 Oct 03 14:40:26.537919 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1001/2006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:26 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1532 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:26.548086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:26.552074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:26.568962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.569493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.570023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.570762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.571239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.571661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.582568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:26.661975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4567f9a5-b6b2-45d5-8202-874258273c61 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 204 len: 0 microversion: 2.25 time: 0.189505 Oct 03 14:40:26.663242 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1006/2007] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:40:26 2022] DELETE /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:40:26.671390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:26.672113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:26.679197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.679755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.680213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.681340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.682378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.683586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.706686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:26.843553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:26.853546 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f0a957ff-0d28-4d1d-a7b3-84ca3452cf79 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1307 microversion: 2.1 time: 0.188769 Oct 03 14:40:26.854632 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1007/2008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:26 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:26.873538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0b9fc5e7-6ca1-4be5-8114-7ef5cd8375d8 req-2b5a1a91-55f8-444d-a1a1-f838e1d7c4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0789d3-d9db-4a84-b17a-81d50042fda0", "tag": "0a9512ee-d472-4ce2-bf03-17184e866ec5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:26.884395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0b9fc5e7-6ca1-4be5-8114-7ef5cd8375d8 req-2b5a1a91-55f8-444d-a1a1-f838e1d7c4ce service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.884878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0b9fc5e7-6ca1-4be5-8114-7ef5cd8375d8 req-2b5a1a91-55f8-444d-a1a1-f838e1d7c4ce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.885351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0b9fc5e7-6ca1-4be5-8114-7ef5cd8375d8 req-2b5a1a91-55f8-444d-a1a1-f838e1d7c4ce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.898132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0b9fc5e7-6ca1-4be5-8114-7ef5cd8375d8 req-2b5a1a91-55f8-444d-a1a1-f838e1d7c4ce service nova] Creating event network-changed:0a9512ee-d472-4ce2-bf03-17184e866ec5 for instance aa0789d3-d9db-4a84-b17a-81d50042fda0 on n-h2-781139-2 Oct 03 14:40:26.898439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:26.904642 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0b9fc5e7-6ca1-4be5-8114-7ef5cd8375d8 req-2b5a1a91-55f8-444d-a1a1-f838e1d7c4ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048074 Oct 03 14:40:26.905610 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1008/2009] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:26.907530 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f058790c-7dd9-4c77-8aa8-773bc602269f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 0.365218 Oct 03 14:40:26.911251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a405cef-66d4-40ac-86f6-89ad1078fefc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:26.912256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0a405cef-66d4-40ac-86f6-89ad1078fefc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: fb5e0271-ad7e-47f9-9c0c-740682c373e2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:26.925259 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1002/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:26 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:26.932160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0a405cef-66d4-40ac-86f6-89ad1078fefc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: fb5e0271-ad7e-47f9-9c0c-740682c373e2] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:26.933638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:26.934234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f86253b5-aa1f-4527-8b1b-22ed255e2949] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:26.951848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.952402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.953103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.953821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:26.954407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:26.958354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:26.979583 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] HTTP exception thrown: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Request method failure captured: Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 HTTP/1.1 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvP3xSvQyK_nT0Cjt1czmcKzeR2yuRoFIVGCxQ_mzkf68FwI35Wr28TVp5OQoeCi_Wo58bpJiSwN0Sb7j-h4QC4Ke3LWemDZI_HYQmjNZ6P3-w0R8gjWPNwNlK5kxOAMc2DIgkgm2DOqUNvNUWOwU2sQjKjqgi3-0nUVy-fszuMjHzY Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1118fb2e9d1a4ad0af213b85620e1cc0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2dbd6bbae7c44725b8a1dadcd8c788e4 Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f86253b5-aa1f-4527-8b1b-22ed255e2949'} Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.982725 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. Oct 03 14:40:26.987409 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:26.990231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Returning 404 to user: Instance f86253b5-aa1f-4527-8b1b-22ed255e2949 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:26.991455 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-259e4ec2-61c9-4770-ab39-608f0c50725a tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949" status: 404 len: 111 microversion: 2.1 time: 0.064814 Oct 03 14:40:26.992501 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1003/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:26 2022] GET /compute/v2.1/servers/f86253b5-aa1f-4527-8b1b-22ed255e2949 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:27.015675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:27.016498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:27.034366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.034868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.037539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.038284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.041110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.041565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.076129 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.scheduler.client.report [None req-0a405cef-66d4-40ac-86f6-89ad1078fefc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Deleted allocations for instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 Oct 03 14:40:27.105716 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a405cef-66d4-40ac-86f6-89ad1078fefc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2" status: 204 len: 0 microversion: 2.1 time: 0.198750 Oct 03 14:40:27.106764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1009/2012] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:26 2022] DELETE /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:27.126444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:27.129180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:27.144644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.145177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.145613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.146332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.146782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.147207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.286572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-820322fc-4245-43b9-9a57-a7fa9dc46c2c tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1532 microversion: 2.1 time: 0.292699 Oct 03 14:40:27.289126 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1004/2013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:26 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1532 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:27.295332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b9ef2074-7abe-4173-9347-9246197977fc req-b954ec58-c7e3-4fd2-a387-b0799d776717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "name": "network-vif-plugged", "status": "completed", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:27.308444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9ef2074-7abe-4173-9347-9246197977fc req-b954ec58-c7e3-4fd2-a387-b0799d776717 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.309451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9ef2074-7abe-4173-9347-9246197977fc req-b954ec58-c7e3-4fd2-a387-b0799d776717 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.310142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b9ef2074-7abe-4173-9347-9246197977fc req-b954ec58-c7e3-4fd2-a387-b0799d776717 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.324148 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b9ef2074-7abe-4173-9347-9246197977fc req-b954ec58-c7e3-4fd2-a387-b0799d776717 service nova] Creating event network-vif-plugged:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h1-781139-2 Oct 03 14:40:27.330224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-b9ef2074-7abe-4173-9347-9246197977fc req-b954ec58-c7e3-4fd2-a387-b0799d776717 service nova] Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:40:27.330894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:27.341665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:27.342307 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b9ef2074-7abe-4173-9347-9246197977fc req-b954ec58-c7e3-4fd2-a387-b0799d776717 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051580 Oct 03 14:40:27.343349 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1005/2014] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:27.344095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:27.345842 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-916cd971-04f6-4e47-b3a7-49fb6424d3e0 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1565 microversion: 2.25 time: 0.237343 Oct 03 14:40:27.346665 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1010/2015] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:27 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1565 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:27.352971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:27.352971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:27.356695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.357074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.357518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.358234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.358755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.359977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.361082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-605efd49-e203-4860-a5ae-ec1e63ba1c5e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '.version_select at 0x7fb234add8b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:27.498633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:27.506725 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50ead4c4-272b-455c-924d-7194fe50f366 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1521 microversion: 2.1 time: 0.162208 Oct 03 14:40:27.507283 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1006/2016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:27 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:27.512235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:27.513014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: fb5e0271-ad7e-47f9-9c0c-740682c373e2] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:27.518850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.519330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.519765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.520473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.520936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.521366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.535597 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2 HTTP/1.1 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'fb5e0271-ad7e-47f9-9c0c-740682c373e2'} Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:27.537293 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27c05666-0a80-41c9-a1d0-159ef12a4bc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2" status: 404 len: 111 microversion: 2.1 time: 0.030466 Oct 03 14:40:27.542249 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1007/2017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:27 2022] GET /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:27.544085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:27.544693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:27.550850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.551329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.551760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.552460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.552905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.553351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.696430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:27.704459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-553e4d5e-817e-470b-b166-83eede6a5e5a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1505 microversion: 2.1 time: 0.163880 Oct 03 14:40:27.705057 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1008/2018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:27 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:27.709335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:27.713513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.715124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.715573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.716317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.716844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.717331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.740829 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-392f49a3-8464-4773-9a72-7ff7bd1c642e tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034686 Oct 03 14:40:27.741507 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1009/2019] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 14:40:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:27.752484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7dfd1fe9-6bfe-4c79-a8a5-0ef47c367bdb req-e2730068-accb-4d00-8446-ab7286fa8286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c", "tag": "c1847700-d232-42c8-a049-ef3bbcdad333"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:27.762529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7dfd1fe9-6bfe-4c79-a8a5-0ef47c367bdb req-e2730068-accb-4d00-8446-ab7286fa8286 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:27.762975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7dfd1fe9-6bfe-4c79-a8a5-0ef47c367bdb req-e2730068-accb-4d00-8446-ab7286fa8286 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:27.763402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7dfd1fe9-6bfe-4c79-a8a5-0ef47c367bdb req-e2730068-accb-4d00-8446-ab7286fa8286 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:27.776499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7dfd1fe9-6bfe-4c79-a8a5-0ef47c367bdb req-e2730068-accb-4d00-8446-ab7286fa8286 service nova] Creating event network-changed:c1847700-d232-42c8-a049-ef3bbcdad333 for instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c on n-h1-781139-2 Oct 03 14:40:27.781391 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7dfd1fe9-6bfe-4c79-a8a5-0ef47c367bdb req-e2730068-accb-4d00-8446-ab7286fa8286 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038756 Oct 03 14:40:27.782171 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1010/2020] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:27.787019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1356041077", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "becfb12c-e5af-4560-80c3-4794784e4ae3"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:27.846780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:40:28.108543 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-605efd49-e203-4860-a5ae-ec1e63ba1c5e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/9a3406ee-1762-471a-93a2-74d91c43d7ed" status: 202 len: 0 microversion: 2.1 time: 0.754448 Oct 03 14:40:28.109252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1011/2021] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:40:27 2022] DELETE /compute/v2.1/os-floating-ips/9a3406ee-1762-471a-93a2-74d91c43d7ed => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:40:28.114381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '.version_select at 0x7fb234b13dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:28.115008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:28.122451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.122964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.123399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.124252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.124708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.125869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.163786 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f392993-1681-42d2-aa32-44421e4df15e tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.053239 Oct 03 14:40:28.171717 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1012/2022] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 3 14:40:28 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0/os-instance-actions => generated 611 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:28.171717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-781139-2", "block_migration": false, "disk_over_commit": false}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:28.172728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:28.178892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.179405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.179838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.181047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.181509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.181931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.206329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lazy-loading 'flavor' on Instance uuid 1a669cbe-531f-4300-a7dd-e014baf44bf3 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:28.218796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Going to try to live migrate instance to n-h2-781139-2 {{(pid=128868) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 14:40:28.316561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:40:28.317173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:40:28.317455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:40:28.317925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:40:28.318395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:40:28.329295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.329781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.330218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.330955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.331482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.331948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.346793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:28.354661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:40:28.360504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:40:28.376779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:40:28.379562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:40:28.428653 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6dc71bb5-2061-49fe-bf19-0c0deab42e28 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645475 Oct 03 14:40:28.429587 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1011/2023] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:40:28.434564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:28.435170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:28.443271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.444217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.444657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.445517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.445966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.446681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.672188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:28.685592 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e03475f-3b7e-4410-8b15-8c4b05fca3c8 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1307 microversion: 2.1 time: 0.253510 Oct 03 14:40:28.686222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1012/2024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:28 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:28.706086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:28.706781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:28.735596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.736112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.736557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.738510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.740254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.740687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.928099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:28.937143 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d682904b-caf2-40b5-95c3-1a76c1e42174 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 0.249861 Oct 03 14:40:28.947798 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1013/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:28 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:28.954331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:28.955145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:28.962751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.963235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.963665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.964368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:28.964813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:28.965255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:28.992671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:29.085578 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b91b0d6a-21ba-4abe-906e-5bf1c79d7265 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 204 len: 0 microversion: 2.1 time: 0.136139 Oct 03 14:40:29.086215 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1014/2026] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:28 2022] DELETE /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:29.091690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:29.092417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:29.099246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.099868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.100410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.101363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.102022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.103110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.139797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:29.229792 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b07583c9-6b91-4a3e-ae2e-41bd810acdde tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 204 len: 0 microversion: 2.1 time: 0.142136 Oct 03 14:40:29.230660 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1015/2027] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:29 2022] DELETE /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:29.238419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:29.239123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:29.245485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.245915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.246359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.247064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.247522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.247937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.392506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:29.401762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:29.403244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:29.404440 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfe5f6b3-a10a-4431-a134-1dfa99ac6318 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1565 microversion: 2.25 time: 0.170089 Oct 03 14:40:29.405000 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1016/2028] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:29 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:29.409915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:29.410292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:29.417281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.417775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.418204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.418922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.419373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.419788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.489902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:29.498849 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dde89aa5-6834-4845-a10f-5f0b8bdcf9c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1217 microversion: 2.1 time: 0.092641 Oct 03 14:40:29.499325 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1017/2029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:29 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:29.504251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:29.504865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:29.511678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.512184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.512617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.513363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.513809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.514233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.662403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:29.672415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52dda139-3d77-48de-974e-c2588ad426e7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1521 microversion: 2.1 time: 0.171273 Oct 03 14:40:29.684997 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1018/2030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:29 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:29.684997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:29.684997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:29.684997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.685615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.686054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.686752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.687216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.687633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.690382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:29.831371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:29.839483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-237e3a2b-02ab-44cc-9d1c-013f0947586e tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1524 microversion: 2.1 time: 0.165129 Oct 03 14:40:29.840055 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1019/2031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:29 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:29.844399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:29.844988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:29.850619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.851100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.851593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:29.852441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:29.853310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:29.853732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.318066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:30.331898 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c90eac4-a015-4fb0-8885-bde7835e267d tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1511 microversion: 2.1 time: 0.490794 Oct 03 14:40:30.334365 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1020/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:29 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:30.353465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-49c421a4-29b0-4592-8ec3-bd5a7b4adf1b req-197f2e84-86a6-4be1-a5ee-d6fc543014da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b8547b-d12f-474d-8e17-19364eb75441", "name": "network-vif-plugged", "status": "completed", "tag": "d6bba469-edef-483e-bd0a-e37d5559b8f0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:30.363132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49c421a4-29b0-4592-8ec3-bd5a7b4adf1b req-197f2e84-86a6-4be1-a5ee-d6fc543014da service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.363611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49c421a4-29b0-4592-8ec3-bd5a7b4adf1b req-197f2e84-86a6-4be1-a5ee-d6fc543014da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.364034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49c421a4-29b0-4592-8ec3-bd5a7b4adf1b req-197f2e84-86a6-4be1-a5ee-d6fc543014da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.375512 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-49c421a4-29b0-4592-8ec3-bd5a7b4adf1b req-197f2e84-86a6-4be1-a5ee-d6fc543014da service nova] Creating event network-vif-plugged:d6bba469-edef-483e-bd0a-e37d5559b8f0 for instance a6b8547b-d12f-474d-8e17-19364eb75441 on n-h2-781139-2 Oct 03 14:40:30.380586 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-49c421a4-29b0-4592-8ec3-bd5a7b4adf1b req-197f2e84-86a6-4be1-a5ee-d6fc543014da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044897 Oct 03 14:40:30.381190 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1021/2033] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:30.386872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:30.387546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:30.393614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.394228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.394600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.395497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.396056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.396330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.571892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:30.582989 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb10dc6f-15ca-4aea-bb2e-5926289118cf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1307 microversion: 2.1 time: 0.199960 Oct 03 14:40:30.583838 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1022/2034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:30 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:30.603541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0071929f-bfea-4127-b5d9-3f061869ac6d req-55e8d6ec-c260-4883-932e-de5b71dc61b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a85eea-3a6c-4b79-b702-6faef8ab910b", "name": "network-vif-deleted", "tag": "badac6a7-8c48-4385-8ede-5a1648db8792"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:30.614789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0071929f-bfea-4127-b5d9-3f061869ac6d req-55e8d6ec-c260-4883-932e-de5b71dc61b2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.615323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0071929f-bfea-4127-b5d9-3f061869ac6d req-55e8d6ec-c260-4883-932e-de5b71dc61b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.616046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0071929f-bfea-4127-b5d9-3f061869ac6d req-55e8d6ec-c260-4883-932e-de5b71dc61b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.627950 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0071929f-bfea-4127-b5d9-3f061869ac6d req-55e8d6ec-c260-4883-932e-de5b71dc61b2 service nova] Creating event network-vif-deleted:badac6a7-8c48-4385-8ede-5a1648db8792 for instance b0a85eea-3a6c-4b79-b702-6faef8ab910b on n-h1-781139-2 Oct 03 14:40:30.633357 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0071929f-bfea-4127-b5d9-3f061869ac6d req-55e8d6ec-c260-4883-932e-de5b71dc61b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042906 Oct 03 14:40:30.634126 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1023/2035] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:30.639764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:30.640818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:30.646849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.647324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.647750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.648443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.648883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.649367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.789027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:30.797245 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04e12707-f391-4507-bafa-e895b9d65e27 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 0.161784 Oct 03 14:40:30.797852 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1024/2036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:30 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:30.802461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:30.803071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:30.809028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.809418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.809848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.810524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.810988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.811699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.876596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:30.886104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:30.888652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:30.890198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00dd57df-bbb3-48a7-a5cf-c10d1ae453ac tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1347 microversion: 2.25 time: 0.091437 Oct 03 14:40:30.890556 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58ec808a-8218-40b7-83c1-fddcbfe076e8 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3/action" status: 202 len: 0 microversion: 2.1 time: 2.724669 Oct 03 14:40:30.891054 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1025/2037] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:30 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1347 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:30.894433 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1013/2038] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:28 2022] POST /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3/action => generated 0 bytes in 2729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:40:30.895372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:30.895970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:30.899593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:30.900282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:30.902067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.902544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.902972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.903663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.904108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.904514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.908321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.908872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.909407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.910174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.910696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.911205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.969435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:30.977418 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10dd809f-4083-437b-a8bd-d04e62a04ada tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1217 microversion: 2.1 time: 0.085499 Oct 03 14:40:30.978034 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1026/2039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:30 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:30.982576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:30.983359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:30.989269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.989767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.990199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:30.990902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:30.991356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:30.991781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.046514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:31.054540 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43411f30-fe20-4ee5-b7d0-ce9496ca75ae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1521 microversion: 2.1 time: 0.158797 Oct 03 14:40:31.055320 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1014/2040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:30 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:31.060193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:31.060914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:31.067006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.067496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.067928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.068625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.069105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.069530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.126032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:31.137486 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9492b01-7d60-46ec-84fd-fdee230f76a8 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1524 microversion: 2.1 time: 0.158106 Oct 03 14:40:31.138946 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1027/2041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:30 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:31.205642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:31.214117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13ef6ea3-6d30-4c4a-ac71-229ebc3f6e6e tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.157626 Oct 03 14:40:31.214669 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1015/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:31 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:31.358171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:31.358791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:31.365413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.365890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.366347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.367056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.367512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.367960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.505603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:31.514083 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad3fd954-a6c0-4043-b639-13508c794ced tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1511 microversion: 2.1 time: 0.159917 Oct 03 14:40:31.514657 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1028/2043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:31 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:31.607232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:31.607894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:31.615584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.616309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.616760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.617855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.618559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.619150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.788899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:31.798251 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc27bc8f-4dd6-4ff7-b0fe-3b9cfcdb0b4d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1307 microversion: 2.1 time: 0.195793 Oct 03 14:40:31.799645 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1016/2044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:31 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:31.820438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:31.821106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:31.827114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.827591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.828020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.828711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.829207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.829636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.915902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:31.916528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:31.922979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.923466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.923895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.924592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.925245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.925931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.960829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:31.961338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:31.961811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:31.962708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lazy-loading 'fault' on Instance uuid b0a85eea-3a6c-4b79-b702-6faef8ab910b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:31.971502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:31.979630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd56834a-554c-42d5-91b9-c1d382dd515a tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 0.163075 Oct 03 14:40:31.980223 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1029/2045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:31 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:32.001303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:32.002088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:32.008827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.009869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.009992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.011146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.011515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.011967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.019543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:32.028896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:32.030654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:32.032023 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3106fd0e-9fe7-4216-ab90-ef4476feaff5 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1352 microversion: 2.25 time: 0.120244 Oct 03 14:40:32.048398 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1017/2046] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:31 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:32.084039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:32.084664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:32.092397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.093334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.093767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.094561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.095011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.095551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.122006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:32.131401 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6264a0d8-af6b-4987-b31d-b6aa88541c7f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1217 microversion: 2.1 time: 0.133959 Oct 03 14:40:32.132498 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1030/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:31 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:32.161737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:32.162367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:32.169962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.170558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.171005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.171853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.172378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.172865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.453284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:32.466361 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3220994a-2b24-4aef-9f3e-da895292f125 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1506 microversion: 2.1 time: 0.391781 Oct 03 14:40:32.469384 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1018/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:32 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:32.477345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:32.478604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:32.487642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.488552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.490711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.491641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.497550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.498246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.567975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:32.583845 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a794230-e971-4198-a3d7-83799878e9a9 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1524 microversion: 2.1 time: 0.425613 Oct 03 14:40:32.585051 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1031/2049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:32 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1524 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:32.591901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:32.592551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:32.609385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.610405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.611233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.612295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.613108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.613738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.892717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:32.906044 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e169900-a1c0-4075-9818-74ae00e81e64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.432725 Oct 03 14:40:32.909635 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1019/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:32 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:32.924979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:32.926314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:32.944268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.945098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.945768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:32.946787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:32.947485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:32.948074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.070075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:33.079923 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96292f83-ffc2-4a90-b8b6-bce65524ec57 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 200 len: 1506 microversion: 2.1 time: 0.493657 Oct 03 14:40:33.080885 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1032/2051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:32 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:33.085554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:33.086176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:33.093078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.093568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.094006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.094717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.095391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.095609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.222303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:33.235026 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82d89693-4c88-4f9a-b090-ac70d054195a tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1511 microversion: 2.1 time: 0.320751 Oct 03 14:40:33.235646 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1020/2052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:32 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:33.247260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:33.248167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:33.260971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:33.265719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.277743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.278202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.278967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.279447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.279901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.476130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:33.499602 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53f2f29b-9101-4d6c-9d7a-a3f593fd3204 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 0.262853 Oct 03 14:40:33.502951 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1021/2053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:33 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:33.506411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:33.513212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:33.513898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:33.515833 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ccb7297-1294-44fa-b6ca-bb2f8aa37d33 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1307 microversion: 2.1 time: 0.433751 Oct 03 14:40:33.526319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.537819 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1033/2054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:33 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:33.537819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:33.537819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:33.539265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.540047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.543866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.544817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.547556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.562801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.573449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.574657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.575648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.576314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.578457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.593337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.593988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.594737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.595154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lazy-loading 'fault' on Instance uuid b0a85eea-3a6c-4b79-b702-6faef8ab910b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:33.634457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:33.660150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:33.675237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:33.676986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19b2b042d70a426989bb5dc6b986b7c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f5e47f71fc4494aa8ed6354736216f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:33.683370 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8df80970-6228-44f4-963f-001778e0a09b tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 200 len: 1352 microversion: 2.25 time: 0.178725 Oct 03 14:40:33.695738 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1022/2055] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:33 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 1352 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:40:33.715179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:33.717624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:33.732273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.732848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.734599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.735354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.739441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.740019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.875811 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ef21afe-c480-4aad-8dd0-1b6f7b88a8d2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 204 len: 0 microversion: 2.1 time: 0.343967 Oct 03 14:40:33.881677 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1034/2056] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:33 2022] DELETE /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:33.898298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-623f7e2c-c450-4264-83d9-fbf658ada6d7 req-eedbd0ac-32d5-4267-bedb-212da037624c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c", "name": "network-vif-deleted", "tag": "c1847700-d232-42c8-a049-ef3bbcdad333"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:33.938297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-623f7e2c-c450-4264-83d9-fbf658ada6d7 req-eedbd0ac-32d5-4267-bedb-212da037624c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:33.943415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-623f7e2c-c450-4264-83d9-fbf658ada6d7 req-eedbd0ac-32d5-4267-bedb-212da037624c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:33.944298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-623f7e2c-c450-4264-83d9-fbf658ada6d7 req-eedbd0ac-32d5-4267-bedb-212da037624c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:33.988467 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-623f7e2c-c450-4264-83d9-fbf658ada6d7 req-eedbd0ac-32d5-4267-bedb-212da037624c service nova] Creating event network-vif-deleted:c1847700-d232-42c8-a049-ef3bbcdad333 for instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c on n-h1-781139-2 Oct 03 14:40:33.998852 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-623f7e2c-c450-4264-83d9-fbf658ada6d7 req-eedbd0ac-32d5-4267-bedb-212da037624c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113259 Oct 03 14:40:33.999488 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1035/2057] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:34.011571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:34.024295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:34.027366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:34.034782 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-38ca5bb5-e5c0-4782-9428-aaf325c62cc5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1273 microversion: 2.1 time: 0.327431 Oct 03 14:40:34.035799 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1023/2058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:33 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:34.051475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-25dc3ae8-b79a-4767-b51d-2ef0df7de9db req-9cf199eb-58fa-4174-9f17-d2809aa0c6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0789d3-d9db-4a84-b17a-81d50042fda0", "name": "network-vif-plugged", "status": "completed", "tag": "0a9512ee-d472-4ce2-bf03-17184e866ec5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:34.062578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.063809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.066271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.068960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.069624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.071382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.112137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-25dc3ae8-b79a-4767-b51d-2ef0df7de9db req-9cf199eb-58fa-4174-9f17-d2809aa0c6d0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.112535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-25dc3ae8-b79a-4767-b51d-2ef0df7de9db req-9cf199eb-58fa-4174-9f17-d2809aa0c6d0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.117406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-25dc3ae8-b79a-4767-b51d-2ef0df7de9db req-9cf199eb-58fa-4174-9f17-d2809aa0c6d0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.117600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:34.127176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:34.133909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.134614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.135281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.136103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lazy-loading 'fault' on Instance uuid f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:34.150719 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-25dc3ae8-b79a-4767-b51d-2ef0df7de9db req-9cf199eb-58fa-4174-9f17-d2809aa0c6d0 service nova] Creating event network-vif-plugged:0a9512ee-d472-4ce2-bf03-17184e866ec5 for instance aa0789d3-d9db-4a84-b17a-81d50042fda0 on n-h2-781139-2 Oct 03 14:40:34.162399 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-25dc3ae8-b79a-4767-b51d-2ef0df7de9db req-9cf199eb-58fa-4174-9f17-d2809aa0c6d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123934 Oct 03 14:40:34.167922 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1024/2059] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:34.174335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e650cafc-8ab6-49ae-b83a-b908d8e40565 req-25981cb0-9fe1-4fd8-a6ef-2befce8a653a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b527955b-b823-441d-a4bb-44a1d880daa0", "name": "network-vif-deleted", "tag": "63b5bd68-d682-4ed9-9c82-e0d2b66eb1f7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:34.205467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e650cafc-8ab6-49ae-b83a-b908d8e40565 req-25981cb0-9fe1-4fd8-a6ef-2befce8a653a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.206758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e650cafc-8ab6-49ae-b83a-b908d8e40565 req-25981cb0-9fe1-4fd8-a6ef-2befce8a653a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.206758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e650cafc-8ab6-49ae-b83a-b908d8e40565 req-25981cb0-9fe1-4fd8-a6ef-2befce8a653a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.242529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e650cafc-8ab6-49ae-b83a-b908d8e40565 req-25981cb0-9fe1-4fd8-a6ef-2befce8a653a service nova] Creating event network-vif-deleted:63b5bd68-d682-4ed9-9c82-e0d2b66eb1f7 for instance b527955b-b823-441d-a4bb-44a1d880daa0 on n-h1-781139-2 Oct 03 14:40:34.251470 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e650cafc-8ab6-49ae-b83a-b908d8e40565 req-25981cb0-9fe1-4fd8-a6ef-2befce8a653a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081916 Oct 03 14:40:34.252546 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1025/2060] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:34.271763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:34.272761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:34.280222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.281124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.282063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.283271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.283943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.284748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.328000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:34.351316 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-473b130c-e48e-4680-b703-41597b916b64 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1313 microversion: 2.1 time: 0.342954 Oct 03 14:40:34.358975 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1036/2061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:34 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:34.370416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-213642237", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "7877a73c-1b04-43e7-a6e7-105e448c1162"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:34.433885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] validate_networks() for [('7877a73c-1b04-43e7-a6e7-105e448c1162', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:40:34.522233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:34.530805 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aedec7ce-944e-4a1d-8cfb-6ccdc34513fb tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.276368 Oct 03 14:40:34.531399 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1026/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:34 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:34.536080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:34.537141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:34.546609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.548117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.548536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.549384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.550248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.550909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.585579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.586243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.586855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.587537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lazy-loading 'fault' on Instance uuid b527955b-b823-441d-a4bb-44a1d880daa0 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:34.645310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:34.655778 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80575a54-5f97-4fcb-be8e-f6fac11d5683 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1306 microversion: 2.1 time: 0.123011 Oct 03 14:40:34.656738 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1027/2063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:34 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:34.661909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:34.662595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:34.669630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.670119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.670558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.671545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:34.672212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:34.672401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:34.924764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:34.950687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc582fed-6f0b-433e-8d8f-0e935289b281 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 0.291404 Oct 03 14:40:34.972228 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1028/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:34 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:34.988452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:34.993172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:35.024740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.027307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.028033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.029022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.029642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.030295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.123619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:40:35.124994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:40:35.125666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:40:35.126255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:40:35.126805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:40:35.138934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.139636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.140252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.141163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.141774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.142372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.172954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Getting quotas for project 7bfd2cb85d9c4983a86823d7b267d66f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:40:35.179105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Getting quotas for user ca91b4c2c303476b870b879e712ba2a4 and project 7bfd2cb85d9c4983a86823d7b267d66f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:40:35.193373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:40:35.196637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:40:35.253726 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65fe9e8b-8035-4573-8dc8-5196383dd35c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891240 Oct 03 14:40:35.262821 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1037/2065] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:40:35.268284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:35.277661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] [instance: b0a85eea-3a6c-4b79-b702-6faef8ab910b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:35.294673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.297310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.298904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.300044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.303623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.304237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.325785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] HTTP exception thrown: Instance b0a85eea-3a6c-4b79-b702-6faef8ab910b could not be found. Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Request method failure captured: Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b HTTP/1.1 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvKxL-8mTKTQmJIZzkKV6hipQLnkz402oNiwAAGkI5bqjHYhbWnOBznBAIBaZSnApIbAfwkImuejemx_ZdvGCGf6rC1IiCWtQhQQFmeU6GtOXMpY3gFSmHraP8PNWD1fTSDftHukY90N2oulVSUR07XtW-z3g8waYfm2ArxLSUmYYGc Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.25 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0f5e47f71fc4494aa8ed6354736216f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0f5e47f71fc4494aa8ed6354736216f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f0f5e47f71fc4494aa8ed6354736216f Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 19b2b042d70a426989bb5dc6b986b7c5 Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268321467-project Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b0a85eea-3a6c-4b79-b702-6faef8ab910b could not be found. Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b0a85eea-3a6c-4b79-b702-6faef8ab910b'} Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a85eea-3a6c-4b79-b702-6faef8ab910b could not be found. Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a85eea-3a6c-4b79-b702-6faef8ab910b could not be found. Oct 03 14:40:35.328166 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a85eea-3a6c-4b79-b702-6faef8ab910b could not be found. Oct 03 14:40:35.333682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:35.336455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] Returning 404 to user: Instance b0a85eea-3a6c-4b79-b702-6faef8ab910b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:35.337674 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba03e55a-1a1f-4efe-b82c-0ff054dde759 tempest-LiveAutoBlockMigrationV225Test-1268321467 tempest-LiveAutoBlockMigrationV225Test-1268321467-project] 10.222.0.20 "GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b" status: 404 len: 111 microversion: 2.25 time: 0.073462 Oct 03 14:40:35.344521 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1038/2066] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:40:35 2022] GET /compute/v2.1/servers/b0a85eea-3a6c-4b79-b702-6faef8ab910b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:40:35.349904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:35.351057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:35.358871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:35.361816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.362633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.363260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.364454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.365165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.366076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.395218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:35.408948 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ced5f42-22b8-40d9-9e4c-dae05f3eb21c tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1307 microversion: 2.1 time: 0.434447 Oct 03 14:40:35.412297 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1029/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:34 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1307 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:35.423219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd048bf1-8f46-4640-a6e1-0b6aaa8bf0a1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:35.425268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fd048bf1-8f46-4640-a6e1-0b6aaa8bf0a1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:35.495754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fd048bf1-8f46-4640-a6e1-0b6aaa8bf0a1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:35.507011 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd048bf1-8f46-4640-a6e1-0b6aaa8bf0a1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1217 microversion: 2.1 time: 0.090322 Oct 03 14:40:35.511193 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1030/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:35 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:35.519581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:35.521490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:35.536562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.539287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.539976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.540903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.541537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.542139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.583364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.584132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.584728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.585364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lazy-loading 'fault' on Instance uuid f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:35.841125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:35.860102 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec6c86d8-dada-4dd6-be55-6c59da9005b8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1279 microversion: 2.1 time: 0.513623 Oct 03 14:40:35.873382 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1039/2069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:35 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1279 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:35.882821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:35.883499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:35.888872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dbd6bbae7c44725b8a1dadcd8c788e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1118fb2e9d1a4ad0af213b85620e1cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:35.899144 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ee2e294e-6db0-480d-938f-d947d25c79d5 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 200 len: 1313 microversion: 2.1 time: 0.386812 Oct 03 14:40:35.902219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.902762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.916953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.916953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.917466 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1031/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:35 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:35.917582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.917582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.917772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:35.917772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:35.932121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.934822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.935560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:35.938021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:35.941590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:35.942522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:36.064631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:36.065924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:36.066660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:36.067365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lazy-loading 'fault' on Instance uuid b527955b-b823-441d-a4bb-44a1d880daa0 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:36.191835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f9d6a0213b45b786fb3950669cc78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4bc0de18ea43e7bc65f1f862a7d592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:36.202632 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd45a777-b6b8-4caa-b29d-21172bd48e84 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 200 len: 1306 microversion: 2.1 time: 0.296669 Oct 03 14:40:36.203844 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1032/2071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:35 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 1306 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:36.320513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:36.355816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:36.356490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:36.373881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:36.374709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:36.377240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:36.378505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:36.379150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:36.382712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:36.826447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:36.840697 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b562928-b4d0-4b99-abc2-a9c08b02f0a2 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 0.635463 Oct 03 14:40:36.865152 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1033/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:36 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:36.877793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-274b25ae-0f06-4d4c-b09f-99f280c5312d req-20f68671-1419-4ef7-9f5f-b8c49a0bd4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:36.896940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-274b25ae-0f06-4d4c-b09f-99f280c5312d req-20f68671-1419-4ef7-9f5f-b8c49a0bd4ca service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:36.902264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-274b25ae-0f06-4d4c-b09f-99f280c5312d req-20f68671-1419-4ef7-9f5f-b8c49a0bd4ca service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:36.902898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-274b25ae-0f06-4d4c-b09f-99f280c5312d req-20f68671-1419-4ef7-9f5f-b8c49a0bd4ca service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:36.933126 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-274b25ae-0f06-4d4c-b09f-99f280c5312d req-20f68671-1419-4ef7-9f5f-b8c49a0bd4ca service nova] Creating event network-changed:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h2-781139-2 Oct 03 14:40:36.951425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-274b25ae-0f06-4d4c-b09f-99f280c5312d req-20f68671-1419-4ef7-9f5f-b8c49a0bd4ca service nova] Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:40:36.979370 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-274b25ae-0f06-4d4c-b09f-99f280c5312d req-20f68671-1419-4ef7-9f5f-b8c49a0bd4ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112313 Oct 03 14:40:36.988642 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1034/2073] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:36.995219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-78bc10f8-f453-42c3-a3d1-d8d17e23d5c8 req-5aa240d1-f276-487e-953e-5d7634c8623a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "name": "network-vif-unplugged", "status": "completed", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:37.019116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-78bc10f8-f453-42c3-a3d1-d8d17e23d5c8 req-5aa240d1-f276-487e-953e-5d7634c8623a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.019828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-78bc10f8-f453-42c3-a3d1-d8d17e23d5c8 req-5aa240d1-f276-487e-953e-5d7634c8623a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.020422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-78bc10f8-f453-42c3-a3d1-d8d17e23d5c8 req-5aa240d1-f276-487e-953e-5d7634c8623a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.036634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-78bc10f8-f453-42c3-a3d1-d8d17e23d5c8 req-5aa240d1-f276-487e-953e-5d7634c8623a service nova] Creating event network-vif-unplugged:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h2-781139-2 Oct 03 14:40:37.044382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-78bc10f8-f453-42c3-a3d1-d8d17e23d5c8 req-5aa240d1-f276-487e-953e-5d7634c8623a service nova] Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 14:40:37.057569 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-78bc10f8-f453-42c3-a3d1-d8d17e23d5c8 req-5aa240d1-f276-487e-953e-5d7634c8623a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067274 Oct 03 14:40:37.059620 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1035/2074] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:37.070411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:37.072863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:37.082285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.083135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.083739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.085353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.085974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.086641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.342577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:37.354871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:37.360683 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76be8f04-7eb9-4ce2-8962-8a707f68b872 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 1.479937 Oct 03 14:40:37.361369 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1040/2075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:35 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:37.369534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12728d2a-561a-471b-b420-131e37c70452 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1488 microversion: 2.1 time: 0.307451 Oct 03 14:40:37.372301 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1036/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:37 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1488 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:37.388608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:37.393999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:37.394996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:37.395306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:37.410490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.410798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.411625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.416099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.416778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.417403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.417778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.418418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.421032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.422365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.422982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.426873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.585674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:37.596954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2a0afbc-05d7-4452-b0e8-1fc5dfc70785 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1269 microversion: 2.1 time: 0.231553 Oct 03 14:40:37.598566 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1041/2077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:37 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1269 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:37.605194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:37.606383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] [instance: f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:37.613792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.614665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.615379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.616522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.617388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.619307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.640275 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] HTTP exception thrown: Instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c could not be found. Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Request method failure captured: Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c HTTP/1.1 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvP3xSvQyK_nT0Cjt1czmcKzeR2yuRoFIVGCxQ_mzkf68FwI35Wr28TVp5OQoeCi_Wo58bpJiSwN0Sb7j-h4QC4Ke3LWemDZI_HYQmjNZ6P3-w0R8gjWPNwNlK5kxOAMc2DIgkgm2DOqUNvNUWOwU2sQjKjqgi3-0nUVy-fszuMjHzY Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1118fb2e9d1a4ad0af213b85620e1cc0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1118fb2e9d1a4ad0af213b85620e1cc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 1118fb2e9d1a4ad0af213b85620e1cc0 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1223816352 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2dbd6bbae7c44725b8a1dadcd8c788e4 Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1223816352-project Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c could not be found. Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c'} Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c could not be found. Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c could not be found. Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.642733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c could not be found. Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] Returning 404 to user: Instance f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75b0ee48-3c15-405d-ab85-88eac88e0296 tempest-FloatingIPsAssociationTestJSON-1223816352 tempest-FloatingIPsAssociationTestJSON-1223816352-project] 10.222.0.20 "GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c" status: 404 len: 111 microversion: 2.1 time: 0.047105 Oct 03 14:40:37.651927 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1042/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:37 2022] GET /compute/v2.1/servers/f5bca7b6-0d8d-4588-b0f0-76a3f3f0966c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:37.660762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:37.663314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] [instance: b527955b-b823-441d-a4bb-44a1d880daa0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:37.671826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.672771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.673652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.675260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.676667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.678315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.697487 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] HTTP exception thrown: Instance b527955b-b823-441d-a4bb-44a1d880daa0 could not be found. Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Request method failure captured: Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 HTTP/1.1 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ1vpNJ6Kp2hh-LHugFqMsEOULjGcAcSjy_TPiuj7MbuaR2hc_UwJhGlW_z-pGidnGWzdqiruANwkxeLiyj63FKnwuFudUotiNZ0BvB7zOxIFGWwBxFh7uld99xGsagHanifoesEHR0ufGqoI5TFkjYuasxZXNM-GTD24g5-E-S8gQ Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ab4bc0de18ea43e7bc65f1f862a7d592 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsTestJSON-2101953261 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab4bc0de18ea43e7bc65f1f862a7d592"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab4bc0de18ea43e7bc65f1f862a7d592", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4bc0de18ea43e7bc65f1f862a7d592"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab4bc0de18ea43e7bc65f1f862a7d592"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsTestJSON-2101953261 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ab4bc0de18ea43e7bc65f1f862a7d592 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2101953261 Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsTestJSON-2101953261-project Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 75f9d6a0213b45b786fb3950669cc78a Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsTestJSON-2101953261-project Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b527955b-b823-441d-a4bb-44a1d880daa0 could not be found. Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b527955b-b823-441d-a4bb-44a1d880daa0'} Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b527955b-b823-441d-a4bb-44a1d880daa0 could not be found. Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b527955b-b823-441d-a4bb-44a1d880daa0 could not be found. Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:37.699608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.704354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:37.704354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:37.704354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:37.704354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:37.704354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:37.704354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b527955b-b823-441d-a4bb-44a1d880daa0 could not be found. Oct 03 14:40:37.704354 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:37.709655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] Returning 404 to user: Instance b527955b-b823-441d-a4bb-44a1d880daa0 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:37.710819 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe1dcf27-eedb-4639-a543-8d78edf395e3 tempest-InstanceActionsTestJSON-2101953261 tempest-InstanceActionsTestJSON-2101953261-project] 10.222.0.20 "GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0" status: 404 len: 111 microversion: 2.1 time: 0.059780 Oct 03 14:40:37.716199 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1043/2079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:37 2022] GET /compute/v2.1/servers/b527955b-b823-441d-a4bb-44a1d880daa0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:37.720319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1145673658"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:37.724059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:37.730227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.730597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.731301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.731896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.732351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.733489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.779369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:37.789624 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0c71b5f6-21dc-4c79-951f-4009a2926699 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.415924 Oct 03 14:40:37.790433 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1037/2080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:37 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:37.874464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:37.875168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:37.898728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.899926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.900382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:37.901197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:37.901842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:37.902478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:38.229586 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab472885-ae6a-4443-bf4c-65f9d36aba47 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "POST /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0/action" status: 202 len: 0 microversion: 2.1 time: 0.511009 Oct 03 14:40:38.239697 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1044/2081] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:40:37 2022] POST /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:40:38.262108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-614878c4-452c-4e5e-bb7e-4a62a34539a6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a0f670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:38.326546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-614878c4-452c-4e5e-bb7e-4a62a34539a6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04" status: 200 len: 1412 microversion: 2.1 time: 0.084992 Oct 03 14:40:38.337747 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1045/2082] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:38 2022] GET /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:38.343125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfb63274-e33f-4a3a-b537-0a55057c2bce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a35670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:38.401258 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfb63274-e33f-4a3a-b537-0a55057c2bce tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04" status: 200 len: 1412 microversion: 2.1 time: 0.061941 Oct 03 14:40:38.412553 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1046/2083] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:38 2022] GET /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04 => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:38.418289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:38.419327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:38.431773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:38.433191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:38.433807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:38.435146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:38.435818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:38.436417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:38.728919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:38.739604 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7ba7584-b821-4b4f-b94e-52cb96175366 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.325338 Oct 03 14:40:38.741616 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1047/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:38 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:38.747515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7c5ec73-5e9c-4716-a9d9-11fd5df8a31a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a35b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:38.982589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7c5ec73-5e9c-4716-a9d9-11fd5df8a31a tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04" status: 204 len: 0 microversion: 2.1 time: 0.239327 Oct 03 14:40:38.983817 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1048/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:38 2022] DELETE /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:38.995753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:38.996991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:39.016875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.018669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.019978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.021702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.022686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.023617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.027519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:39.038732 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5425340-95f2-4bcb-a144-36f920529066 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 1.170741 Oct 03 14:40:39.040412 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1038/2086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:37 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:39.049516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:39.056429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:39.073125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.076759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.077529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.081549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.082208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.082791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.259140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:39.276038 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4df73804-88c2-4dc0-9e85-f33b73165c4a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1275 microversion: 2.1 time: 0.287343 Oct 03 14:40:39.277290 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1049/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:38 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:39.306317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2036fb77-7293-4377-ae41-58be2cb6ac89 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230c500d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:39.337322 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2036fb77-7293-4377-ae41-58be2cb6ac89 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Image not found. Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2036fb77-7293-4377-ae41-58be2cb6ac89 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04 HTTP/1.1 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c10ccffd-2428-48f9-b0a2-edd612d0bc04'} Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c10ccffd-2428-48f9-b0a2-edd612d0bc04 Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:40:39.339949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c10ccffd-2428-48f9-b0a2-edd612d0bc04 could not be found. Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:40:39.345165 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:39.351476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2036fb77-7293-4377-ae41-58be2cb6ac89 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:39.358415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2036fb77-7293-4377-ae41-58be2cb6ac89 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04" status: 404 len: 62 microversion: 2.1 time: 0.064166 Oct 03 14:40:39.359276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1050/2088] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:40:39 2022] GET /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:40:39.366304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-883a25b0-b134-4301-b582-d843e3d5b35c req-57ef801d-805d-41e3-8f63-b34e9c9b8dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b8547b-d12f-474d-8e17-19364eb75441", "name": "network-vif-deleted", "tag": "d6bba469-edef-483e-bd0a-e37d5559b8f0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:39.396779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-883a25b0-b134-4301-b582-d843e3d5b35c req-57ef801d-805d-41e3-8f63-b34e9c9b8dbf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.397944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-883a25b0-b134-4301-b582-d843e3d5b35c req-57ef801d-805d-41e3-8f63-b34e9c9b8dbf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.398506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-883a25b0-b134-4301-b582-d843e3d5b35c req-57ef801d-805d-41e3-8f63-b34e9c9b8dbf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.418607 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-883a25b0-b134-4301-b582-d843e3d5b35c req-57ef801d-805d-41e3-8f63-b34e9c9b8dbf service nova] Creating event network-vif-deleted:d6bba469-edef-483e-bd0a-e37d5559b8f0 for instance a6b8547b-d12f-474d-8e17-19364eb75441 on n-h2-781139-2 Oct 03 14:40:39.426709 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-883a25b0-b134-4301-b582-d843e3d5b35c req-57ef801d-805d-41e3-8f63-b34e9c9b8dbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065937 Oct 03 14:40:39.428702 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1051/2089] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:39.444503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b2c4c28a-3af7-4b5c-b945-d354358c2c5f req-279587a3-7377-44a9-9409-da6a888c73aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33a24ca-ff38-4431-a385-8131e29d5a3b", "tag": "1a7dd992-5b6d-454d-be14-57dbb8fbc076"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:39.486912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2c4c28a-3af7-4b5c-b945-d354358c2c5f req-279587a3-7377-44a9-9409-da6a888c73aa service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.487689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2c4c28a-3af7-4b5c-b945-d354358c2c5f req-279587a3-7377-44a9-9409-da6a888c73aa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.488282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2c4c28a-3af7-4b5c-b945-d354358c2c5f req-279587a3-7377-44a9-9409-da6a888c73aa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.508969 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b2c4c28a-3af7-4b5c-b945-d354358c2c5f req-279587a3-7377-44a9-9409-da6a888c73aa service nova] Creating event network-changed:1a7dd992-5b6d-454d-be14-57dbb8fbc076 for instance a33a24ca-ff38-4431-a385-8131e29d5a3b on n-h1-781139-2 Oct 03 14:40:39.518153 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b2c4c28a-3af7-4b5c-b945-d354358c2c5f req-279587a3-7377-44a9-9409-da6a888c73aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087148 Oct 03 14:40:39.519084 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1052/2090] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:39.528536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:39.529670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:39.537167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.537656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.538227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.538936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.539381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.539849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.692966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:39.702424 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ca744354-c37c-4233-ab89-1fbb5fa9a876 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.660392 Oct 03 14:40:39.713141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1039/2091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:39 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:39.766342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:39.767195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:39.774501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.775158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.775961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.776959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:39.777599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:39.778025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:39.940361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:39.973551 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c54374c0-e19d-4f9c-a0ed-76dce74e7efb tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1508 microversion: 2.1 time: 0.453118 Oct 03 14:40:39.976738 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1053/2092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:39 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:40.068825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:40.069502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:40.084394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:40.084898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:40.085373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:40.088685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:40.089770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:40.090255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:40.267331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:40.283246 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e1ce106-2de2-45b2-9417-7d4029d084f0 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.522432 Oct 03 14:40:40.286321 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1040/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:39 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:40.316707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:40.317456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:40.333217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:40.334548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:40.336903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:40.337910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:40.338376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:40.338909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:40.479607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:40.491706 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b03a6d1a-8c8c-4d8d-a967-c1f06fdcb044 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1275 microversion: 2.1 time: 0.190377 Oct 03 14:40:40.517027 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1041/2094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:40 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:40.741892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:40.742284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:40.755924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:40.756428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:40.756872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:40.757643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:40.758195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:40.758638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:41.060287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:41.071245 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-622b90d3-af40-4fc2-b981-4667ed4396c6 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1469 microversion: 2.1 time: 1.008760 Oct 03 14:40:41.093033 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1054/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:40 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1469 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:41.093033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:41.093033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:41.107993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:41.108567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:41.109143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:41.109965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:41.110557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:41.111081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:41.424902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:41.436449 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d46d4f3e-31dc-436b-9035-4681d9a2ff61 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1506 microversion: 2.1 time: 0.357762 Oct 03 14:40:41.447113 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1055/2096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:41 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:41.448458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:41.450436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:41.463501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:41.464059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:41.464683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:41.466031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:41.466735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:41.467587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:41.799405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:41.811924 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d194a0b5-d071-47ba-b345-4adba3710827 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.371445 Oct 03 14:40:41.812727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1056/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:41 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:41.819218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:41.819841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:41.837221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:41.837450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:41.837848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:41.838575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:41.839029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:41.839992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:41.883224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:41.887419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:41.892605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-141acf98-5bc7-4bd0-8380-4218f9ba5ae7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 1.154837 Oct 03 14:40:41.906381 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1042/2098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:40 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:42.100079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:42.101099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:42.113022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.116634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.117325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.118285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.118957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.120264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.390439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:42.398440 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d89687ac-9b21-449d-8b63-fb6b7df38fc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.584813 Oct 03 14:40:42.399091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1057/2099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:41 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:42.464223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:42.464854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:42.483781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.484276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.484727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.485590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.485894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.486393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.738005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:42.747054 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9ecdb68-ec1f-419f-a7db-9c273ae5cbb3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1462 microversion: 2.1 time: 0.650907 Oct 03 14:40:42.747822 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1043/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:42 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1462 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:42.772351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:42.773285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:42.779838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.780322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.780747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.781460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.781905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.782317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.819115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:42.829069 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5059354c-39c8-41af-9774-9dd8c883b56d tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1506 microversion: 2.1 time: 0.369638 Oct 03 14:40:42.829936 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1058/2101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:42 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:42.835111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:42.835921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:42.844164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.844961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.845570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.846504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:42.846962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:42.847387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:42.852984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:43.131030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:43.144195 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b35b343b-6d54-4609-b723-6ec23fc20631 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.312753 Oct 03 14:40:43.145966 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35fc05a5-290c-4387-99c2-a86a21c569b2 tempest-MigrationsAdminTest-433163805 tempest-MigrationsAdminTest-433163805-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1613 microversion: 2.1 time: 0.377746 Oct 03 14:40:43.147179 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1044/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:42 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1613 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:43.156525 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1059/2103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:42 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:43.177391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:43.178016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:43.185254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:43.185749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:43.189351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.190123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.190798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:43.191773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.192447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.193138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:43.195192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.195953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.196574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:43.197477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.198089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.198689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:43.295193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:43.482991 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-738b4550-5b75-4a33-bcdc-781e411f1e93 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 204 len: 0 microversion: 2.1 time: 0.301663 Oct 03 14:40:43.487191 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1060/2104] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:43 2022] DELETE /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:40:43.493945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:43.495272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:43.505731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.506769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.508151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:43.509455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.510153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.511118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:43.663311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:43.684010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-11de0b93-3578-42d4-b74c-820cccae15fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.530309 Oct 03 14:40:43.696190 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1045/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:43 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:43.709058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:43.710821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:43.718291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.719225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.719910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:43.721105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:43.723046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:43.724972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:44.481806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:44.500265 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1818de9e-1f57-4f76-8ed7-4c67bb1b2970 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 1.011498 Oct 03 14:40:44.502919 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1061/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:43 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:44.518230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-852bdff8-9666-4ebc-92b6-a0a1b5d0916e req-4530a0ef-64f4-488d-8bc9-73d52100341b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "name": "network-vif-plugged", "status": "completed", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:44.571813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-852bdff8-9666-4ebc-92b6-a0a1b5d0916e req-4530a0ef-64f4-488d-8bc9-73d52100341b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:44.572834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-852bdff8-9666-4ebc-92b6-a0a1b5d0916e req-4530a0ef-64f4-488d-8bc9-73d52100341b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:44.574098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-852bdff8-9666-4ebc-92b6-a0a1b5d0916e req-4530a0ef-64f4-488d-8bc9-73d52100341b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:44.616279 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-852bdff8-9666-4ebc-92b6-a0a1b5d0916e req-4530a0ef-64f4-488d-8bc9-73d52100341b service nova] Creating event network-vif-plugged:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h2-781139-2 Oct 03 14:40:44.639528 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-852bdff8-9666-4ebc-92b6-a0a1b5d0916e req-4530a0ef-64f4-488d-8bc9-73d52100341b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133374 Oct 03 14:40:44.643090 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1062/2107] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:44.656618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:44.657697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:44.667240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:44.669105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:44.670006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:44.671784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:44.672418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:44.673038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:44.684389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:44.697835 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ec07d01-fdb1-4037-9a56-4c4a9730a0bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1468 microversion: 2.1 time: 1.000142 Oct 03 14:40:44.702422 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1046/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:43 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1468 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:44.719002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:44.719949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:44.739333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:44.743918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:44.744673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:44.751264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:44.758985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:44.760699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.163489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:45.192328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:45.197790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=18 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:45.204133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:45.230978 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e99fd79e-e2c5-4deb-b787-00adda6e729b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.526682 Oct 03 14:40:45.236184 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1047/2109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:44 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:45.241279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:45.243729 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3cc3245-288d-489f-923c-4615fa56e889 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1488 microversion: 2.1 time: 0.596412 Oct 03 14:40:45.244467 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1063/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:44 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1488 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:45.245264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:45.252138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.253054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.253792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.254803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.255590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.256475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.268713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:45.270862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:45.286838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.287527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.288248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.289240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.290058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.290818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.342476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:45.501329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:45.548493 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2578e0e-ef5a-4f69-9875-036df00334ae tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 204 len: 0 microversion: 2.1 time: 0.276701 Oct 03 14:40:45.550816 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1064/2111] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:45 2022] DELETE /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:40:45.557939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:45.558922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:45.571905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.575348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.577891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.578978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.583098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.584320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.751377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:45.791302 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bcc1f985-799c-4717-925b-0d1ac7d89a85 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.553798 Oct 03 14:40:45.791911 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1048/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:45 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:45.803911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9c295a9-5828-4995-bf23-e92b0bc9d5f5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234b138b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:45.830477 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-a9c295a9-5828-4995-bf23-e92b0bc9d5f5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Image not found. Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9c295a9-5828-4995-bf23-e92b0bc9d5f5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04 HTTP/1.1 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: exception: Image not found. Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c10ccffd-2428-48f9-b0a2-edd612d0bc04'} Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c10ccffd-2428-48f9-b0a2-edd612d0bc04 to delete Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c10ccffd-2428-48f9-b0a2-edd612d0bc04 could not be found. Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:45.832601 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:40:45.837478 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:45.840696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9c295a9-5828-4995-bf23-e92b0bc9d5f5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Image not found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:45.841842 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a9c295a9-5828-4995-bf23-e92b0bc9d5f5 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04" status: 404 len: 62 microversion: 2.1 time: 0.041893 Oct 03 14:40:45.843423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1049/2113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:45 2022] DELETE /compute/v2.1/images/c10ccffd-2428-48f9-b0a2-edd612d0bc04 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:40:45.849410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:45.850304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:45.858113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.858944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.859651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:45.860571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:45.861473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:45.862112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.264712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:46.284723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c987a3ba-0a5e-4186-8f2b-97b6da558e6d tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1468 microversion: 2.1 time: 0.439646 Oct 03 14:40:46.286676 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1050/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:45 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1468 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:46.295199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:46.296272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:46.307886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.309911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.316479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.319929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.320622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.322088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.324460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:46.339308 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed6d1baa-41cd-4e81-8f33-23f0a51bd0e4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.786829 Oct 03 14:40:46.339922 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1065/2115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:45 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:46.349641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-92f2d0a9-90c3-45b8-a947-9552d2678f60 req-ab218b03-cd80-45c4-acc7-17cfa0d4ee70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e4183c-88c6-4279-8889-833abf5136e1", "tag": "88bd6bdd-668c-40fb-ae52-e7ed24eeceeb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:46.375392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92f2d0a9-90c3-45b8-a947-9552d2678f60 req-ab218b03-cd80-45c4-acc7-17cfa0d4ee70 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.375824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92f2d0a9-90c3-45b8-a947-9552d2678f60 req-ab218b03-cd80-45c4-acc7-17cfa0d4ee70 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.376352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92f2d0a9-90c3-45b8-a947-9552d2678f60 req-ab218b03-cd80-45c4-acc7-17cfa0d4ee70 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.397798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:46.399324 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-92f2d0a9-90c3-45b8-a947-9552d2678f60 req-ab218b03-cd80-45c4-acc7-17cfa0d4ee70 service nova] Creating event network-changed:88bd6bdd-668c-40fb-ae52-e7ed24eeceeb for instance e8e4183c-88c6-4279-8889-833abf5136e1 on n-h1-781139-2 Oct 03 14:40:46.410812 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-92f2d0a9-90c3-45b8-a947-9552d2678f60 req-ab218b03-cd80-45c4-acc7-17cfa0d4ee70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069625 Oct 03 14:40:46.412000 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1066/2116] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:46.423265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:46.423980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:46.434349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.441777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.442236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.443008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.443451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.453742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.535955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.compute.api [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Instance is already in deleting state, ignoring this request Oct 03 14:40:46.536811 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da58d9ff-bd3e-45e7-bd81-8e9eab68bd96 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 204 len: 0 microversion: 2.1 time: 0.248852 Oct 03 14:40:46.543325 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1051/2117] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:46 2022] DELETE /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:46.557416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:46.558014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:46.571526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.572019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.572457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.573261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.573647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.574197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.880329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:46.898895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c60666d0-0587-43dc-bcd8-c20ddbeb2140 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.484919 Oct 03 14:40:46.900196 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1067/2118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:46 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:46.914453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c457a19a-a65a-4a36-963a-1985987cd130 req-080a7929-95b3-4270-9639-e5a7e908786d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0789d3-d9db-4a84-b17a-81d50042fda0", "name": "network-vif-plugged", "status": "completed", "tag": "0a9512ee-d472-4ce2-bf03-17184e866ec5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:46.927717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c457a19a-a65a-4a36-963a-1985987cd130 req-080a7929-95b3-4270-9639-e5a7e908786d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.928288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c457a19a-a65a-4a36-963a-1985987cd130 req-080a7929-95b3-4270-9639-e5a7e908786d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.929010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c457a19a-a65a-4a36-963a-1985987cd130 req-080a7929-95b3-4270-9639-e5a7e908786d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.942744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c457a19a-a65a-4a36-963a-1985987cd130 req-080a7929-95b3-4270-9639-e5a7e908786d service nova] Creating event network-vif-plugged:0a9512ee-d472-4ce2-bf03-17184e866ec5 for instance aa0789d3-d9db-4a84-b17a-81d50042fda0 on n-h2-781139-2 Oct 03 14:40:46.948731 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c457a19a-a65a-4a36-963a-1985987cd130 req-080a7929-95b3-4270-9639-e5a7e908786d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046804 Oct 03 14:40:46.949619 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1068/2119] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:46.957101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:46.958189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:46.967695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.968880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.969595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:46.970546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:46.971325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:46.971972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:47.039998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:47.050985 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66ce5bb9-91a6-436a-a6c8-1b306a8aefe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1494 microversion: 2.1 time: 0.503361 Oct 03 14:40:47.053384 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1052/2120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:46 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1494 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:47.313496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:47.314454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:47.325450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:47.329497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:47.330467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:47.331497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:47.332216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:47.337051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:47.492650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:47.503664 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eaba5024-a5fc-4d95-84a8-19c8b5975723 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1426 microversion: 2.1 time: 0.194183 Oct 03 14:40:47.505848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1053/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:47 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1426 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:47.528845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:47.529723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:47.540000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:47.541872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:47.542614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:47.543899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:47.544634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:47.546249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:47.621191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:47.636252 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-640b7312-e16f-40cd-81d7-5d656f90c2c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.684111 Oct 03 14:40:47.637185 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1069/2122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:46 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:47.645675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-838d9af7-c1f6-436b-a69b-f919f8911fda req-fd6424f0-703a-417e-ac9f-eaa0f9485bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce", "name": "network-vif-deleted", "tag": "9f3c50a9-0f79-470d-904e-0f16ec332801"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:47.659679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-838d9af7-c1f6-436b-a69b-f919f8911fda req-fd6424f0-703a-417e-ac9f-eaa0f9485bad service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:47.660156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-838d9af7-c1f6-436b-a69b-f919f8911fda req-fd6424f0-703a-417e-ac9f-eaa0f9485bad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:47.660582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-838d9af7-c1f6-436b-a69b-f919f8911fda req-fd6424f0-703a-417e-ac9f-eaa0f9485bad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:47.673344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-838d9af7-c1f6-436b-a69b-f919f8911fda req-fd6424f0-703a-417e-ac9f-eaa0f9485bad service nova] Creating event network-vif-deleted:9f3c50a9-0f79-470d-904e-0f16ec332801 for instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce on n-h2-781139-2 Oct 03 14:40:47.679227 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-838d9af7-c1f6-436b-a69b-f919f8911fda req-fd6424f0-703a-417e-ac9f-eaa0f9485bad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040529 Oct 03 14:40:47.680572 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1070/2123] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:47.916800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:47.925991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:47.926829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:47.935850 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c52728e9-12c2-4935-80fb-2f66381f919d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.417875 Oct 03 14:40:47.942040 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1054/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:47 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:47.966899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:47.967943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:47.971029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:47.971801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:47.972362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:47.972797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.077415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:48.078774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:48.085722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.087259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.087916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.088896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.089758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.090282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.271249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:48.313209 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b587585c-515e-4031-ae75-77d84420dfa8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.393189 Oct 03 14:40:48.318913 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1071/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:47 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:48.412213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:48.458592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2facb927-b471-4e33-b6fb-5f1f3310a11e req-f1722d41-a6d9-40b8-bb0d-3a0a1ba29b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0789d3-d9db-4a84-b17a-81d50042fda0", "name": "network-vif-deleted", "tag": "0a9512ee-d472-4ce2-bf03-17184e866ec5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:48.467875 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0949c18b-8253-4393-acd4-593aaec21451 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1494 microversion: 2.1 time: 0.393794 Oct 03 14:40:48.471771 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1055/2126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:48 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1494 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:48.482964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2facb927-b471-4e33-b6fb-5f1f3310a11e req-f1722d41-a6d9-40b8-bb0d-3a0a1ba29b83 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.483714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2facb927-b471-4e33-b6fb-5f1f3310a11e req-f1722d41-a6d9-40b8-bb0d-3a0a1ba29b83 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.485185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2facb927-b471-4e33-b6fb-5f1f3310a11e req-f1722d41-a6d9-40b8-bb0d-3a0a1ba29b83 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.535810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:48.539879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:48.553661 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2facb927-b471-4e33-b6fb-5f1f3310a11e req-f1722d41-a6d9-40b8-bb0d-3a0a1ba29b83 service nova] Creating event network-vif-deleted:0a9512ee-d472-4ce2-bf03-17184e866ec5 for instance aa0789d3-d9db-4a84-b17a-81d50042fda0 on n-h2-781139-2 Oct 03 14:40:48.568359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.568959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.569303 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2facb927-b471-4e33-b6fb-5f1f3310a11e req-f1722d41-a6d9-40b8-bb0d-3a0a1ba29b83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120553 Oct 03 14:40:48.569815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.573843 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1072/2127] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:48.574062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.574568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.574994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.643340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.643816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.644250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.644695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lazy-loading 'fault' on Instance uuid 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:48.660375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:48.661485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:48.669630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.670637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.677465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.680641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.681685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.682361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.903207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:48.913484 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c73848f6-9ffc-4c72-aee3-35da1d0a244f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 200 len: 1302 microversion: 2.1 time: 0.385591 Oct 03 14:40:48.930266 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1056/2128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:48 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 1302 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:48.968161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:48.968776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:48.982955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.983954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.984836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:48.986091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:48.986784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:48.987434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.199650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:49.284354 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b5d30e4-dba4-4a6d-948b-d29f10d148f4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.625209 Oct 03 14:40:49.299767 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1073/2129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:48 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:49.351990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:49.354325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:49.373415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.374235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.374914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.376042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.376713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.377386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.809656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:49.823034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbf036fc-fda1-471d-b16d-f124bce9aa48 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.475820 Oct 03 14:40:49.823685 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1074/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:49 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:49.833457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:49.834142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:49.851485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.854070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:49.854593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.855023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.857343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.859351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.859791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.865529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f439a154-8448-4149-b621-20ccf8b45b75 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.901033 Oct 03 14:40:49.871291 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1057/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:48 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:49.877268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-40afd836-f352-420c-b941-4078737e7072 req-c1dc486b-0060-4ad2-b78f-db09aafc06a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33a24ca-ff38-4431-a385-8131e29d5a3b", "name": "network-vif-plugged", "status": "completed", "tag": "1a7dd992-5b6d-454d-be14-57dbb8fbc076"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:49.894337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-40afd836-f352-420c-b941-4078737e7072 req-c1dc486b-0060-4ad2-b78f-db09aafc06a9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.895176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-40afd836-f352-420c-b941-4078737e7072 req-c1dc486b-0060-4ad2-b78f-db09aafc06a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.895826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-40afd836-f352-420c-b941-4078737e7072 req-c1dc486b-0060-4ad2-b78f-db09aafc06a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.927873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-40afd836-f352-420c-b941-4078737e7072 req-c1dc486b-0060-4ad2-b78f-db09aafc06a9 service nova] Creating event network-vif-plugged:1a7dd992-5b6d-454d-be14-57dbb8fbc076 for instance a33a24ca-ff38-4431-a385-8131e29d5a3b on n-h1-781139-2 Oct 03 14:40:49.940530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.942455 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-40afd836-f352-420c-b941-4078737e7072 req-c1dc486b-0060-4ad2-b78f-db09aafc06a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069417 Oct 03 14:40:49.943372 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1058/2132] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:49.944081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.946425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.947190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lazy-loading 'fault' on Instance uuid aa0789d3-d9db-4a84-b17a-81d50042fda0 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:49.953191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:49.957315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:49.958552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:49.973485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.974952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.975678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:49.976731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:49.977463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:49.978187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.007458 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] HTTP exception thrown: Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce could not be found. Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Request method failure captured: Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce HTTP/1.1 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvM2wvtpK1onicBTGP2me4fsYQTS5-ZkgKMkTcx6VO4CMWUkiN0vpFU2UrV117TlisMh_letKOAFYlIg3fAKRncL-0FeGU1ER2Aoe05rDZe5gxHiBwsBiW7DdnWEw6G-cmsMdzN-0kLy5a2j8qDZuBzDqWTjBuT7-pBFHX0Qb8dYe7c Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adcd764080de463c8416d98168a9ee94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adcd764080de463c8416d98168a9ee94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-MigrationsAdminTest-968999665 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-MigrationsAdminTest-968999665-project Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 7415ca24b92d4ba193b3f6762d4196b3 Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-MigrationsAdminTest-968999665-project Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce could not be found. Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce'} Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce could not be found. Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce could not be found. Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:50.012268 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:50.018366 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:50.018366 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:50.018366 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:50.018366 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:50.018366 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:50.018366 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce could not be found. Oct 03 14:40:50.018366 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:50.021020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Returning 404 to user: Instance 9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:50.022282 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07803a36-b878-4dce-b418-23ccf73ca218 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce" status: 404 len: 111 microversion: 2.1 time: 0.076733 Oct 03 14:40:50.026476 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1059/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:49 2022] GET /compute/v2.1/servers/9f714bc4-8ccf-4ee3-a3f8-5f39c1b963ce => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:50.032168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:50.033106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:50.039920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.040742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.041476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.042418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.043078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.043792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.048894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:50.066107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62b7df215b144de94e02cd1e01f6f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9df0f94aef14058908b1bdf602aafbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:50.077561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c9ac5b8-4a54-49f7-9b30-c1c4744256d6 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 200 len: 1297 microversion: 2.1 time: 0.249325 Oct 03 14:40:50.080074 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1075/2134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:49 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 1297 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:50.112061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:50.245723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b881627-37dd-4a0e-9dad-148c57eced6e tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 204 len: 0 microversion: 2.1 time: 0.216932 Oct 03 14:40:50.259290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:50.259839 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1060/2135] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:50 2022] DELETE /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:50.259991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:50.277001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.277693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.278401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.280659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.282372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.291661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.327619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:50.328706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:50.345794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.346707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.349822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.350759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.353805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.357488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.716225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:50.725525 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7493362-19f3-4a3a-8878-98b1e6bd2335 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.402257 Oct 03 14:40:50.746131 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1061/2136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:50 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:50.790693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:50.806142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96024efd-d35f-407c-936f-c6c26df1fc86 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1534 microversion: 2.1 time: 0.547818 Oct 03 14:40:50.808761 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1076/2137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:50 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1534 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:50.850492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:50.850492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:50.859834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.861545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.862606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.863711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.864471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.865168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.895720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:50.896343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:50.905341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.909324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.910036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:50.910578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:50.911040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:50.911455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.111905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:51.128107 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a53ed36b-8279-4db6-8034-2db337b67a2c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.237721 Oct 03 14:40:51.129046 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1077/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:50 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:51.137845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1c496ab3-0c27-43ed-99c9-138ccdcb131f req-89ec0094-d4fd-4e6f-b0fd-fdf0879d8d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a669cbe-531f-4300-a7dd-e014baf44bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "0f57491e-aa97-4ff7-a32d-cd0ed03cd108"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:51.152110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c496ab3-0c27-43ed-99c9-138ccdcb131f req-89ec0094-d4fd-4e6f-b0fd-fdf0879d8d64 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.153067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c496ab3-0c27-43ed-99c9-138ccdcb131f req-89ec0094-d4fd-4e6f-b0fd-fdf0879d8d64 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.153715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c496ab3-0c27-43ed-99c9-138ccdcb131f req-89ec0094-d4fd-4e6f-b0fd-fdf0879d8d64 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.167224 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1c496ab3-0c27-43ed-99c9-138ccdcb131f req-89ec0094-d4fd-4e6f-b0fd-fdf0879d8d64 service nova] Creating event network-vif-unplugged:0f57491e-aa97-4ff7-a32d-cd0ed03cd108 for instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 on n-h1-781139-2 Oct 03 14:40:51.172742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1c496ab3-0c27-43ed-99c9-138ccdcb131f req-89ec0094-d4fd-4e6f-b0fd-fdf0879d8d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041985 Oct 03 14:40:51.174006 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1078/2139] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:51.179362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.180359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: aa0789d3-d9db-4a84-b17a-81d50042fda0] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.187258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.188030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.189474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.190516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.191219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.191885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.214187 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Instance aa0789d3-d9db-4a84-b17a-81d50042fda0 could not be found. Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 HTTP/1.1 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance aa0789d3-d9db-4a84-b17a-81d50042fda0 could not be found. Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'aa0789d3-d9db-4a84-b17a-81d50042fda0'} Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0789d3-d9db-4a84-b17a-81d50042fda0 could not be found. Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0789d3-d9db-4a84-b17a-81d50042fda0 could not be found. Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.215871 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0789d3-d9db-4a84-b17a-81d50042fda0 could not be found. Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Instance aa0789d3-d9db-4a84-b17a-81d50042fda0 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.227320 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28f5b61d-1934-45db-8422-ef97a680a738 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0" status: 404 len: 111 microversion: 2.1 time: 0.041960 Oct 03 14:40:51.229401 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1079/2140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] GET /compute/v2.1/servers/aa0789d3-d9db-4a84-b17a-81d50042fda0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:51.239365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fbebc16-d16f-44b2-b48d-6d5988e57b04 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb234ae9700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.287188 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3fbebc16-d16f-44b2-b48d-6d5988e57b04 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Image not found. Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fbebc16-d16f-44b2-b48d-6d5988e57b04 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 HTTP/1.1 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '7ba5d4dc-f993-4424-a278-6ca82e4f7767'} Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7ba5d4dc-f993-4424-a278-6ca82e4f7767 to delete Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7ba5d4dc-f993-4424-a278-6ca82e4f7767 could not be found. Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.290381 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:40:51.296202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.306567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fbebc16-d16f-44b2-b48d-6d5988e57b04 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.306567 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fbebc16-d16f-44b2-b48d-6d5988e57b04 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767" status: 404 len: 62 microversion: 2.1 time: 0.069574 Oct 03 14:40:51.306567 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1080/2141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] DELETE /compute/v2.1/images/7ba5d4dc-f993-4424-a278-6ca82e4f7767 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:40:51.313374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.315039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.322072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.322893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.323550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.325070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.325744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.326397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.346303 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 HTTP/1.1 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a011620-a90d-4d52-a7b6-5bec3e47d444'} Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:51.348630 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.353558 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.356048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.358950 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a8e2645-e9ef-4bfa-a199-ae430dcadfcf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 404 len: 111 microversion: 2.1 time: 0.048743 Oct 03 14:40:51.359793 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1081/2142] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:51 2022] DELETE /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:51.361208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:51.370953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.371915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 1a011620-a90d-4d52-a7b6-5bec3e47d444] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.377770 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-27a55c58-b3de-46a8-8974-7ffc462cb2ac tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.530957 Oct 03 14:40:51.384251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.387790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.389485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.391145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.392013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.393861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.400732 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1062/2143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:50 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:51.424671 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 HTTP/1.1 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a011620-a90d-4d52-a7b6-5bec3e47d444'} Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.430028 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.434676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.434676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.434676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.434676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.434676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. Oct 03 14:40:51.434676 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.438878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Instance 1a011620-a90d-4d52-a7b6-5bec3e47d444 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.444160 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1011898-5e80-457f-8ddc-bdb15de87051 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444" status: 404 len: 111 microversion: 2.1 time: 0.074269 Oct 03 14:40:51.446285 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1082/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] GET /compute/v2.1/servers/1a011620-a90d-4d52-a7b6-5bec3e47d444 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:51.455220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29c1d9cb-af07-41b2-bb3e-6c27e5cb7fe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb2304343a0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.486340 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-29c1d9cb-af07-41b2-bb3e-6c27e5cb7fe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Image not found. Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29c1d9cb-af07-41b2-bb3e-6c27e5cb7fe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d HTTP/1.1 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: exception: Image not found. Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4f05f05b-9a1e-4b37-aaab-f03e0511716d'} Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4f05f05b-9a1e-4b37-aaab-f03e0511716d to delete Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f05f05b-9a1e-4b37-aaab-f03e0511716d could not be found. Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.490287 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.495931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29c1d9cb-af07-41b2-bb3e-6c27e5cb7fe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Image not found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.499403 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29c1d9cb-af07-41b2-bb3e-6c27e5cb7fe4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d" status: 404 len: 62 microversion: 2.1 time: 0.048833 Oct 03 14:40:51.501516 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1063/2145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] DELETE /compute/v2.1/images/4f05f05b-9a1e-4b37-aaab-f03e0511716d => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:40:51.510209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.511067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.523994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.524695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.525190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.525922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.526375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.526802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.555271 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 HTTP/1.1 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '4388889a-755e-4663-b75c-84220b9d8fb1'} Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:51.557276 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.562738 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.567423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.568517 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d22ff9e0-de7a-4ba5-8925-9609c66fa1db tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 404 len: 111 microversion: 2.1 time: 0.062722 Oct 03 14:40:51.569997 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1083/2146] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:51 2022] DELETE /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:40:51.580065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.582303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 4388889a-755e-4663-b75c-84220b9d8fb1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.597917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:51.602996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.604097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.604622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.605460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.605982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.606467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.630389 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 HTTP/1.1 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4388889a-755e-4663-b75c-84220b9d8fb1'} Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.632913 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Instance 4388889a-755e-4663-b75c-84220b9d8fb1 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.639610 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3add12cd-7d69-45d5-b7e1-a6dd608af4bf tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1" status: 404 len: 111 microversion: 2.1 time: 0.060568 Oct 03 14:40:51.640598 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1064/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] GET /compute/v2.1/servers/4388889a-755e-4663-b75c-84220b9d8fb1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:51.644662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccf86ba0-6d39-460b-9d7d-c9924a8a70c4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '.version_select at 0x7fb230a0f670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.687422 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ccf86ba0-6d39-460b-9d7d-c9924a8a70c4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Image not found. Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccf86ba0-6d39-460b-9d7d-c9924a8a70c4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f HTTP/1.1 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '0e5c2854-75ac-4d71-a2c1-796b9800588f'} Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0e5c2854-75ac-4d71-a2c1-796b9800588f to delete Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0e5c2854-75ac-4d71-a2c1-796b9800588f could not be found. Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.689407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccf86ba0-6d39-460b-9d7d-c9924a8a70c4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccf86ba0-6d39-460b-9d7d-c9924a8a70c4 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f" status: 404 len: 62 microversion: 2.1 time: 0.051015 Oct 03 14:40:51.694692 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1084/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] DELETE /compute/v2.1/images/0e5c2854-75ac-4d71-a2c1-796b9800588f => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:40:51.702010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.702668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.709704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.710323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.711175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.712238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.712987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.713678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.730199 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 HTTP/1.1 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '906e2b64-19c2-4e64-b53b-037cbbf0f202'} Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:51.732982 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.741828 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.745460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.746570 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c76ebd0-81c0-4211-b820-4d59d86a2eef tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 404 len: 111 microversion: 2.1 time: 0.048525 Oct 03 14:40:51.747390 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1065/2149] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:51 2022] DELETE /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:51.756170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.757269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] [instance: 906e2b64-19c2-4e64-b53b-037cbbf0f202] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.759890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.761252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.768582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.770750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.771419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.772663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.773270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.774954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.776190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.776772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.777440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.778985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.779483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.779992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.806692 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] HTTP exception thrown: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Request method failure captured: Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 HTTP/1.1 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvNuN4WvUF0ANxOSzwRPb_jtX1GP8fsiRULVnK34kAlO0mAKa5Wna3hAonhLudOmS2ijdysPn_G8edmPuQhIh0PUa44hKve4niP3Q9ShV2fX1k2KBZkQ4Ya4jCJgek9-81ZHwQDmRrRF0PFE_sccwzUETW02bQ7RKUsLoyGw0ltSRVU Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f9df0f94aef14058908b1bdf602aafbc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f9df0f94aef14058908b1bdf602aafbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f9df0f94aef14058908b1bdf602aafbc Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesTestJSON-793321751 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e62b7df215b144de94e02cd1e01f6f21 Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesTestJSON-793321751-project Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '906e2b64-19c2-4e64-b53b-037cbbf0f202'} Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.810266 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:51.816286 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:51.816286 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:51.816286 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:51.816286 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:51.816286 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. Oct 03 14:40:51.816286 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:51.819604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] Returning 404 to user: Instance 906e2b64-19c2-4e64-b53b-037cbbf0f202 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:51.820505 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6eb7d7fc-56f3-42cc-b7cf-9f20ddb35621 tempest-ImagesTestJSON-793321751 tempest-ImagesTestJSON-793321751-project] 10.222.0.20 "GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202" status: 404 len: 111 microversion: 2.1 time: 0.068560 Oct 03 14:40:51.821521 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1085/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] GET /compute/v2.1/servers/906e2b64-19c2-4e64-b53b-037cbbf0f202 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:51.849363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:51.851428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:51.871029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.872569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.875798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:51.876808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:51.877480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:51.878109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:52.269402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:52.280631 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e3e6890d-31d6-4b5f-855e-7a1897ec9725 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1321 microversion: 2.1 time: 0.525696 Oct 03 14:40:52.282752 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1066/2151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:52.288666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:52.290367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:52.297172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:52.297966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:52.298672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:52.299474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:52.300218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:52.300862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:52.639772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:52.650844 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a111d5bd-2b25-4c0f-a9ad-fe2406d385f9 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.366031 Oct 03 14:40:52.656703 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1067/2152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:52 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:52.668100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:52.668957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:52.688219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:52.692328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:52.692764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:52.693708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:52.696470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:52.699649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:52.973237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:52.996134 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9084cb27-b077-44b1-bf37-4c42e53d0005 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1534 microversion: 2.1 time: 1.154140 Oct 03 14:40:53.003803 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1086/2153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:51 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1534 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:53.306681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:53.307299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:53.320028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:53.322737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:53.323597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:53.325214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:53.326814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:53.335419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:53.649765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:53.662229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a3e1cf88-e592-4142-bcc5-f836a2dcbb75 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 1.004102 Oct 03 14:40:53.669561 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1068/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:52 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:53.681864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:53.682910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:53.703127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:53.704666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:53.705537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:53.706414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:53.710266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:53.711479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:53.934158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:53.955034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b6123d1-72f2-4f77-8668-6cadc751dfd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1502 microversion: 2.1 time: 0.646987 Oct 03 14:40:53.970148 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1087/2155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:53 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1502 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:53.995864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:53.996636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:53.999971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:54.003885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.004629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.005379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.006317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.006967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.007638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.324881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:54.345695 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3c792f6d-7e7b-41dd-84d7-be8f1e6e3318 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.655598 Oct 03 14:40:54.346719 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1069/2156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:53 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:54.351679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:54.352496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:54.361108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.365693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.366205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.367321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.367997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.368448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.585772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:54.594551 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f776d19-62b5-41fe-904a-4e5c67f5d270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1502 microversion: 2.1 time: 0.603508 Oct 03 14:40:54.595750 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1088/2157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:53 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1502 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:54.615036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dbd87826-56c6-4d56-a77a-73e96a9deace req-d9d53e60-9ae1-4a48-bb86-ffdb8ebdb3eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a669cbe-531f-4300-a7dd-e014baf44bf3", "tag": "0f57491e-aa97-4ff7-a32d-cd0ed03cd108"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:54.629311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbd87826-56c6-4d56-a77a-73e96a9deace req-d9d53e60-9ae1-4a48-bb86-ffdb8ebdb3eb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.630065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbd87826-56c6-4d56-a77a-73e96a9deace req-d9d53e60-9ae1-4a48-bb86-ffdb8ebdb3eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.630776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dbd87826-56c6-4d56-a77a-73e96a9deace req-d9d53e60-9ae1-4a48-bb86-ffdb8ebdb3eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.648124 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dbd87826-56c6-4d56-a77a-73e96a9deace req-d9d53e60-9ae1-4a48-bb86-ffdb8ebdb3eb service nova] Creating event network-changed:0f57491e-aa97-4ff7-a32d-cd0ed03cd108 for instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 on n-h1-781139-2 Oct 03 14:40:54.655698 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dbd87826-56c6-4d56-a77a-73e96a9deace req-d9d53e60-9ae1-4a48-bb86-ffdb8ebdb3eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058457 Oct 03 14:40:54.657060 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1089/2158] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:54.666295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:54.667398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:54.677484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.679038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.679986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.682093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.682847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.683503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.719054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:40:54.777228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:54.812041 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc0a5b1a-7bdd-4570-9b17-f758166d06c3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1534 microversion: 2.1 time: 0.459905 Oct 03 14:40:54.812208 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1070/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:54 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1534 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:54.827405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:54.829164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:54.849222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.849741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.852829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.854746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.857542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.858856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.917138 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-912030ae-f409-494a-a6d9-95685e7b5c8e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 204 len: 0 microversion: 2.1 time: 0.255570 Oct 03 14:40:54.918557 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1090/2160] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:40:54 2022] DELETE /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:40:54.948609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:54.949682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:54.963242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.964326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.965580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:54.966665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:54.967640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:54.968852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:55.289855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:55.301519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-11a6ba06-06e3-4537-839b-82b8d8d05427 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.485248 Oct 03 14:40:55.325590 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1071/2161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:54 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:55.342696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-9418dd96-87aa-4835-93e3-67a543841f96 req-f35e09e2-891b-4a0c-bf7e-04722ca45758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31e21b53-e336-4990-b573-9cced61076bc", "name": "network-vif-deleted", "tag": "0441cd47-154d-4303-8bbd-2ec0d338c773"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:55.374259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9418dd96-87aa-4835-93e3-67a543841f96 req-f35e09e2-891b-4a0c-bf7e-04722ca45758 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:55.375646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9418dd96-87aa-4835-93e3-67a543841f96 req-f35e09e2-891b-4a0c-bf7e-04722ca45758 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:55.378730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9418dd96-87aa-4835-93e3-67a543841f96 req-f35e09e2-891b-4a0c-bf7e-04722ca45758 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:55.410912 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-9418dd96-87aa-4835-93e3-67a543841f96 req-f35e09e2-891b-4a0c-bf7e-04722ca45758 service nova] Creating event network-vif-deleted:0441cd47-154d-4303-8bbd-2ec0d338c773 for instance 31e21b53-e336-4990-b573-9cced61076bc on n-h1-781139-2 Oct 03 14:40:55.423000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-9418dd96-87aa-4835-93e3-67a543841f96 req-f35e09e2-891b-4a0c-bf7e-04722ca45758 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094714 Oct 03 14:40:55.426661 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1072/2162] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:55.439153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:55.442332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:55.461653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:55.462528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:55.463174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:55.464086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:55.464708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:55.466978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:55.598805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:55.609675 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d0ef280-636a-4b8e-bd3c-9784fee27a90 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1508 microversion: 2.1 time: 0.685172 Oct 03 14:40:55.622276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1091/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:54 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1508 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:55.788702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:55.802747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7dd2317-3f46-479b-8b00-c85b93857540 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.374284 Oct 03 14:40:55.803394 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1073/2164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:55 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:55.839445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:55.840119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:55.853987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:55.854907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:55.859480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:55.860479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:55.861792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:55.862529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:55.884191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-90cd7fdc-3308-49a0-b78e-9fcf7b279525 req-d4456fe9-006d-4105-a701-075b6cdef0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e4183c-88c6-4279-8889-833abf5136e1", "name": "network-vif-plugged", "status": "completed", "tag": "88bd6bdd-668c-40fb-ae52-e7ed24eeceeb"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:40:55.923930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-90cd7fdc-3308-49a0-b78e-9fcf7b279525 req-d4456fe9-006d-4105-a701-075b6cdef0c8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:55.924665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-90cd7fdc-3308-49a0-b78e-9fcf7b279525 req-d4456fe9-006d-4105-a701-075b6cdef0c8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:55.925212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-90cd7fdc-3308-49a0-b78e-9fcf7b279525 req-d4456fe9-006d-4105-a701-075b6cdef0c8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:55.940824 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-90cd7fdc-3308-49a0-b78e-9fcf7b279525 req-d4456fe9-006d-4105-a701-075b6cdef0c8 service nova] Creating event network-vif-plugged:88bd6bdd-668c-40fb-ae52-e7ed24eeceeb for instance e8e4183c-88c6-4279-8889-833abf5136e1 on n-h1-781139-2 Oct 03 14:40:55.946606 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-90cd7fdc-3308-49a0-b78e-9fcf7b279525 req-d4456fe9-006d-4105-a701-075b6cdef0c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067966 Oct 03 14:40:55.952424 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1074/2165] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:40:56.194243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:56.202499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee3e44aa-cd63-4823-a443-c6ce529ace1c tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1492 microversion: 2.1 time: 0.371229 Oct 03 14:40:56.203357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1092/2166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:55 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1492 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:56.332242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:56.333028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:56.348581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:56.349152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:56.349588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:56.353173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:56.355095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:56.355798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:56.635957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:56.636565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:56.643339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:56.644135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:56.644756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:56.645661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:56.646437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:56.647009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:56.770262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:56.782986 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7b150bd-a03a-4af5-9f1b-a1525de9e6cf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.454762 Oct 03 14:40:56.783709 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1075/2167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:56 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:56.829892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:56.832230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:56.840466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:56.841642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:56.842288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:56.843322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:56.844008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:56.844723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:57.316122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:57.328553 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6adf2ad6-7d46-49bc-8792-40ac7c2cbf65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 0.502336 Oct 03 14:40:57.333048 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1076/2168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:56 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:57.339548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:57.340699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:57.349845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:57.350728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:57.352201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:57.371492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:57.372255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:57.372720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:57.443205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:57.443947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:57.444559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:57.445285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lazy-loading 'fault' on Instance uuid 31e21b53-e336-4990-b573-9cced61076bc {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:40:57.616191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:57.620592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:57.629781 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50aa4e52-1b05-4799-b37d-526845ae25bb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1508 microversion: 2.1 time: 0.998044 Oct 03 14:40:57.631859 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db73c999-3d95-47c9-9d85-0d2ede5d26bc tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 200 len: 1368 microversion: 2.1 time: 0.296726 Oct 03 14:40:57.634000 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1077/2169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:57 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:57.641231 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1093/2170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:56 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1508 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:40:57.807121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:57.808006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:57.820675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:57.821224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:57.821686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:57.827150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:57.827647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:57.828102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:57.888248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:58.354915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:58.355873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:58.369989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:58.373375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:58.376832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:58.378798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:58.379601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:58.381991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:58.971092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:58.983164 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a63885e-a2fd-4281-9c23-f25911087677 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 1.179084 Oct 03 14:40:58.983798 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1078/2171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:57 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:58.996752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:59.004122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:59.024912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:59.025744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:59.026334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:59.031245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:59.036575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:59.038835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:59.534827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:59.549538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8765e560-adcc-4050-bcea-0fc82100f817 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1317 microversion: 2.1 time: 1.198775 Oct 03 14:40:59.555198 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1094/2172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:58 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1317 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:40:59.580035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:59.582049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 31e21b53-e336-4990-b573-9cced61076bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:40:59.600704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:59.601572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:59.602261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:59.603560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:40:59.604242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:40:59.604910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:40:59.625888 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] HTTP exception thrown: Instance 31e21b53-e336-4990-b573-9cced61076bc could not be found. Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Request method failure captured: Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc HTTP/1.1 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvM2wvtpK1onicBTGP2me4fsYQTS5-ZkgKMkTcx6VO4CMWUkiN0vpFU2UrV117TlisMh_letKOAFYlIg3fAKRncL-0FeGU1ER2Aoe05rDZe5gxHiBwsBiW7DdnWEw6G-cmsMdzN-0kLy5a2j8qDZuBzDqWTjBuT7-pBFHX0Qb8dYe7c Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adcd764080de463c8416d98168a9ee94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adcd764080de463c8416d98168a9ee94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-MigrationsAdminTest-968999665 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-MigrationsAdminTest-968999665-project Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7415ca24b92d4ba193b3f6762d4196b3 Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-MigrationsAdminTest-968999665-project Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 31e21b53-e336-4990-b573-9cced61076bc could not be found. Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '31e21b53-e336-4990-b573-9cced61076bc'} Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e21b53-e336-4990-b573-9cced61076bc could not be found. Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e21b53-e336-4990-b573-9cced61076bc could not be found. Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:40:59.628765 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:59.636429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:40:59.636429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:40:59.636429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:40:59.636429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:40:59.636429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:40:59.636429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e21b53-e336-4990-b573-9cced61076bc could not be found. Oct 03 14:40:59.636429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:40:59.640031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Returning 404 to user: Instance 31e21b53-e336-4990-b573-9cced61076bc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:40:59.645024 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20d42a53-5d15-4216-9b8c-2080ee5c6058 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc" status: 404 len: 111 microversion: 2.1 time: 0.085365 Oct 03 14:40:59.648190 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1095/2173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:59 2022] GET /compute/v2.1/servers/31e21b53-e336-4990-b573-9cced61076bc => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:40:59.658910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5c97b46-a142-48c3-a011-d0cb190d9973 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '.version_select at 0x7fb230a415e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:40:59.689127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:40:59.699742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5c97b46-a142-48c3-a011-d0cb190d9973 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473765627" status: 202 len: 0 microversion: 2.1 time: 0.046091 Oct 03 14:40:59.702607 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-520908df-6f4f-4bb3-a1f3-e8d6df68227b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1508 microversion: 2.1 time: 0.713878 Oct 03 14:40:59.702838 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1096/2174] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:40:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473765627 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:40:59.704913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1079/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:40:58 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:00.016271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:00.016894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:00.034655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:00.038947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:00.039780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:00.042553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:00.043500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:00.044110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:00.557679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-fd91ee7b-2b3f-471f-83b0-1cb1fd7f17d1 req-34002f8a-137a-4f33-b050-18f2d250ade2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33a24ca-ff38-4431-a385-8131e29d5a3b", "name": "network-vif-deleted", "tag": "1a7dd992-5b6d-454d-be14-57dbb8fbc076"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:00.580786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd91ee7b-2b3f-471f-83b0-1cb1fd7f17d1 req-34002f8a-137a-4f33-b050-18f2d250ade2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:00.581322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd91ee7b-2b3f-471f-83b0-1cb1fd7f17d1 req-34002f8a-137a-4f33-b050-18f2d250ade2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:00.581766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd91ee7b-2b3f-471f-83b0-1cb1fd7f17d1 req-34002f8a-137a-4f33-b050-18f2d250ade2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:00.604175 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-fd91ee7b-2b3f-471f-83b0-1cb1fd7f17d1 req-34002f8a-137a-4f33-b050-18f2d250ade2 service nova] Creating event network-vif-deleted:1a7dd992-5b6d-454d-be14-57dbb8fbc076 for instance a33a24ca-ff38-4431-a385-8131e29d5a3b on n-h1-781139-2 Oct 03 14:41:00.609651 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-fd91ee7b-2b3f-471f-83b0-1cb1fd7f17d1 req-34002f8a-137a-4f33-b050-18f2d250ade2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057166 Oct 03 14:41:00.611155 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1080/2176] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:00.616464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:00.617836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:00.624720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:00.625518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:00.626119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:00.627153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:00.627774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:00.628396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:00.904783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:00.938032 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92c835e6-3c1c-4b58-892e-406de5ad1dcf tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.911132 Oct 03 14:41:00.939024 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1097/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:00 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:00.962553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:00.963501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:00.991125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:00.992156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:00.993636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:00.994642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:00.995387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:00.996098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:01.088562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:01.091202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:01.091673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:01.094278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lazy-loading 'fault' on Instance uuid a33a24ca-ff38-4431-a385-8131e29d5a3b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:41:01.107100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:01.292484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:01.305434 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d35f1e97-353f-4ced-adbc-b8ca21814c78 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 200 len: 1311 microversion: 2.1 time: 0.364408 Oct 03 14:41:01.306383 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1098/2178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:00 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 1311 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:01.322129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:01.339255 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f1b90533-f5af-49be-bc99-4a20de1bbdc6 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1507 microversion: 2.1 time: 0.724618 Oct 03 14:41:01.339861 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1081/2179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:00 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1507 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:01.376006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:01.377012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:01.390362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:01.392129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:01.393105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:01.394036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:01.395216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:01.395818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:01.969774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:01.970386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:01.984313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:01.984816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:01.985295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:01.986032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:01.986482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:01.986909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.144997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:02.159017 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d16d2171-13e1-4b3e-8291-7621d2c64993 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1507 microversion: 2.1 time: 0.797803 Oct 03 14:41:02.159621 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1099/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:01 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1507 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:02.195432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:02.202776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:02.217977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.218496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.220679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.222644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.223146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.223587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.366351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa5fb874-6c2e-4aeb-a03b-16918c055c08 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "PUT /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1079 microversion: 2.1 time: 0.184762 Oct 03 14:41:02.382043 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1100/2181] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:41:02 2022] PUT /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1079 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:02.393569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:02.394488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:02.402948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.403937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.404608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.406191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.406709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.408756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.444166 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b HTTP/1.1 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a33a24ca-ff38-4431-a385-8131e29d5a3b'} Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:02.453975 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87168816-d9a7-4d5c-add3-30309d67ffdc tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 404 len: 111 microversion: 2.1 time: 0.073389 Oct 03 14:41:02.460324 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1101/2182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:02 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:41:02.482014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:02.485537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:02.497277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.500794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.502180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.511948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.512545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.513081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.738913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:02.748220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a983b2b-c122-456c-8c40-36930d47b06f tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.785413 Oct 03 14:41:02.752557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1082/2183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:01 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:02.758061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-933e7864-530f-447c-bc4b-8c27564c91c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: .version_select at 0x7fb230435d30>, body: {"keypair": {"name": "tempest-key-1325626539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRtHYitTemnzzn2pPcGShwDDco5Idta71FE+sT99YTFredGk8Aa/nctr86Rk7keNjnDWuzNxcPg4BnnM6/ZOQEdCr6pL/4n9wBt1Y+REmsXcjA9oUtea/8Qgi/w6Pn+cw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:02.804804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-933e7864-530f-447c-bc4b-8c27564c91c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:02.823789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-933e7864-530f-447c-bc4b-8c27564c91c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:02.863631 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-933e7864-530f-447c-bc4b-8c27564c91c4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.108304 Oct 03 14:41:02.864845 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1083/2184] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:41:02 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:02.875622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:02.876138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:02.887409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.887822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.888263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.889015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:02.889488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:02.889899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:02.946719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:03.105464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29aa7a5c-42dd-4d69-96ef-ac80378c7045 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 204 len: 0 microversion: 2.1 time: 0.237757 Oct 03 14:41:03.110478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1084/2185] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:02 2022] DELETE /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:03.117621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-036bdc4b-90d3-4d14-b79f-62c12b435638 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '.version_select at 0x7fb2304224c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:03.122029 n-d-781139-2 devstack@n-api.service[128868]: WARNING oslo_db.sqlalchemy.utils [None req-036bdc4b-90d3-4d14-b79f-62c12b435638 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 03 14:41:03.134122 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-036bdc4b-90d3-4d14-b79f-62c12b435638 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.022168 Oct 03 14:41:03.135950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1085/2186] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:41:03 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:03.146739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:03.149953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:03.164286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:03.164803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:03.165463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:03.166390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:03.167127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:03.168526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:03.650189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:03.659374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f703e33e-1f9d-4554-a5b5-af3deffce069 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1467 microversion: 2.1 time: 0.522190 Oct 03 14:41:03.660853 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1086/2187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:03 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1467 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:03.666776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-639858880", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-key-1325626539", "networks": [{"uuid": "becfb12c-e5af-4560-80c3-4794784e4ae3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:03.747686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:41:03.804952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:03.816782 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6fa019d3-ac33-4440-bea5-8d3ebd078d65 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1505 microversion: 2.1 time: 1.346766 Oct 03 14:41:03.818166 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1102/2188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:02 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1505 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:03.824984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:03.825908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:03.833630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:03.834459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:03.835110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:03.836108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:03.837670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:03.838451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:04.381118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:04.401860 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8594230e-4d97-4836-a92e-648bfef6ae40 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.576863 Oct 03 14:41:04.403553 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1103/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:03 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:04.661716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1863036706", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:04.779112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:04.779782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:04.780370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:04.781771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:04.783550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:04.804595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:04.808266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:04.810346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:04.811327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:04.813908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:04.814465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:04.870116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Getting quotas for project 06b186be7b6742859294975b2c28319e. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:04.885810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Getting quotas for user 19184a3e475e44aaa6289f0d230a3e98 and project 06b186be7b6742859294975b2c28319e. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:04.921092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:04.928222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:04.992051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b11cfcc4-edc2-406f-9d5f-2cf7cc7ce1e9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.586470 Oct 03 14:41:05.020968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1104/2190] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:41:05.030156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:05.032764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:05.043468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:05.044090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:05.044971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:05.045881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:05.046570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:05.047015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:05.693911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:05.705827 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bd711bb-f8c7-4ac2-8a58-79b2aa27b7ce tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1505 microversion: 2.1 time: 0.683423 Oct 03 14:41:05.709217 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1105/2191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:05 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1505 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:05.726038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:05.727030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:05.744791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:05.746084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:05.746727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:05.748297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:05.749882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:05.754670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:05.850157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:05.852463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:05.853266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:05.853912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:05.854808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:05.913654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:05.916798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:05.918659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:05.936679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:05.938407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:05.947014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:06.042016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:06.065554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:06.078999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:06.108954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:06.110802 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8727a83-c15c-41b0-ac0f-987e51db1d3f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 200 len: 1425 microversion: 2.1 time: 0.400181 Oct 03 14:41:06.112569 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1106/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:05 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 1425 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:06.126873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b0c9b1f-38b6-44f1-9b48-fae6293dc9d6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:06.127768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b0c9b1f-38b6-44f1-9b48-fae6293dc9d6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:06.151976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:06.351150 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be02878f-a74f-4569-bfa8-6e29d0a5f731 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.685953 Oct 03 14:41:06.361993 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1087/2193] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:41:06.377417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:06.396266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:06.420742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:06.439003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:06.446261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:06.449149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:06.450772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:06.451256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:06.720844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b0c9b1f-38b6-44f1-9b48-fae6293dc9d6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:06.732451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b0c9b1f-38b6-44f1-9b48-fae6293dc9d6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:06.736558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b0c9b1f-38b6-44f1-9b48-fae6293dc9d6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:06.762361 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b0c9b1f-38b6-44f1-9b48-fae6293dc9d6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1454 microversion: 2.91 time: 0.642574 Oct 03 14:41:06.763034 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1107/2194] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:06 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1454 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:06.773336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:06.777061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:06.784707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:06.785491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:06.786169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:06.787411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:06.788115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:06.788806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:06.951556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:06.969410 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-44f150e6-656f-4f72-a16f-3c0b639ecf64 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.598835 Oct 03 14:41:06.977525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1088/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:06 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:06.997176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-09be79f9-92e1-4a60-9404-ae89eece482d req-ee665c8d-bc13-4e44-afea-4c098ac811f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5d4472-5a15-4669-9f9c-abfad1afd9a8", "name": "network-vif-deleted", "tag": "6ed8a1bb-17a8-4a46-b317-c702126c5e6f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:07.047903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-09be79f9-92e1-4a60-9404-ae89eece482d req-ee665c8d-bc13-4e44-afea-4c098ac811f8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.053079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-09be79f9-92e1-4a60-9404-ae89eece482d req-ee665c8d-bc13-4e44-afea-4c098ac811f8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.053951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-09be79f9-92e1-4a60-9404-ae89eece482d req-ee665c8d-bc13-4e44-afea-4c098ac811f8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.055383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:07.056019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:07.057385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:07.058149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:07.058717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:07.099842 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-09be79f9-92e1-4a60-9404-ae89eece482d req-ee665c8d-bc13-4e44-afea-4c098ac811f8 service nova] Creating event network-vif-deleted:6ed8a1bb-17a8-4a46-b317-c702126c5e6f for instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 on n-h2-781139-2 Oct 03 14:41:07.124407 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-09be79f9-92e1-4a60-9404-ae89eece482d req-ee665c8d-bc13-4e44-afea-4c098ac811f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141265 Oct 03 14:41:07.128281 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1089/2196] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:07.143629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94cc3a6b-6c1c-441b-aef7-d8046c328270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:07.152653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94cc3a6b-6c1c-441b-aef7-d8046c328270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:07.254115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:07.271802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.275790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.277683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.278675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.281199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.283965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.356769 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8396cfc6-802c-4cd6-83de-9293149fea6a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "POST /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1/action" status: 202 len: 1111 microversion: 2.1 time: 0.592616 Oct 03 14:41:07.360448 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1108/2197] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:41:06 2022] POST /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1/action => generated 1111 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 14:41:07.371028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:07.374389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 4f5d4472-5a15-4669-9f9c-abfad1afd9a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:07.391628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.393908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.395369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.396305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.399048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.400443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.435426 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] HTTP exception thrown: Instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 could not be found. Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Request method failure captured: Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 HTTP/1.1 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvM2wvtpK1onicBTGP2me4fsYQTS5-ZkgKMkTcx6VO4CMWUkiN0vpFU2UrV117TlisMh_letKOAFYlIg3fAKRncL-0FeGU1ER2Aoe05rDZe5gxHiBwsBiW7DdnWEw6G-cmsMdzN-0kLy5a2j8qDZuBzDqWTjBuT7-pBFHX0Qb8dYe7c Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adcd764080de463c8416d98168a9ee94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adcd764080de463c8416d98168a9ee94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-MigrationsAdminTest-968999665 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-MigrationsAdminTest-968999665-project Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7415ca24b92d4ba193b3f6762d4196b3 Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-MigrationsAdminTest-968999665-project Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 could not be found. Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '4f5d4472-5a15-4669-9f9c-abfad1afd9a8'} Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 could not be found. Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 could not be found. Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:07.441680 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:07.449091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:07.449091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:07.449091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:07.449091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:07.449091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:07.449091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 could not be found. Oct 03 14:41:07.449091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:07.453698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94cc3a6b-6c1c-441b-aef7-d8046c328270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:07.454788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Returning 404 to user: Instance 4f5d4472-5a15-4669-9f9c-abfad1afd9a8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:07.455862 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8e0acbd-bb2a-4db4-898a-fc6767d53a11 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8" status: 404 len: 111 microversion: 2.1 time: 0.093395 Oct 03 14:41:07.458206 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1109/2198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:07 2022] GET /compute/v2.1/servers/4f5d4472-5a15-4669-9f9c-abfad1afd9a8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:41:07.474875 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94cc3a6b-6c1c-441b-aef7-d8046c328270 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1228 microversion: 2.1 time: 0.336182 Oct 03 14:41:07.479152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:07.480477 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1090/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:07 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1228 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:07.484215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:07.498616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.499664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.500699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.501734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.511916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.514583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.533576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:07.535009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:07.583687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.584411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.584979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.588689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.589228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.590191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.660637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:07.871118 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1a33cc2d-fe89-46a9-8fbd-d42ca813584f tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 204 len: 0 microversion: 2.1 time: 0.389033 Oct 03 14:41:07.873040 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1091/2200] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:07 2022] DELETE /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:07.904152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:07.906362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:07.917726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.918587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.919409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:07.921696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:07.922378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:07.923081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:08.224223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:08.240794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:08.244455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:08.275021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:08.286105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c4d2db92-3c57-49a4-8049-8903753a3d6c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1506 microversion: 2.91 time: 0.409212 Oct 03 14:41:08.290721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1092/2201] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:07 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:08.317879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:08.321457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:08.340083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:08.340668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:08.341251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:08.342161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:08.351612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:08.352741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:08.467847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:08.485238 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-986e6543-a047-4494-b382-462841ca095e tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 1.023925 Oct 03 14:41:08.488496 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1110/2202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:07 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:08.507422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:08.511964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:08.526703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:08.527441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:08.528148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:08.529045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:08.529657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:08.530673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:08.834316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:08.845648 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5691170b-366b-4d69-bbd9-ba4ad7bbbec9 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.355762 Oct 03 14:41:08.846470 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1111/2203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:08 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:08.851772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:08.852554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:08.872123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:08.873859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:08.875982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:08.880150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:08.880684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:08.881298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:08.922826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:08.935352 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ecef9911-65a7-42f3-ab00-5b687ef469b3 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1469 microversion: 2.1 time: 0.641774 Oct 03 14:41:08.936225 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1093/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:08 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1469 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:09.325302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:09.326852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:09.338811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:09.339488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:09.340045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:09.342922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:09.348678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:09.358779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:09.359698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:09.362395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c4fe238-d8d8-4860-804d-c2d0468b3b4a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1280 microversion: 2.1 time: 0.511072 Oct 03 14:41:09.377040 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1112/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:08 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1280 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:09.530528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:09.534473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:09.562041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:09.562994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:09.563437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:09.564154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:09.564601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:09.565050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:09.629091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:09.650702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:09.655909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:09.672076 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2d67e1c7-f967-40c2-a6c3-206ce06618ff tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1512 microversion: 2.91 time: 0.349118 Oct 03 14:41:09.697324 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1094/2206] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:09 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:09.871961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:09.872889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:09.888139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:09.889176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:09.890300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:09.892664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:09.893340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:09.895514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:10.172080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:10.184730 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce261133-993f-4d28-9a3a-a13ec728d1aa tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1391 microversion: 2.1 time: 0.317377 Oct 03 14:41:10.190785 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1095/2207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:09 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1391 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:10.280564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:10.310842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be7123da-076c-45ab-a231-faa70999a6d5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.792112 Oct 03 14:41:10.313341 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1113/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:09 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:10.324533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:10.325398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:10.338504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:10.339949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:10.340561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:10.341491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:10.342089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:10.345186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:10.882934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04f55dc5-b8d1-451d-a5fd-beed05293a2e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'create', calling method: .version_select at 0x7fb234aac310>, body: {"keypair": {"name": "tempest-keypair-1182761437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInoT5rNZWr1pegTk0N91EJb6BCSRMf0SoIR4kp9eN5YW5SXwcMxK4yg0QLoK1u1V93N2ix2VsCI6QJ8kYteFYXGhN8VkwNSYJSgJsqsckkg6zl9O/BPLW4RD2sfKRNW7A=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:10.981328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-04f55dc5-b8d1-451d-a5fd-beed05293a2e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:11.016150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-04f55dc5-b8d1-451d-a5fd-beed05293a2e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for user 2cd32680b6b342ea962e104cfaf4c311 and project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:11.061612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:11.070891 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eef331df-9514-41cc-9439-dc3139973963 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1469 microversion: 2.1 time: 0.756190 Oct 03 14:41:11.071495 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1114/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:10 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1469 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:11.083421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:11.084219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:11.100583 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04f55dc5-b8d1-451d-a5fd-beed05293a2e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.908138 Oct 03 14:41:11.106210 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1096/2210] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:41:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:11.126988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:11.130723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:11.130984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.131525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.142435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.147593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.149685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.150148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.156053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.156700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.157189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.161387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.166620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.167336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.190904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:11.310056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:11.313648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:11.324583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:11.326739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:11.343166 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13886a2a-0e55-4157-98c2-ec5667cb4843 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1533 microversion: 2.91 time: 0.234499 Oct 03 14:41:11.356970 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1097/2211] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:11 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1533 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:11.358136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:11.368998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:11.378122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.378976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.379608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.380411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.380889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.386866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.417648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:11.431941 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-441aa6ec-9186-4a2f-a299-e6d96bcf927f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1286 microversion: 2.1 time: 0.358646 Oct 03 14:41:11.453556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1115/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:11 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1286 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:11.721538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-585845255", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "efa828c8-d88f-47f1-9c38-951dbcad8cf8"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:11.780022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:11.788335 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-327919ea-9004-4bd0-b37d-4d74f9e365b2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1381 microversion: 2.1 time: 0.442528 Oct 03 14:41:11.789045 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1098/2213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:11 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1381 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:11.809832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:11.810686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:11.825337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.825835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.826276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.826989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:11.827439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:11.827863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:11.837268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] validate_networks() for [('efa828c8-d88f-47f1-9c38-951dbcad8cf8', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:41:12.672138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:12.672696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:12.673018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:12.673997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:12.674562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:12.687755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:12.688748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:12.689398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:12.690309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:12.690901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:12.691775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:12.720461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Getting quotas for project a2c5cf88658642ef80bf14ff7ea0bafd. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:12.732985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Getting quotas for user fbe047904bae466791a4456e96224aca and project a2c5cf88658642ef80bf14ff7ea0bafd. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:12.752771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:12.756205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:12.769358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:12.781747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5956f4d-9c11-4213-a9af-f7582f1d6f45 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.987784 Oct 03 14:41:12.793356 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1099/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:11 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:12.811520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:12.851027 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2dda70c-6396-4f03-a6fe-364c1d26ef53 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392570 Oct 03 14:41:12.863373 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1116/2215] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:41:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:41:12.886430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27595d0f-a159-40c9-890f-dddecbae7a47 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '.version_select at 0x7fb234ccf0d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:12.890359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27595d0f-a159-40c9-890f-dddecbae7a47 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:12.891155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27595d0f-a159-40c9-890f-dddecbae7a47 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:12.891737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27595d0f-a159-40c9-890f-dddecbae7a47 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:12.909031 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27595d0f-a159-40c9-890f-dddecbae7a47 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1946 microversion: 2.1 time: 0.043884 Oct 03 14:41:12.911702 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1117/2216] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 14:41:12 2022] GET /compute/v2.1/os-migrations => generated 1946 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:12.917758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ec95ad87-5b25-4ff0-9640-64828d64476e req-c2e89318-dcc8-48ea-8cbb-2b1650f42077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3391fb69-afb2-4b6d-9e80-ff790a5efe1c", "name": "network-vif-deleted", "tag": "26c09168-e710-43fc-95bb-48db3c675f1f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:12.934621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ec95ad87-5b25-4ff0-9640-64828d64476e req-c2e89318-dcc8-48ea-8cbb-2b1650f42077 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:12.935308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ec95ad87-5b25-4ff0-9640-64828d64476e req-c2e89318-dcc8-48ea-8cbb-2b1650f42077 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:12.935885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ec95ad87-5b25-4ff0-9640-64828d64476e req-c2e89318-dcc8-48ea-8cbb-2b1650f42077 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:12.959060 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ec95ad87-5b25-4ff0-9640-64828d64476e req-c2e89318-dcc8-48ea-8cbb-2b1650f42077 service nova] Creating event network-vif-deleted:26c09168-e710-43fc-95bb-48db3c675f1f for instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c on n-h1-781139-2 Oct 03 14:41:12.966800 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ec95ad87-5b25-4ff0-9640-64828d64476e req-c2e89318-dcc8-48ea-8cbb-2b1650f42077 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053654 Oct 03 14:41:12.969952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1118/2217] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:12.980385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:12.982374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:12.993608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:12.994446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:12.995310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:12.996180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.002558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.014736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:13.078018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.078725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.079329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:13.079917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lazy-loading 'fault' on Instance uuid 3391fb69-afb2-4b6d-9e80-ff790a5efe1c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:41:13.141779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:13.144040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:13.156757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.157455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.158087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:13.159124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.159712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.160449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:13.188702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7415ca24b92d4ba193b3f6762d4196b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd764080de463c8416d98168a9ee94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:13.206342 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3af65d83-473d-4231-920b-5d407628bc37 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 200 len: 1303 microversion: 2.1 time: 0.234208 Oct 03 14:41:13.208979 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1119/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:12 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 1303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:13.226676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:13.228086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:13.243015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.244587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.245296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:13.262548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.269537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.270279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:13.482773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lazy-loading 'services' on Instance uuid 87b3c599-7ab6-4d1e-8223-0b23c1661c63 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:41:13.528796 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-144929af-e786-4ece-9ec9-4d6fb32a69b7 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1938 microversion: 2.91 time: 0.730801 Oct 03 14:41:13.532441 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1100/2219] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:12 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1938 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:13.545467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-006557b4-85c9-4d92-82fc-6d8d5d07f96b tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:13.547961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-006557b4-85c9-4d92-82fc-6d8d5d07f96b tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:13.714153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-006557b4-85c9-4d92-82fc-6d8d5d07f96b tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:13.729221 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-006557b4-85c9-4d92-82fc-6d8d5d07f96b tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1231 microversion: 2.1 time: 0.189838 Oct 03 14:41:13.747852 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1101/2220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:13 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1231 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:13.762906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:13.767897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:13.793679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.794998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.797230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:13.805958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:13.806791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:13.807382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.219983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:14.235897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3846c951-03b0-4f12-82d5-19907f99d849 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 1.021655 Oct 03 14:41:14.237283 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1120/2221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:13 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:14.246909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:14.247656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:14.264023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.265247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.265846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.266836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.267815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.269038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.512617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lazy-loading 'services' on Instance uuid 87b3c599-7ab6-4d1e-8223-0b23c1661c63 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:41:14.529507 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9f192591-afc3-490d-8ce6-f3ddbdaa8478 tempest-LiveMigrationTest-792631921 tempest-LiveMigrationTest-792631921-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1532 microversion: 2.1 time: 0.779630 Oct 03 14:41:14.532724 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1102/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:13 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1532 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:14.542082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:14.543005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:14.569086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.574345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.579343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-710c9b20-43a1-421d-a309-f274bb032379 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1938 microversion: 2.91 time: 0.340519 Oct 03 14:41:14.580431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.581422 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1121/2223] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:14 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1938 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:14.585950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.586034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.586442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.619595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:14.623044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] [instance: 3391fb69-afb2-4b6d-9e80-ff790a5efe1c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:14.643929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.645340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.647938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.650393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.652031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.652700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.708036 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] HTTP exception thrown: Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c could not be found. Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Request method failure captured: Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c HTTP/1.1 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvM2wvtpK1onicBTGP2me4fsYQTS5-ZkgKMkTcx6VO4CMWUkiN0vpFU2UrV117TlisMh_letKOAFYlIg3fAKRncL-0FeGU1ER2Aoe05rDZe5gxHiBwsBiW7DdnWEw6G-cmsMdzN-0kLy5a2j8qDZuBzDqWTjBuT7-pBFHX0Qb8dYe7c Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/adcd764080de463c8416d98168a9ee94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_adcd764080de463c8416d98168a9ee94", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/adcd764080de463c8416d98168a9ee94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-MigrationsAdminTest-968999665 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: adcd764080de463c8416d98168a9ee94 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MigrationsAdminTest-968999665 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-MigrationsAdminTest-968999665-project Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7415ca24b92d4ba193b3f6762d4196b3 Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-MigrationsAdminTest-968999665-project Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c could not be found. Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3391fb69-afb2-4b6d-9e80-ff790a5efe1c'} Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c could not be found. Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c could not be found. Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:14.712519 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:14.715653 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:14.715653 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:14.715653 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:14.715653 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:14.715653 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:14.715653 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c could not be found. Oct 03 14:41:14.715653 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:14.721629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] Returning 404 to user: Instance 3391fb69-afb2-4b6d-9e80-ff790a5efe1c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:14.722845 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74069a87-4066-48cd-b46b-f3800cfdbde4 tempest-MigrationsAdminTest-968999665 tempest-MigrationsAdminTest-968999665-project] 10.222.0.20 "GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c" status: 404 len: 111 microversion: 2.1 time: 0.140195 Oct 03 14:41:14.724157 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1122/2224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:14 2022] GET /compute/v2.1/servers/3391fb69-afb2-4b6d-9e80-ff790a5efe1c => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:41:14.748426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:14.749390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:14.764083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.765477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.766195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.767120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:14.768040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:14.769660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:14.838242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:15.039604 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4b6bd51-9e73-485c-8f92-65fad8528a3b tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 204 len: 0 microversion: 2.1 time: 0.300172 Oct 03 14:41:15.040224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1123/2225] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:14 2022] DELETE /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:15.054001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:15.056791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:15.065666 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dad8cb6d-d9fa-48e0-a6d9-08a57e569526 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.527400 Oct 03 14:41:15.066238 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1103/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:14 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:15.068522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.069059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.069742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.070484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.070982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.071450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.076273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:15.080399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:15.097172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.097914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.098494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.099401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.100006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.100565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.156313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c44161c7-3544-411f-93c5-65350822377d tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.109204 Oct 03 14:41:15.166969 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1124/2227] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 3 14:41:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:41:15.173031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:15.173774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:15.200481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.201015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.201459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.202192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.202650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.208973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.329164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:15.346237 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ccc9552-0229-4ef8-86bb-f3f95fc75fc9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1283 microversion: 2.1 time: 0.278683 Oct 03 14:41:15.346856 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1104/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:15 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1283 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:15.359419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:15.369839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:15.392607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.396251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.396901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.398970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.404536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.405191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.483030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lazy-loading 'flavor' on Instance uuid 87b3c599-7ab6-4d1e-8223-0b23c1661c63 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:41:15.689121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:15.697877 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dc3b017-49ef-4309-ad76-f0b3ac3ffd61 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1387 microversion: 2.1 time: 0.529658 Oct 03 14:41:15.698704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1125/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:15 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1387 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:15.703769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:15.704479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:15.713153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.714087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.715010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.716009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:15.716651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:15.717290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:15.975639 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d1ca47b-2e16-4933-87fa-d0e75be69d09 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action" status: 202 len: 0 microversion: 2.91 time: 0.622880 Oct 03 14:41:15.982799 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1105/2230] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:41:15 2022] POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:16.001195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5d710d62-e1b9-4cb5-92b9-57360107a5c6 req-68849576-b4de-408c-81b5-1f3ada620b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d582c80c-2b40-485c-bf9b-df042789ad88", "tag": "d2289cac-60ba-46b7-ad62-c7fa9d32bf05"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:16.031468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:16.038760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d710d62-e1b9-4cb5-92b9-57360107a5c6 req-68849576-b4de-408c-81b5-1f3ada620b80 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.039254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d710d62-e1b9-4cb5-92b9-57360107a5c6 req-68849576-b4de-408c-81b5-1f3ada620b80 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.039690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d710d62-e1b9-4cb5-92b9-57360107a5c6 req-68849576-b4de-408c-81b5-1f3ada620b80 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.080973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5d710d62-e1b9-4cb5-92b9-57360107a5c6 req-68849576-b4de-408c-81b5-1f3ada620b80 service nova] Creating event network-changed:d2289cac-60ba-46b7-ad62-c7fa9d32bf05 for instance d582c80c-2b40-485c-bf9b-df042789ad88 on n-h2-781139-2 Oct 03 14:41:16.099250 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5d710d62-e1b9-4cb5-92b9-57360107a5c6 req-68849576-b4de-408c-81b5-1f3ada620b80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111443 Oct 03 14:41:16.100456 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1106/2231] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:16.107642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:16.108354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:16.117294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.117796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.118243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.118998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.119457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.119870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.371064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:16.386091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a94ca9d2-e468-46d8-a97d-7c7f75e29097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 0.686246 Oct 03 14:41:16.386863 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1126/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:15 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:16.399549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:16.401840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:16.417706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.418357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.418926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.419797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.422147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.422758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.454484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:16.472292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:16.477106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:16.492746 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c4605f56-6ad2-41ae-b465-a608ae68a353 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.390855 Oct 03 14:41:16.494129 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1107/2233] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:16 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:16.500693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:16.507859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:16.521896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.522801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.523399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.524887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.525707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.526279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.620514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:16.638491 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7192947d-b2c6-4150-aa84-f2fc21d820bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1289 microversion: 2.1 time: 0.140791 Oct 03 14:41:16.639497 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1108/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:16 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1289 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:16.723568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:16.724517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:16.747700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.748417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.754040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:16.758080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:16.758811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:16.761244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:17.117162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:17.133275 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-620afc3f-3480-4f18-b5f5-8c5088ab564d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1387 microversion: 2.1 time: 0.413301 Oct 03 14:41:17.145327 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1109/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:16 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1387 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:17.410040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:17.410672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:17.421919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:17.425989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:17.447022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:17.448191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:17.457662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:17.471130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:17.711397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:17.720785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1336b773-edd5-46ed-8e00-5980dc429607 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 0.314531 Oct 03 14:41:17.726313 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1110/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:17 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:17.738963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:17.739583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:17.746878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:17.748239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:17.749073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:17.750299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:17.750917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:17.751346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:17.811610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:17.833362 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2aa2e18-bd00-4b75-bd0d-cd9872a669e5 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 1.440812 Oct 03 14:41:17.835312 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1127/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:16 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:17.835694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:17.845653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:17.847649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:17.854805 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-979f641c-d538-41c4-976c-45f160c8c28c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.127200 Oct 03 14:41:17.860185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-287291148", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85fcbfd3-3026-41ec-a964-76a31555f33f"}], "security_groups": [{"name": "tempest-securitygroup--46337030"}], "key_name": "tempest-keypair-1182761437", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:17.871325 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1111/2238] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:17 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:17.876661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:17.877499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:17.886555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:17.889224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:17.889976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:17.891003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:17.891849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:17.892528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:17.971797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:17.996323 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ad96aec4-0840-48ef-a64c-e282f8fb48d9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1289 microversion: 2.1 time: 0.123374 Oct 03 14:41:17.997315 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1112/2239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:17 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:18.162283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:18.163869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:18.171574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:18.193344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:18.194090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:18.194966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:18.195471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:18.195870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:18.229556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] validate_networks() for [('85fcbfd3-3026-41ec-a964-76a31555f33f', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:41:18.361545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:18.365830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:18.379880 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-941b32e7-c224-472c-a533-972ef5562a4d tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1345 microversion: 2.1 time: 0.223920 Oct 03 14:41:18.380532 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1113/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:18 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:18.749152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:18.750085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:18.778682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:18.781694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:18.783602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:18.785410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:18.786964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:18.789524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.153743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:19.172524 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f925da23-8952-46ba-8efa-917a6001a274 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 0.432508 Oct 03 14:41:19.177354 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1114/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:18 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:19.193073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:19.198493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:19.233602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.237415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.243337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.244407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.249203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.250369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.581675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:19.597593 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed826279-52a5-4509-89b9-5cfd0f12858b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.418314 Oct 03 14:41:19.604127 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1115/2242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:19 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:19.614770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:19.615502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:19.630760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.631256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.631693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.632466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.632952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.633371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.745808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:19.754563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:19.760306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:19.779008 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4d6d315-d9ae-462e-879f-a23f5650a0c0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.173582 Oct 03 14:41:19.780743 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1116/2243] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:19 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:19.786845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ca2d3b03-9abe-450f-a5ce-d2742bcbebdb req-cf7c793e-6eb7-4277-abbf-3f0637b60b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a669cbe-531f-4300-a7dd-e014baf44bf3", "name": "network-vif-deleted", "tag": "0f57491e-aa97-4ff7-a32d-cd0ed03cd108"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:19.802820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ca2d3b03-9abe-450f-a5ce-d2742bcbebdb req-cf7c793e-6eb7-4277-abbf-3f0637b60b2b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.807717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ca2d3b03-9abe-450f-a5ce-d2742bcbebdb req-cf7c793e-6eb7-4277-abbf-3f0637b60b2b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.808419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ca2d3b03-9abe-450f-a5ce-d2742bcbebdb req-cf7c793e-6eb7-4277-abbf-3f0637b60b2b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.822696 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ca2d3b03-9abe-450f-a5ce-d2742bcbebdb req-cf7c793e-6eb7-4277-abbf-3f0637b60b2b service nova] Creating event network-vif-deleted:0f57491e-aa97-4ff7-a32d-cd0ed03cd108 for instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 on n-h2-781139-2 Oct 03 14:41:19.828022 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ca2d3b03-9abe-450f-a5ce-d2742bcbebdb req-cf7c793e-6eb7-4277-abbf-3f0637b60b2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045892 Oct 03 14:41:19.828688 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1117/2244] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:19.836585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:19.837227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:19.844637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.845156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.845602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.846300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.846744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.847161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.955432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:19.956489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:19.957166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:19.957823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:19.958446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:19.975607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.981365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.984852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:19.986027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:19.987546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:19.988198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.031238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:20.041426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for user 2cd32680b6b342ea962e104cfaf4c311 and project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:20.069781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:20.079369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:20.165606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:20.193164 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46ade4c8-95bd-4660-afaa-7517716564bb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.361126 Oct 03 14:41:20.196729 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1118/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:19 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:20.203017 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8466ebd5-c1b0-4a50-a507-858a4757b390 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.362635 Oct 03 14:41:20.211353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:20.212216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:20.215868 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1128/2246] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:41:17 2022] POST /compute/v2.1/servers => generated 407 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:41:20.226957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:20.227509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:20.245207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.245708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.245812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.246149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.246251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.246692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.247405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.247508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.247859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.248284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.248383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.248733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.334817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:20.346208 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-96d13f9a-736f-4755-9014-941419cc7055 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1183 microversion: 2.1 time: 0.146930 Oct 03 14:41:20.347298 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1119/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:20 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:20.352901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51353e01-3319-4e66-8abd-f1e27eabdb1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:20.353547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51353e01-3319-4e66-8abd-f1e27eabdb1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:20.431287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-51353e01-3319-4e66-8abd-f1e27eabdb1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:20.439131 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51353e01-3319-4e66-8abd-f1e27eabdb1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1238 microversion: 2.1 time: 0.090995 Oct 03 14:41:20.439922 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1120/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:20 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:20.658040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:20.669700 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65039422-dab9-4b7a-b77d-6cc05c6e78eb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 0.452647 Oct 03 14:41:20.674062 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1129/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:20 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:20.681984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:20.684142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:20.695628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.696120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.696551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.699368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.700991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.701945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.814162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1124215462", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": "none"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:20.878199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:20.878629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:20.880638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:20.881085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:20.881928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:20.893866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.894674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.895305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.896234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:20.896885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:20.897625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:20.918489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Getting quotas for project ada472e0e1ef45fb8affb8928b1866b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:20.925882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Getting quotas for user 9aa1e5606e124a08a017dd6da74b6477 and project ada472e0e1ef45fb8affb8928b1866b4. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:20.941784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:20.944705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:21.045178 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0f383dd-4501-4e7c-818c-17149b576644 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.459246 Oct 03 14:41:21.061404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1121/2250] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 03 14:41:21.066783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:21.078168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:21.085184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:21.087454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.088105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.088694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:21.089701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.091581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.092201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:21.241754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.246435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.256403 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-421ce020-54ea-4341-8994-a5a78ac83f47 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.581143 Oct 03 14:41:21.262638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.270669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.275131 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1130/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:20 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:21.288312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b5f00d8-9257-483e-a6bc-35408a452a31 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:21.291557 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a75f1949-d999-4c12-88a8-3437e48342da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.228582 Oct 03 14:41:21.292159 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1122/2252] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:21 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:21.295522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b5f00d8-9257-483e-a6bc-35408a452a31 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:21.313315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:21.318765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:21.333860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.334347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.335141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:21.335566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.337112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.337699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:21.527540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b5f00d8-9257-483e-a6bc-35408a452a31 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.539222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b5f00d8-9257-483e-a6bc-35408a452a31 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.545804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b5f00d8-9257-483e-a6bc-35408a452a31 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.578359 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b5f00d8-9257-483e-a6bc-35408a452a31 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "PUT /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1359 microversion: 2.75 time: 0.301324 Oct 03 14:41:21.612658 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1131/2253] 10.222.0.20 () {62 vars in 1297 bytes} [Mon Oct 3 14:41:21 2022] PUT /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1359 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:21.620666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:21.623194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:21.638599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.639524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.640601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:21.643777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.657737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.661224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:21.873999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:21.893217 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7da6a786-534f-46a6-b299-94fc3d20ff95 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1183 microversion: 2.1 time: 0.273098 Oct 03 14:41:21.894825 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1132/2254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:21 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:21.907343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:21.909535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:21.931503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.934804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.937475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:21.941171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:21.941808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:21.943829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.170477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.179766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-223ec56a-02da-445c-9281-48e501a496a3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.879398 Oct 03 14:41:22.180379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1123/2255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:21 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:22.197474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:22.198444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:22.213619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.214518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.216502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.216773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.217799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.223840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.224731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.240132 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fc41e8f-bd70-46b6-aa37-1355a3bd9d74 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1290 microversion: 2.1 time: 0.342698 Oct 03 14:41:22.244628 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1133/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:21 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1290 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:22.263057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:22.264823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:22.285855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.289596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.291639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.293938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.297675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.298506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.523487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.528224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:22.532621 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7aa691f-c550-47f1-a331-792a1f31991a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 0.286363 Oct 03 14:41:22.534649 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1134/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:22 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:22.542432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-494d439b-2fa6-4622-8585-54e06149bb61 req-08a0a5a8-9fa5-4bc7-a7f8-3c6961cd2964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8036f959-01b9-4758-bb2c-033b73318347", "tag": "5d50b1dc-274e-4868-b6b8-fcdbf42dc578"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:22.554929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-494d439b-2fa6-4622-8585-54e06149bb61 req-08a0a5a8-9fa5-4bc7-a7f8-3c6961cd2964 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.556419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-494d439b-2fa6-4622-8585-54e06149bb61 req-08a0a5a8-9fa5-4bc7-a7f8-3c6961cd2964 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.556716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-494d439b-2fa6-4622-8585-54e06149bb61 req-08a0a5a8-9fa5-4bc7-a7f8-3c6961cd2964 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.562796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.573372 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-494d439b-2fa6-4622-8585-54e06149bb61 req-08a0a5a8-9fa5-4bc7-a7f8-3c6961cd2964 service nova] Creating event network-changed:5d50b1dc-274e-4868-b6b8-fcdbf42dc578 for instance 8036f959-01b9-4758-bb2c-033b73318347 on n-h1-781139-2 Oct 03 14:41:22.578291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.579420 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-494d439b-2fa6-4622-8585-54e06149bb61 req-08a0a5a8-9fa5-4bc7-a7f8-3c6961cd2964 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043340 Oct 03 14:41:22.579828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.580101 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1135/2258] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:22.590707 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-18aa8e9d-484f-4d48-9375-1a295dcea4f3 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1363 microversion: 2.75 time: 0.405971 Oct 03 14:41:22.591083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:22.593136 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1124/2259] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:22 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:22.597784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:22.604583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:22.605673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:22.606432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.607016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.607798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.618687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.620483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.621489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.621605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.622216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.622850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.634066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.635186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.635829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.750373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.760252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.770957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.778145 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-405722a4-96a3-4edd-9019-6151eebce35e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.183899 Oct 03 14:41:22.780013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1125/2260] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:22 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:22.834226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:22.843319 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13933a4c-655b-4c32-85df-a91b82502077 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.259001 Oct 03 14:41:22.853209 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1136/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:22 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:22.925543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:22.927336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:22.938919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.940034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.940644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:22.943551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:22.946009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:22.946914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.061606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:23.074715 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4457f972-87b7-40db-baef-36eb1e9aeb01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1183 microversion: 2.1 time: 0.156800 Oct 03 14:41:23.090471 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1126/2262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:22 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:23.211885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:23.212515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:23.219187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.219675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.220111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.220840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.221506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.221931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.267784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:23.268417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:23.283808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.286114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.290208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.291197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.291863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.292594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.412218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:23.422900 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-140b425f-4c58-428c-a086-3381c9ce8484 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.219678 Oct 03 14:41:23.436192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:23.437931 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1137/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:23 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:23.445308 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-64c171b4-d16f-4a1a-b52c-a2d96f9341c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1308 microversion: 2.1 time: 0.181442 Oct 03 14:41:23.445910 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1127/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:23 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:23.562850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:23.563470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:23.572335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.573248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.573493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.574328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.574783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.575203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.618243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:23.618770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:23.629813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.630304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.630748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.636975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.637445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.637892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.802212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:23.821610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:23.824495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:23.845333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:23.875961 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58ee829c-7e13-42f8-8a0c-412ae63989f0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1355 microversion: 2.75 time: 0.261969 Oct 03 14:41:23.878469 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1128/2265] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:23 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1355 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:41:23.883850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:23.884468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:23.899720 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9ddaf3e-034f-4a65-a04e-eb4d3dd8df49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 0.338368 Oct 03 14:41:23.901255 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1138/2266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:23 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:23.907217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.907742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.909919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.909919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.909919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.909919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.928880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:23.929898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:23.938505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.939474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.940108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:23.941739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:23.942421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:23.943057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.109837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:24.122270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:24.123980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:24.150236 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a0df6a0-8a91-4054-a059-44d9253c3149 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.270592 Oct 03 14:41:24.166339 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1129/2267] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:23 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:24.179940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-28ee213f-98d0-4c4d-bb40-9256ce8a4b15 req-0da3d83a-a32a-4dd9-865b-ef004c85b1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d582c80c-2b40-485c-bf9b-df042789ad88", "name": "network-vif-plugged", "status": "completed", "tag": "d2289cac-60ba-46b7-ad62-c7fa9d32bf05"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:24.186791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:24.192114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28ee213f-98d0-4c4d-bb40-9256ce8a4b15 req-0da3d83a-a32a-4dd9-865b-ef004c85b1e9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.197004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28ee213f-98d0-4c4d-bb40-9256ce8a4b15 req-0da3d83a-a32a-4dd9-865b-ef004c85b1e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.197685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28ee213f-98d0-4c4d-bb40-9256ce8a4b15 req-0da3d83a-a32a-4dd9-865b-ef004c85b1e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.215622 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-28ee213f-98d0-4c4d-bb40-9256ce8a4b15 req-0da3d83a-a32a-4dd9-865b-ef004c85b1e9 service nova] Creating event network-vif-plugged:d2289cac-60ba-46b7-ad62-c7fa9d32bf05 for instance d582c80c-2b40-485c-bf9b-df042789ad88 on n-h2-781139-2 Oct 03 14:41:24.223196 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-28ee213f-98d0-4c4d-bb40-9256ce8a4b15 req-0da3d83a-a32a-4dd9-865b-ef004c85b1e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054551 Oct 03 14:41:24.224436 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ef02591-fc14-48e1-ac10-c304e1151262 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.297317 Oct 03 14:41:24.224652 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1130/2268] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:24.225232 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1139/2269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:23 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:24.236322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:24.251125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:24.258305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.258815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.259290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.260355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.261093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.261536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.402779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:24.412773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f34c1a7-e84d-4de0-bc87-090e7b5f5314 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1183 microversion: 2.1 time: 0.186304 Oct 03 14:41:24.415995 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1131/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:24 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:24.449240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:24.450121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:24.460825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.467667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:24.468295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:24.472104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.472583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.475343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.475468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.475880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.476428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.476553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.477300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.478240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.478925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.479555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.609558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:24.619680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5891d1e-a770-47e4-97de-be085329db24 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1308 microversion: 2.1 time: 0.155864 Oct 03 14:41:24.621421 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1132/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:24 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:24.732467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:24.755589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9eea8bdc-f401-432a-815c-1dc419195ba1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.310766 Oct 03 14:41:24.764412 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1140/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:24 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:24.906705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:24.907561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:24.914352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.915090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.915711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.917660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.918607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.919703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.928017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:24.928698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:24.936761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.937296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.937728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.938435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:24.938885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:24.945327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:24.952347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:25.078241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:25.092436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:25.097026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:25.115605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9abb6575-60f8-4747-9822-8712c8fba4c8 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1411 microversion: 2.75 time: 0.213048 Oct 03 14:41:25.118283 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1133/2273] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:24 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1411 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:25.184828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:25.185473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:25.192788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:25.193335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:25.194087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:25.194502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:25.194953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:25.195443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:25.366999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:25.385960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:25.396530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:25.415712 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d0633925-2894-4875-9a08-82143e768583 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.234911 Oct 03 14:41:25.416836 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1134/2274] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:25 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:41:25.431537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:25.432469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:25.449655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:25.450454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:25.452291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:25.454437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:25.456545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:25.458124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:25.943006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:25.956061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa5d8cf3-1986-4927-a0cc-66a98f94b806 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1328 microversion: 2.1 time: 1.031867 Oct 03 14:41:25.957541 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1141/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:24 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1328 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:25.979700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:25.980319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:26.001253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.001770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.002248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.006741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.007571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.008020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.198326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.208250 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46f235cd-e009-4038-a0bb-ffd0caef3df6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 200 len: 1183 microversion: 2.1 time: 0.248320 Oct 03 14:41:26.209647 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1142/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:25 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 1183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:26.221007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:26.223330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:26.233207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.234375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.235054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.235634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.236498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.237343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.237910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.248052 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ca45d55-1245-4c9a-b571-4496fe94b83b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.826436 Oct 03 14:41:26.265090 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1135/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:25 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:26.285582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:26.286431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:26.295701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.296556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.297445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.298359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.299121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.300092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.548569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.558988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-318b4d01-f70f-4623-882f-187f71747508 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.345300 Oct 03 14:41:26.575480 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1143/2278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:26 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:26.578808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:26.579540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:26.588280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.589332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.589965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.591029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.591857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.592425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.769091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.781675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.783205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.792052 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8d11bc8-4509-433c-b15d-9cf15ffbed36 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1417 microversion: 2.75 time: 0.227324 Oct 03 14:41:26.792654 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1144/2279] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:26 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1417 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:26.809881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:26.811040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:26.818920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.819503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.820069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.820512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.821357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.822008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.822615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.829807 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ccabaccf-454b-4925-94b5-d51dd7e50b31 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.562409 Oct 03 14:41:26.834904 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1136/2280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:26 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:26.903904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.917629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.919466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:26.926025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0eae8fd-750e-4cdf-904a-8ce6ec09ba65 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.132285 Oct 03 14:41:26.927304 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1145/2281] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:26 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:26.982908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:26.983833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:26.992572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:26.993809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:26.994413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:26.995336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.013593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.014385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.238971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:27.240264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1a669cbe-531f-4300-a7dd-e014baf44bf3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:27.249170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:27.254922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.255851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.271908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.280540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.281616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.282635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.312331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:27.323318 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] HTTP exception thrown: Instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 could not be found. Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Request method failure captured: Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 HTTP/1.1 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLWBvVnEYhE7u51-fQ-BP93v4spM_D35t9m0c1S06m6ufh-svH7Qm8Rr1BZMm2Z3D2eZQbWLTgG5uQd4n_qOU2EHK8d_qJ8Gi4_lqMD49XZvI-QdeP4MhSwtN5w687imIYwawORhOUWU706j_DdzDyYAxdxivjKI9OJ5Kgz10B-4Tw Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/387637769447441dbf4d5df340ddecce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_387637769447441dbf4d5df340ddecce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-LiveMigrationTest-39744637 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: a91d62c6a8f04094b64c79e338b1dc49 Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 could not be found. Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a669cbe-531f-4300-a7dd-e014baf44bf3'} Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 could not be found. Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 could not be found. Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:27.324660 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 could not be found. Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Returning 404 to user: Instance 1a669cbe-531f-4300-a7dd-e014baf44bf3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b556bc83-d4c6-4c4c-a7d4-0ae99e213af4 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3" status: 404 len: 111 microversion: 2.1 time: 0.094497 Oct 03 14:41:27.333759 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1146/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:27 2022] GET /compute/v2.1/servers/1a669cbe-531f-4300-a7dd-e014baf44bf3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:41:27.336412 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f65e9349-88f1-4474-bea0-21571a7ce59f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1509 microversion: 2.1 time: 0.351473 Oct 03 14:41:27.337994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:27.338617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:27.345006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.345496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.346893 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1137/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:26 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:27.351286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.356357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.356877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.357366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.362936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:27.363569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:27.377254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.377753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.382902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.383703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.388869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.389798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.670519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:27.683756 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-011f0019-b4a2-46be-81a9-97f778dd1aa3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.353549 Oct 03 14:41:27.684164 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1147/2284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:27 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:27.688741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:27.689383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:27.716714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.717244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.717684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.718407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.718863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.719293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.886317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:27.905421 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ad99d5d3-6c73-4738-ad68-c8b9ebc48553 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1509 microversion: 2.1 time: 0.543832 Oct 03 14:41:27.907592 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1138/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:27 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1509 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:27.922354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:27.923670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:27.946215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.947092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.947837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:27.949017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:27.949632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:27.950501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.099655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.109141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.118399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.136599 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4adc8402-0dae-4025-b36e-b5990f8c29f1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1417 microversion: 2.75 time: 0.223519 Oct 03 14:41:28.138673 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1139/2286] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:27 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1417 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:28.151060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:28.154466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:28.168956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.171966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.173660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.176235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.178798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.179797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.248157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.260868 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d40bf28-6b4c-4653-a5fd-024d748c1f8b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.571928 Oct 03 14:41:28.274261 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1148/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:27 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:28.283889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:28.284571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:28.291986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.292689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.293352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.294368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.295051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.295775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.351767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:28.538648 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bf43eec-6f55-44f8-a8f0-b5ff0ba3b27e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 204 len: 0 microversion: 2.1 time: 0.262791 Oct 03 14:41:28.539697 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1149/2288] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:28 2022] DELETE /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:28.548766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:28.549700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:28.564006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.564689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.565313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.566605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.567180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.568356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.609599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.618925 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7616a820-ffb6-442d-bdc5-cf6c34a4abce tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.477929 Oct 03 14:41:28.624413 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1140/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:28 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:28.635965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5d77bbc7-7868-4074-956d-6c74ee188890 req-a97d2d33-a8bf-48a9-a752-6fd9ac8d97b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8036f959-01b9-4758-bb2c-033b73318347", "name": "network-vif-plugged", "status": "completed", "tag": "5d50b1dc-274e-4868-b6b8-fcdbf42dc578"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:28.662253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d77bbc7-7868-4074-956d-6c74ee188890 req-a97d2d33-a8bf-48a9-a752-6fd9ac8d97b7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.663421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d77bbc7-7868-4074-956d-6c74ee188890 req-a97d2d33-a8bf-48a9-a752-6fd9ac8d97b7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.664238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d77bbc7-7868-4074-956d-6c74ee188890 req-a97d2d33-a8bf-48a9-a752-6fd9ac8d97b7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.680466 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5d77bbc7-7868-4074-956d-6c74ee188890 req-a97d2d33-a8bf-48a9-a752-6fd9ac8d97b7 service nova] Creating event network-vif-plugged:5d50b1dc-274e-4868-b6b8-fcdbf42dc578 for instance 8036f959-01b9-4758-bb2c-033b73318347 on n-h1-781139-2 Oct 03 14:41:28.687682 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5d77bbc7-7868-4074-956d-6c74ee188890 req-a97d2d33-a8bf-48a9-a752-6fd9ac8d97b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059997 Oct 03 14:41:28.689021 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1141/2290] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:28.697166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-48484782-0d0e-4af9-ba63-98e08449141b req-bac87928-3ab8-4bb4-9e27-eb9389a42fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:28.710838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-48484782-0d0e-4af9-ba63-98e08449141b req-bac87928-3ab8-4bb4-9e27-eb9389a42fc7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.711694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-48484782-0d0e-4af9-ba63-98e08449141b req-bac87928-3ab8-4bb4-9e27-eb9389a42fc7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.712604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-48484782-0d0e-4af9-ba63-98e08449141b req-bac87928-3ab8-4bb4-9e27-eb9389a42fc7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.727077 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-48484782-0d0e-4af9-ba63-98e08449141b req-bac87928-3ab8-4bb4-9e27-eb9389a42fc7 service nova] Creating event network-changed:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:41:28.733521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-48484782-0d0e-4af9-ba63-98e08449141b req-bac87928-3ab8-4bb4-9e27-eb9389a42fc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042431 Oct 03 14:41:28.734839 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1142/2291] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:28.745524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:28.746766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:28.755258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.756105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.758034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.759455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.760494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.761165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.798753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.818813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.826071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:28.842576 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48ec4c44-7d4f-4faa-a5dd-6f702238bcb2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.301395 Oct 03 14:41:28.846210 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1150/2292] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:28 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:28.855566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:28.856206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:28.876102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.876669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.877163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.883019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:28.883773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:28.885431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:28.966955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:29.040212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:29.054031 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f56a1577-f5a2-4082-8185-2a3df7c68bb4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1515 microversion: 2.1 time: 0.316193 Oct 03 14:41:29.068539 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1143/2293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:28 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:29.171629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:29.172270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:29.182670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.183181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.185525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:29.186296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.188215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.188675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:29.325919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:29.342231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf967172-ee59-495a-a506-ea54a82ae025 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.494642 Oct 03 14:41:29.342848 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1151/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:28 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:29.356575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:29.357268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:29.370507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.373106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.373651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:29.374421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.374885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.375315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:29.381514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:29.395583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:29.400812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:29.415819 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-662d32af-446d-4919-85c0-de1d00c97155 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1417 microversion: 2.75 time: 0.248477 Oct 03 14:41:29.417187 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1144/2295] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:29 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1417 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:41:29.645464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:29.647136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:29.654207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.655223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.655879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:29.656822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.658083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.658722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:29.772246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:29.780299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-473e7bff-1ae8-4008-beab-8af6d73d630e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.436370 Oct 03 14:41:29.784634 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1152/2296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:29 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:29.879225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:29.879847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:29.893537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.894051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.894499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:29.895240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:29.895697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:29.896130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.005056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:30.090620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:30.108946 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ef51b8f-7b87-4fee-b585-cfbb1ef93191 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.470455 Oct 03 14:41:30.109556 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1145/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:29 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:30.127537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:30.128176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:30.146362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:30.160306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.162107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:30.162961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.163707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.164126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:30.166601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.175974 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60b4a607-7024-4e34-9c59-cb9755dfeec7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.300637 Oct 03 14:41:30.176182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.181574 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1153/2298] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:29 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:30.205950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.371259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:30.371884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:30.393691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.394207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.394643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.395372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.395821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.396243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.591096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:30.611189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-23b6c60b-2f8f-453d-8d22-68f1dc982062 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1515 microversion: 2.1 time: 0.500470 Oct 03 14:41:30.613723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1146/2299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:30 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1515 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:30.629442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:30.630422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:30.645141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.645969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.649400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.655071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.657527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.657992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.744196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:30.762212 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b94ca9b8-a12b-4d76-9303-d603f7362cda tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1516 microversion: 2.1 time: 0.394882 Oct 03 14:41:30.763224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1154/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:30 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1516 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:30.821436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:30.829368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:30.856404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.856941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.866585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.874836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:30.877436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:30.879769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:30.907435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:30.936108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=26 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:31.096666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.126144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.128865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.137839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6afd0dd-a8b0-4e74-aae7-c48a1177100a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1417 microversion: 2.75 time: 0.522633 Oct 03 14:41:31.139049 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1147/2301] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:30 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1417 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:31.150228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:31.151680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:31.160648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.161468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.162117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.163273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.163896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.164554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.419260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.455380 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4cd60417-ebc0-4076-929f-58bf2d91fa86 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.649894 Oct 03 14:41:31.457207 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1155/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:30 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:41:31.469524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:31.471345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:31.491621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.492202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.492705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.494343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.494838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.495349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.535619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.550869 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1fb29385-13e7-4443-a3ec-0db2d2c674bf tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1331 microversion: 2.1 time: 0.401094 Oct 03 14:41:31.553925 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1148/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:31 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1331 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:31.590905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=22 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:31.609960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-86a9f5e0-9ef5-473b-a0b3-0bab117f2a21 req-29f7237f-2431-4e22-ac3d-ad9dbb777c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d582c80c-2b40-485c-bf9b-df042789ad88", "name": "network-vif-deleted", "tag": "d2289cac-60ba-46b7-ad62-c7fa9d32bf05"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:31.627940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86a9f5e0-9ef5-473b-a0b3-0bab117f2a21 req-29f7237f-2431-4e22-ac3d-ad9dbb777c03 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.628459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86a9f5e0-9ef5-473b-a0b3-0bab117f2a21 req-29f7237f-2431-4e22-ac3d-ad9dbb777c03 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.628880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86a9f5e0-9ef5-473b-a0b3-0bab117f2a21 req-29f7237f-2431-4e22-ac3d-ad9dbb777c03 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.669658 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-86a9f5e0-9ef5-473b-a0b3-0bab117f2a21 req-29f7237f-2431-4e22-ac3d-ad9dbb777c03 service nova] Creating event network-vif-deleted:d2289cac-60ba-46b7-ad62-c7fa9d32bf05 for instance d582c80c-2b40-485c-bf9b-df042789ad88 on n-h2-781139-2 Oct 03 14:41:31.688807 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-86a9f5e0-9ef5-473b-a0b3-0bab117f2a21 req-29f7237f-2431-4e22-ac3d-ad9dbb777c03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082433 Oct 03 14:41:31.700465 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1149/2304] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:41:31.706171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:31.721007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:31.751851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.758726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.760040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.760763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.761684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.765583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.766268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.777456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.799284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:31.823574 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3512b20-8be4-4aad-9781-8d30be103821 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.363571 Oct 03 14:41:31.863053 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1156/2305] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:31 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:31.886220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:31.889673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:31.905239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.906358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.907092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.907980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.908567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.909412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.936480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:31.937090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:31.937972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:31.938591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lazy-loading 'fault' on Instance uuid d582c80c-2b40-485c-bf9b-df042789ad88 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:41:32.162384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.177731 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fc76aae4-ab1d-43ba-ab92-eb49a76cfa0c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 200 len: 1318 microversion: 2.1 time: 0.475808 Oct 03 14:41:32.178549 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1150/2306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:31 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:32.183909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:32.186788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:32.193223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.194324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.195088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.196204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.196803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.197570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.295132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.295887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.300229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:32.306503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.308346 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca0bafab-6a81-4421-a1be-5d00469dd802 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1534 microversion: 2.1 time: 0.440009 Oct 03 14:41:32.308696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.320952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1157/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:31 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1534 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:32.327363 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33adce4f-893c-4df7-83c2-a9554b702082 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1438 microversion: 2.75 time: 0.147327 Oct 03 14:41:32.328161 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1151/2308] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:32 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1438 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:32.360718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:32.364889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:32.372695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.373008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.373304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.374015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.375313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.375313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.485113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:32.486335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:32.490148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:32.490749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:32.491520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:32.492041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:32.497133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:32.514717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.516267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.516908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.521038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.524042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.524652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.649731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:32.661773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.663664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.669503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.670550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.671225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.672083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.930062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.943542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.945657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:32.954797 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdf729c9-5bae-44e0-8c57-c9921689ab8d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "POST /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a/action" status: 202 len: 1495 microversion: 2.75 time: 0.598389 Oct 03 14:41:32.959654 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1158/2309] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:41:32 2022] POST /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a/action => generated 1495 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 03 14:41:32.967043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:32.967980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:32.974789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.975682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.976318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:32.977277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:32.977984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:32.978603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.458790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.467495 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dfc2e78-700c-410c-bade-57ac15f57412 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1535 microversion: 2.1 time: 0.506190 Oct 03 14:41:33.490479 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1159/2310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:32 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1535 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:33.500449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:33.501588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:33.509541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.510894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.511693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.512631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.513324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.513948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.573132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.581482 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cec2682d-8f9b-4ab0-a068-12562f216c12 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 1.105237 Oct 03 14:41:33.583906 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1152/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:32 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:33.589202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:33.590200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:33.619864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.620784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.621502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.622428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.623117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.623773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.668198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.696894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.703640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.716831 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f252a6a4-f21b-4c0a-b765-558629a45975 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.224932 Oct 03 14:41:33.728966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1160/2312] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:33 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:33.733163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:33.735244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:33.746370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.757267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.767564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.768055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.768491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.769227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.769684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.770101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.772908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:33.779701 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b224e782-f08e-4ad0-b219-d365769e6dff tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.194337 Oct 03 14:41:33.780231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1153/2313] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:33 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:33.797979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:33.797979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:33.806040 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:41:33.806447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.807102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.809447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.810326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 HTTP/1.1 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd582c80c-2b40-485c-bf9b-df042789ad88'} Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:33.810502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:33.813947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:33.813947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:33.813947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:33.813947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:33.813947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:33.813947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:41:33.813947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:33.815123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:33.816003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:33.816617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:33.817752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89fe12df-eac1-44d5-90c3-cce6231235dd tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 404 len: 111 microversion: 2.1 time: 0.095887 Oct 03 14:41:33.820274 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1161/2314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:33 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:41:33.828707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a363a3f-ea27-4455-938d-3d8c2cc96bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'create', calling method: .version_select at 0x7fb2301c7f70>, body: {"pool": "69d37d98-1d3b-4dad-8cee-9d78aa7b9aee"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:34.053690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:34.062868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-97e7826e-23f1-4e83-a229-c21185de1f01 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1522 microversion: 2.1 time: 0.281490 Oct 03 14:41:34.064032 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1154/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:33 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:34.069476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a5056255-fb81-4c0a-80a4-84e84d1b0e20 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '.version_select at 0x7fb230c650d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:34.102228 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a5056255-fb81-4c0a-80a4-84e84d1b0e20 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-1325626539" status: 202 len: 0 microversion: 2.1 time: 0.036525 Oct 03 14:41:34.121916 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1155/2316] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Oct 3 14:41:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1325626539 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:41:34.216591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:34.221262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:34.241532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:34.242035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:34.242481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:34.254797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:34.255448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:34.255907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:34.363414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:34.512169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:34.521101 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb398403-5ff3-4809-95e7-7b5f5d649d10 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 204 len: 0 microversion: 2.1 time: 0.316680 Oct 03 14:41:34.522114 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1156/2317] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:34 2022] DELETE /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:34.529123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-968685523", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "becfb12c-e5af-4560-80c3-4794784e4ae3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:34.587276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:41:35.170398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:35.170818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:35.171300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:35.171710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:35.172121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:35.188173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:35.189530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:35.190858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:35.191758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:35.192437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:35.193210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:35.215901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:35.226535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:35.244311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:35.247290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:35.323157 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-263d25b5-2f05-4777-8a23-4fb28fc851e7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799643 Oct 03 14:41:35.324696 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1157/2318] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:41:35.329816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:35.330326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:35.339778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:35.348786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:35.349638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:35.350890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:35.351788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:35.352437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:35.819989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:35.830822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54349070-0f56-4150-95c2-203ea1f5f68c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1665 microversion: 2.1 time: 0.504859 Oct 03 14:41:35.833147 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1158/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:35 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1665 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:35.840308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:35.840955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:35.859383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:35.862163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:35.862889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:35.863974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:35.869930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:35.870432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:36.218609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:36.226922 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-20121bca-e645-44ab-87fd-53b82420ee62 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.392308 Oct 03 14:41:36.230249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1159/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:35 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:36.247383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:36.248202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:36.271152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:36.272809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:36.273517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:36.275006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:36.275636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:36.276214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:36.434666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:36.447473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:36.451221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:36.463443 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4e5b91b-52f3-4fd2-8d42-2d8286e890d4 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.230589 Oct 03 14:41:36.464560 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1160/2321] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:36 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:36.471484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:36.472101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:36.492413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:36.493136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:36.493550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:36.494803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:36.495272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:36.495687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:36.636453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:36.658820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:36.660317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:36.674103 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94aa8e50-66ff-4270-be60-5939e840f5d1 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.208195 Oct 03 14:41:36.674731 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1161/2322] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:36 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:36.690072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:36.691094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:36.703394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:36.704179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:36.705642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:36.706532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:36.707258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:36.707758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.001368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:37.013690 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d26834f-6d5e-48c5-8981-61864caae0b1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1522 microversion: 2.1 time: 0.331326 Oct 03 14:41:37.014826 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1162/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:36 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:37.020561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:37.023599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:37.039120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.039912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.040549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.041553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.042322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.043791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.175236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:37.179810 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a363a3f-ea27-4455-938d-3d8c2cc96bf9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.355005 Oct 03 14:41:37.189258 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1162/2324] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:41:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:37.195145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9bee495c-0ea2-4a29-aacf-e8ac091afc1b req-99f8cd18-d477-4d22-baac-98ab08162f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e4183c-88c6-4279-8889-833abf5136e1", "name": "network-vif-unplugged", "status": "completed", "tag": "88bd6bdd-668c-40fb-ae52-e7ed24eeceeb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:37.196858 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed4aacd3-5955-49ff-96e3-4c9bf6e3d357 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1260 microversion: 2.1 time: 0.180667 Oct 03 14:41:37.204411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1163/2325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:37 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:37.214712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:37.215838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:37.232364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.235368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.238326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.239097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.239558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.239989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.243787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9bee495c-0ea2-4a29-aacf-e8ac091afc1b req-99f8cd18-d477-4d22-baac-98ab08162f8d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.244283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9bee495c-0ea2-4a29-aacf-e8ac091afc1b req-99f8cd18-d477-4d22-baac-98ab08162f8d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.244713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9bee495c-0ea2-4a29-aacf-e8ac091afc1b req-99f8cd18-d477-4d22-baac-98ab08162f8d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.280745 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9bee495c-0ea2-4a29-aacf-e8ac091afc1b req-99f8cd18-d477-4d22-baac-98ab08162f8d service nova] Creating event network-vif-unplugged:88bd6bdd-668c-40fb-ae52-e7ed24eeceeb for instance e8e4183c-88c6-4279-8889-833abf5136e1 on n-h1-781139-2 Oct 03 14:41:37.294786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9bee495c-0ea2-4a29-aacf-e8ac091afc1b req-99f8cd18-d477-4d22-baac-98ab08162f8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103896 Oct 03 14:41:37.304112 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1163/2326] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:37.310617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c6cd6cd8-c3d6-4606-93d9-c48a31811d25 req-8c5510dc-2d70-4aa0-b403-307561d88451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf0cae3-a215-4491-bcc9-6ce278351274", "name": "network-vif-deleted", "tag": "d2339708-7bad-42a0-938d-9ef9e761a731"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:37.349476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c6cd6cd8-c3d6-4606-93d9-c48a31811d25 req-8c5510dc-2d70-4aa0-b403-307561d88451 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.354434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c6cd6cd8-c3d6-4606-93d9-c48a31811d25 req-8c5510dc-2d70-4aa0-b403-307561d88451 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.355210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c6cd6cd8-c3d6-4606-93d9-c48a31811d25 req-8c5510dc-2d70-4aa0-b403-307561d88451 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.371573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.373927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.374544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.375169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lazy-loading 'fault' on Instance uuid 1cf0cae3-a215-4491-bcc9-6ce278351274 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:41:37.391404 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c6cd6cd8-c3d6-4606-93d9-c48a31811d25 req-8c5510dc-2d70-4aa0-b403-307561d88451 service nova] Creating event network-vif-deleted:d2339708-7bad-42a0-938d-9ef9e761a731 for instance 1cf0cae3-a215-4491-bcc9-6ce278351274 on n-h2-781139-2 Oct 03 14:41:37.409518 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c6cd6cd8-c3d6-4606-93d9-c48a31811d25 req-8c5510dc-2d70-4aa0-b403-307561d88451 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101163 Oct 03 14:41:37.411444 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1164/2327] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:37.431895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.145"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:37.441016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:37.460410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.460410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.467078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.468365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.471772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.472533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.503236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:37.517887 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-725d3459-2621-43c8-b1e8-6e419244ebcd tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 200 len: 1323 microversion: 2.1 time: 0.308186 Oct 03 14:41:37.528528 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1164/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:37 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:37.553466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:37.554179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:37.568493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:41:37.572078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquired lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:41:37.578509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.581472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.581941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.582698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:37.583143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:37.583583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:37.997530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:38.005964 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d40d13d2-599b-460b-94a7-dd72f728e155 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.476490 Oct 03 14:41:38.006724 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1165/2329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:37 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:38.023777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:38.026342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:38.052766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:38.053521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:38.056288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:38.057069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:38.057533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:38.057957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:38.330644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:38.351653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:38.354913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:38.381571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6c119ee3-ef0e-4258-a545-e65b6b3e17da tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.370330 Oct 03 14:41:38.410875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1166/2330] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:38 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:38.423407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:38.424263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:38.433194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:38.433662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:38.433954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:38.434718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:38.435176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:38.435597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:38.640573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:38.650607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:38.665777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:38.671665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04610f77-f663-4e3f-a19d-ab97d5fa81dd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.258022 Oct 03 14:41:38.672729 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1167/2331] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:38 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:38.691467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:38.692285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:38.719255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:38.736608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:38.737124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:38.737901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:38.738385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:38.738792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:38.817058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:39.337400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:39.345350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-343f9176-dcf5-4d9e-bab8-406c03a42df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1522 microversion: 2.1 time: 0.671455 Oct 03 14:41:39.355086 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1168/2332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:38 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1522 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:39.360182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:39.360794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:39.377312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:39.377933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:39.378856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:39.379697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:39.382514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:39.383235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:39.564631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:39.584777 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-257a4559-637f-4918-8bc4-511e0921e5c2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1266 microversion: 2.1 time: 0.225583 Oct 03 14:41:39.592609 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1169/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:39 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:39.610951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:39.612293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 1cf0cae3-a215-4491-bcc9-6ce278351274] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:39.622404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:39.623214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:39.623801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:39.624701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:39.625408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:39.626573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:39.670607 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] HTTP exception thrown: Instance 1cf0cae3-a215-4491-bcc9-6ce278351274 could not be found. Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Request method failure captured: Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 HTTP/1.1 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLWBvVnEYhE7u51-fQ-BP93v4spM_D35t9m0c1S06m6ufh-svH7Qm8Rr1BZMm2Z3D2eZQbWLTgG5uQd4n_qOU2EHK8d_qJ8Gi4_lqMD49XZvI-QdeP4MhSwtN5w687imIYwawORhOUWU706j_DdzDyYAxdxivjKI9OJ5Kgz10B-4Tw Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/387637769447441dbf4d5df340ddecce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_387637769447441dbf4d5df340ddecce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-LiveMigrationTest-39744637 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: a91d62c6a8f04094b64c79e338b1dc49 Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1cf0cae3-a215-4491-bcc9-6ce278351274 could not be found. Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1cf0cae3-a215-4491-bcc9-6ce278351274'} Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf0cae3-a215-4491-bcc9-6ce278351274 could not be found. Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf0cae3-a215-4491-bcc9-6ce278351274 could not be found. Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:39.696592 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:39.700575 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:39.700575 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:39.700575 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:39.700575 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:39.700575 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:39.700575 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf0cae3-a215-4491-bcc9-6ce278351274 could not be found. Oct 03 14:41:39.700575 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:39.722294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Returning 404 to user: Instance 1cf0cae3-a215-4491-bcc9-6ce278351274 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:39.723577 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e69d569-f584-49a8-a247-1053f8bd00d2 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274" status: 404 len: 111 microversion: 2.1 time: 0.129109 Oct 03 14:41:39.733961 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1170/2334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:39 2022] GET /compute/v2.1/servers/1cf0cae3-a215-4491-bcc9-6ce278351274 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:41:39.757045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:39.758702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:39.786337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:39.787924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:39.789185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:39.790101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:39.791631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:39.792305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:40.084338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:40.093870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24c4a04a-965b-4c16-a6ad-8ac863da07d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.355888 Oct 03 14:41:40.098653 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1171/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:39 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:40.110140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:40.111047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:40.125322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:40.131452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:40.132398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:40.133207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:40.133683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:40.134110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:40.639779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:40.653982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:40.655442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:40.672584 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14548897-8d86-464c-8d63-804658dacf02 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.570517 Oct 03 14:41:40.674034 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1172/2336] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:40 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:40.693402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:40.699638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:40.713844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:41:40.744264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:40.746279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:40.746752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:40.752217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:40.752722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:40.753206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:40.927608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:40.939465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:40.945720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:40.956522 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b1f47364-a5f0-4270-9793-3c3a89e7850a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.278871 Oct 03 14:41:40.957159 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1173/2337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:40 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:40.965204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-615f6a18-23a8-4e1a-975c-1ed234428a3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '.version_select at 0x7fb231141280>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:41.017382 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-615f6a18-23a8-4e1a-975c-1ed234428a3a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920014205" status: 202 len: 0 microversion: 2.1 time: 0.056015 Oct 03 14:41:41.024436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1174/2338] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 14:41:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920014205 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:41:41.030579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:41.032095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:41.039482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:41.040233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:41.040814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:41.042519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:41.045641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:41.046227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:41.694766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:41.711234 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7b16fd4-c2be-486f-8478-d7abd0a4bf73 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1522 microversion: 2.1 time: 0.683867 Oct 03 14:41:41.714926 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1175/2339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:41 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1522 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:41.722858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b17b65b8-61ee-4fb0-8949-e63d1bd584a2 req-69b46a6b-a23b-46d7-b3c1-cad06bc84c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e4183c-88c6-4279-8889-833abf5136e1", "name": "network-vif-plugged", "status": "completed", "tag": "88bd6bdd-668c-40fb-ae52-e7ed24eeceeb"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:41.764169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b17b65b8-61ee-4fb0-8949-e63d1bd584a2 req-69b46a6b-a23b-46d7-b3c1-cad06bc84c86 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:41.771362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b17b65b8-61ee-4fb0-8949-e63d1bd584a2 req-69b46a6b-a23b-46d7-b3c1-cad06bc84c86 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:41.772366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b17b65b8-61ee-4fb0-8949-e63d1bd584a2 req-69b46a6b-a23b-46d7-b3c1-cad06bc84c86 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:41.804721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Updating instance_info_cache with network_info: [{"id": "5d50b1dc-274e-4868-b6b8-fcdbf42dc578", "address": "fa:16:3e:83:91:22", "network": {"id": "efa828c8-d88f-47f1-9c38-951dbcad8cf8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1566204714-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a2c5cf88658642ef80bf14ff7ea0bafd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d50b1dc-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:41:41.818429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b17b65b8-61ee-4fb0-8949-e63d1bd584a2 req-69b46a6b-a23b-46d7-b3c1-cad06bc84c86 service nova] Creating event network-vif-plugged:88bd6bdd-668c-40fb-ae52-e7ed24eeceeb for instance e8e4183c-88c6-4279-8889-833abf5136e1 on n-h1-781139-2 Oct 03 14:41:41.821934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Releasing lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:41:41.823187 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e648b8fd-ad4d-446d-9314-4803b376c3dc tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action" status: 202 len: 0 microversion: 2.1 time: 4.409008 Oct 03 14:41:41.825433 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1165/2340] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:41:37 2022] POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action => generated 0 bytes in 4413 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:41:41.835443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:41.835888 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b17b65b8-61ee-4fb0-8949-e63d1bd584a2 req-69b46a6b-a23b-46d7-b3c1-cad06bc84c86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118475 Oct 03 14:41:41.838258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:41.841006 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1176/2341] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:41.868348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ba0bdaeb-786a-432f-8541-12c7ae55db96 req-53d5ed39-244a-4eb6-bce4-2a01d6ec0e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8036f959-01b9-4758-bb2c-033b73318347", "tag": "5d50b1dc-274e-4868-b6b8-fcdbf42dc578"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:41.870723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:41.872594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:41.873288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:41.875658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:41.876289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:41.878387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:41.901917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ba0bdaeb-786a-432f-8541-12c7ae55db96 req-53d5ed39-244a-4eb6-bce4-2a01d6ec0e49 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:41.902778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ba0bdaeb-786a-432f-8541-12c7ae55db96 req-53d5ed39-244a-4eb6-bce4-2a01d6ec0e49 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:41.905702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ba0bdaeb-786a-432f-8541-12c7ae55db96 req-53d5ed39-244a-4eb6-bce4-2a01d6ec0e49 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:41.960803 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ba0bdaeb-786a-432f-8541-12c7ae55db96 req-53d5ed39-244a-4eb6-bce4-2a01d6ec0e49 service nova] Creating event network-changed:5d50b1dc-274e-4868-b6b8-fcdbf42dc578 for instance 8036f959-01b9-4758-bb2c-033b73318347 on n-h1-781139-2 Oct 03 14:41:41.976832 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ba0bdaeb-786a-432f-8541-12c7ae55db96 req-53d5ed39-244a-4eb6-bce4-2a01d6ec0e49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124307 Oct 03 14:41:41.986676 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1177/2342] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:42.020688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:42.021752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:42.049129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:42.049874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:42.051588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:42.061421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:42.062267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:42.062872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:42.621847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:42.632355 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbbf6c0f-7e8b-46c6-a25d-15764cc924c3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1308 microversion: 2.1 time: 0.805621 Oct 03 14:41:42.639103 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1166/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:41 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1308 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:42.646343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:42.647565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:42.670343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:42.671795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:42.673928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:42.675130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:42.677513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:42.680588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:42.752964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:42.932786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:42.945421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:42.955317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:42.966662 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-553f89a8-7bbc-4903-a69d-9a2dd95c3517 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1560 microversion: 2.91 time: 0.325067 Oct 03 14:41:42.978720 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1167/2344] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:42 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1560 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:42.992889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc586cc7-79ba-4b3b-b634-2883135aa20f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'create', calling method: .version_select at 0x7fb23012d9d0>, body: {"pool": "69d37d98-1d3b-4dad-8cee-9d78aa7b9aee"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:43.166212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:43.176281 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05427610-eb56-47cc-9d2b-c3ea601274ce tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 1.188081 Oct 03 14:41:43.193055 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1178/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:41 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:43.201428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:43.202522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:43.217377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:43.218111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:43.218558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:43.219957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:43.220556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:43.221158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:43.375267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:43.387362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:43.390262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:43.397284 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dfde23f6-d5ff-449a-a587-5490dcd76f15 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.199854 Oct 03 14:41:43.398463 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1179/2346] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:43 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:43.403660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-195a2a95-9ef8-4d4e-9c72-b3c24277c662 req-0b9bf6e1-40b7-485d-a487-17e150a5d3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b608d4ea-6bc1-4d4b-b383-491340c2dc15", "tag": "5af30399-6d29-43ed-94fd-4c5c8fa2c1d2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:43.415720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-195a2a95-9ef8-4d4e-9c72-b3c24277c662 req-0b9bf6e1-40b7-485d-a487-17e150a5d3ea service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:43.416475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-195a2a95-9ef8-4d4e-9c72-b3c24277c662 req-0b9bf6e1-40b7-485d-a487-17e150a5d3ea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:43.417357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-195a2a95-9ef8-4d4e-9c72-b3c24277c662 req-0b9bf6e1-40b7-485d-a487-17e150a5d3ea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:43.442040 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-195a2a95-9ef8-4d4e-9c72-b3c24277c662 req-0b9bf6e1-40b7-485d-a487-17e150a5d3ea service nova] Creating event network-changed:5af30399-6d29-43ed-94fd-4c5c8fa2c1d2 for instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 on n-h2-781139-2 Oct 03 14:41:43.449692 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-195a2a95-9ef8-4d4e-9c72-b3c24277c662 req-0b9bf6e1-40b7-485d-a487-17e150a5d3ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049564 Oct 03 14:41:43.450898 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1180/2347] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:43.457881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:43.459317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:43.473258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:43.474330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:43.475147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:43.476570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:43.477632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:43.479299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:43.785171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:43.801032 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b52bd714-54ff-43a3-9089-45ada2f49b70 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1522 microversion: 2.1 time: 0.347190 Oct 03 14:41:43.803198 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1181/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:43 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:43.808090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:43.810198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:43.828609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:43.829139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:43.829574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:43.830559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:43.831259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:43.831687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:43.862624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:43.976973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4fc1ee2f-a969-449c-b7fe-0f081c49b6f6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 204 len: 0 microversion: 2.1 time: 0.171065 Oct 03 14:41:43.978490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1182/2349] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:43 2022] DELETE /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:43.992493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:43.993383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:44.000105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.000602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.002387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.002387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.002387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.002802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.204713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.213879 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e31ac412-edcc-4a56-be84-e2f6d607a751 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1308 microversion: 2.1 time: 0.233469 Oct 03 14:41:44.215168 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1183/2350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:43 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:44.220672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a42a8a46-5885-4521-bcac-3c774bc933eb req-c6c1675c-80fc-4108-87de-284e313d0d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "name": "network-vif-plugged", "status": "completed", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:44.232008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a42a8a46-5885-4521-bcac-3c774bc933eb req-c6c1675c-80fc-4108-87de-284e313d0d45 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.232474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a42a8a46-5885-4521-bcac-3c774bc933eb req-c6c1675c-80fc-4108-87de-284e313d0d45 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.233097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a42a8a46-5885-4521-bcac-3c774bc933eb req-c6c1675c-80fc-4108-87de-284e313d0d45 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.245382 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a42a8a46-5885-4521-bcac-3c774bc933eb req-c6c1675c-80fc-4108-87de-284e313d0d45 service nova] Creating event network-vif-plugged:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:41:44.250874 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a42a8a46-5885-4521-bcac-3c774bc933eb req-c6c1675c-80fc-4108-87de-284e313d0d45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034201 Oct 03 14:41:44.251478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1184/2351] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:44.259366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:44.260592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:44.267452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.268037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.268524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.269543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.270021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.270630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.449847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.467450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb1c23e4-bb8a-471c-8293-084257f4800c tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1484 microversion: 2.1 time: 0.212707 Oct 03 14:41:44.468065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1185/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:44 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1484 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:44.475723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:44.476337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:44.479910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:44.484760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.486618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.486618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.486840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.487147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.487574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.578516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.588773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.590505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.595695 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-915a2f10-c8b8-4e65-8ac6-ee1287526595 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.124233 Oct 03 14:41:44.596298 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1186/2353] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:44 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:44.605812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:44.606540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:44.616450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.616956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.618074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.619450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.619450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.620111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.645399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:44.683951 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc586cc7-79ba-4b3b-b634-2883135aa20f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.703955 Oct 03 14:41:44.685955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1168/2354] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:41:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:44.690999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:44.692205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:44.722066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.723710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.724398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.725504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.727556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.728278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.849548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.858704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.866864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:44.872968 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1d8ed94-4f1b-421e-8bbc-811037e260b4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.185811 Oct 03 14:41:44.873843 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1169/2355] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:44 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:44.879021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.10"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:44.882236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:44.892557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.895564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.896237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.899298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:44.900093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:44.900750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:44.929107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:41:44.929778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquired lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:41:45.150289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:45.164247 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4d3a0aa-20fe-474c-af32-4c012ea1de88 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.562114 Oct 03 14:41:45.165815 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1187/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:44 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:45.185174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:45.185788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:45.192221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:45.192709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:45.193196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:45.194497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:45.194497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:45.194781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:45.200975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:45.251524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:45.557546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee.", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:41:45.558609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Releasing lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:41:45.559422 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee. Oct 03 14:41:45.559422 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-0eacd7d9-f5d3-41f0-a3a1-eb740eb8788b'] Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Request method failure captured: Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action HTTP/1.1 Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 45 Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSH-Fls1DEdOsl9vml2K5AgYTBlEsLtjhw_843Kx53SZk1if7ijhmLcoD-yRIaS4TsAJfFgfHVCTb2Gg6SAemAgOWst8BspCmMiOo8RFc37FvpKyqsutS5VwN2D-wJBVKJ3kMhCOExxWq7HV4AoZblBBFLuQCcPF0pWJq8c7T9R7mM Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2c5cf88658642ef80bf14ff7ea0bafd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: fbe047904bae466791a4456e96224aca Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: {"addFloatingIp": {"address": "172.25.6.10"}} Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee. Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-0eacd7d9-f5d3-41f0-a3a1-eb740eb8788b'] Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '8036f959-01b9-4758-bb2c-033b73318347', 'body': {'addFloatingIp': {'address': '172.25.6.10'}}} Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:41:45.561788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee. Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0eacd7d9-f5d3-41f0-a3a1-eb740eb8788b'] Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee. Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0eacd7d9-f5d3-41f0-a3a1-eb740eb8788b'] Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee. Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0eacd7d9-f5d3-41f0-a3a1-eb740eb8788b'] Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee. Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0eacd7d9-f5d3-41f0-a3a1-eb740eb8788b'] Oct 03 14:41:45.565150 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:45.569130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Returning 400 to user: Cannot associate floating IP 172.25.6.10 (a9442fd5-b889-4b26-b47d-a1da1bbdecf3) with port 5d50b1dc-274e-4868-b6b8-fcdbf42dc578 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 69d37d98-1d3b-4dad-8cee-9d78aa7b9aee. Oct 03 14:41:45.569130 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-0eacd7d9-f5d3-41f0-a3a1-eb740eb8788b'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:45.570255 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdd80a6d-374d-474b-b73d-6992aeb1a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action" status: 400 len: 380 microversion: 2.1 time: 0.695245 Oct 03 14:41:45.570992 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1170/2357] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:41:44 2022] POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action => generated 380 bytes in 696 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:41:45.575765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:45.576379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:45.585172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:45.585870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:45.587474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:45.588558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:45.589238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:45.589810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:45.810870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:45.819813 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af5cd425-4347-4f1c-8367-3967fccbb6fb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1308 microversion: 2.1 time: 0.247561 Oct 03 14:41:45.820990 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1171/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:45 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:45.826975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:45.827780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:45.834320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:45.835020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:45.835610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:45.836461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:45.837082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:45.837644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.006472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.020082 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fbbc7863-f1e3-42f0-8822-b1e10a12ed24 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1507 microversion: 2.1 time: 0.835971 Oct 03 14:41:46.022842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1188/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:45 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1507 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:46.027957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b61eaeb-853b-4bd3-bea4-40a66c8d42b9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '.version_select at 0x7fb234bf44c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:46.059500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.071532 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d5ce2f5-9543-4e1d-887a-54a858e78a4a tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1484 microversion: 2.1 time: 0.249307 Oct 03 14:41:46.072754 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1172/2360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:45 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1484 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:46.079518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:46.080326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:46.087377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.088181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.089229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.089766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.090345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.092597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.183079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.195263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.196707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.209874 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2186e488-e9ea-40fd-a560-42bf0fd8c018 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.135614 Oct 03 14:41:46.212015 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1173/2361] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:46 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:46.218093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:46.218919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:46.225824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.226571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.227151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.229402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.230031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.230597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.314464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.327647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.330258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.337094 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab55720b-60c4-4979-8dde-5d8ba912b2be tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.123784 Oct 03 14:41:46.338259 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1174/2362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:46 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:46.351506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:46.352560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:46.359876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.360687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.361399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.362334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.365198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.365967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.568804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.592975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ecc42e1-27e2-46cf-b177-33711a9d9b54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 200 len: 1507 microversion: 2.1 time: 0.253383 Oct 03 14:41:46.613818 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1175/2363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:46 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:46.621062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:46.621897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:46.629611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.630253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.631241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.632110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.633377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.634098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.855988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:46.870156 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f28e35b-c0b0-456a-ab88-3748080cd1e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1362 microversion: 2.1 time: 0.254485 Oct 03 14:41:46.871227 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1176/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:46 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:46.876747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:46.877675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:46.885914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.886396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.886961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.887707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:46.888325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:46.888762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:46.928053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:47.076425 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a442458-d079-4e26-a3fd-6926c9a29697 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 204 len: 0 microversion: 2.1 time: 0.203765 Oct 03 14:41:47.084232 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1177/2365] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:46 2022] DELETE /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:47.095758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:47.096973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:47.131241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:47.134746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:47.136438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:47.140562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:47.142239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:47.143603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:47.482144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:47.492689 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-495574ed-8aff-49c3-93aa-560afd24ea54 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1308 microversion: 2.1 time: 0.403676 Oct 03 14:41:47.496409 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1178/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:47 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:47.501990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:47.502863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:47.535792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:47.537692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:47.539840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:47.540730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:47.543270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:47.543836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:47.660816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:47.675724 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57fc4b29-3d7c-4f97-978a-87e89922e5f7 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 200 len: 1442 microversion: 2.1 time: 0.176392 Oct 03 14:41:47.675724 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1179/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:47 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 1442 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:47.681349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:47.682043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:47.689505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:47.690078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:47.690574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:47.691360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:47.691868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:47.692515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:47.832957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:47.849343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:47.851954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:47.867840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:47.872578 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b3aa8ec-b418-44c9-959c-5b7b20b3e8c3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.194321 Oct 03 14:41:47.887252 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1180/2368] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:47 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:47.891140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1153924620", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "7877a73c-1b04-43e7-a6e7-105e448c1162"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:48.188973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b61eaeb-853b-4bd3-bea4-40a66c8d42b9 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/a9442fd5-b889-4b26-b47d-a1da1bbdecf3" status: 202 len: 0 microversion: 2.1 time: 2.164764 Oct 03 14:41:48.194013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1189/2369] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:41:46 2022] DELETE /compute/v2.1/os-floating-ips/a9442fd5-b889-4b26-b47d-a1da1bbdecf3 => generated 0 bytes in 2170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:41:48.202389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:48.203667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:48.213788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:48.214548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:48.215139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:48.216005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:48.216608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:48.217217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:48.310366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:48.321129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:48.322882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:48.328960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e44d31f-8692-4496-bbd2-5524c3055b38 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.133544 Oct 03 14:41:48.330322 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1190/2370] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:48 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:48.336577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-abb3a5d7-4569-4118-93ec-ad6d0b03e5bb req-11d0f143-4388-4d62-bab6-ccd6f9ae25a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bf712c-1bc6-4798-9771-c906336c84a9", "name": "network-vif-deleted", "tag": "d499f67e-28ef-4b4d-a430-de0827a421bc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:48.348872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abb3a5d7-4569-4118-93ec-ad6d0b03e5bb req-11d0f143-4388-4d62-bab6-ccd6f9ae25a3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:48.349727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abb3a5d7-4569-4118-93ec-ad6d0b03e5bb req-11d0f143-4388-4d62-bab6-ccd6f9ae25a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:48.350377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abb3a5d7-4569-4118-93ec-ad6d0b03e5bb req-11d0f143-4388-4d62-bab6-ccd6f9ae25a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:48.394515 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-abb3a5d7-4569-4118-93ec-ad6d0b03e5bb req-11d0f143-4388-4d62-bab6-ccd6f9ae25a3 service nova] Creating event network-vif-deleted:d499f67e-28ef-4b4d-a430-de0827a421bc for instance f8bf712c-1bc6-4798-9771-c906336c84a9 on n-h1-781139-2 Oct 03 14:41:48.410510 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-abb3a5d7-4569-4118-93ec-ad6d0b03e5bb req-11d0f143-4388-4d62-bab6-ccd6f9ae25a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078726 Oct 03 14:41:48.414758 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1191/2371] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:48.424677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:48.425718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:48.434540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:48.435561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:48.436181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:48.437323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:48.438265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:48.438921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:48.626952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:48.641326 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5bc591db-eb32-4bf5-817b-329ed008263e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1549 microversion: 2.1 time: 0.222588 Oct 03 14:41:48.657207 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1192/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:48 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:48.660023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.145"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:48.823202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:48.829589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:48.830157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:48.830613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:48.831314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:48.831786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:48.832253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:49.260634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:41:49.261966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquired lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:41:50.662773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Building network info cache for instance {{(pid=128868) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:41:51.701721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Updating instance_info_cache with network_info: [{"id": "5d50b1dc-274e-4868-b6b8-fcdbf42dc578", "address": "fa:16:3e:83:91:22", "network": {"id": "efa828c8-d88f-47f1-9c38-951dbcad8cf8", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1566204714-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a2c5cf88658642ef80bf14ff7ea0bafd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d50b1dc-27", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128868) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:41:51.728514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Releasing lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:41:51.729766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9f6d2411-f8b1-49f7-8c6e-5f0395a17f21 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action" status: 202 len: 0 microversion: 2.1 time: 3.083233 Oct 03 14:41:51.734884 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1193/2373] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:41:48 2022] POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action => generated 0 bytes in 3089 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:41:51.741493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:51.742374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:51.750081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:51.750819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:51.751600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:51.752706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:51.753910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:51.754562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:51.996802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:52.009161 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0306119-750b-4ed2-82d9-c172e6ba4e4b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1308 microversion: 2.1 time: 0.272581 Oct 03 14:41:52.010404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1194/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:51 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:52.017004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:52.017795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:52.025757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.026685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.027286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.028150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.028744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.029347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.140160 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d160ce1-6bf3-450b-9738-3ec5ad088ff8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127367 Oct 03 14:41:52.149525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1195/2375] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:41:52 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:52.154387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:52.155346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: f8bf712c-1bc6-4798-9771-c906336c84a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:52.164835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.165818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.166496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.167756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.168428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.169110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.184908 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] HTTP exception thrown: Instance f8bf712c-1bc6-4798-9771-c906336c84a9 could not be found. Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Request method failure captured: Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 HTTP/1.1 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvLWBvVnEYhE7u51-fQ-BP93v4spM_D35t9m0c1S06m6ufh-svH7Qm8Rr1BZMm2Z3D2eZQbWLTgG5uQd4n_qOU2EHK8d_qJ8Gi4_lqMD49XZvI-QdeP4MhSwtN5w687imIYwawORhOUWU706j_DdzDyYAxdxivjKI9OJ5Kgz10B-4Tw Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/387637769447441dbf4d5df340ddecce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_387637769447441dbf4d5df340ddecce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-LiveMigrationTest-39744637 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: a91d62c6a8f04094b64c79e338b1dc49 Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f8bf712c-1bc6-4798-9771-c906336c84a9 could not be found. Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f8bf712c-1bc6-4798-9771-c906336c84a9'} Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bf712c-1bc6-4798-9771-c906336c84a9 could not be found. Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bf712c-1bc6-4798-9771-c906336c84a9 could not be found. Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:52.186996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:52.190379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:52.190379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:52.190379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:52.190379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:52.190379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:52.190379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bf712c-1bc6-4798-9771-c906336c84a9 could not be found. Oct 03 14:41:52.190379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:52.192589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Returning 404 to user: Instance f8bf712c-1bc6-4798-9771-c906336c84a9 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:52.193845 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-18545a5b-21b3-4401-b4b3-164b62b059b6 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9" status: 404 len: 111 microversion: 2.1 time: 0.043521 Oct 03 14:41:52.197828 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1196/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:52 2022] GET /compute/v2.1/servers/f8bf712c-1bc6-4798-9771-c906336c84a9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:41:52.204250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:52.205635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:52.213905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.214772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.215430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.216459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.217059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.217577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.292896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:52.308707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:52.310532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:52.317516 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-562740b5-35a2-4ddf-8107-f23144f181a1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.118318 Oct 03 14:41:52.318811 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1197/2377] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:52 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:52.328502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:52.329506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:52.336399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.337236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.337892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.338813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.339483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.340124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.467822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:52.484503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:52.486633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:52.493089 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8d795be7-54b6-4fbe-aa8d-e3ee5041cb5a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.172977 Oct 03 14:41:52.494317 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1198/2378] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:52 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:52.499672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d8ccf319-9971-43fa-8a99-18ebc62d2a54 req-6ca042a3-8af2-48a2-91b2-e34d813f743e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b608d4ea-6bc1-4d4b-b383-491340c2dc15", "name": "network-vif-plugged", "status": "completed", "tag": "5af30399-6d29-43ed-94fd-4c5c8fa2c1d2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:52.510168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d8ccf319-9971-43fa-8a99-18ebc62d2a54 req-6ca042a3-8af2-48a2-91b2-e34d813f743e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.512504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d8ccf319-9971-43fa-8a99-18ebc62d2a54 req-6ca042a3-8af2-48a2-91b2-e34d813f743e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.513217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d8ccf319-9971-43fa-8a99-18ebc62d2a54 req-6ca042a3-8af2-48a2-91b2-e34d813f743e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.530615 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d8ccf319-9971-43fa-8a99-18ebc62d2a54 req-6ca042a3-8af2-48a2-91b2-e34d813f743e service nova] Creating event network-vif-plugged:5af30399-6d29-43ed-94fd-4c5c8fa2c1d2 for instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 on n-h2-781139-2 Oct 03 14:41:52.539708 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d8ccf319-9971-43fa-8a99-18ebc62d2a54 req-6ca042a3-8af2-48a2-91b2-e34d813f743e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043681 Oct 03 14:41:52.543023 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1199/2379] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:52.566095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d2ee3f78-59e9-4980-bf92-6cbfb004b5f5 req-c726f5f7-4407-43fd-ae60-4aeced5cd486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e4183c-88c6-4279-8889-833abf5136e1", "name": "network-vif-deleted", "tag": "88bd6bdd-668c-40fb-ae52-e7ed24eeceeb"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:52.605612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d2ee3f78-59e9-4980-bf92-6cbfb004b5f5 req-c726f5f7-4407-43fd-ae60-4aeced5cd486 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:52.606244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d2ee3f78-59e9-4980-bf92-6cbfb004b5f5 req-c726f5f7-4407-43fd-ae60-4aeced5cd486 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:52.606782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d2ee3f78-59e9-4980-bf92-6cbfb004b5f5 req-c726f5f7-4407-43fd-ae60-4aeced5cd486 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:52.630859 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d2ee3f78-59e9-4980-bf92-6cbfb004b5f5 req-c726f5f7-4407-43fd-ae60-4aeced5cd486 service nova] Creating event network-vif-deleted:88bd6bdd-668c-40fb-ae52-e7ed24eeceeb for instance e8e4183c-88c6-4279-8889-833abf5136e1 on n-h1-781139-2 Oct 03 14:41:52.642401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d2ee3f78-59e9-4980-bf92-6cbfb004b5f5 req-c726f5f7-4407-43fd-ae60-4aeced5cd486 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097667 Oct 03 14:41:52.647010 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1200/2380] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:52.652497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-16869ef3-ff28-4c7e-a693-2461544c9efe tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '.version_select at 0x7fb230cd3550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:54.268979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-16869ef3-ff28-4c7e-a693-2461544c9efe tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6be595a4-83fa-4c5a-b0c7-121a1ed83b29" status: 202 len: 0 microversion: 2.1 time: 1.619803 Oct 03 14:41:54.269747 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1201/2381] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:41:52 2022] DELETE /compute/v2.1/os-floating-ips/6be595a4-83fa-4c5a-b0c7-121a1ed83b29 => generated 0 bytes in 1622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:41:54.281346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:54.281969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:54.300446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.300963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.301405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.302470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.303085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.303911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.339578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:54.480430 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f1c741f-d5ad-4e0e-a386-48a477586c01 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 204 len: 0 microversion: 2.1 time: 0.204639 Oct 03 14:41:54.481499 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1202/2382] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:54 2022] DELETE /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:41:54.495643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:54.499420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:54.514179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.514677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.515117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.515835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.516285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.516708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.693301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:54.702088 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-834e9d06-8187-49b4-b392-fdb4c869363b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1489 microversion: 2.1 time: 0.215822 Oct 03 14:41:54.703006 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1203/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:54 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1489 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:54.707911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:54.708541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:54.714957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.715444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.716037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.716747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.717234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.717658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.831728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:54.844070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:54.845553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:54.854317 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-334584bf-0b4a-4f9c-8732-c0403d841d47 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.150081 Oct 03 14:41:54.855249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1204/2384] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:54 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:54.863934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:54.864576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:54.874125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.874646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.875093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.875811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:54.876532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:54.877120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:54.966254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:54.976810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:54.987602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:54.997586 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bee69231-46e2-4b6b-99aa-aecfb058a9e9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.141151 Oct 03 14:41:55.008996 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1205/2385] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:54 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:55.008996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-2995f91d-7e6b-4cd5-a90a-0a25ea28fe1d req-cb6dbc0e-13c4-4545-977f-ba7fb812240e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:55.025618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2995f91d-7e6b-4cd5-a90a-0a25ea28fe1d req-cb6dbc0e-13c4-4545-977f-ba7fb812240e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:55.025618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2995f91d-7e6b-4cd5-a90a-0a25ea28fe1d req-cb6dbc0e-13c4-4545-977f-ba7fb812240e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:55.025618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2995f91d-7e6b-4cd5-a90a-0a25ea28fe1d req-cb6dbc0e-13c4-4545-977f-ba7fb812240e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:55.032824 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-2995f91d-7e6b-4cd5-a90a-0a25ea28fe1d req-cb6dbc0e-13c4-4545-977f-ba7fb812240e service nova] Creating event network-changed:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:41:55.043781 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-2995f91d-7e6b-4cd5-a90a-0a25ea28fe1d req-cb6dbc0e-13c4-4545-977f-ba7fb812240e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043014 Oct 03 14:41:55.044329 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1206/2386] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:55.057544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-194c901e-b26c-4a80-aa01-09ca1a245f26 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'action', calling method: .version_select at 0x7fb232fe88b0>, body: {"addFloatingIp": {"address": ""}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-194c901e-b26c-4a80-aa01-09ca1a245f26 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Request method failure captured: Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action HTTP/1.1 Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 34 Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvSH-Fls1DEdOsl9vml2K5AgYTBlEsLtjhw_843Kx53SZk1if7ijhmLcoD-yRIaS4TsAJfFgfHVCTb2Gg6SAemAgOWst8BspCmMiOo8RFc37FvpKyqsutS5VwN2D-wJBVKJ3kMhCOExxWq7HV4AoZblBBFLuQCcPF0pWJq8c7T9R7mM Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2c5cf88658642ef80bf14ff7ea0bafd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: fbe047904bae466791a4456e96224aca Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: {"addFloatingIp": {"address": ""}} Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '8036f959-01b9-4758-bb2c-033b73318347', 'body': {'addFloatingIp': {'address': ''}}} Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '' Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:41:55.061983 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-194c901e-b26c-4a80-aa01-09ca1a245f26 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:55.069514 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-194c901e-b26c-4a80-aa01-09ca1a245f26 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action" status: 400 len: 142 microversion: 2.1 time: 0.019001 Oct 03 14:41:55.075566 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1207/2387] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:41:55 2022] POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action => generated 142 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:41:55.076561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:55.077383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:55.085020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:55.085508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:55.085953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:55.086685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:55.087142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:55.087563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:55.109214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:55.356657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a91d62c6a8f04094b64c79e338b1dc49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387637769447441dbf4d5df340ddecce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:55.368975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-48a61a90-ddc5-4e09-9f68-90b960451ed8 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 200 len: 1499 microversion: 2.1 time: 0.293427 Oct 03 14:41:55.370671 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1208/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:55 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 1499 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:55.376252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3baecfa0-1276-43fe-9dd0-d7f6ae3bdb4c req-05b54ad1-2721-4059-a992-b08914d8bee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8036f959-01b9-4758-bb2c-033b73318347", "tag": "5d50b1dc-274e-4868-b6b8-fcdbf42dc578"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:55.405011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3baecfa0-1276-43fe-9dd0-d7f6ae3bdb4c req-05b54ad1-2721-4059-a992-b08914d8bee9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:55.406517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3baecfa0-1276-43fe-9dd0-d7f6ae3bdb4c req-05b54ad1-2721-4059-a992-b08914d8bee9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:55.406977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3baecfa0-1276-43fe-9dd0-d7f6ae3bdb4c req-05b54ad1-2721-4059-a992-b08914d8bee9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:55.445381 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3baecfa0-1276-43fe-9dd0-d7f6ae3bdb4c req-05b54ad1-2721-4059-a992-b08914d8bee9 service nova] Creating event network-changed:5d50b1dc-274e-4868-b6b8-fcdbf42dc578 for instance 8036f959-01b9-4758-bb2c-033b73318347 on n-h1-781139-2 Oct 03 14:41:55.460696 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3baecfa0-1276-43fe-9dd0-d7f6ae3bdb4c req-05b54ad1-2721-4059-a992-b08914d8bee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087214 Oct 03 14:41:55.470190 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1209/2389] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:55.495517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-968685523", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "becfb12c-e5af-4560-80c3-4794784e4ae3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:57.351485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] validate_networks() for [('7877a73c-1b04-43e7-a6e7-105e448c1162', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:41:57.356960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:41:57.841416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:57.938129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:57.971475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:57.972149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:57.972794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:57.973233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:57.973960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:57.985886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:57.986622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:57.987223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:57.988113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:57.988728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:57.989344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.013833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:58.020479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:58.038091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:58.041418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:58.090350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:41:58.090821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:41:58.091353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:41:58.091843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:41:58.092314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:41:58.110186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.110950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.111606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.112485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.113195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.115946 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-514af0d5-9766-419c-8bbc-b5b4f991a72a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.644688 Oct 03 14:41:58.127325 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1210/2390] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:41:58.133608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.134737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:58.140534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:58.159357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.162057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.162622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.165654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.166383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.166757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.188495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Getting quotas for project 7bfd2cb85d9c4983a86823d7b267d66f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:41:58.197008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Getting quotas for user ca91b4c2c303476b870b879e712ba2a4 and project 7bfd2cb85d9c4983a86823d7b267d66f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:41:58.216662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:41:58.219539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:41:58.236847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:41:58.237191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquired lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:41:58.332732 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-664a10be-19b5-4b92-bf94-eb4292fd7ee4 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.445504 Oct 03 14:41:58.340616 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1181/2391] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:41:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 10454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:41:58.346103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:58.351650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:58.383170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.383675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.384123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.385229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.405347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.409713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.552183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Releasing lock "refresh_cache-8036f959-01b9-4758-bb2c-033b73318347" {{(pid=128868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:41:58.553643 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] HTTP exception thrown: floating IP not found Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Request method failure captured: Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action HTTP/1.1 Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 41 Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvSH-Fls1DEdOsl9vml2K5AgYTBlEsLtjhw_843Kx53SZk1if7ijhmLcoD-yRIaS4TsAJfFgfHVCTb2Gg6SAemAgOWst8BspCmMiOo8RFc37FvpKyqsutS5VwN2D-wJBVKJ3kMhCOExxWq7HV4AoZblBBFLuQCcPF0pWJq8c7T9R7mM Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2c5cf88658642ef80bf14ff7ea0bafd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: fbe047904bae466791a4456e96224aca Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: exception: floating IP not found Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '8036f959-01b9-4758-bb2c-033b73318347', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 03 14:41:58.556476 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 03 14:41:58.561145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.563443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Returning 404 to user: floating IP not found {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:58.564485 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63e8a069-5862-4017-b802-a2a83fb0f79f tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action" status: 404 len: 67 microversion: 2.1 time: 0.435851 Oct 03 14:41:58.565346 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1211/2392] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:41:58 2022] POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action => generated 67 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:41:58.572987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:58.573974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:58.580327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.581322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.583889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.585148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.585956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.586752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.604773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:58.625917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:58.639291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:58.664407 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26d8baf5-2c6b-4698-8309-40aeab0d9d4c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.322104 Oct 03 14:41:58.670381 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1182/2393] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:58 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:58.702439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:58.705324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] [instance: 92bbc8f0-e427-4021-bcc7-3d530f263eb8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:58.722658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.723836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.724603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.724824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:58.725800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.726559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.727277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.742269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:58.753911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:58.765630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] HTTP exception thrown: Instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 could not be found. Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Request method failure captured: Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 HTTP/1.1 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvLWBvVnEYhE7u51-fQ-BP93v4spM_D35t9m0c1S06m6ufh-svH7Qm8Rr1BZMm2Z3D2eZQbWLTgG5uQd4n_qOU2EHK8d_qJ8Gi4_lqMD49XZvI-QdeP4MhSwtN5w687imIYwawORhOUWU706j_DdzDyYAxdxivjKI9OJ5Kgz10B-4Tw Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/387637769447441dbf4d5df340ddecce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_387637769447441dbf4d5df340ddecce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/387637769447441dbf4d5df340ddecce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-LiveMigrationTest-39744637 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 387637769447441dbf4d5df340ddecce Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-LiveMigrationTest-39744637 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: a91d62c6a8f04094b64c79e338b1dc49 Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-LiveMigrationTest-39744637-project Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 could not be found. Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '92bbc8f0-e427-4021-bcc7-3d530f263eb8'} Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 could not be found. Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 could not be found. Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:58.768029 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.771910 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:58.771910 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:58.771910 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:58.771910 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:58.771910 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:58.771910 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 could not be found. Oct 03 14:41:58.771910 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:58.775178 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-75d36f1f-23ae-435c-be0e-3350af46742f tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.208501 Oct 03 14:41:58.775791 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1212/2394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:58 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:41:58.776833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] Returning 404 to user: Instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:58.777940 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aaae4123-a170-484a-b1a8-31984c48e382 tempest-LiveMigrationTest-39744637 tempest-LiveMigrationTest-39744637-project] 10.222.0.20 "GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8" status: 404 len: 111 microversion: 2.1 time: 0.106278 Oct 03 14:41:58.779000 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1183/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:58 2022] GET /compute/v2.1/servers/92bbc8f0-e427-4021-bcc7-3d530f263eb8 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:41:58.784947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9d5375d-c7df-481c-9876-79ff85598bac tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:58.786004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9d5375d-c7df-481c-9876-79ff85598bac tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:58.790805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-99b5fc7c-ffe2-4a5b-8f11-2ae91f0f5b00 req-9646f713-d81a-4939-9f37-06d549300784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bbc8f0-e427-4021-bcc7-3d530f263eb8", "name": "network-vif-deleted", "tag": "78fb81bf-61f4-46aa-acb3-a9f95766502a"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:58.838175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-99b5fc7c-ffe2-4a5b-8f11-2ae91f0f5b00 req-9646f713-d81a-4939-9f37-06d549300784 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:58.840826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-99b5fc7c-ffe2-4a5b-8f11-2ae91f0f5b00 req-9646f713-d81a-4939-9f37-06d549300784 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:58.843304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-99b5fc7c-ffe2-4a5b-8f11-2ae91f0f5b00 req-9646f713-d81a-4939-9f37-06d549300784 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:58.882537 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-99b5fc7c-ffe2-4a5b-8f11-2ae91f0f5b00 req-9646f713-d81a-4939-9f37-06d549300784 service nova] Creating event network-vif-deleted:78fb81bf-61f4-46aa-acb3-a9f95766502a for instance 92bbc8f0-e427-4021-bcc7-3d530f263eb8 on n-h1-781139-2 Oct 03 14:41:58.903428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-99b5fc7c-ffe2-4a5b-8f11-2ae91f0f5b00 req-9646f713-d81a-4939-9f37-06d549300784 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126368 Oct 03 14:41:58.916556 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1213/2396] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:41:58.926804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53af14ed-309c-4c7c-8171-33de3406d210 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:58.933820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9d5375d-c7df-481c-9876-79ff85598bac tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:58.939074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53af14ed-309c-4c7c-8171-33de3406d210 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:58.941546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9d5375d-c7df-481c-9876-79ff85598bac tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1208 microversion: 2.1 time: 0.161236 Oct 03 14:41:58.956359 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1184/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:58 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1208 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:58.965589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e292b9cc-fddf-42d6-889a-b07defa0ade7 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:41:59.097651 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e292b9cc-fddf-42d6-889a-b07defa0ade7 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e292b9cc-fddf-42d6-889a-b07defa0ade7 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Request method failure captured: Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action HTTP/1.1 Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 44 Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSH-Fls1DEdOsl9vml2K5AgYTBlEsLtjhw_843Kx53SZk1if7ijhmLcoD-yRIaS4TsAJfFgfHVCTb2Gg6SAemAgOWst8BspCmMiOo8RFc37FvpKyqsutS5VwN2D-wJBVKJ3kMhCOExxWq7HV4AoZblBBFLuQCcPF0pWJq8c7T9R7mM Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2c5cf88658642ef80bf14ff7ea0bafd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: fbe047904bae466791a4456e96224aca Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: exception: Floating IP not found for address 0.0.0.0. Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '8036f959-01b9-4758-bb2c-033b73318347', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 03 14:41:59.100368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 03 14:41:59.104677 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:41:59.106732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e292b9cc-fddf-42d6-889a-b07defa0ade7 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:41:59.107783 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e292b9cc-fddf-42d6-889a-b07defa0ade7 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action" status: 404 len: 88 microversion: 2.1 time: 0.147214 Oct 03 14:41:59.108583 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1185/2398] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:41:58 2022] POST /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347/action => generated 88 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:41:59.114617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53af14ed-309c-4c7c-8171-33de3406d210 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:59.124099 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53af14ed-309c-4c7c-8171-33de3406d210 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1218 microversion: 2.1 time: 0.205789 Oct 03 14:41:59.125963 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1214/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:58 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:59.128077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:59.129958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:59.150492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.156230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.156767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.167989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.170330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.172371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.294756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:41:59.419322 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58b92183-0f43-40f5-8a19-b25425844610 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 204 len: 0 microversion: 2.1 time: 0.304984 Oct 03 14:41:59.426158 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1186/2400] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:41:59 2022] DELETE /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:41:59.445071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:59.447315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:59.472619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.475438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.476087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.478642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.480884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.481784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.698684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:59.699861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:59.703435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:59.717949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.728633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.731611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.733466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.734658 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4d74043b-26fe-4e06-a0a8-437a8a1e1e95 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1541 microversion: 2.1 time: 0.307223 Oct 03 14:41:59.736795 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1215/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:59 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1541 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:41:59.739033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.741645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.813243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:59.814019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:59.826788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.830160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.830711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.834396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:41:59.835594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:41:59.838468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:41:59.935564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:59.953086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:59.954563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:59.957999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:59.980402 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8174a834-4f3f-4ad7-a4f9-6128c31da961 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.286252 Oct 03 14:41:59.992952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1187/2402] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:59 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:41:59.992952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:41:59.992952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:41:59.993339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:41:59.993339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:00.015316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:00.015818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:00.016267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:00.017020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:00.017476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:00.017732 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e98716b-21b3-4d1a-a6ab-ee42f36332c9 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.207721 Oct 03 14:42:00.027323 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1216/2403] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:41:59 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:00.029518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:00.149739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:00.150366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:00.161181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:00.161910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:00.162318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:00.163051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:00.163491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:00.163914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:00.173576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:00.184255 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d96e59d-85bc-4228-9e6d-d2530c9af521 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1260 microversion: 2.1 time: 0.202118 Oct 03 14:42:00.184869 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1188/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:41:59 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:00.269757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:00.279335 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d685508e-96f7-416b-8eb6-06c6aed27a31 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1214 microversion: 2.1 time: 0.133420 Oct 03 14:42:00.286978 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1217/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:00 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:00.764728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:00.766782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:00.783867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:00.784771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:00.785456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:00.786434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:00.787136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:00.787762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.014832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:01.015461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:01.044368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.044860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.046855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.047601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.048078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.048515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.171423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.186508 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ca0a0f0-8139-4729-bad6-73e1feeb5dbb tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1541 microversion: 2.1 time: 0.428406 Oct 03 14:42:01.202924 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1189/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:00 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1541 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:01.219175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:01.219784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:01.246737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.247239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.247671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.248384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.248826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.249271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.360202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.374161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.376134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.392493 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-40dc419f-4a45-4a31-9483-b52c984cc3f2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.383846 Oct 03 14:42:01.393697 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1218/2407] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:01 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:01.398950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:01.405245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:01.421853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:01.424091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.428060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.428777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.429713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.430324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.435333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.468435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.495811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.500279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.515480 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22f4b706-d60d-47b8-b85b-0ef7395ea56d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.311286 Oct 03 14:42:01.519026 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1190/2408] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:01 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:01.527110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:01.528059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:01.571213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.573175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.577113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.578188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:01.584049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:01.585258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:01.706534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.721813 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70b5864c-435d-46d6-86cf-eff91d63280e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1266 microversion: 2.1 time: 0.325197 Oct 03 14:42:01.724219 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1219/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:01 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:01.733878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:01.746211 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54b9b693-ef10-4e2f-a5c6-1840fc8321b2 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1288 microversion: 2.1 time: 0.225712 Oct 03 14:42:01.758695 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1191/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:01 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1288 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:02.214832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:02.215458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:02.231212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.234276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.236478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.237654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.244358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.244969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.426320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:02.427114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:02.434948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.437801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.439625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.441422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.442192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.444045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.555543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:02.564740 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f5bf53f-15a6-461d-a45e-e0344782eed4 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1541 microversion: 2.1 time: 0.353784 Oct 03 14:42:02.585791 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1220/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:02 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1541 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:02.590776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:02.591410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:02.599927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.600420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.600856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.601597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.602991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.605364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.779097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:02.786336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:02.794612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:02.794818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:02.796123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:02.796253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:02.803540 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fc390f2c-59fa-4ca5-b0c0-a67b55adf684 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.216457 Oct 03 14:42:02.804154 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1221/2412] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:02 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:02.835600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:02.845391 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-037a1bf8-7075-4f70-9587-b52894108fe1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.423689 Oct 03 14:42:02.846248 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1192/2413] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:02 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:02.849567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:02.854771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:02.861765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:02.867050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.869637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.870243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.875793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.876593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.877068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.879557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.880385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.880570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:02.898252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:02.898987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:02.899575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:03.080108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:03.088988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ae1aac9-9370-4565-bccd-51caa254bab1 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1276 microversion: 2.1 time: 0.241529 Oct 03 14:42:03.096224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1193/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:02 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:03.107206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1b1e8155-355b-4b6d-a4e8-b3ed2591017e req-992993a0-5cd2-4e50-893b-9fe0c8afc9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8036f959-01b9-4758-bb2c-033b73318347", "name": "network-vif-deleted", "tag": "5d50b1dc-274e-4868-b6b8-fcdbf42dc578"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:03.126906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1b1e8155-355b-4b6d-a4e8-b3ed2591017e req-992993a0-5cd2-4e50-893b-9fe0c8afc9cf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:03.127465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1b1e8155-355b-4b6d-a4e8-b3ed2591017e req-992993a0-5cd2-4e50-893b-9fe0c8afc9cf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:03.127964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1b1e8155-355b-4b6d-a4e8-b3ed2591017e req-992993a0-5cd2-4e50-893b-9fe0c8afc9cf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:03.159324 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1b1e8155-355b-4b6d-a4e8-b3ed2591017e req-992993a0-5cd2-4e50-893b-9fe0c8afc9cf service nova] Creating event network-vif-deleted:5d50b1dc-274e-4868-b6b8-fcdbf42dc578 for instance 8036f959-01b9-4758-bb2c-033b73318347 on n-h1-781139-2 Oct 03 14:42:03.164767 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1b1e8155-355b-4b6d-a4e8-b3ed2591017e req-992993a0-5cd2-4e50-893b-9fe0c8afc9cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067527 Oct 03 14:42:03.165510 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1194/2415] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:03.309741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:03.323219 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7182ddef-ba09-4b1d-9590-c12cc9d3f3da tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.497802 Oct 03 14:42:03.325225 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1222/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:02 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:03.592648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:03.593447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:03.613102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:03.613320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:03.613947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:03.615073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:03.615713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:03.616298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:03.723159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:03.724091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:03.725316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:03.725934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lazy-loading 'fault' on Instance uuid 8036f959-01b9-4758-bb2c-033b73318347 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:03.832168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:03.833172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:03.840116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:03.840944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:03.841672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:03.842567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:03.843239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:03.843867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:03.963417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:03.976660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:03.978514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:03.984308 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7a83a16-d190-41d1-9a37-6fbbfccfbbfd tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.156071 Oct 03 14:42:04.026498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1223/2417] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:03 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:04.031835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:04.032694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:04.040685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:04.041425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:04.045613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:04.046611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:04.047232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:04.047810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:04.106524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe047904bae466791a4456e96224aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c5cf88658642ef80bf14ff7ea0bafd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:04.117341 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4dc8014b-84f3-4c66-b91e-a364633edaa0 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 200 len: 1321 microversion: 2.1 time: 0.528206 Oct 03 14:42:04.118075 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1195/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:03 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:04.133709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:04.135997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:04.154181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:04.155605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:04.156881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:04.158265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:04.159058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:04.160129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:04.245390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:04.261275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:04.264022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:04.271433 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9863f6f9-8806-4d58-89fd-045f86859d60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1537 microversion: 2.91 time: 0.243040 Oct 03 14:42:04.272755 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1224/2419] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:04 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:04.356462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:04.358023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:04.367060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:04.368330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:04.373217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:04.374104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:04.374593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:04.376371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:04.443910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:04.452300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0089c020-051b-4d89-a9bc-4aa26c3cead3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.332011 Oct 03 14:42:04.453807 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1196/2420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:04 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:04.596227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:04.606428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da9b43cd-a6d0-4885-98d5-d2fa4fbc62ae tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.255380 Oct 03 14:42:04.608843 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1225/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:04 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:05.019258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:05.021596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:05.030526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.031714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.032385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.034401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.035000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.035606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.147149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:05.147706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] [instance: 8036f959-01b9-4758-bb2c-033b73318347] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:05.154571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.155228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.155856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.156773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.157819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.158243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.188881 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] HTTP exception thrown: Instance 8036f959-01b9-4758-bb2c-033b73318347 could not be found. Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Request method failure captured: Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 HTTP/1.1 Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvSH-Fls1DEdOsl9vml2K5AgYTBlEsLtjhw_843Kx53SZk1if7ijhmLcoD-yRIaS4TsAJfFgfHVCTb2Gg6SAemAgOWst8BspCmMiOo8RFc37FvpKyqsutS5VwN2D-wJBVKJ3kMhCOExxWq7HV4AoZblBBFLuQCcPF0pWJq8c7T9R7mM Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2c5cf88658642ef80bf14ff7ea0bafd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2c5cf88658642ef80bf14ff7ea0bafd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: a2c5cf88658642ef80bf14ff7ea0bafd Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: fbe047904bae466791a4456e96224aca Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 8036f959-01b9-4758-bb2c-033b73318347 could not be found. Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '8036f959-01b9-4758-bb2c-033b73318347'} Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8036f959-01b9-4758-bb2c-033b73318347 could not be found. Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8036f959-01b9-4758-bb2c-033b73318347 could not be found. Oct 03 14:42:05.191338 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8036f959-01b9-4758-bb2c-033b73318347 could not be found. Oct 03 14:42:05.195258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:05.200082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] Returning 404 to user: Instance 8036f959-01b9-4758-bb2c-033b73318347 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:05.201355 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5bbe8dbb-7fae-4a78-b159-c62acbbc75d1 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872 tempest-FloatingIPsAssociationNegativeTestJSON-1374970872-project] 10.222.0.20 "GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347" status: 404 len: 111 microversion: 2.1 time: 0.059021 Oct 03 14:42:05.202196 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1226/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:05 2022] GET /compute/v2.1/servers/8036f959-01b9-4758-bb2c-033b73318347 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:05.237786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-56185442-cf35-4e41-97ed-bbd7942eea23 req-a50a50c6-abdd-4054-92e5-5e5fa30fb106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af6414f-c6d7-4c0a-9215-80a91bbff1df", "tag": "9ea8f36b-63f4-4e1f-8c1c-e41829141e66"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:05.251387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-56185442-cf35-4e41-97ed-bbd7942eea23 req-a50a50c6-abdd-4054-92e5-5e5fa30fb106 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.252598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-56185442-cf35-4e41-97ed-bbd7942eea23 req-a50a50c6-abdd-4054-92e5-5e5fa30fb106 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.253425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-56185442-cf35-4e41-97ed-bbd7942eea23 req-a50a50c6-abdd-4054-92e5-5e5fa30fb106 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.267430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:05.273967 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-56185442-cf35-4e41-97ed-bbd7942eea23 req-a50a50c6-abdd-4054-92e5-5e5fa30fb106 service nova] Creating event network-changed:9ea8f36b-63f4-4e1f-8c1c-e41829141e66 for instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df on n-h2-781139-2 Oct 03 14:42:05.277003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:05.278726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:05.281783 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-56185442-cf35-4e41-97ed-bbd7942eea23 req-a50a50c6-abdd-4054-92e5-5e5fa30fb106 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051422 Oct 03 14:42:05.283707 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1227/2423] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:42:05.299494 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a95cf15-9dce-4eff-8cce-cac16a2da940 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.286015 Oct 03 14:42:05.301236 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1197/2424] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:05 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:05.315243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:05.318572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:05.329260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.330106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.330744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.332428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.332914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.333910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.441556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:05.453410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:05.454878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:05.462036 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-859898c8-bf3e-42ea-a9c7-f826cc78b89a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1540 microversion: 2.91 time: 0.163763 Oct 03 14:42:05.463022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1228/2425] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:05 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1540 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:05.481481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:05.483621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:05.494388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.495390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.495981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.497217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:05.497778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.498467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.499100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.499710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:05.512501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.515667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.516292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.520223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.521138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.521733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.600895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:05.603077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-781139-2". {{(pid=128868) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 14:42:05.715450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c03d0df3-d699-428b-b6dd-fa0bff8fd92e tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action" status: 202 len: 0 microversion: 2.91 time: 0.222387 Oct 03 14:42:05.717571 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1229/2426] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:42:05 2022] POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:42:05.732846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:05.733688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:05.744326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.744871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.754018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.754869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.755419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.755976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.927544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:05.939971 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29dec207-f458-4155-a888-07cd734dcb13 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.220916 Oct 03 14:42:05.941861 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1230/2427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:05 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:05.953034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:05.953729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:05.961505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.962090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.962669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:05.963667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:05.964206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:05.964799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:06.082376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:06.098202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:06.101469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:06.108195 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34a6b10b-d83a-4ef4-ae43-e4529887fc6f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1488 microversion: 2.91 time: 0.165377 Oct 03 14:42:06.111023 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1231/2428] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:05 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1488 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:06.166806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:06.179338 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a06520eb-a6f6-493a-bfee-446c5310362a tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.707563 Oct 03 14:42:06.181443 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1198/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:05 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:06.329849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:06.330967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:06.341732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:06.342579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:06.343663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:06.346822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:06.347212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:06.347802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:06.580711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:06.597454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:06.602229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:06.618585 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df16423b-8ebb-4f9c-af0e-3e98ab2c994e tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.293324 Oct 03 14:42:06.636246 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1232/2430] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:06 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:06.965163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:06.965794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:06.976382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:06.978218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:06.978673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:06.979453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:06.990403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:06.991100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.051659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:07.139765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:07.140401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:07.154618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:07.157280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:07.157842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.160331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:07.160810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:07.163100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.366586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:07.390890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:07.396221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:07.410519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-121b7cd3-5ce9-4fd6-8e57-4521fe4cc208 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1488 microversion: 2.91 time: 0.275784 Oct 03 14:42:07.412341 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1233/2431] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:07 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1488 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:07.423907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:07.427628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:07.441355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:07.450009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:07.450616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.451370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:07.451843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:07.452267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.584351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:07.597201 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0e97a5c-b4d4-44f0-bf0a-a5be15b4463f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.635597 Oct 03 14:42:07.597822 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1199/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:06 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:07.607717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1edae8c7-c78c-476b-a557-f107095081e5 req-ea0256b6-ae52-4aec-9c88-d6e90f02ba8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e2cfc2c-d093-46a8-ab70-d5627e4b09a9", "tag": "d6d0d3fb-8344-4199-b8f1-addb7e2101d0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:07.632375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1edae8c7-c78c-476b-a557-f107095081e5 req-ea0256b6-ae52-4aec-9c88-d6e90f02ba8c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:07.632862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1edae8c7-c78c-476b-a557-f107095081e5 req-ea0256b6-ae52-4aec-9c88-d6e90f02ba8c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:07.633322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1edae8c7-c78c-476b-a557-f107095081e5 req-ea0256b6-ae52-4aec-9c88-d6e90f02ba8c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.675203 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1edae8c7-c78c-476b-a557-f107095081e5 req-ea0256b6-ae52-4aec-9c88-d6e90f02ba8c service nova] Creating event network-changed:d6d0d3fb-8344-4199-b8f1-addb7e2101d0 for instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 on n-h2-781139-2 Oct 03 14:42:07.681212 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1edae8c7-c78c-476b-a557-f107095081e5 req-ea0256b6-ae52-4aec-9c88-d6e90f02ba8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082053 Oct 03 14:42:07.681820 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1200/2433] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:07.688003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:07.692775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:07.715553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:07.720001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:07.721365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.722499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:07.723162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:07.723803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:07.838896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:07.852348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:07.854527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:07.876728 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9430aeed-94c4-47fb-8360-846c9a8364f6 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.179032 Oct 03 14:42:07.879753 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1201/2434] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:07 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:08.001623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:08.111913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:08.135571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff121a26-e152-4d05-8705-455bfb429099 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.721736 Oct 03 14:42:08.136548 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1234/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:07 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:08.444173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:08.444789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:08.447365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:08.463532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:08.466021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:08.469590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:08.471767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:08.472265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:08.475373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:08.622256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:08.623096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:08.646900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:08.647660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:08.648251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:08.649843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:08.651767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:08.652185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:08.691622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:08.708204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:08.709952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:08.717060 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4331ffde-2a68-4170-a625-f9e03f4b8579 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.278077 Oct 03 14:42:08.732962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1202/2436] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:08 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:08.909034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:08.909687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:08.928635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:08.929158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:08.929600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:08.930313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:08.930763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:08.931179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:08.963264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:08.997978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:09.014163 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d83d6fe7-8c6c-4863-a76f-e8f95e4e0b76 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.396067 Oct 03 14:42:09.015677 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1235/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:08 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:09.159489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:09.160960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:09.163918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:09.169357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:09.170106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:09.170767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:09.171632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:09.172230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:09.173307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:09.249350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:09.258777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:09.261713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:09.267961 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbd9b568-ff52-4acc-ac9d-88a37fa1d8f4 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1447 microversion: 2.75 time: 0.363768 Oct 03 14:42:09.268545 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1203/2438] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:08 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1447 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:09.413800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:09.422106 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c8d26cf1-2a42-4351-bd68-3d40effc8c4c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.266644 Oct 03 14:42:09.422755 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1236/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:09 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:09.749590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:09.750193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:09.766035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:09.766829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:09.769975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:09.770938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:09.781767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:09.785292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:09.998191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.015605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.035358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.043992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:10.044577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:10.058024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:10.058518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:10.058956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:10.059678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:10.060105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:10.060523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:10.060820 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8959c64b-7b79-4840-895a-bde2354f7801 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.313698 Oct 03 14:42:10.076092 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1204/2440] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:09 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:10.295973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:10.297171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:10.311675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:10.312773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:10.313736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:10.314929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:10.316206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:10.317813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:10.463267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.476323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.480349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.493478 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d594138-afbf-4e38-91d4-58b934eaea6d tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1453 microversion: 2.75 time: 0.201372 Oct 03 14:42:10.494091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1205/2441] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:10 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:10.503888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:10.504488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:10.530995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:10.531755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:10.532227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:10.539182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:10.539771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:10.540518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:10.917838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.919891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:10.931649 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2a7dce14-b7a4-47b0-8505-3d92feef96e1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.891781 Oct 03 14:42:10.936856 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ab639ed-707a-429d-90d6-ba263e5160a8 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.438563 Oct 03 14:42:10.948954 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1206/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:10 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:10.951720 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1237/2443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:10 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:11.098799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:11.099593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:11.126407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:11.126954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:11.137772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:11.138801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:11.139310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:11.139805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:11.529408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:11.530845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:11.543932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:11.553687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:11.557071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:11.565842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:11.566711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:11.568626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:11.743088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:11.768326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:11.773536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:11.791235 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fad70d0-6436-4b38-9859-783e17e73cbc tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1453 microversion: 2.75 time: 0.267030 Oct 03 14:42:11.792064 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1238/2444] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:11 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1453 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:11.949858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:11.961903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:11.962692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:11.966013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:11.967462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:11.982684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:11.983213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:11.987353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:11.988783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:12.002999 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80b97c7d-c9b8-425f-9580-436f07d72422 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.903534 Oct 03 14:42:12.002999 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1207/2445] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:11 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:12.010393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:12.018233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:12.028689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:12.030603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:12.047273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:12.049397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:12.049985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:12.057847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:12.058562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:12.059311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:12.373841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:12.385880 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ca88916-8f2d-4df5-a7fd-f9132bb33f43 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.430409 Oct 03 14:42:12.397999 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1239/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:11 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:12.825349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:12.825985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:12.852049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:12.852562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:12.854326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:12.857215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:12.861696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:12.862555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:13.003822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:13.015742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:13.023656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:13.039364 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4907b43-3136-4176-9cb7-2cc359fee2eb tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1453 microversion: 2.75 time: 0.218997 Oct 03 14:42:13.044184 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1240/2447] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:12 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:13.056640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:13.060139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:13.081197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:13.083407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:13.085701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:13.086732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:13.088102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:13.092435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:13.145935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:13.157582 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee4ae609-b19d-4cc7-a798-5e350dfc5c8b tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 1.152057 Oct 03 14:42:13.159787 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1208/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:12 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:13.389659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:13.403496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:13.412350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:13.416749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:13.419919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:13.427961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:13.429953 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b85e7b6b-9509-41b4-ada7-73c624052e9a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.384475 Oct 03 14:42:13.431076 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1241/2449] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:13 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:13.439507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:13.444029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:13.444655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:13.445646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:13.448472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:13.450824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.075512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:14.076258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:14.092339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:14.093223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:14.098538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.102093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:14.106125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:14.106829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.326075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.351611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.362564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.385483 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74d3b404-38e9-46c5-a30a-5ea14df3999a tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1453 microversion: 2.75 time: 0.308799 Oct 03 14:42:14.415223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1242/2450] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:14 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1453 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:14.426173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:14.428328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:14.439948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:14.440726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:14.442911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.443964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:14.445675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:14.446372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.623464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.641835 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5e341df-a00f-4cc3-add1-df2588d4876d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 1.234361 Oct 03 14:42:14.648244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1209/2451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:13 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:14.655775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:14.658747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:14.671841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:14.675171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:14.678625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.679640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:14.680272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:14.681038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.801714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.821033 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b10ba86a-b4a1-4092-a1d4-79770900afb3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.398215 Oct 03 14:42:14.823616 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1243/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:14 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:14.845767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ae7b75db-e119-44cc-80a8-83ca07702ba7 req-aaf10fb6-f6f8-43e4-80ba-b78dd25ca547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af6414f-c6d7-4c0a-9215-80a91bbff1df", "name": "network-vif-plugged", "status": "completed", "tag": "9ea8f36b-63f4-4e1f-8c1c-e41829141e66"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:14.856578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.882533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ae7b75db-e119-44cc-80a8-83ca07702ba7 req-aaf10fb6-f6f8-43e4-80ba-b78dd25ca547 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:14.887995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ae7b75db-e119-44cc-80a8-83ca07702ba7 req-aaf10fb6-f6f8-43e4-80ba-b78dd25ca547 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:14.888720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ae7b75db-e119-44cc-80a8-83ca07702ba7 req-aaf10fb6-f6f8-43e4-80ba-b78dd25ca547 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:14.891551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.902006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:14.931666 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ae7b75db-e119-44cc-80a8-83ca07702ba7 req-aaf10fb6-f6f8-43e4-80ba-b78dd25ca547 service nova] Creating event network-vif-plugged:9ea8f36b-63f4-4e1f-8c1c-e41829141e66 for instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df on n-h2-781139-2 Oct 03 14:42:14.938172 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed1952c6-cfa3-4daf-9173-63c27ecd0264 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.286884 Oct 03 14:42:14.940884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1210/2453] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:14 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:14.942368 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ae7b75db-e119-44cc-80a8-83ca07702ba7 req-aaf10fb6-f6f8-43e4-80ba-b78dd25ca547 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112511 Oct 03 14:42:14.945174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1244/2454] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:15.422200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:15.423610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:15.439463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:15.441219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:15.443433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:15.446285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:15.446987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:15.453452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:15.674354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:15.675865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:15.693165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:15.693912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:15.695544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:15.696522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:15.697802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:15.698396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:15.945734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:15.961740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:15.964101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:15.978181 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ee9e3b0-f0c3-47bf-826c-7e9f92c6a2d0 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1438 microversion: 2.75 time: 0.559891 Oct 03 14:42:15.980385 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1211/2455] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:15 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1438 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:15.990254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:15.994534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:16.029331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:16.030131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:16.032685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:16.034688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:16.037813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:16.038445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:16.360292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:16.363125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:16.373506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f8804045-12fb-438f-a0ad-4593c9e03bc1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.705342 Oct 03 14:42:16.379250 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1245/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:15 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:16.390179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:16.391056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:16.413951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:16.418118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:16.418782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:16.421321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:16.421794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:16.424698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:16.695555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:16.704057 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-199c3f1b-cb85-495d-968a-4214831218af tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.721044 Oct 03 14:42:16.718335 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1212/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:15 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:16.898870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:16.902282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:16.911383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:16.916692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:16.918628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:16.919649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:16.920347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:16.921069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:16.961898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:16.970969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:16.991186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:17.004222 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29163435-9e9e-45bf-8928-34ad3e171992 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.622170 Oct 03 14:42:17.029771 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1246/2458] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:16 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:17.047056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-044ff3f3-75e8-41ad-b442-3f7479704e25 req-2cac7567-fe26-4e02-893f-da32c8b878b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2cfc2c-d093-46a8-ab70-d5627e4b09a9", "name": "network-vif-plugged", "status": "completed", "tag": "d6d0d3fb-8344-4199-b8f1-addb7e2101d0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:17.066803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:42:17.074781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:42:17.075292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:42:17.075708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:42:17.076126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:42:17.077690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-044ff3f3-75e8-41ad-b442-3f7479704e25 req-2cac7567-fe26-4e02-893f-da32c8b878b8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:17.078300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-044ff3f3-75e8-41ad-b442-3f7479704e25 req-2cac7567-fe26-4e02-893f-da32c8b878b8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:17.085663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-044ff3f3-75e8-41ad-b442-3f7479704e25 req-2cac7567-fe26-4e02-893f-da32c8b878b8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:17.107678 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-044ff3f3-75e8-41ad-b442-3f7479704e25 req-2cac7567-fe26-4e02-893f-da32c8b878b8 service nova] Creating event network-vif-plugged:d6d0d3fb-8344-4199-b8f1-addb7e2101d0 for instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 on n-h2-781139-2 Oct 03 14:42:17.118814 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-044ff3f3-75e8-41ad-b442-3f7479704e25 req-2cac7567-fe26-4e02-893f-da32c8b878b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082039 Oct 03 14:42:17.120273 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1247/2459] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:42:17.236812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:17.259614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:17.260138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:17.263225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:17.265843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:17.266725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:17.267175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:17.407327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:17.411452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:17.432663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:17.434195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:17.434968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:17.436283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:17.439110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:17.443332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:17.559479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:17.644594 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8e54538-8eee-4938-8d78-462e5a55c7f1 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a/action" status: 202 len: 1942 microversion: 2.75 time: 0.924627 Oct 03 14:42:17.685570 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1213/2460] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:42:16 2022] POST /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a/action => generated 1942 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 03 14:42:17.698818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:17.699951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:17.718863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:17.721837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:17.722577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:17.723952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:17.729988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:17.730718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:17.748014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:17.964523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:18.007019 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ca0ae25-8a04-4e66-a127-1679677889e5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1308 microversion: 2.1 time: 0.598753 Oct 03 14:42:18.008019 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1248/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:17 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:18.030192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:18.031066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:18.077428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:18.079248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:18.080371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:18.083154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:18.086656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:18.088344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:18.350001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:18.373793 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5432a12-b0d6-466c-acb2-092b535c5dcb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.686782 Oct 03 14:42:18.374927 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1214/2462] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:17 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:18.407653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:18.410082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:18.426506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:18.428145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:18.430123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:18.432376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:18.434046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:18.436466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:18.563708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:18.579032 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e770e0c6-c522-4528-9e93-269f7f53f6cb tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.566227 Oct 03 14:42:18.579731 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1249/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:18 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:18.694326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:18.715463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:18.717292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:18.754086 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d65d7772-f46f-4fc6-95a5-eb5e3f868baf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.375393 Oct 03 14:42:18.777827 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1215/2464] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:18 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:19.035173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:19.035843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:19.049783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.053633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.055114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:19.057102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.057659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.060001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:19.407311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:19.408684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:19.419281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.419776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.424404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:19.425067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.427932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.429187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:19.610809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:19.685314 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91067bfa-16da-46a8-b36f-93b8337c4fe8 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.282501 Oct 03 14:42:19.686603 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1216/2465] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:19 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:19.714125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:19.715302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:19.738518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.739112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.739556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:19.745649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.746147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.746594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:19.755620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:19.775367 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3fd2c601-4c87-4661-9a13-4efb49079123 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1490 microversion: 2.1 time: 0.744259 Oct 03 14:42:19.779268 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1250/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:19 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1490 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:19.799898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:19.800965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:19.823546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.835297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.837024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:19.846102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:19.846973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:19.851086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:20.096383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:20.122977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:20.135287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:20.153066 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff9adf85-ce27-4a14-b1ac-8d1bc82053a7 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.354268 Oct 03 14:42:20.155620 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1251/2467] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:19 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:20.177716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:20.179770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:20.188739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:20.208422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:20.209356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1bbb6aa7-99fe-4d3b-9253-08a8d9f34245 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1318 microversion: 2.1 time: 0.521221 Oct 03 14:42:20.213860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:20.214510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:20.219344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:20.221294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:20.222428 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1217/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:19 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:20.223477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:20.724368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:20.725024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:20.735643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:20.736327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:20.736963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:20.753339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:20.756594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:20.757246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:20.845074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:20.858536 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-67bed315-7d62-4ad4-8130-3b234b04c011 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1489 microversion: 2.1 time: 0.697093 Oct 03 14:42:20.863257 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1252/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:20 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1489 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:20.869239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-77a96df0-33c4-4364-9805-a4e7959192c9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Action: 'create', calling method: .version_select at 0x7fb2308985e0>, body: {"keypair": {"name": "tempest-keypair-496860179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuMbw52s0jgVlA25CwMa0dffC6n2/VilSwPDrNJG4XJ034QdBCcuDUvZ9WjL79B9AZXWN8EFTWekkIFckkxvybmxnT/0fmpvDOkAmNytD5gM195f7+VfSkETF2C7kkl/g=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:20.892741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:20.910269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-77a96df0-33c4-4364-9805-a4e7959192c9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Getting quotas for project c33c2d9960274f1dad48de24a88484dd. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:20.917359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-77a96df0-33c4-4364-9805-a4e7959192c9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Getting quotas for user 645649c7b4ad474c8aa0ffa7677e121d and project c33c2d9960274f1dad48de24a88484dd. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:20.949225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:20.964496 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-77a96df0-33c4-4364-9805-a4e7959192c9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.098640 Oct 03 14:42:20.967030 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1253/2470] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:42:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:21.002459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec3bd4e7-e4e3-486f-baea-f41dbec61271 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.279897 Oct 03 14:42:21.002459 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1218/2471] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:20 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:21.003742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:21.014242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:21.041370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.046177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.048284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.049748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.054996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.055720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.187882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:21.188667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:21.204169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.204680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.205186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.205906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.206377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.206798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.426663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:21.450011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:21.461189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:21.486371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bbfe1df-9884-4df5-a14d-de3c34561760 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.298624 Oct 03 14:42:21.500958 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1219/2472] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:21 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:21.514685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:21.518901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:21.545735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.548373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.548877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.549808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.550282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.550712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.820827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:21.836188 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0d0ed012-f06b-472f-825b-a632d611e3e8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1490 microversion: 2.1 time: 0.866123 Oct 03 14:42:21.839262 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1254/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:20 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1490 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:21.866346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:21.866903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:21.884975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.886265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.886808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.887617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:21.888135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:21.891960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:21.961725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:42:21.964628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:21.978796 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7172461-0e0f-4a74-baeb-e41ed2e61f54 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1509 microversion: 2.1 time: 0.485400 Oct 03 14:42:22.002407 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1220/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:21 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:22.026817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:22.028009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:22.040332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.041011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.041837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.042592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.047369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.048727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.143534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e8a9f07-77db-4bab-9480-73a6f4fe6097 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 204 len: 0 microversion: 2.1 time: 0.281586 Oct 03 14:42:22.144145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1255/2475] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:42:21 2022] DELETE /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:42:22.153099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:22.153798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:22.170874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.173528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.174217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.190547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.194054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.195420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.322983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:22.331799 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37110926-3644-4317-af58-a3b63c840df3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1509 microversion: 2.1 time: 0.323625 Oct 03 14:42:22.347392 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1221/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:22 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:22.368637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:22.369412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:22.377591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.378360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.379006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.380274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.380957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.381594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.526781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:22.584113 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-808f1fde-ced9-45d1-bfbd-14a236cb0994 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.433801 Oct 03 14:42:22.586376 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1256/2477] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:22 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:22.592758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:22.597115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:22.609227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:22.621366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f2a0771-0e6e-4ce1-8997-ca284547bbd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1496 microversion: 2.1 time: 0.272361 Oct 03 14:42:22.626800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.628678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.636685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.638473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.638661 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1222/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:22 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1496 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:22.640294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.641099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.669482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:22.671012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:22.678508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.679399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.680744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.681755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.682648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.683238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.767176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:22.782827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:22.788890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:22.804813 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c9a4d661-37e1-4222-86c4-8e043e83a479 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.163895 Oct 03 14:42:22.807960 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1223/2479] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:22 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:22.835309 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-548d5e8f-6b3d-4c37-ade1-7e66a46889c7 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "PUT /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1081 microversion: 2.1 time: 0.245709 Oct 03 14:42:22.836058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1257/2480] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:42:22 2022] PUT /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1081 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:22.857620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:22.858227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:22.872529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.873784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.875155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:22.876331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:22.877024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:22.877706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.144144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:23.154375 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97dd0efc-5b20-4b5c-8eef-9b2af21de138 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1507 microversion: 2.1 time: 0.300584 Oct 03 14:42:23.155468 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1224/2481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:22 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:23.179349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:23.179901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:23.196501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.198454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.200273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.201066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.203718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.206569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.292672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-705f968f-2a6a-4451-aed6-76f873258821 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb2300f4160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:23.345673 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-705f968f-2a6a-4451-aed6-76f873258821 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176" status: 200 len: 637 microversion: 2.1 time: 0.057008 Oct 03 14:42:23.355639 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1225/2482] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:42:23 2022] GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176 => generated 637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:42:23.362040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db2018dd-3992-49e4-8a04-177e2ca31392 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update_all', calling method: .version_select at 0x7fb2300f4550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:23.437240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-db2018dd-3992-49e4-8a04-177e2ca31392 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:23.443217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-db2018dd-3992-49e4-8a04-177e2ca31392 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:23.628304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:23.654956 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a9a57b24-b2fb-4516-ba4b-86422ad63312 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1507 microversion: 2.1 time: 0.478867 Oct 03 14:42:23.656022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1258/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:23 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:23.662694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:23.663766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:23.683477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.683807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.684257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.685133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.685735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.686161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.803096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:23.829145 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-526b9b0e-2a43-411c-9966-3ee91074991b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.171738 Oct 03 14:42:23.830759 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1259/2484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:23 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:23.838572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:23.839354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:23.846809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.847469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.848144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.848771 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db2018dd-3992-49e4-8a04-177e2ca31392 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 61 microversion: 2.1 time: 0.491683 Oct 03 14:42:23.849346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.849950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.850524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.854060 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1226/2485] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:23 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 61 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:23.858832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:23.862559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:23.875552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.876275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.876856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.877603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.878376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.879091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.972149 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bb87cf0-0f3c-4644-ae1b-557f7695c390 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "PUT /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1083 microversion: 2.1 time: 0.116317 Oct 03 14:42:23.972508 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1227/2486] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:42:23 2022] PUT /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1083 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:23.978599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:23.978599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:23.986313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.986881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.987356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:23.988295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:23.988781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:23.989898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:24.077670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:24.090558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:24.092276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:24.097646 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e36e5355-5fb3-4d35-9a6e-035d4358d81b tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.123873 Oct 03 14:42:24.108552 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1228/2487] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:23 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:24.112270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02855f4e-7a3e-48ff-b03c-6ec426e39e86 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb2302038b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:24.161416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:24.169975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec442238-3ec2-4d86-b625-8c3926b62324 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1496 microversion: 2.1 time: 0.337699 Oct 03 14:42:24.173571 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1260/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:23 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1496 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:24.186905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:24.187655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:24.200216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:24.201215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:24.202895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:24.205772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:24.206319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:24.206851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:24.212903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:24.384864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:24.394533 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8a801117-804c-4e92-ad6b-bcadd61afa55 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1509 microversion: 2.1 time: 0.219617 Oct 03 14:42:24.396051 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1261/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:24 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:24.409506 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02855f4e-7a3e-48ff-b03c-6ec426e39e86 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "DELETE /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.310016 Oct 03 14:42:24.413137 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1229/2490] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 3 14:42:24 2022] DELETE /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata/os_version => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:42:24.416465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2085211895", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "25b896d0-39e0-480c-989c-208b9ed100ba"}, {"port": "84d54848-c6f3-4db7-b825-aea10dffd716", "tag": "port-1"}, {"port": "cfca253d-f28f-451d-80fd-bd99585b6293", "tag": "port-2"}, {"uuid": "26b7a1fe-d68c-4241-a355-5358f9c8225f", "tag": "net-1"}, {"uuid": "26b7a1fe-d68c-4241-a355-5358f9c8225f"}, {"uuid": "27e087bd-f36d-420f-8ae5-0648c4ab5d3c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "27e087bd-f36d-420f-8ae5-0648c4ab5d3c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "899a9349-7199-4296-a8ac-784b4a45812f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c101247d-91af-49af-8cad-ad19dd53c6ba", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ebf4a8da-f0bd-4903-96e5-344fc44cd787", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--443352822"}], "key_name": "tempest-keypair-496860179", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:24.537863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f856fce7-1618-42e7-bbd7-d2aec9469772 tempest-NetworksTest-1345314016 tempest-NetworksTest-1345314016-project-admin] Calling method '.version_select at 0x7fb230978c10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:24.583296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] validate_networks() for [('25b896d0-39e0-480c-989c-208b9ed100ba', None, None, None, None, None), (None, None, '84d54848-c6f3-4db7-b825-aea10dffd716', None, None, None), (None, None, 'cfca253d-f28f-451d-80fd-bd99585b6293', None, None, None), ('26b7a1fe-d68c-4241-a355-5358f9c8225f', None, None, None, None, None), ('26b7a1fe-d68c-4241-a355-5358f9c8225f', None, None, None, None, None), ('27e087bd-f36d-420f-8ae5-0648c4ab5d3c', '10.2.2.100', None, None, None, None), ('27e087bd-f36d-420f-8ae5-0648c4ab5d3c', '10.2.2.200', None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:42:24.660306 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f856fce7-1618-42e7-bbd7-d2aec9469772 tempest-NetworksTest-1345314016 tempest-NetworksTest-1345314016-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 6703 microversion: 2.1 time: 0.262353 Oct 03 14:42:24.661075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1262/2491] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:42:24 2022] GET /compute/v2.1/os-networks => generated 6703 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:24.665562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a575509b-1ad7-4663-a10b-a29df0b0d537 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb230d63940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:24.704300 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a575509b-1ad7-4663-a10b-a29df0b0d537 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 37 microversion: 2.1 time: 0.042171 Oct 03 14:42:24.710415 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1263/2492] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:42:24 2022] GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 37 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:24.715346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:24.716045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:24.723355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:24.723842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:24.724428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:24.725157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:24.725607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:24.726015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:24.863840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:24.872877 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e1d9572c-2111-445b-b6ca-b7bbbba59f03 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1509 microversion: 2.1 time: 0.161070 Oct 03 14:42:24.873824 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1264/2493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:24 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:24.878883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61b557ae-ae21-49a6-80f6-c93bdd175b04 tempest-NetworksTest-1345314016 tempest-NetworksTest-1345314016-project-admin] Calling method '.version_select at 0x7fb230a981f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:24.979603 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61b557ae-ae21-49a6-80f6-c93bdd175b04 tempest-NetworksTest-1345314016 tempest-NetworksTest-1345314016-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/69d37d98-1d3b-4dad-8cee-9d78aa7b9aee" status: 200 len: 652 microversion: 2.1 time: 0.104548 Oct 03 14:42:24.980205 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1265/2494] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:42:24 2022] GET /compute/v2.1/os-networks/69d37d98-1d3b-4dad-8cee-9d78aa7b9aee => generated 652 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:24.985180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f38040f9-8fdf-40ce-909e-ca2edffb33ca tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update_all', calling method: .version_select at 0x7fb230c73040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:25.038056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f38040f9-8fdf-40ce-909e-ca2edffb33ca tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:25.043945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f38040f9-8fdf-40ce-909e-ca2edffb33ca tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:25.298866 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f38040f9-8fdf-40ce-909e-ca2edffb33ca tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 61 microversion: 2.1 time: 0.317557 Oct 03 14:42:25.299467 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1266/2495] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:24 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 61 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:25.303952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:25.304557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:25.311274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:25.311747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:25.312358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:25.313075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:25.313774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:25.314198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:25.385665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:25.404778 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cfdab794-e75b-4d03-be5d-49f5bd9d5b61 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.104253 Oct 03 14:42:25.405423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1267/2496] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:25 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:25.418179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:25.419342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:25.426612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:25.427325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:25.427829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:25.428721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:25.429500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:25.430407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:25.499667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:42:25.678901 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3710cf8-0203-48a5-b95d-a9e23ca053a3 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 204 len: 0 microversion: 2.1 time: 0.271978 Oct 03 14:42:25.679548 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1268/2497] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:42:25 2022] DELETE /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:42:25.688718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a263b64a-8744-4063-b208-0156b5b90e18 tempest-NetworksTest-1345314016 tempest-NetworksTest-1345314016-project-admin] Calling method '.version_select at 0x7fb230d27040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:25.849049 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a263b64a-8744-4063-b208-0156b5b90e18 tempest-NetworksTest-1345314016 tempest-NetworksTest-1345314016-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 6703 microversion: 2.1 time: 0.167844 Oct 03 14:42:25.849691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1269/2498] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:42:25 2022] GET /compute/v2.1/os-networks => generated 6703 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:25.861225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:25.862021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:25.871912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:25.872470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:25.872849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:25.873985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:25.876023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:25.877530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:25.982233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:25.991867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:25.993349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:25.999342 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-27d4f318-2623-47a8-9f56-14932ef00612 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.141894 Oct 03 14:42:25.999906 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1270/2499] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:25 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:26.022102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:26.023068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:26.030140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.030825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.031610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.032470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.033631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.034213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.075856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.076721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.077710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.078245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lazy-loading 'fault' on Instance uuid 1af6414f-c6d7-4c0a-9215-80a91bbff1df {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:26.129692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:26.138494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a514911f-891f-4048-811c-5f7c38ede859 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1298 microversion: 2.1 time: 0.137400 Oct 03 14:42:26.153011 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1271/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:26 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:26.161353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b3cee83-44da-4b62-a936-e03c263db36e tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb2308984c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:26.206974 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b3cee83-44da-4b62-a936-e03c263db36e tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.050469 Oct 03 14:42:26.213390 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1272/2501] 10.222.0.20 () {58 vars in 1290 bytes} [Mon Oct 3 14:42:26 2022] GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata/os_distro => generated 33 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:26.224873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e20f02ff-2b78-4c06-9729-91ffeecc3330 req-cf14e5df-a58a-4038-b262-dde1c3706998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af6414f-c6d7-4c0a-9215-80a91bbff1df", "name": "network-vif-deleted", "tag": "9ea8f36b-63f4-4e1f-8c1c-e41829141e66"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:26.248407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e20f02ff-2b78-4c06-9729-91ffeecc3330 req-cf14e5df-a58a-4038-b262-dde1c3706998 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.249073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e20f02ff-2b78-4c06-9729-91ffeecc3330 req-cf14e5df-a58a-4038-b262-dde1c3706998 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.249729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e20f02ff-2b78-4c06-9729-91ffeecc3330 req-cf14e5df-a58a-4038-b262-dde1c3706998 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.264479 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e20f02ff-2b78-4c06-9729-91ffeecc3330 req-cf14e5df-a58a-4038-b262-dde1c3706998 service nova] Creating event network-vif-deleted:9ea8f36b-63f4-4e1f-8c1c-e41829141e66 for instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df on n-h2-781139-2 Oct 03 14:42:26.271506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e20f02ff-2b78-4c06-9729-91ffeecc3330 req-cf14e5df-a58a-4038-b262-dde1c3706998 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056546 Oct 03 14:42:26.272797 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1273/2502] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:26.278598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:26.279323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:26.286182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.286718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.287250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.288052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.288603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.289217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.328586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:42:26.399059 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.compute.api [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Instance is already in deleting state, ignoring this request Oct 03 14:42:26.400358 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-739f3ca0-3d5c-402a-9bdd-3fa9a26f0791 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 204 len: 0 microversion: 2.1 time: 0.126129 Oct 03 14:42:26.402241 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1274/2503] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:42:26 2022] DELETE /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:42:26.410999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-10d2a278-6c38-406d-901c-350ae4524d56 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update_all', calling method: .version_select at 0x7fb230782310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:26.480326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-10d2a278-6c38-406d-901c-350ae4524d56 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:26.486881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-10d2a278-6c38-406d-901c-350ae4524d56 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:26.666493 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-10d2a278-6c38-406d-901c-350ae4524d56 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 61 microversion: 2.1 time: 0.262953 Oct 03 14:42:26.667249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1275/2504] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:26 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 61 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:26.672065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:26.672892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:26.680319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.680805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.681278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.681982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.682426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.682844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.870089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:26.890866 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc103b3d-c912-4ae3-a409-524bdb03a67d tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1515 microversion: 2.1 time: 0.222387 Oct 03 14:42:26.911050 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1276/2505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:26 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:26.920784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:26.921959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:26.930137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.930324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.930758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:26.931471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:26.931964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:26.932363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.045348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:27.069016 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a57f196e-1472-441a-ae12-47498e10f95a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.156557 Oct 03 14:42:27.069624 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1277/2506] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:26 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:27.074092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76f6e8e9-8b8e-448e-aafa-0af577bfd4a1 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb2308985e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:27.125984 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76f6e8e9-8b8e-448e-aafa-0af577bfd4a1 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 61 microversion: 2.1 time: 0.055302 Oct 03 14:42:27.127074 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1278/2507] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:42:27 2022] GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 61 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:27.133225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:27.134792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:27.141666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.142258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.143102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.144679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.145844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.146289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.243835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:27.257322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:27.266347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:27.273363 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-efc0b748-31bd-49ab-b9d3-580d78b1754d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1533 microversion: 2.91 time: 0.144701 Oct 03 14:42:27.274287 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1279/2508] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:27 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1533 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:27.279854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bf32aabe-cc0c-4109-9d63-215bfc1145c4 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update_all', calling method: .version_select at 0x7fb230978c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:27.350124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-bf32aabe-cc0c-4109-9d63-215bfc1145c4 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:27.355285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-bf32aabe-cc0c-4109-9d63-215bfc1145c4 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:27.515094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bf32aabe-cc0c-4109-9d63-215bfc1145c4 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 61 microversion: 2.1 time: 0.239218 Oct 03 14:42:27.515674 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1280/2509] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:27 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 61 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:27.523559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:27.523982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:27.530201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.530691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.531131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.531830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.532313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.532705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.565496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.565976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.566407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.567027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lazy-loading 'fault' on Instance uuid 1af6414f-c6d7-4c0a-9215-80a91bbff1df {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:27.620637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:27.629521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ffa6e6e-2b3a-4b38-9f19-c1677143c1c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 200 len: 1298 microversion: 2.1 time: 0.112517 Oct 03 14:42:27.640951 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1281/2510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:27 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:27.640951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:27.640951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:27.640951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:27.647377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.647377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.647377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.647377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.647377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.647377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.722619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lazy-loading 'services' on Instance uuid 87b3c599-7ab6-4d1e-8223-0b23c1661c63 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:27.724982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:27.745071 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9b9f353-4f23-4983-ba42-c628e431c60a tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1938 microversion: 2.91 time: 0.113862 Oct 03 14:42:27.749197 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1282/2511] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:27 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1938 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:27.754395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00cd9374-3c42-4dd9-bf20-c1f747ba8112 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update_all', calling method: .version_select at 0x7fb23096de50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:27.829690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-00cd9374-3c42-4dd9-bf20-c1f747ba8112 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:27.836962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-00cd9374-3c42-4dd9-bf20-c1f747ba8112 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:27.902934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:42:27.903412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:42:27.903813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:42:27.904222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:42:27.904633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:42:27.916183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.916665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.917167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.917888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:27.918339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:27.918759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:27.939672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Getting quotas for project c33c2d9960274f1dad48de24a88484dd. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:27.946626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Getting quotas for user 645649c7b4ad474c8aa0ffa7677e121d and project c33c2d9960274f1dad48de24a88484dd. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:28.186783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:42:28.190223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='899a9349-7199-4296-a8ac-784b4a45812f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c101247d-91af-49af-8cad-ad19dd53c6ba',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebf4a8da-f0bd-4903-96e5-344fc44cd787',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:42:28.299211 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00cd9374-3c42-4dd9-bf20-c1f747ba8112 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 64 microversion: 2.1 time: 0.548779 Oct 03 14:42:28.300302 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1283/2512] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:27 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 64 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:28.309929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:28.310716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:28.319794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.320326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.321005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.321877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.322751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.323483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.350848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lazy-loading 'flavor' on Instance uuid 87b3c599-7ab6-4d1e-8223-0b23c1661c63 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:28.576673 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5a6dbdb-5c5e-4c59-a535-b25bcddbef1c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action" status: 202 len: 0 microversion: 2.91 time: 0.274491 Oct 03 14:42:28.577321 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1284/2513] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:42:28 2022] POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:42:28.585035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:28.585553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:28.592188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.593061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.593771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.594480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.595127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.595555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.630065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.630582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.631020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.631475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lazy-loading 'fault' on Instance uuid 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:28.645755 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04faef18-623b-4ce3-83f3-9b1f4065c5bb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.231342 Oct 03 14:42:28.654869 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1230/2514] 10.222.0.20 () {62 vars in 1189 bytes} [Mon Oct 3 14:42:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 4244 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:42:28.664309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:28.669320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:28.676236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.676754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.677276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.678171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.678784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.679478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.683704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca91b4c2c303476b870b879e712ba2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bfd2cb85d9c4983a86823d7b267d66f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:28.694144 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-88f41c12-3e99-4011-9ed6-a09a05269d8c tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 200 len: 1308 microversion: 2.1 time: 0.115334 Oct 03 14:42:28.695360 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1285/2515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:28 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:28.712288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a7d0d8fe-4803-4e60-8d44-743c7b1ee7df tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb2308881f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:28.780086 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a7d0d8fe-4803-4e60-8d44-743c7b1ee7df tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 64 microversion: 2.1 time: 0.083102 Oct 03 14:42:28.780785 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1286/2516] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:42:28 2022] GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:28.790181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:28.790849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:28.805259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.805757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.806192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.806908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.807367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.807786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.815050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:28.859901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-956215bf-70ab-4c68-9b18-519c69c2e93a tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.203558 Oct 03 14:42:28.860828 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1231/2517] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:28 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:28.866280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6501f4b9-a557-4703-a367-260b0d561693 req-35ab4ccd-8e5d-4723-a0a5-975ccee81fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e2cfc2c-d093-46a8-ab70-d5627e4b09a9", "name": "network-vif-deleted", "tag": "d6d0d3fb-8344-4199-b8f1-addb7e2101d0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:28.880086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6501f4b9-a557-4703-a367-260b0d561693 req-35ab4ccd-8e5d-4723-a0a5-975ccee81fa7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.880756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6501f4b9-a557-4703-a367-260b0d561693 req-35ab4ccd-8e5d-4723-a0a5-975ccee81fa7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.881454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6501f4b9-a557-4703-a367-260b0d561693 req-35ab4ccd-8e5d-4723-a0a5-975ccee81fa7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.906772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6501f4b9-a557-4703-a367-260b0d561693 req-35ab4ccd-8e5d-4723-a0a5-975ccee81fa7 service nova] Creating event network-vif-deleted:d6d0d3fb-8344-4199-b8f1-addb7e2101d0 for instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 on n-h2-781139-2 Oct 03 14:42:28.913464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:28.923799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:28.925019 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6501f4b9-a557-4703-a367-260b0d561693 req-35ab4ccd-8e5d-4723-a0a5-975ccee81fa7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062556 Oct 03 14:42:28.926199 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1232/2518] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:28.926407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:28.932489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:28.933924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:28.934367 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-28d19aac-4e3a-4164-a8c5-a1e80960e96d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.148191 Oct 03 14:42:28.942280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.942999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.943489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.944309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:28.944851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:28.945396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:28.950032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:28.950385 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1287/2519] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:28 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:28.959577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c002809d-2c68-4169-96b2-ecd3d99d808f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:28.960473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c002809d-2c68-4169-96b2-ecd3d99d808f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:28.963156 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df HTTP/1.1 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1af6414f-c6d7-4c0a-9215-80a91bbff1df'} Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:28.965111 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:28.968955 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:28.968955 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:28.968955 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:28.968955 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:28.968955 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:28.968955 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:42:28.968955 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:28.971182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:28.972114 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eea164d5-2f08-4a79-b526-71cd147332e2 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 404 len: 111 microversion: 2.1 time: 0.044443 Oct 03 14:42:28.976140 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1233/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:28 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:28.979919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63c2b69b-85de-4f0d-93ee-79e62e89c5e8 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update_all', calling method: .version_select at 0x7fb230203d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:29.048510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c002809d-2c68-4169-96b2-ecd3d99d808f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:29.053361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-63c2b69b-85de-4f0d-93ee-79e62e89c5e8 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:29.058628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c002809d-2c68-4169-96b2-ecd3d99d808f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:29.060803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-63c2b69b-85de-4f0d-93ee-79e62e89c5e8 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:29.073172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c002809d-2c68-4169-96b2-ecd3d99d808f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:29.074728 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c002809d-2c68-4169-96b2-ecd3d99d808f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1285 microversion: 2.42 time: 0.123107 Oct 03 14:42:29.075537 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1288/2521] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:28 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:29.075748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:29.124912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.124912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:29.137238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.137736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.138182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.141922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.142840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.143485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.186509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:42:29.287230 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df3cbb09-b1e1-4710-9bed-89f5106be528 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 204 len: 0 microversion: 2.1 time: 0.190135 Oct 03 14:42:29.288045 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1289/2522] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:42:29 2022] DELETE /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:42:29.298070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.299006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:29.306374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.306930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.307341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.308053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.308477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.308901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.451139 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63c2b69b-85de-4f0d-93ee-79e62e89c5e8 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 61 microversion: 2.1 time: 0.477299 Oct 03 14:42:29.455871 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1234/2523] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:28 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 61 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:29.462394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2603a300-f04e-408e-be0c-09f57a7bef0b tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update', calling method: .version_select at 0x7fb2313fd160>, body: {"meta": {"os_version": "alt"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:29.519301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:29.526607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2603a300-f04e-408e-be0c-09f57a7bef0b tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:29.528681 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-08307c71-3aa4-48cf-9b68-4d1c7f183e93 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1495 microversion: 2.1 time: 0.235062 Oct 03 14:42:29.532561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2603a300-f04e-408e-be0c-09f57a7bef0b tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:29.541677 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1290/2524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:29 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1495 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:29.719351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.719968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:29.727696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.728192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.728601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.729328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.729771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.730189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.746051 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] HTTP exception thrown: Instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 could not be found. Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Request method failure captured: Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 HTTP/1.1 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQe1_SUD0eeuoliOXpqOdDR1z7JAY2wTOaKCMNxgp4NZwmNryMbqjJCmDVEq29ZwhuBh9i0gcv9bz1LRUu-meikBfgp2hSFcOH4GvkJMe_y2RQjd6pVh0q9_KJiycTl30QVXaz17FQ4htcUEz3Ik0wx3HSVuGZDg1jayqjLtnYmFCY Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bfd2cb85d9c4983a86823d7b267d66f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ca91b4c2c303476b870b879e712ba2a4 Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 could not be found. Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '0e2cfc2c-d093-46a8-ab70-d5627e4b09a9'} Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 could not be found. Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 could not be found. Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:29.747638 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 could not be found. Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Returning 404 to user: Instance 0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82ca41b8-876a-40c4-a368-ec669bbffa29 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9" status: 404 len: 111 microversion: 2.1 time: 0.033757 Oct 03 14:42:29.752019 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1291/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:29 2022] GET /compute/v2.1/servers/0e2cfc2c-d093-46a8-ab70-d5627e4b09a9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:29.825207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2603a300-f04e-408e-be0c-09f57a7bef0b tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.366715 Oct 03 14:42:29.825797 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1235/2526] 10.222.0.20 () {60 vars in 1313 bytes} [Mon Oct 3 14:42:29 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata/os_version => generated 31 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:29.830527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.831036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:29.837468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.837955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.838379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.839079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.839524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.839943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.855910 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] HTTP exception thrown: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Request method failure captured: Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 HTTP/1.1 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQe1_SUD0eeuoliOXpqOdDR1z7JAY2wTOaKCMNxgp4NZwmNryMbqjJCmDVEq29ZwhuBh9i0gcv9bz1LRUu-meikBfgp2hSFcOH4GvkJMe_y2RQjd6pVh0q9_KJiycTl30QVXaz17FQ4htcUEz3Ik0wx3HSVuGZDg1jayqjLtnYmFCY Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bfd2cb85d9c4983a86823d7b267d66f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ca91b4c2c303476b870b879e712ba2a4 Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e8e4183c-88c6-4279-8889-833abf5136e1'} Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:29.857666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Returning 404 to user: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-906e29f2-e778-474a-ad3b-4ba9168e2431 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 404 len: 111 microversion: 2.1 time: 0.033267 Oct 03 14:42:29.861837 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1236/2527] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:42:29 2022] DELETE /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:29.865686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff990f28-9c32-4389-a852-2f38aea1f8da tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb230203c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.903546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0d6642c8-ad1c-4e2a-a1ec-5a3ef9f1f3e8 tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] Calling method '.version_select at 0x7fb2309cb9d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.908801 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff990f28-9c32-4389-a852-2f38aea1f8da tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 58 microversion: 2.1 time: 0.047124 Oct 03 14:42:29.909632 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1237/2528] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:42:29 2022] GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 58 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:29.915648 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0d6642c8-ad1c-4e2a-a1ec-5a3ef9f1f3e8 tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.165048 Oct 03 14:42:29.916227 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1292/2529] 10.222.0.20 () {60 vars in 1226 bytes} [Mon Oct 3 14:42:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:29.919497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.920285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: e8e4183c-88c6-4279-8889-833abf5136e1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:29.920818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:29.921460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:29.928225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.928713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.928818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.929177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.930039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.930151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.930508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.930704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.930919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.931817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:29.932341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:29.932836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:29.949935 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] HTTP exception thrown: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Request method failure captured: Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 HTTP/1.1 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQe1_SUD0eeuoliOXpqOdDR1z7JAY2wTOaKCMNxgp4NZwmNryMbqjJCmDVEq29ZwhuBh9i0gcv9bz1LRUu-meikBfgp2hSFcOH4GvkJMe_y2RQjd6pVh0q9_KJiycTl30QVXaz17FQ4htcUEz3Ik0wx3HSVuGZDg1jayqjLtnYmFCY Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bfd2cb85d9c4983a86823d7b267d66f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ca91b4c2c303476b870b879e712ba2a4 Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e8e4183c-88c6-4279-8889-833abf5136e1'} Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:29.951809 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Returning 404 to user: Instance e8e4183c-88c6-4279-8889-833abf5136e1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e97e18f5-e9c5-40db-90ce-6dec9fca46bc tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1" status: 404 len: 111 microversion: 2.1 time: 0.039768 Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1238/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:29 2022] GET /compute/v2.1/servers/e8e4183c-88c6-4279-8889-833abf5136e1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:29.959112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdcc075e-2d2c-4d63-b74f-9e4ce3147349 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'update_all', calling method: .version_select at 0x7fb231056f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:30.008430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bdcc075e-2d2c-4d63-b74f-9e4ce3147349 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:30.013348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:30.016329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bdcc075e-2d2c-4d63-b74f-9e4ce3147349 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:30.031700 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8622324a-812d-4450-9146-1f5837c489bb tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.114450 Oct 03 14:42:30.032545 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1293/2531] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:29 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:30.037266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bfa5d5ee-ddbe-4db2-8446-8987f19c63aa tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] Action: 'update', calling method: .version_select at 0x7fb230898430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:30.152980 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bfa5d5ee-ddbe-4db2-8446-8987f19c63aa tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.119112 Oct 03 14:42:30.159074 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1294/2532] 10.222.0.20 () {62 vars in 1247 bytes} [Mon Oct 3 14:42:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:30.159074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:30.159074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:30.165743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.166241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.166726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.167498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.167957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.168387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.194654 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] HTTP exception thrown: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Request method failure captured: Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 HTTP/1.1 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQe1_SUD0eeuoliOXpqOdDR1z7JAY2wTOaKCMNxgp4NZwmNryMbqjJCmDVEq29ZwhuBh9i0gcv9bz1LRUu-meikBfgp2hSFcOH4GvkJMe_y2RQjd6pVh0q9_KJiycTl30QVXaz17FQ4htcUEz3Ik0wx3HSVuGZDg1jayqjLtnYmFCY Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bfd2cb85d9c4983a86823d7b267d66f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ca91b4c2c303476b870b879e712ba2a4 Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'a6b8547b-d12f-474d-8e17-19364eb75441'} Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:30.196821 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.200978 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.203009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Returning 404 to user: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:30.204226 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1947e98-42cf-4206-b22a-7282136ceaae tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 404 len: 111 microversion: 2.1 time: 0.049406 Oct 03 14:42:30.208685 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1295/2533] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:42:30 2022] DELETE /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:30.214605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:30.215408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:30.223940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.224473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.224889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.225796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.226293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.226724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.295506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:30.305232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:30.306694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:30.311592 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42bafe5f-bfcf-4623-b6b9-51c7f4faee5a tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.101686 Oct 03 14:42:30.312164 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1296/2534] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:30 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:30.314707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdcc075e-2d2c-4d63-b74f-9e4ce3147349 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 61 microversion: 2.1 time: 0.359612 Oct 03 14:42:30.315631 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1239/2535] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:29 2022] PUT /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 61 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:30.317478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:30.318350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:30.320974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-073763ff-0414-4d01-abeb-3888b518d242 tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] Calling method '.version_select at 0x7fb230136160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:30.324603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.325399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.326049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.327011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.327718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.328351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.338128 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-073763ff-0414-4d01-abeb-3888b518d242 tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021360 Oct 03 14:42:30.338829 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1240/2536] 10.222.0.20 () {60 vars in 1226 bytes} [Mon Oct 3 14:42:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:30.349534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:30.350184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] [instance: a6b8547b-d12f-474d-8e17-19364eb75441] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:30.357159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.357635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.358066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.358751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.359193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.359637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.373289 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] HTTP exception thrown: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Request method failure captured: Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 HTTP/1.1 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQe1_SUD0eeuoliOXpqOdDR1z7JAY2wTOaKCMNxgp4NZwmNryMbqjJCmDVEq29ZwhuBh9i0gcv9bz1LRUu-meikBfgp2hSFcOH4GvkJMe_y2RQjd6pVh0q9_KJiycTl30QVXaz17FQ4htcUEz3Ik0wx3HSVuGZDg1jayqjLtnYmFCY Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7bfd2cb85d9c4983a86823d7b267d66f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7bfd2cb85d9c4983a86823d7b267d66f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 7bfd2cb85d9c4983a86823d7b267d66f Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1934696651 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ca91b4c2c303476b870b879e712ba2a4 Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-1934696651-project Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a6b8547b-d12f-474d-8e17-19364eb75441'} Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:30.374860 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] Returning 404 to user: Instance a6b8547b-d12f-474d-8e17-19364eb75441 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbcb0fc6-b527-48f8-aa54-481570dd2530 tempest-ServerDiskConfigTestJSON-1934696651 tempest-ServerDiskConfigTestJSON-1934696651-project] 10.222.0.20 "GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441" status: 404 len: 111 microversion: 2.1 time: 0.036310 Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1241/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:30 2022] GET /compute/v2.1/servers/a6b8547b-d12f-474d-8e17-19364eb75441 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:30.381962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42ec73a5-bca6-4de7-b225-b7a39ff835a6 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Action: 'create', calling method: .version_select at 0x7fb23012d550>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:30.433417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-42ec73a5-bca6-4de7-b225-b7a39ff835a6 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:30.439428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-42ec73a5-bca6-4de7-b225-b7a39ff835a6 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Getting quotas for user 74f8961bb56d4ad1bd7aba52b5827cf0 and project 2ec4c8d1aad640db9d540727a12f0384. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:30.442912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:30.452708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:30.454193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:30.455378 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8de66000-ad3c-4040-bfd5-5daa67403163 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1575 microversion: 2.42 time: 0.142238 Oct 03 14:42:30.456205 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1297/2538] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:30 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1575 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:30.468505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c6fb663-705b-4e53-a34f-9e90650acdcf tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] Action: 'update', calling method: .version_select at 0x7fb2308880d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:30.592257 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c6fb663-705b-4e53-a34f-9e90650acdcf tempest-QuotaClassesAdmin257Test-1229255466 tempest-QuotaClassesAdmin257Test-1229255466-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.134774 Oct 03 14:42:30.593116 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1298/2539] 10.222.0.20 () {62 vars in 1247 bytes} [Mon Oct 3 14:42:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:30.598596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:30.599306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:30.608298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.609113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.609551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.610252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:30.610885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:30.611307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:30.860379 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42ec73a5-bca6-4de7-b225-b7a39ff835a6 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "POST /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 85 microversion: 2.1 time: 0.482506 Oct 03 14:42:30.861082 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1242/2540] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Oct 3 14:42:30 2022] POST /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 85 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:42:30.874239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f4b0c29-2a47-431c-bcf9-0e8fc19c7782 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] Calling method '.version_select at 0x7fb230a69d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:30.936542 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f4b0c29-2a47-431c-bcf9-0e8fc19c7782 tempest-ImagesMetadataTestJSON-378186112 tempest-ImagesMetadataTestJSON-378186112-project] 10.222.0.20 "GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata" status: 200 len: 85 microversion: 2.1 time: 0.068512 Oct 03 14:42:30.937180 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1243/2541] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:42:30 2022] GET /compute/v2.1/images/888083d5-950b-4eb5-9e09-b989edb0e176/metadata => generated 85 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:42:30.979304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:30.992128 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3132cea3-e248-41a7-8307-d05cc9facaea tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1495 microversion: 2.1 time: 0.395452 Oct 03 14:42:31.005835 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1299/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:30 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1495 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:31.064166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:31.065778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:31.079285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:31.079804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:31.082624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:31.083873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:31.084354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:31.084795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:31.239057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:31.293791 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76aa9314-d57a-4a88-bd13-57314573c908 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.235206 Oct 03 14:42:31.294575 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1244/2543] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:31 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:31.345929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:31.347094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:31.359988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:31.360573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:31.370079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:31.370951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:31.371498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:31.371996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:31.483073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:31.491077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:31.494145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:31.507533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:31.512883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:31.513407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:31.513848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:31.514569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:31.515017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:31.515438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:31.520118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:31.541294 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e267116-bb8e-403c-99be-ddab93224bbb tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.199363 Oct 03 14:42:31.545498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1300/2544] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:31 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:31.807766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:31.823603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:31.826589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:31.828778 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29849abd-739f-49d7-9804-7ec5fd5e1747 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1593 microversion: 2.42 time: 0.345736 Oct 03 14:42:31.830035 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1245/2545] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:31 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1593 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:32.017641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:32.018743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:32.026033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.027167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.027814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.029382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.030486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.031644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.073084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4944bc49-7177-49c5-bcd0-60dce75ba1ec req-ba03716c-6fd2-42e2-881b-cd734a97f881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b608d4ea-6bc1-4d4b-b383-491340c2dc15", "name": "network-vif-deleted", "tag": "5af30399-6d29-43ed-94fd-4c5c8fa2c1d2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:32.111631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4944bc49-7177-49c5-bcd0-60dce75ba1ec req-ba03716c-6fd2-42e2-881b-cd734a97f881 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.114288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4944bc49-7177-49c5-bcd0-60dce75ba1ec req-ba03716c-6fd2-42e2-881b-cd734a97f881 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.114857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4944bc49-7177-49c5-bcd0-60dce75ba1ec req-ba03716c-6fd2-42e2-881b-cd734a97f881 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.177832 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4944bc49-7177-49c5-bcd0-60dce75ba1ec req-ba03716c-6fd2-42e2-881b-cd734a97f881 service nova] Creating event network-vif-deleted:5af30399-6d29-43ed-94fd-4c5c8fa2c1d2 for instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 on n-h2-781139-2 Oct 03 14:42:32.195881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4944bc49-7177-49c5-bcd0-60dce75ba1ec req-ba03716c-6fd2-42e2-881b-cd734a97f881 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131572 Oct 03 14:42:32.196792 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1246/2546] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:42:32.325346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:32.326486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:32.341917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.342701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.343307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.350745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.351242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.351687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.365934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:32.382417 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2413408-d631-4ef8-83ae-9c0f0d8a59cb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 200 len: 1453 microversion: 2.1 time: 0.370022 Oct 03 14:42:32.385281 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1301/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:32 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 1453 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:32.562922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:32.575114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:32.575731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:32.590762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.591460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.592048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.592751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.593238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.593669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.639385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:32.640819 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-803e5c0a-7484-49d8-8f6c-fc4cadcfc59b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.314394 Oct 03 14:42:32.645297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1247/2548] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:32 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:32.836540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:32.851081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:32.853014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:32.856410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:32.856713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=15,nova_api:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:32.857067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:32.861053 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-049d1249-b571-44b4-a5ea-859900472948 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.289530 Oct 03 14:42:32.866820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.867576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.873084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.874315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:32.874934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:32.875656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:32.885533 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1302/2549] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:32 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:33.236166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:33.259845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:33.262780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:33.264866 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45922d08-9b78-45ac-afa4-684e3b1f7757 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1660 microversion: 2.42 time: 0.413019 Oct 03 14:42:33.277318 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1248/2550] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:32 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1660 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:33.408448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:33.409656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:33.417580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:33.418298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:33.418911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:33.419787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:33.420420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:33.421039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:33.440414 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 HTTP/1.1 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'b608d4ea-6bc1-4d4b-b383-491340c2dc15'} Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:33.443259 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:33.447246 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:33.447246 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:33.447246 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:33.447246 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:33.447246 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:33.447246 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:42:33.447246 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:33.448849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:33.450100 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b16fade9-8a83-417d-a167-f970fc0619c6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 404 len: 111 microversion: 2.1 time: 0.046001 Oct 03 14:42:33.454428 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1303/2551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:33 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:33.581215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-365954024", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "becfb12c-e5af-4560-80c3-4794784e4ae3"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:33.675973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:33.676583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:33.678245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:42:33.689725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:33.690436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:33.691469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:33.692384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:33.693250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:33.693810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:33.807190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:33.851202 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2a8bc1d0-1e76-42cd-96d0-0f348555da1f tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.178869 Oct 03 14:42:33.866653 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1304/2552] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:33 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:33.896366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:33.897083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:33.908122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:33.908621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:33.909075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:33.915166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:33.915843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:33.916484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:34.075246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:34.093791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:34.096480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:34.113534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00fb5761-43a0-4e4c-9ffc-67808ad23578 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.221934 Oct 03 14:42:34.114434 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1305/2553] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:33 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:34.295831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:34.297130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:34.321044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:34.322706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:34.324870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:34.345868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:34.350148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:34.350743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:34.879827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:34.892358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:34.897135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:34.901413 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cfb94ff4-6d82-4d8a-a4e3-87cc591e721b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1706 microversion: 2.42 time: 0.612231 Oct 03 14:42:34.904669 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1306/2554] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:34 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1706 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:34.910159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:34.914390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:34.920641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:34.926544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:34.927309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:34.932305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:34.933290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:34.934844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:35.531571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:42:35.532613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:42:35.533277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:42:35.533870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:42:35.534435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:42:35.550464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:35.553503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:35.554388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:35.556627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:35.558392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:35.559426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:35.564746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:35.610459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:35.620659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:35.624424 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6aa5a13d-73fb-40ff-8911-bb7a533c8f4b tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.716079 Oct 03 14:42:35.625292 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1307/2555] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:34 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:35.636979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:35.647964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:35.660544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:42:35.663266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:42:35.666100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:35.666599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:35.667041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:35.667754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:35.668209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:35.668633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:35.772414 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02b6468b-257e-4a7b-9e66-bcbc769a8804 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.195880 Oct 03 14:42:35.774938 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1249/2556] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:42:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:42:35.985095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:36.011367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:36.012724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:36.030634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bdb5619c-3a36-43b9-87ed-8ab9434244ed tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.402537 Oct 03 14:42:36.031357 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1308/2557] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:35 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:36.069658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3d174c69-3c70-4111-b6bc-4f6f41740b69 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:36.071534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3d174c69-3c70-4111-b6bc-4f6f41740b69 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:36.244462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40151333-49ee-43bd-ae67-0c01725266d6 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Calling method '.version_select at 0x7fb2300f4700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:36.305991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3d174c69-3c70-4111-b6bc-4f6f41740b69 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:36.319186 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3d174c69-3c70-4111-b6bc-4f6f41740b69 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1208 microversion: 2.1 time: 0.256360 Oct 03 14:42:36.320151 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-40151333-49ee-43bd-ae67-0c01725266d6 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] HTTP exception thrown: Image not found. Oct 03 14:42:36.320442 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1309/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:36 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1208 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:36.343939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:36.347644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40151333-49ee-43bd-ae67-0c01725266d6 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Request method failure captured: Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/images/28a20ea3-d61d-4acd-9575-e8a8f5f2c395/metadata/os_distro HTTP/1.1 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTbi17KRR7z2qWLja4wZhZqMiGlDQA_2J27WKPnoZ1UbSjExhE646BCBfaD-dPpKHlZJ0SNp3JlaDTJcKIBU5o10YsnUtYfdQDYxJznOgixVtDEi-pzn2nDrZQGIzBf-tKHa_GD1qzEt0GSYY1OCf89UkPcJhd-iirvGUJiQ8TaiVs Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_748fbf13164f41aa8943ab660d7b9c83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f4fbb27b62544b70850385f7e272d385 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'image_id': '28a20ea3-d61d-4acd-9575-e8a8f5f2c395', 'id': 'os_distro'} Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 28a20ea3-d61d-4acd-9575-e8a8f5f2c395 Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:42:36.356333 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28a20ea3-d61d-4acd-9575-e8a8f5f2c395 could not be found. Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:42:36.360010 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.369234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40151333-49ee-43bd-ae67-0c01725266d6 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:36.370395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40151333-49ee-43bd-ae67-0c01725266d6 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] 10.222.0.20 "DELETE /compute/v2.1/images/28a20ea3-d61d-4acd-9575-e8a8f5f2c395/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.593311 Oct 03 14:42:36.371529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1250/2559] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 3 14:42:35 2022] DELETE /compute/v2.1/images/28a20ea3-d61d-4acd-9575-e8a8f5f2c395/metadata/os_distro => generated 62 bytes in 595 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:42:36.387677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef620a3a-5216-4bab-b04d-f8278a13b394 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Calling method '.version_select at 0x7fb234b28b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:36.392623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:36.393160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:36.393599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:36.404676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:36.406245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:36.406706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:36.431405 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ef620a3a-5216-4bab-b04d-f8278a13b394 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] HTTP exception thrown: Image not found. Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef620a3a-5216-4bab-b04d-f8278a13b394 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Request method failure captured: Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/b191856f-0bfe-475d-8111-fc2f3743f7b8/metadata/os_version HTTP/1.1 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTbi17KRR7z2qWLja4wZhZqMiGlDQA_2J27WKPnoZ1UbSjExhE646BCBfaD-dPpKHlZJ0SNp3JlaDTJcKIBU5o10YsnUtYfdQDYxJznOgixVtDEi-pzn2nDrZQGIzBf-tKHa_GD1qzEt0GSYY1OCf89UkPcJhd-iirvGUJiQ8TaiVs Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_748fbf13164f41aa8943ab660d7b9c83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f4fbb27b62544b70850385f7e272d385 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'image_id': 'b191856f-0bfe-475d-8111-fc2f3743f7b8', 'id': 'os_version'} Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b191856f-0bfe-475d-8111-fc2f3743f7b8 Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:42:36.433712 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b191856f-0bfe-475d-8111-fc2f3743f7b8 could not be found. Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef620a3a-5216-4bab-b04d-f8278a13b394 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef620a3a-5216-4bab-b04d-f8278a13b394 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] 10.222.0.20 "GET /compute/v2.1/images/b191856f-0bfe-475d-8111-fc2f3743f7b8/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.057290 Oct 03 14:42:36.437098 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1251/2560] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 3 14:42:36 2022] GET /compute/v2.1/images/b191856f-0bfe-475d-8111-fc2f3743f7b8/metadata/os_version => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:42:36.455611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-123bf3e8-93cf-4dbd-bc08-cb070d542caf tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Calling method '.version_select at 0x7fb234b28b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:36.510501 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-123bf3e8-93cf-4dbd-bc08-cb070d542caf tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] HTTP exception thrown: Image not found. Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-123bf3e8-93cf-4dbd-bc08-cb070d542caf tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Request method failure captured: Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/453babde-8c04-44b9-a88a-56704a2daf37/metadata HTTP/1.1 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTbi17KRR7z2qWLja4wZhZqMiGlDQA_2J27WKPnoZ1UbSjExhE646BCBfaD-dPpKHlZJ0SNp3JlaDTJcKIBU5o10YsnUtYfdQDYxJznOgixVtDEi-pzn2nDrZQGIzBf-tKHa_GD1qzEt0GSYY1OCf89UkPcJhd-iirvGUJiQ8TaiVs Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_748fbf13164f41aa8943ab660d7b9c83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f4fbb27b62544b70850385f7e272d385 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'image_id': '453babde-8c04-44b9-a88a-56704a2daf37'} Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 453babde-8c04-44b9-a88a-56704a2daf37 Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:42:36.512917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 453babde-8c04-44b9-a88a-56704a2daf37 could not be found. Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-123bf3e8-93cf-4dbd-bc08-cb070d542caf tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:36.517458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-123bf3e8-93cf-4dbd-bc08-cb070d542caf tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] 10.222.0.20 "GET /compute/v2.1/images/453babde-8c04-44b9-a88a-56704a2daf37/metadata" status: 404 len: 62 microversion: 2.1 time: 0.075046 Oct 03 14:42:36.521655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1252/2561] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:42:36 2022] GET /compute/v2.1/images/453babde-8c04-44b9-a88a-56704a2daf37/metadata => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:42:36.527086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a21ea7bf-e286-48a9-86b4-3f1c40f41124 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Action: 'update_all', calling method: .version_select at 0x7fb23103c8b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:36.599675 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a21ea7bf-e286-48a9-86b4-3f1c40f41124 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] HTTP exception thrown: Image not found. Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a21ea7bf-e286-48a9-86b4-3f1c40f41124 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Request method failure captured: Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/images/69260c4f-cf12-4960-b1af-e0abaf503a32/metadata HTTP/1.1 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 57 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTbi17KRR7z2qWLja4wZhZqMiGlDQA_2J27WKPnoZ1UbSjExhE646BCBfaD-dPpKHlZJ0SNp3JlaDTJcKIBU5o10YsnUtYfdQDYxJznOgixVtDEi-pzn2nDrZQGIzBf-tKHa_GD1qzEt0GSYY1OCf89UkPcJhd-iirvGUJiQ8TaiVs Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_748fbf13164f41aa8943ab660d7b9c83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f4fbb27b62544b70850385f7e272d385 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'image_id': '69260c4f-cf12-4960-b1af-e0abaf503a32', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 69260c4f-cf12-4960-b1af-e0abaf503a32 Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:42:36.601943 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 69260c4f-cf12-4960-b1af-e0abaf503a32 could not be found. Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a21ea7bf-e286-48a9-86b4-3f1c40f41124 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:36.606841 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a21ea7bf-e286-48a9-86b4-3f1c40f41124 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] 10.222.0.20 "PUT /compute/v2.1/images/69260c4f-cf12-4960-b1af-e0abaf503a32/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080218 Oct 03 14:42:36.615936 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1253/2562] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:36 2022] PUT /compute/v2.1/images/69260c4f-cf12-4960-b1af-e0abaf503a32/metadata => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:42:36.625444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae28c1b-c178-433d-860f-9f8c824a5173 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Action: 'update', calling method: .version_select at 0x7fb2301b0700>, body: {"meta": {"os_distro": "alt"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:36.676867 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7ae28c1b-c178-433d-860f-9f8c824a5173 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] HTTP exception thrown: Image not found. Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae28c1b-c178-433d-860f-9f8c824a5173 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Request method failure captured: Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/images/ff50b4e6-f8ba-4945-8596-b806e3944d8a/metadata/os_distro HTTP/1.1 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 30 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTbi17KRR7z2qWLja4wZhZqMiGlDQA_2J27WKPnoZ1UbSjExhE646BCBfaD-dPpKHlZJ0SNp3JlaDTJcKIBU5o10YsnUtYfdQDYxJznOgixVtDEi-pzn2nDrZQGIzBf-tKHa_GD1qzEt0GSYY1OCf89UkPcJhd-iirvGUJiQ8TaiVs Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_748fbf13164f41aa8943ab660d7b9c83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f4fbb27b62544b70850385f7e272d385 Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: {"meta": {"os_distro": "alt"}} Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'image_id': 'ff50b4e6-f8ba-4945-8596-b806e3944d8a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ff50b4e6-f8ba-4945-8596-b806e3944d8a Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:42:36.680145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ff50b4e6-f8ba-4945-8596-b806e3944d8a could not be found. Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae28c1b-c178-433d-860f-9f8c824a5173 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ae28c1b-c178-433d-860f-9f8c824a5173 tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] 10.222.0.20 "PUT /compute/v2.1/images/ff50b4e6-f8ba-4945-8596-b806e3944d8a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.071359 Oct 03 14:42:36.689492 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1254/2563] 10.222.0.20 () {60 vars in 1310 bytes} [Mon Oct 3 14:42:36 2022] PUT /compute/v2.1/images/ff50b4e6-f8ba-4945-8596-b806e3944d8a/metadata/os_distro => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:42:36.700157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:36.700157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:36.705993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:36.712969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:36.713537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:36.714326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:36.714803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:36.715241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:36.864797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:36.921636 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16ceb491-7a79-4884-a138-d925e9a35430 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.237909 Oct 03 14:42:36.922557 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1255/2564] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:36 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:36.941215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0731fe8a-5839-4ff5-8bd2-d3eff806441f tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Action: 'create', calling method: .version_select at 0x7fb230203e50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:36.975230 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0731fe8a-5839-4ff5-8bd2-d3eff806441f tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] HTTP exception thrown: Image not found. Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0731fe8a-5839-4ff5-8bd2-d3eff806441f tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Request method failure captured: Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/images/765c1751-3dfd-42a3-bbd3-17618ab75982/metadata HTTP/1.1 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 57 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTbi17KRR7z2qWLja4wZhZqMiGlDQA_2J27WKPnoZ1UbSjExhE646BCBfaD-dPpKHlZJ0SNp3JlaDTJcKIBU5o10YsnUtYfdQDYxJznOgixVtDEi-pzn2nDrZQGIzBf-tKHa_GD1qzEt0GSYY1OCf89UkPcJhd-iirvGUJiQ8TaiVs Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_748fbf13164f41aa8943ab660d7b9c83", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/748fbf13164f41aa8943ab660d7b9c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 748fbf13164f41aa8943ab660d7b9c83 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f4fbb27b62544b70850385f7e272d385 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1634841550-project Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'image_id': '765c1751-3dfd-42a3-bbd3-17618ab75982', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 765c1751-3dfd-42a3-bbd3-17618ab75982 Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:42:36.978410 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 765c1751-3dfd-42a3-bbd3-17618ab75982 could not be found. Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0731fe8a-5839-4ff5-8bd2-d3eff806441f tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0731fe8a-5839-4ff5-8bd2-d3eff806441f tempest-ImagesMetadataNegativeTestJSON-1634841550 tempest-ImagesMetadataNegativeTestJSON-1634841550-project] 10.222.0.20 "POST /compute/v2.1/images/765c1751-3dfd-42a3-bbd3-17618ab75982/metadata" status: 404 len: 62 microversion: 2.1 time: 0.056239 Oct 03 14:42:36.981949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1256/2565] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Oct 3 14:42:36 2022] POST /compute/v2.1/images/765c1751-3dfd-42a3-bbd3-17618ab75982/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:42:37.052821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:37.071051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:37.071668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:37.077267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:37.083080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:37.086811 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d7b4593-1dc6-4ccf-a0ae-8554ebe6695d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1752 microversion: 2.42 time: 0.762893 Oct 03 14:42:37.090421 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1310/2566] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:36 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1752 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:37.097821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.098577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.100589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:37.101521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.102352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.102847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:37.240000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:37.257151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:37.259071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:37.276721 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ad2dbdb-0bbe-4505-bf0a-d848081c5045 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.209025 Oct 03 14:42:37.277699 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1257/2567] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:37 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:37.352561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:37.353925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:37.363653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.365029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.365946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:37.367396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.368404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.369157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:37.514387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:37.518976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Action: 'update', calling method: .version_select at 0x7fb2309975e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:37.523145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ace2b1e1-9eab-48c8-b8d2-e788713012e4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1260 microversion: 2.1 time: 0.180688 Oct 03 14:42:37.526449 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1258/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:37 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:37.952098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:37.953375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:37.970288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.972700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.973918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:37.978603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.982629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.984355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:37.984980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.985596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.986270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:37.987213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:37.988069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:37.989001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.094112 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ab3b7da-6391-4380-95da-fd4c62627b8e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773" status: 200 len: 240 microversion: 2.36 time: 0.892662 Oct 03 14:42:38.097385 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1311/2569] 10.222.0.20 () {62 vars in 1303 bytes} [Mon Oct 3 14:42:37 2022] PUT /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773 => generated 240 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:42:38.107070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Calling method '.version_select at 0x7fb230849e50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:38.205031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:38.228490 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-166c9ca2-90e8-4187-9d6b-290a1879d8ef tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.281153 Oct 03 14:42:38.229530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1259/2570] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:37 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:38.235395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:38.236673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:38.246455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.247443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.247857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.248604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.249225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.249816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.266515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.267253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.267909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.268777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.269433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.270056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.315339 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92519ce7-677c-44ff-b9f6-e92c0e16707c tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773/detail" status: 200 len: 672 microversion: 2.36 time: 0.212271 Oct 03 14:42:38.317502 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1312/2571] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Oct 3 14:42:38 2022] GET /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773/detail => generated 672 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:42:38.323331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:38.324666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:38.348313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.350163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.350712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.351615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.352076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.352740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.505052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:38.531198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:38.533020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:38.548912 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3129707a-1e41-4445-be7b-b0f03fe899a0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.229890 Oct 03 14:42:38.551243 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1313/2572] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:38 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:38.569256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:38.570434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:38.587435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.588042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.588575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.589446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.590398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.590998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.690181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:38.701029 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2742140-030f-4581-a4a8-b469ea5d1446 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1266 microversion: 2.1 time: 0.147475 Oct 03 14:42:38.702209 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1314/2573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:38 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:38.724785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Action: 'update', calling method: .version_select at 0x7fb230997820>, body: {"quota_set": {"ram": "2048"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:38.805430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:38.830975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:38.832768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:38.836292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.839115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.843238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.844090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.844557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.845018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.847383 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-953eb4e8-8bf3-4c89-bb97-dab373515e25 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1798 microversion: 2.42 time: 0.615788 Oct 03 14:42:38.848168 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1260/2574] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:38 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1798 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:38.915183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.915580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.916058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:38.917821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:38.918280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:38.919053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.009828 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3a38fefb-116c-4912-8070-369e6c2d439e tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773?user_id=c74fd814fbcd47ea96255c6354b5e560" status: 200 len: 240 microversion: 2.36 time: 0.305037 Oct 03 14:42:39.016490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1315/2575] 10.222.0.20 () {62 vars in 1384 bytes} [Mon Oct 3 14:42:38 2022] PUT /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773?user_id=c74fd814fbcd47ea96255c6354b5e560 => generated 240 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:39.023842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4152d652-62f0-477c-b92d-521c476586cb tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] Calling method '.version_select at 0x7fb230136820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:39.141169 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4152d652-62f0-477c-b92d-521c476586cb tempest-QuotasAdminTestV236-425545976 tempest-QuotasAdminTestV236-425545976-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773?user_id=c74fd814fbcd47ea96255c6354b5e560" status: 200 len: 282 microversion: 2.36 time: 0.123081 Oct 03 14:42:39.143639 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1261/2576] 10.222.0.20 () {60 vars in 1364 bytes} [Mon Oct 3 14:42:39 2022] GET /compute/v2.1/os-quota-sets/36f5774ab699494d981c0826437f4773?user_id=c74fd814fbcd47ea96255c6354b5e560 => generated 282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:39.265849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:39.267308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:39.301574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.304068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.305180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.308101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.311497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.313207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.459961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:39.526067 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99df714b-20af-4f7d-8592-85138e0b1946 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.266134 Oct 03 14:42:39.528577 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1316/2577] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:39 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:39.585603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:39.586558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:39.598586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.599179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.599793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.600748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.601422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.601994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.729780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:39.730584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:39.740365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.741142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.743550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.744678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.745323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.745965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.840901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:39.855739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:39.858322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:39.867059 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-946b090e-2871-40dd-96e5-3b6ad3bc89b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.285875 Oct 03 14:42:39.885797 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1262/2578] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:39 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:39.910835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:39.912831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:39.935406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.936130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.944034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:39.946498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:39.948903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:39.950484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:40.255204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:40.274656 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36056963-6dc5-4769-8933-a413b817b88f tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1308 microversion: 2.1 time: 0.550826 Oct 03 14:42:40.276907 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1317/2579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:39 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:40.492605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:40.507704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:40.511341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:40.516629 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09af0dab-af36-4d8d-a3ad-810283a31034 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1844 microversion: 2.42 time: 0.626937 Oct 03 14:42:40.529421 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1263/2580] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:39 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1844 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:40.559342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:40.560681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:40.570198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:40.573871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:40.575635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:40.578803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:40.579652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:40.582083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:40.814332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:40.858223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a0c78311-6af9-4df6-a0d6-6b99ee7309cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.295586 Oct 03 14:42:40.859454 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1318/2581] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:40 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:40.902754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:40.903594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:40.911754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:40.912307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:40.913511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:40.916826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:40.917478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:40.920259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:41.092076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:41.118177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:41.125235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:41.150095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60977be3-a80a-448f-9cfd-5545fade3076 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.251293 Oct 03 14:42:41.154967 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1264/2582] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:40 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:41.287368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f7f58c85-b41e-4efc-a547-85290f00a5bc req-9072b92e-63ba-44d6-878b-4260059e0b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "f24df28a-2ac7-4b48-9b16-7e4ad927f924"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:41.303048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:41.304239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:41.324449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:41.327342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f7f58c85-b41e-4efc-a547-85290f00a5bc req-9072b92e-63ba-44d6-878b-4260059e0b8f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:41.331115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:41.332556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f7f58c85-b41e-4efc-a547-85290f00a5bc req-9072b92e-63ba-44d6-878b-4260059e0b8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:41.333503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:41.334134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f7f58c85-b41e-4efc-a547-85290f00a5bc req-9072b92e-63ba-44d6-878b-4260059e0b8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:41.335113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:41.338657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:41.339649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:41.377306 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f7f58c85-b41e-4efc-a547-85290f00a5bc req-9072b92e-63ba-44d6-878b-4260059e0b8f service nova] Creating event network-changed:f24df28a-2ac7-4b48-9b16-7e4ad927f924 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:42:41.392270 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f7f58c85-b41e-4efc-a547-85290f00a5bc req-9072b92e-63ba-44d6-878b-4260059e0b8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108853 Oct 03 14:42:41.396415 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1319/2583] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:41.549372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:41.550985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:41.560180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:41.561134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:41.561799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:41.562981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:41.563666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:41.564869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:41.955456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:41.966521 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75a3e495-6d75-4d02-bb65-8f2eee62ab24 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1308 microversion: 2.1 time: 0.668038 Oct 03 14:42:41.969629 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1265/2584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:41 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:42.166926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-875571154", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:42.184441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:42.196017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:42.205269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:42.206684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24d2d4a7-2de2-4a8f-8fa6-177ff843c36c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1844 microversion: 2.42 time: 0.663305 Oct 03 14:42:42.207601 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1320/2585] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:41 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1844 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:42.230777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:42.231580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:42.235740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:42:42.246435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:42.247159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:42.247738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:42.248692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:42.249346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:42.249941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:42.276192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:42.446130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:42.489974 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c1b6c728-9487-4554-8f58-40000a5d622c tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.261962 Oct 03 14:42:42.506293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1321/2586] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:42 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:42.520114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5a8da3f1-9b89-4d6b-b6ce-cc459386ea3d req-a4ab2ce2-e879-4b87-a4b0-625a557a0605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8de68b-0c52-4794-a4db-7cade3df7e5b", "tag": "b136120e-aff3-4bdd-be27-82cbdca3aad7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:42.547518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5a8da3f1-9b89-4d6b-b6ce-cc459386ea3d req-a4ab2ce2-e879-4b87-a4b0-625a557a0605 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:42.553982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5a8da3f1-9b89-4d6b-b6ce-cc459386ea3d req-a4ab2ce2-e879-4b87-a4b0-625a557a0605 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:42.554855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5a8da3f1-9b89-4d6b-b6ce-cc459386ea3d req-a4ab2ce2-e879-4b87-a4b0-625a557a0605 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:42.578219 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5a8da3f1-9b89-4d6b-b6ce-cc459386ea3d req-a4ab2ce2-e879-4b87-a4b0-625a557a0605 service nova] Creating event network-changed:b136120e-aff3-4bdd-be27-82cbdca3aad7 for instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b on n-h2-781139-2 Oct 03 14:42:42.588132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5a8da3f1-9b89-4d6b-b6ce-cc459386ea3d req-a4ab2ce2-e879-4b87-a4b0-625a557a0605 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080391 Oct 03 14:42:42.590685 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1322/2587] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:42.600796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:42.608113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:42.621839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:42.625257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:42.625865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:42.626652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:42.629523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:42.630176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:42.706179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:42:42.706900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:42:42.707565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:42:42.708405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:42:42.709818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:42:42.714904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:42.737225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:42.737725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:42.742679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:42.745261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:42.745829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:42.749445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:42.775193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:42.786663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:42.798749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:42.802212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:42.806729 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5748a1c5-2226-46af-a7f9-9616fc1c1c8e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.210836 Oct 03 14:42:42.807435 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1323/2588] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:42 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:42.820915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Getting quotas for project 93c499a00f3842bd8c6512a4e06c2945. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:42:42.840965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Getting quotas for user c90e0563672845d0ad07db3f935eed70 and project 93c499a00f3842bd8c6512a4e06c2945. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:42:42.874007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:42:42.876325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:42:42.940125 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f318357-bc6f-4fe2-b35d-820b8b361680 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968024 Oct 03 14:42:42.948082 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1266/2589] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:42:42.953763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-558efa9c-ee07-426e-8d79-26ffff3eb718 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:42.954992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-558efa9c-ee07-426e-8d79-26ffff3eb718 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:42.996620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:42.998005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:43.007884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.009233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.010780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.013413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.014287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.015384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.022910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:43.203250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:43.226932 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29c72548-cedf-46dd-be43-771861d18867 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1308 microversion: 2.1 time: 0.236471 Oct 03 14:42:43.227525 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1267/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:42 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:43.238661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-558efa9c-ee07-426e-8d79-26ffff3eb718 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:43.248275 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-558efa9c-ee07-426e-8d79-26ffff3eb718 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1216 microversion: 2.1 time: 0.299753 Oct 03 14:42:43.250094 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1324/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:42 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1216 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:43.272184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:43.273969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:43.291332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.302390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.311366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.313280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.313936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.314540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.524057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:43.525397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:43.531565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.532345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.532919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.534141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.534737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.535542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.650009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:43.663447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:43.664897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:43.666114 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b1a87c87-e607-4ef4-886e-40b8523b467e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1865 microversion: 2.42 time: 0.423996 Oct 03 14:42:43.666688 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1268/2592] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:43 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1865 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:43.676136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7beaaab7-0d42-4e0e-96d8-6a4a6b8c4d1b req-b72c51b4-3916-4590-8a42-ffffdbe71ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "84d54848-c6f3-4db7-b825-aea10dffd716"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:43.690688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:43.693034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7beaaab7-0d42-4e0e-96d8-6a4a6b8c4d1b req-b72c51b4-3916-4590-8a42-ffffdbe71ed2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.693526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7beaaab7-0d42-4e0e-96d8-6a4a6b8c4d1b req-b72c51b4-3916-4590-8a42-ffffdbe71ed2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.693955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7beaaab7-0d42-4e0e-96d8-6a4a6b8c4d1b req-b72c51b4-3916-4590-8a42-ffffdbe71ed2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.713991 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7beaaab7-0d42-4e0e-96d8-6a4a6b8c4d1b req-b72c51b4-3916-4590-8a42-ffffdbe71ed2 service nova] Creating event network-changed:84d54848-c6f3-4db7-b825-aea10dffd716 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:42:43.735604 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7beaaab7-0d42-4e0e-96d8-6a4a6b8c4d1b req-b72c51b4-3916-4590-8a42-ffffdbe71ed2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067627 Oct 03 14:42:43.741387 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1269/2593] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:43.777110 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ea91707-01b2-4680-afca-8da7fdef4ab5 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1929 microversion: 2.75 time: 0.255111 Oct 03 14:42:43.781250 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1325/2594] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:43 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1929 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:43.835994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:43.837143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:43.852739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.853550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.855037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:43.856119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:43.858848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:43.859613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:44.094627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:44.110468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:44.113821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:44.126931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca087248-7b74-4d4f-b6cd-4b0c1de5a1fc tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.295532 Oct 03 14:42:44.132105 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1270/2595] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:43 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:44.256423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:44.257090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:44.271879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:44.272437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:44.274057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:44.275015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:44.275480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:44.276819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:44.277505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:44.277988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:44.299363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:44.299884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:44.300346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:44.312771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:44.313401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:44.315079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:45.016682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:45.055513 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aacf6c56-f54c-431e-99c7-c85398621732 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1268 microversion: 2.1 time: 0.780792 Oct 03 14:42:45.059189 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1271/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:44 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1268 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:45.073677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:45.077195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:45.092862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:45.096385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:45.099344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:45.100310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:45.101164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:45.101763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:45.559114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:45.574183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:45.577804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:45.581248 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0dff25b-fcf0-47e6-b3e4-ded13762f427 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1865 microversion: 2.42 time: 0.520658 Oct 03 14:42:45.584154 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1272/2597] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:45 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1865 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:45.590547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:45.592288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:45.610756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:45.611247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:45.611688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:45.612405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:45.613794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:45.613971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:45.776135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:45.818655 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8e3e661-ba97-4315-95f2-308363ee95cc tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1935 microversion: 2.75 time: 0.232417 Oct 03 14:42:45.820240 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1273/2598] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:45 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1935 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:45.827344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:45.828185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:45.835072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:45.835849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:45.836469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:45.837389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:45.837993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:45.838764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:45.942448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:45.952557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:45.954194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:45.960522 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4b3c303-1a6d-4bc0-8124-cb97dc421465 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.137468 Oct 03 14:42:45.961542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1274/2599] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:45 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:46.078700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:46.079322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:46.085729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:46.086236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:46.086831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:46.088007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:46.088874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:46.089717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:46.222147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:46.239311 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af5581f9-8727-47d6-838f-24d6553e0e37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1274 microversion: 2.1 time: 0.164405 Oct 03 14:42:46.240052 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1275/2600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:46 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:46.361085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:46.377717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5bf00f75-221e-4330-ab9f-da6a06981361 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1308 microversion: 2.1 time: 2.126100 Oct 03 14:42:46.393039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1326/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:44 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1308 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:46.544325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8d528803-c41c-4833-b861-eda0ca0cd386 req-4e4f4880-b529-4d15-9626-85ae34bb50cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8de68b-0c52-4794-a4db-7cade3df7e5b", "name": "network-vif-plugged", "status": "completed", "tag": "b136120e-aff3-4bdd-be27-82cbdca3aad7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:46.568631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8d528803-c41c-4833-b861-eda0ca0cd386 req-4e4f4880-b529-4d15-9626-85ae34bb50cb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:46.569937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8d528803-c41c-4833-b861-eda0ca0cd386 req-4e4f4880-b529-4d15-9626-85ae34bb50cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:46.570964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8d528803-c41c-4833-b861-eda0ca0cd386 req-4e4f4880-b529-4d15-9626-85ae34bb50cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:46.586625 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8d528803-c41c-4833-b861-eda0ca0cd386 req-4e4f4880-b529-4d15-9626-85ae34bb50cb service nova] Creating event network-vif-plugged:b136120e-aff3-4bdd-be27-82cbdca3aad7 for instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b on n-h2-781139-2 Oct 03 14:42:46.592121 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8d528803-c41c-4833-b861-eda0ca0cd386 req-4e4f4880-b529-4d15-9626-85ae34bb50cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051434 Oct 03 14:42:46.593387 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1276/2602] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:46.611185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:46.611832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:46.621445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:46.622190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:46.622793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:46.623680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:46.624279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:46.624856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:46.858972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:46.859717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:46.866922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:46.867425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:46.867868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:46.868589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:46.869304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:46.869746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:46.987136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:47.029749 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e612c17f-c3ce-455c-98b2-5b6dd8e187cf tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1935 microversion: 2.75 time: 0.175571 Oct 03 14:42:47.033424 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1277/2603] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:46 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1935 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:47.038731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:47.039351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:47.046897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:47.047576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:47.048159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:47.049122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:47.049734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:47.050400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:47.175816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:47.194599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:47.196062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:47.202042 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46a1c984-222a-444b-ae80-cd588ba5abb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.167501 Oct 03 14:42:47.202634 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1278/2604] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:47 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:47.230698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:47.243223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:47.244668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:47.245963 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3345a9ff-44fe-4a14-b860-c17d495fc865 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1865 microversion: 2.42 time: 0.639096 Oct 03 14:42:47.273918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:47.274652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:47.280915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:47.281464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:47.281865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:47.282583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:47.283066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:47.283731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:47.287842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1327/2605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:46 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1865 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:47.390478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:47.403116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:47.405103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:47.412614 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f06c694d-9454-44aa-af56-2d2276d600a3 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1274 microversion: 2.1 time: 0.146569 Oct 03 14:42:47.413274 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1279/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:47 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:47.415118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:47.415801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:47.416400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:47.418176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:47.418804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:47.419461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.059852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.060723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:48.061441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:48.069698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b579497-f052-4c6b-81d6-06b4084b955c tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1308 microversion: 2.1 time: 0.670889 Oct 03 14:42:48.070036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.079030 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1328/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:47 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:48.079176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.079176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.079176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.079176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.079176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.152490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:48.182202 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65164ddf-3962-4616-8464-53fa52c245cd tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1935 microversion: 2.75 time: 0.125453 Oct 03 14:42:48.200955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1280/2608] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:48 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1935 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:48.236598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:48.237581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:48.245337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.246101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.246774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.247886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.248752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.249449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.281528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:48.282836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:48.294682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.295602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.296045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.296768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.297267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.297702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.378387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.390100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.392353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.399680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ff482cd-5ffa-405b-a367-a95809596f9d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.167886 Oct 03 14:42:48.400534 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1329/2609] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:48 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:48.440431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:48.442777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:48.451857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.453223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.453888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.455036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.455684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.456771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.523447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.537331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.539723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.541142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-067b3329-6531-4665-aff2-787eb791f695 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1886 microversion: 2.42 time: 0.265282 Oct 03 14:42:48.541855 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1281/2610] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:48 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1886 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:48.655936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:48.683233 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58734c21-03ac-443a-b7d2-f123cecaf039 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1274 microversion: 2.1 time: 0.250869 Oct 03 14:42:48.699774 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1330/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:48 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1274 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:48.771036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-54f536c3-d1bd-446e-80c7-1aa1c69dfe40 req-4b03f4bd-92c9-42ab-a4a6-0ff17f0540dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "cfca253d-f28f-451d-80fd-bd99585b6293"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:48.788070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-54f536c3-d1bd-446e-80c7-1aa1c69dfe40 req-4b03f4bd-92c9-42ab-a4a6-0ff17f0540dd service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:48.790169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-54f536c3-d1bd-446e-80c7-1aa1c69dfe40 req-4b03f4bd-92c9-42ab-a4a6-0ff17f0540dd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:48.790925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-54f536c3-d1bd-446e-80c7-1aa1c69dfe40 req-4b03f4bd-92c9-42ab-a4a6-0ff17f0540dd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:48.817437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-54f536c3-d1bd-446e-80c7-1aa1c69dfe40 req-4b03f4bd-92c9-42ab-a4a6-0ff17f0540dd service nova] Creating event network-changed:cfca253d-f28f-451d-80fd-bd99585b6293 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:42:48.823455 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-54f536c3-d1bd-446e-80c7-1aa1c69dfe40 req-4b03f4bd-92c9-42ab-a4a6-0ff17f0540dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058530 Oct 03 14:42:48.824706 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1282/2612] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:42:49.097304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:49.098331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:49.115558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=9 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:49.117904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.123189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.124147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.125406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.128083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.129137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.211594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:49.217408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:49.225409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.226234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.226909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.227861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.228532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.229059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.333493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] Lazy-loading 'services' on Instance uuid 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:49.371608 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32575cac-3cb6-45de-8ff6-764084b6b964 tempest-ServersAdmin275Test-1150030918 tempest-ServersAdmin275Test-1150030918-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1920 microversion: 2.75 time: 0.164176 Oct 03 14:42:49.373017 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1283/2613] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:49 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1920 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:49.417570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:49.418325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:49.424745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.425560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.426143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.427020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.427618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.428625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.451722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:49.456630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:42:49.559935 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12097a95-f521-4cd4-9890-2897c0a7edbf tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "DELETE /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 204 len: 0 microversion: 2.75 time: 0.145520 Oct 03 14:42:49.560559 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1284/2614] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:42:49 2022] DELETE /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 14:42:49.570455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:49.571419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:49.578788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.579501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.580201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.581826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.582454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.583065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.789973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:49.823051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:49.833735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:49.844863 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-505b2e56-8614-49bf-a15f-c7cffb7525e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.282207 Oct 03 14:42:49.848216 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1285/2615] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:49 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:49.860545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:49.862963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:49.881098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.881776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.882368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:49.883270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:49.884234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:49.884881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.028665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.047244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.054995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.072288 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f323324-c8c7-4cf0-925d-9dcd819b5634 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1444 microversion: 2.75 time: 0.220567 Oct 03 14:42:50.073880 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1286/2616] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:49 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1444 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:50.080375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:50.095650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:50.112339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.114286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.114773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.116642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.118344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.119949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.465950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.489902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.491532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.493292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.494652 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7c48814-0a6c-4a0a-86d5-3948f705cf37 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1886 microversion: 2.42 time: 0.419265 Oct 03 14:42:50.495812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1287/2617] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:50 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1886 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:50.500970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:50.501788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:50.509211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.510786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.511039 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c8eb369-535a-436c-b58f-d6cce0bead41 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1489 microversion: 2.1 time: 1.418297 Oct 03 14:42:50.511593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.528111 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1331/2618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:49 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1489 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:50.529410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.530163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.530969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.545685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:50.548782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:50.566992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.568957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.569429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.572163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.572647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.575008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.713861 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-897c8ade-67e0-4b10-b079-df38e7e6aabb tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "PUT /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1084 microversion: 2.1 time: 0.173038 Oct 03 14:42:50.729547 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1332/2619] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:42:50 2022] PUT /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1084 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:50.738236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:50.738866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:50.748759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.749317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.749761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.750487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.750943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.751376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.794376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:50.803519 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68aa7396-1191-4aee-8b84-0e50f5833e77 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.306358 Oct 03 14:42:50.817744 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1288/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:50 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:50.881033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:50.881907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:50.892650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.893174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.893611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:50.894342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:50.897285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:50.897923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:51.027175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:51.037297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:51.046406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:51.055399 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86b92e41-c699-45d2-be9c-19f066845685 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.179000 Oct 03 14:42:51.059038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1289/2621] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:50 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:51.107292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:51.108499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:51.115892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:51.126647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:51.127585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:51.129452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:51.129452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:51.130134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:51.247004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:51.257580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:51.265255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aa1e5606e124a08a017dd6da74b6477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada472e0e1ef45fb8affb8928b1866b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:51.280316 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6aac1213-9d33-4952-aabd-e6d0b9d1d8c2 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 200 len: 1444 microversion: 2.75 time: 0.176937 Oct 03 14:42:51.281672 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1290/2622] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:51 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:51.525541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:51.526147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:51.533410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:51.533900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:51.534332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:51.535365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:51.535824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:51.536240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:51.746147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:51.757767 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b790a52b-1653-4d58-b21b-6d1fc4459e11 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1510 microversion: 2.1 time: 1.024163 Oct 03 14:42:51.776006 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1333/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:50 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1510 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:42:51.963389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Action: 'update', calling method: .version_select at 0x7fb2306975e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:51.967559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:51.968357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:51.968957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:51.980159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:51.980950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:51.981532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:51.990745 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] HTTP exception thrown: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Request method failure captured: Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9 HTTP/1.1 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 56 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvTrL529pltctXrISJx1fwHLrqFzqzd36FGiN-16qNXlZD2QcZotZUoFWjUQckar0jKlcSgv_E3n-_qgKS6BNg7np2z25s8CpDSiRMAtwHjeLKybLu73bfw6pBbJVQcMFvpqHmC-dkRjUi2liFTHOyNaRVHZGQHqg4UoIm6xkCN6naw Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: dab2343f6a234422a620f71aac75ea75 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dab2343f6a234422a620f71aac75ea75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: dab2343f6a234422a620f71aac75ea75 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 510d8b131b4444d192e24fd69c379a02 Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: exception: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '03a17395-299e-4210-a802-f64702fa03b9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:42:51.993666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:51.998095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.000495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Returning 404 to user: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:52.001586 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ad7b617-1327-4000-9b6f-5783f9e7fb63 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9" status: 404 len: 110 microversion: 2.53 time: 0.224292 Oct 03 14:42:52.003147 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1334/2624] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Oct 3 14:42:51 2022] PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9 => generated 110 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:42:52.012859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.013764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:52.022021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.022503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.022935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.023631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.024076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.024491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.109984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.120343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.121896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.123238 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6597d6c6-34f3-49f0-ada7-1c5f7bf9f34d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1886 microversion: 2.42 time: 0.601599 Oct 03 14:42:52.124710 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1291/2625] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:51 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1886 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:52.129945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.130708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:52.138878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.139899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.140954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.141918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.142516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.143100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.311121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.321182 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3192a14-a9c2-4bb6-b5a0-f71cf7a0eeaf tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.195096 Oct 03 14:42:52.321775 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1292/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:52.327427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Action: 'update', calling method: .version_select at 0x7fb230a69430>, body: {"status": "disabled"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:52.333517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.334297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.335279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.343170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:52.345468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.346141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.347019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.358299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] HTTP exception thrown: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Request method failure captured: Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9 HTTP/1.1 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 22 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTrL529pltctXrISJx1fwHLrqFzqzd36FGiN-16qNXlZD2QcZotZUoFWjUQckar0jKlcSgv_E3n-_qgKS6BNg7np2z25s8CpDSiRMAtwHjeLKybLu73bfw6pBbJVQcMFvpqHmC-dkRjUi2liFTHOyNaRVHZGQHqg4UoIm6xkCN6naw Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: dab2343f6a234422a620f71aac75ea75 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dab2343f6a234422a620f71aac75ea75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: dab2343f6a234422a620f71aac75ea75 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 510d8b131b4444d192e24fd69c379a02 Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: {"status": "disabled"} Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: exception: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '03a17395-299e-4210-a802-f64702fa03b9', 'body': {'status': 'disabled'}} Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:42:52.360837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.365933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.367687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Returning 404 to user: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:52.368664 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-951af3f1-ae4c-46bb-bc58-e05ff94e8044 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9" status: 404 len: 110 microversion: 2.53 time: 0.045654 Oct 03 14:42:52.373969 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1293/2627] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Oct 3 14:42:52 2022] PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:42:52.379354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.379978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:52.391461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.392086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.392591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.393409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.394323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.394908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.486722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.497047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.498976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.509434 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e73dc7bd-8799-4841-bc8a-614115895cab tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.134279 Oct 03 14:42:52.510426 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1294/2628] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:52.518006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.518709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] [instance: 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:52.530186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.530884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.534107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.536487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.537385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.540445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.560427 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] HTTP exception thrown: Instance 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a could not be found. Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Request method failure captured: Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a HTTP/1.1 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSPBFBD2iM9DMn3WIxEDrkXi6l_FD4iYJieTC7dWSVbrTCXmTAp8QthvwjfAIwt3iesT2P5qWLbVpkyzFRRnkL1ZU44SgbQmydbKZvR4YtipOQLcdsQCBwaRLhTuoCI0wISoE_kCUMU6uBruKa9rNEH65ZylBdniOxWe4OQdecLanc Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.75 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ada472e0e1ef45fb8affb8928b1866b4 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdmin275Test-830583105 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ada472e0e1ef45fb8affb8928b1866b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ada472e0e1ef45fb8affb8928b1866b4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ada472e0e1ef45fb8affb8928b1866b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ada472e0e1ef45fb8affb8928b1866b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdmin275Test-830583105 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ada472e0e1ef45fb8affb8928b1866b4 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdmin275Test-830583105 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersAdmin275Test-830583105-project Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9aa1e5606e124a08a017dd6da74b6477 Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdmin275Test-830583105-project Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a could not be found. Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a'} Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a could not be found. Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a could not be found. Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.564473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a could not be found. Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] Returning 404 to user: Instance 357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:52.568902 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-227c1034-bed2-42c3-b1c5-2e8f1f499f73 tempest-ServersAdmin275Test-830583105 tempest-ServersAdmin275Test-830583105-project] 10.222.0.20 "GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a" status: 404 len: 111 microversion: 2.75 time: 0.054393 Oct 03 14:42:52.571097 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1295/2629] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/servers/357bc0b9-1d7c-41c3-8cc6-6d78e5e8411a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:42:52.579596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Action: 'update', calling method: .version_select at 0x7fb230d4f1f0>, body: {"status": "enabled"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:52.584693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.585245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.585686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.593666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.594147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.607913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.609887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:52.627620 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12879ab9-e513-4f88-bcd0-c014303279c8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1510 microversion: 2.1 time: 0.623057 Oct 03 14:42:52.628614 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1335/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1510 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:52.651180 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] HTTP exception thrown: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Request method failure captured: Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9 HTTP/1.1 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 21 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTrL529pltctXrISJx1fwHLrqFzqzd36FGiN-16qNXlZD2QcZotZUoFWjUQckar0jKlcSgv_E3n-_qgKS6BNg7np2z25s8CpDSiRMAtwHjeLKybLu73bfw6pBbJVQcMFvpqHmC-dkRjUi2liFTHOyNaRVHZGQHqg4UoIm6xkCN6naw Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: dab2343f6a234422a620f71aac75ea75 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dab2343f6a234422a620f71aac75ea75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dab2343f6a234422a620f71aac75ea75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: dab2343f6a234422a620f71aac75ea75 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 510d8b131b4444d192e24fd69c379a02 Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: {"status": "enabled"} Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: exception: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '03a17395-299e-4210-a802-f64702fa03b9', 'body': {'status': 'enabled'}} Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:42:52.665045 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. Oct 03 14:42:52.673268 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:52.680790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.680790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:52.681119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Returning 404 to user: Service 03a17395-299e-4210-a802-f64702fa03b9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:52.681119 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6fabf79-0fb7-4d52-aee4-c7c4e120720b tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9" status: 404 len: 110 microversion: 2.53 time: 0.093872 Oct 03 14:42:52.681119 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1296/2631] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Oct 3 14:42:52 2022] PUT /compute/v2.1/os-services/03a17395-299e-4210-a802-f64702fa03b9 => generated 110 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:42:52.681541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.681541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.681807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.684955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.684955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.684955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.688129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.701753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.704113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.704902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.708249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.709728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.711722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.753941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:42:52.764305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:52.788512 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99aa450e-2de0-4a21-9dea-80be9a7cd753 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.104376 Oct 03 14:42:52.795630 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1297/2632] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:52.810219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.817593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.819306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.820474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.822067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.825428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.827328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.896032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=44 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:52.917923 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c9b49f4-c4bc-4e98-ba82-8d42ee1c8300 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.112020 Oct 03 14:42:52.919761 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1298/2633] 10.222.0.20 () {60 vars in 1211 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:52.940143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.943709 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06fc406c-9881-4b3a-b863-4c2206c9be32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 204 len: 0 microversion: 2.1 time: 0.283009 Oct 03 14:42:52.945558 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1336/2634] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:42:52 2022] DELETE /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:42:52.959350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.959787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:52.960491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:52.962058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.962904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.965720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.967249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.969210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.972168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.973260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.973704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:52.976224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:52.976691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:52.981597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.030314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:53.070300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc092249-6b3c-41ee-88eb-ba1919fd3098 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.137462 Oct 03 14:42:53.073946 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1299/2635] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:53.091810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:53.098175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.098944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.099656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.100774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.101489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.102148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.142265 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8825d59a-c9fe-45a1-b239-3737f2f6941d tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-781139-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.057214 Oct 03 14:42:53.143739 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1300/2636] 10.222.0.20 () {60 vars in 1235 bytes} [Mon Oct 3 14:42:53 2022] GET /compute/v2.1/os-services?host=n-d-781139-2&binary=xxx => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:53.153598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:53.154870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:53.164721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.165617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.166290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.167841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.168515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.169233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.243924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:53.288319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:53.297461 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4fd59a8c-1645-48d0-9130-f68a09473ae6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1516 microversion: 2.1 time: 0.347083 Oct 03 14:42:53.301250 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1337/2637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:52 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:53.312777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:53.326565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.327876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.328497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.336395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.337193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.337789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.403677 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd152fee-ff64-492a-b510-97f33dbb27c0 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.101223 Oct 03 14:42:53.404435 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1338/2638] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 3 14:42:53 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:53.414329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-42071d7c-cee5-4cd1-bef6-e615294ac05a req-ef13c8aa-1cbf-4d3f-94b8-c82033101502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd6470d-2444-4729-9eb9-26609bc154d9", "tag": "1800b505-397e-4bfe-846d-aabd3fa8087b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:53.437860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42071d7c-cee5-4cd1-bef6-e615294ac05a req-ef13c8aa-1cbf-4d3f-94b8-c82033101502 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.438706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42071d7c-cee5-4cd1-bef6-e615294ac05a req-ef13c8aa-1cbf-4d3f-94b8-c82033101502 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.440289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42071d7c-cee5-4cd1-bef6-e615294ac05a req-ef13c8aa-1cbf-4d3f-94b8-c82033101502 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.465226 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-42071d7c-cee5-4cd1-bef6-e615294ac05a req-ef13c8aa-1cbf-4d3f-94b8-c82033101502 service nova] Creating event network-changed:1800b505-397e-4bfe-846d-aabd3fa8087b for instance 8dd6470d-2444-4729-9eb9-26609bc154d9 on n-h2-781139-2 Oct 03 14:42:53.475481 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-42071d7c-cee5-4cd1-bef6-e615294ac05a req-ef13c8aa-1cbf-4d3f-94b8-c82033101502 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067521 Oct 03 14:42:53.479618 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1339/2639] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:53.492115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:53.493131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:53.506800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.509951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.510095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:53.510700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.523571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:53.527074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:53.528288 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0b7b6bd-4cf0-44fd-96f7-3189f73f810d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1886 microversion: 2.42 time: 0.379817 Oct 03 14:42:53.529032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.529679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.532638 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1301/2640] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:53 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1886 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:53.533649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.542789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:53.547171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.547664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.548125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.548849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.549358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.549789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.603940 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e283e0c-92f6-4b39-ac74-4eb7c50a5c07 tempest-ServicesAdminNegativeV253TestJSON-1233409667 tempest-ServicesAdminNegativeV253TestJSON-1233409667-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.069486 Oct 03 14:42:53.604893 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1302/2641] 10.222.0.20 () {60 vars in 1239 bytes} [Mon Oct 3 14:42:53 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:53.617107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:53.618613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:53.654751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.659936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.660766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.670892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:53.672439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:53.674306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:53.870059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:53.891315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:53.898998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:53.919490 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2ea9fd4-a396-488e-9112-618f815a27be tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.309582 Oct 03 14:42:53.920540 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1303/2642] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:53 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:54.254187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:54.272091 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c5c96e4-3bed-4720-b18e-3501fac038e6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.783206 Oct 03 14:42:54.273015 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1340/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:53 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:54.297945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2029a7c8-e02d-41a6-b87c-ba12d28a6110 tempest-ServicesAdminNegativeV253TestJSON-149697068 tempest-ServicesAdminNegativeV253TestJSON-149697068-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:54.301850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2029a7c8-e02d-41a6-b87c-ba12d28a6110 tempest-ServicesAdminNegativeV253TestJSON-149697068 tempest-ServicesAdminNegativeV253TestJSON-149697068-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f94f99a500004d4b973ee97636e42e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93c0309e194be7950c74679607010e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2029a7c8-e02d-41a6-b87c-ba12d28a6110 tempest-ServicesAdminNegativeV253TestJSON-149697068 tempest-ServicesAdminNegativeV253TestJSON-149697068-project] Request method failure captured: Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTqCZ7ccN3UjP2yCowh9OB6q21JWcCm2neqzAckFKO2Wdk2e1TMGJiQLhFH7TntaxSUyi17dwuY4WwBa6r87Js1lqMjrWwlpoB7o4rGyhiyrO44ZMTPdzPByjm5fuD-L1oSqs7cZ8sFLAd0UqFizZMu_h6AfMiNlI-9a7gwaRa_C9o Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.53 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: bf93c0309e194be7950c74679607010e Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-149697068 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bf93c0309e194be7950c74679607010e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bf93c0309e194be7950c74679607010e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bf93c0309e194be7950c74679607010e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bf93c0309e194be7950c74679607010e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-149697068 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: bf93c0309e194be7950c74679607010e Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-149697068 Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServicesAdminNegativeV253TestJSON-149697068-project Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f94f99a500004d4b973ee97636e42e7b Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-149697068-project Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: action_args: {} Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:42:54.306048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2029a7c8-e02d-41a6-b87c-ba12d28a6110 tempest-ServicesAdminNegativeV253TestJSON-149697068 tempest-ServicesAdminNegativeV253TestJSON-149697068-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:54.310315 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2029a7c8-e02d-41a6-b87c-ba12d28a6110 tempest-ServicesAdminNegativeV253TestJSON-149697068 tempest-ServicesAdminNegativeV253TestJSON-149697068-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.385866 Oct 03 14:42:54.316290 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1304/2644] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 3 14:42:53 2022] GET /compute/v2.1/os-services => generated 112 bytes in 395 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:42:54.323721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:54.329245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:54.342140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:54.344334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:54.346238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:54.347523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:54.349973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:54.351509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:54.557649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:54.558610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:54.570997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:54.573718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:54.576660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:54.577783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:54.578485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:54.579823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:55.309720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:55.313574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:55.322535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:55.325232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:55.326892 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2ca85e8-c883-46ea-8509-b73036fd666a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1886 microversion: 2.42 time: 0.774897 Oct 03 14:42:55.357769 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1305/2645] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:54 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1886 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:42:55.369120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:55.369756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:55.381414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:55.381910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:55.382357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:55.383082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:55.383913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:55.384343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:55.494647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:55.510163 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35d6893e-53ee-4c20-8e8a-edb01e5aa0d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1516 microversion: 2.1 time: 1.189172 Oct 03 14:42:55.511886 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1341/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:54 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1516 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:55.521642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:55.533219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:55.533219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:55.535401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:55.542866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:55.555796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:55.556450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:55.557072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:55.557933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:55.558497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:55.559283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:55.560559 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d69495d7-5dd5-4b5b-b022-543d3416ab60 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1560 microversion: 2.91 time: 0.201231 Oct 03 14:42:55.573569 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1306/2647] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:55 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:55.603489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1c7e646b-3c64-4492-b151-fcdfc26ea597 req-2e113345-341a-488d-a9ab-8300b5ed8d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "6d38d07f-4e09-4390-929a-ce568815329f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:55.615368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c7e646b-3c64-4492-b151-fcdfc26ea597 req-2e113345-341a-488d-a9ab-8300b5ed8d11 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:55.616025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c7e646b-3c64-4492-b151-fcdfc26ea597 req-2e113345-341a-488d-a9ab-8300b5ed8d11 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:55.616827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1c7e646b-3c64-4492-b151-fcdfc26ea597 req-2e113345-341a-488d-a9ab-8300b5ed8d11 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:55.631249 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1c7e646b-3c64-4492-b151-fcdfc26ea597 req-2e113345-341a-488d-a9ab-8300b5ed8d11 service nova] Creating event network-changed:6d38d07f-4e09-4390-929a-ce568815329f for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:42:55.646555 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1c7e646b-3c64-4492-b151-fcdfc26ea597 req-2e113345-341a-488d-a9ab-8300b5ed8d11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046987 Oct 03 14:42:55.647828 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1307/2648] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:56.327658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7bb749b6-b908-4a56-89ca-952c05f0cbbd req-a92463a3-e9d0-453c-ae76-6551de4dd896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8de68b-0c52-4794-a4db-7cade3df7e5b", "name": "network-vif-deleted", "tag": "b136120e-aff3-4bdd-be27-82cbdca3aad7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:56.379419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7bb749b6-b908-4a56-89ca-952c05f0cbbd req-a92463a3-e9d0-453c-ae76-6551de4dd896 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:56.379902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7bb749b6-b908-4a56-89ca-952c05f0cbbd req-a92463a3-e9d0-453c-ae76-6551de4dd896 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:56.380339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7bb749b6-b908-4a56-89ca-952c05f0cbbd req-a92463a3-e9d0-453c-ae76-6551de4dd896 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:56.442435 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7bb749b6-b908-4a56-89ca-952c05f0cbbd req-a92463a3-e9d0-453c-ae76-6551de4dd896 service nova] Creating event network-vif-deleted:b136120e-aff3-4bdd-be27-82cbdca3aad7 for instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b on n-h2-781139-2 Oct 03 14:42:56.448871 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7bb749b6-b908-4a56-89ca-952c05f0cbbd req-a92463a3-e9d0-453c-ae76-6551de4dd896 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132506 Oct 03 14:42:56.451529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1308/2649] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:42:56.462920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:56.465706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:56.481377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:56.482154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:56.482761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:56.483739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:56.484418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:56.485110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:56.757871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:56.770098 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ede2e862-8a6e-450d-a100-4714f79af787 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 1.256599 Oct 03 14:42:56.784974 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1342/2650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:55 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:56.784974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:56.784974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:56.795938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:56.796735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:56.797466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:56.798390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:56.799113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:56.799660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:56.841380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:56.842206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:56.842802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:56.843248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lazy-loading 'fault' on Instance uuid 4e8de68b-0c52-4794-a4db-7cade3df7e5b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:42:57.122514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:57.139875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:57.140543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:57.141929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:57.143419 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01874487-6bc7-4ebb-a7c4-fbeb427f7beb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.690023 Oct 03 14:42:57.145764 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1309/2651] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:56 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:57.151767 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5b968fce-25e9-45c1-9378-fa2f045155b9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 200 len: 1319 microversion: 2.1 time: 0.378830 Oct 03 14:42:57.166062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:57.167171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:57.176121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:57.177270 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1343/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:56 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:57.178019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:57.179023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:57.181379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:57.183228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:57.184157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:57.425849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:57.447033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:57.454135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:57.470549 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c72e068c-4457-409d-9f03-0f517dcbf632 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.321927 Oct 03 14:42:57.472783 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1310/2653] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:57 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:57.695536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6741c5e9-b4cd-4d8c-8211-b28a11144964 req-5ff94dbc-3fa7-4f99-a60c-d935628f808c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "5390fedc-da97-4712-a8da-7629aee81daf"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:57.717120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6741c5e9-b4cd-4d8c-8211-b28a11144964 req-5ff94dbc-3fa7-4f99-a60c-d935628f808c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:57.717120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6741c5e9-b4cd-4d8c-8211-b28a11144964 req-5ff94dbc-3fa7-4f99-a60c-d935628f808c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:57.717120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6741c5e9-b4cd-4d8c-8211-b28a11144964 req-5ff94dbc-3fa7-4f99-a60c-d935628f808c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:57.753879 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6741c5e9-b4cd-4d8c-8211-b28a11144964 req-5ff94dbc-3fa7-4f99-a60c-d935628f808c service nova] Creating event network-changed:5390fedc-da97-4712-a8da-7629aee81daf for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:42:57.771206 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6741c5e9-b4cd-4d8c-8211-b28a11144964 req-5ff94dbc-3fa7-4f99-a60c-d935628f808c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079008 Oct 03 14:42:57.777293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1344/2654] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:42:57.799314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:57.800290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:57.812879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:57.817193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:57.817943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:57.818974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:57.819655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:57.823757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:58.386356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-657431267", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "68d6428c-e180-49e1-85dc-631c13540af9"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:42:58.522779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] validate_networks() for [('68d6428c-e180-49e1-85dc-631c13540af9', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:42:58.578672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:58.592580 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc7de0c0-1672-42e6-982e-350c3763d67b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.799122 Oct 03 14:42:58.593474 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1311/2655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:57 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:58.611473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:58.615196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:58.642622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:58.646434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:58.649857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:58.652819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:58.656175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:58.660789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:59.403831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:59.417060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:59.427304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:59.428803 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b45417a-3f05-4f4e-9607-6c46649cbd2f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.828918 Oct 03 14:42:59.430041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1312/2656] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:58 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:42:59.442649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:59.443583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:59.456976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:59.457778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:59.458372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:59.459347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:59.460142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:59.461254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:59.505419 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b HTTP/1.1 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '4e8de68b-0c52-4794-a4db-7cade3df7e5b'} Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:42:59.508099 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:59.514593 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:42:59.514593 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:42:59.514593 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:42:59.514593 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:42:59.514593 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:42:59.514593 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:42:59.514593 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:42:59.517826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:42:59.519166 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6453ffeb-698e-4865-94b9-fced325ca1c1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 404 len: 111 microversion: 2.1 time: 0.087651 Oct 03 14:42:59.520023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1313/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:59 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:42:59.564705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:59.570761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:59.612528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:59.615387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:59.616605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:59.618568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:59.620601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:59.625407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:59.943290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:42:59.962929 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-745cd0ef-8092-49e1-8223-c61e33a2d68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.441166 Oct 03 14:42:59.963737 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1314/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:42:59 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:42:59.969498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:42:59.970487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:42:59.983654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:59.984415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:59.985170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:42:59.992622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:42:59.996404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:42:59.997994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:00.111630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:43:00.112973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:43:00.113757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:43:00.114314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:43:00.114892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:43:00.161229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:00.162533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:00.163123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:00.164193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:00.164794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:00.165397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:00.192473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:00.210076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:00.216880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:00.227204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Getting quotas for project ca0b820e921a46c48cbf1fc6af563d5e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:00.229193 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5abf0641-784a-499a-8c8f-df533b439974 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.260638 Oct 03 14:43:00.230819 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1315/2659] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:42:59 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:00.240793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Getting quotas for user bacca3be013646da8b5c1a2697063909 and project ca0b820e921a46c48cbf1fc6af563d5e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:00.242519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:00.244785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:00.259573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:00.260061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:00.260494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:00.261322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:00.261696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:00.262114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:00.281593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:43:00.298032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:43:00.467792 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2029ae28-a2cc-452f-bdcb-1a9c26220668 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.351552 Oct 03 14:43:00.489077 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1345/2660] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 03 14:43:00.537482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-920197623", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "becfb12c-e5af-4560-80c3-4794784e4ae3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:00.645031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:00.657368 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7742f55d-c96a-4213-975b-23c0c3d71863 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.423768 Oct 03 14:43:00.657943 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1316/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:00 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:00.681688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] validate_networks() for [('becfb12c-e5af-4560-80c3-4794784e4ae3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:43:00.701281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:00.702154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:00.716800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:00.718710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:00.719293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:00.720720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:00.722796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:00.727091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:01.090340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:01.105014 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7d96cd4-4959-438b-8e6b-678e2dfa97c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.411236 Oct 03 14:43:01.106096 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1317/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:00 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:01.123140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fd1b341b-fc7e-44cf-b12a-311660c3d79b req-08bd20da-8661-47fa-93b9-19dd1aa3394e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "12ef2c91-4d07-4180-bd5b-de28f42de817"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:01.143783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fd1b341b-fc7e-44cf-b12a-311660c3d79b req-08bd20da-8661-47fa-93b9-19dd1aa3394e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:01.146424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fd1b341b-fc7e-44cf-b12a-311660c3d79b req-08bd20da-8661-47fa-93b9-19dd1aa3394e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:01.148665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fd1b341b-fc7e-44cf-b12a-311660c3d79b req-08bd20da-8661-47fa-93b9-19dd1aa3394e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:01.171811 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fd1b341b-fc7e-44cf-b12a-311660c3d79b req-08bd20da-8661-47fa-93b9-19dd1aa3394e service nova] Creating event network-changed:12ef2c91-4d07-4180-bd5b-de28f42de817 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:43:01.189994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fd1b341b-fc7e-44cf-b12a-311660c3d79b req-08bd20da-8661-47fa-93b9-19dd1aa3394e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081081 Oct 03 14:43:01.192295 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1318/2663] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:01.206688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:01.207917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:01.234830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:01.235643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:01.236295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:01.237468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:01.238388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:01.239032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:01.759968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:01.776249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:01.780598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:01.782641 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a8d9cb2-1f53-4a57-bd15-c4fe83c641bd tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.590741 Oct 03 14:43:01.785069 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1319/2664] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:01 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:01.816244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8763edba-6d8c-473a-9d10-288bec2ccd33 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:01.818851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8763edba-6d8c-473a-9d10-288bec2ccd33 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:01.980327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8763edba-6d8c-473a-9d10-288bec2ccd33 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:01.994110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8763edba-6d8c-473a-9d10-288bec2ccd33 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:01.998033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8763edba-6d8c-473a-9d10-288bec2ccd33 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:01.999503 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8763edba-6d8c-473a-9d10-288bec2ccd33 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1258 microversion: 2.21 time: 0.213233 Oct 03 14:43:02.026160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1320/2665] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:01 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:02.036816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:02.038127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:02.056771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:02.057640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:02.059920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:02.060941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:02.061894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:02.062696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:02.335097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:02.350406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-614f2e23-6c48-4fca-91b9-fd214a53586d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.322849 Oct 03 14:43:02.351294 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1321/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:02 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:02.378768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:02.380306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:02.389384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:02.390319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:02.391006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:02.391983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:02.392698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:02.393665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:02.515762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:02.531402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:02.534680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:02.542056 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a81c18fa-0618-489f-ba5f-87ecdbfe0884 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.178366 Oct 03 14:43:02.545149 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1322/2667] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:02 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:02.580406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:02.581361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:02.593768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:02.594450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:02.595787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:02.597797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:02.598706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:02.599346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:02.957770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:02.980836 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-766f3ead-a1bb-48d4-baf8-7424246cd8b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.404435 Oct 03 14:43:02.983706 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1323/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:02 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:02.989994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-260753588"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:02.993851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:03.015863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.016636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.018122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:03.019794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.020857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.021908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:03.451032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:43:03.451625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:43:03.452295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:43:03.452954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:43:03.453532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:43:03.483804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.485282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.487700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:03.487991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:03.490521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.492738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.495219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:03.518447 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-091aa581-8fbd-47f2-b0b7-ffa6f0964cfa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.530386 Oct 03 14:43:03.522151 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1324/2669] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:43:02 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 03 14:43:03.578183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:03.585242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:03.586696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:03.593789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Getting quotas for user 72817942188546d9bb9b64e22c121f16 and project 6c3c4a89df1341f59f41b7547ebcfa22. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:03.617020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=13 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:03.623685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.624247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.624683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:03.630379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.631241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:43:03.631563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.632343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:03.635346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:43:03.815993 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37fd1e65-d36a-4e24-8b7f-2bea22171480 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.325091 Oct 03 14:43:03.825969 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1346/2670] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:43:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:43:03.832211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:03.833070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:03.842386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.843092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.844476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:03.845381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:03.845987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:03.846680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:04.066383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.105628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.107125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.108376 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ba26452-f543-4dbf-903a-78097c9ea0da tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.561121 Oct 03 14:43:04.108965 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1325/2671] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:03 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:04.157747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:04.158376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:04.184344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:04.184837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:04.189317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:04.195468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:04.196309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:04.197338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:04.272403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.289659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.292477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.294409 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be76e829-dd7c-4e91-9322-4178637e9c32 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1318 microversion: 2.21 time: 0.467047 Oct 03 14:43:04.308882 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1347/2672] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:03 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:04.308882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2beb6bd6-2eb1-4126-86ed-a1b97f335f50 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:04.308882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2beb6bd6-2eb1-4126-86ed-a1b97f335f50 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:04.362013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.372468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.374171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.381539 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8d766fc-8d98-4b58-8a43-b4ed9c1a0ac8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.237022 Oct 03 14:43:04.383582 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1326/2673] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:04 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:04.469219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2beb6bd6-2eb1-4126-86ed-a1b97f335f50 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:04.479054 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2beb6bd6-2eb1-4126-86ed-a1b97f335f50 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1208 microversion: 2.1 time: 0.181925 Oct 03 14:43:04.479904 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1348/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:04 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1208 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:04.496251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:04.500954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:04.522011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:04.522511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:04.522948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:04.530167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:04.533146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:04.533624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:04.544233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2079103402", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:04.670228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:43:04.967812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:43:04.968515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:43:04.969143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:43:04.969810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:43:04.970439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:43:04.982837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:04.983449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:04.984031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:04.984967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:04.985689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:04.986316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:05.025391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Getting quotas for project 7c3ae16f9bf846cca4c0b07f11c405b6. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:05.031416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Getting quotas for user 27cd868c67c44856861d76e57a9bb29f and project 7c3ae16f9bf846cca4c0b07f11c405b6. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:05.045461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:05.055664 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52ab46e0-f084-43e7-834b-30de22101df5 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.574513 Oct 03 14:43:05.057129 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1349/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:04 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:05.060697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:43:05.063092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:43:05.166950 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85b3e760-7bf8-4cf3-9eef-d4ff92449b22 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779518 Oct 03 14:43:05.168844 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1327/2676] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:43:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:43:05.176352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ef2e531a-a183-470e-9d73-7a48088eade4 req-4820809c-ed57-4a49-8a1f-f236b67d08ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd6470d-2444-4729-9eb9-26609bc154d9", "name": "network-vif-plugged", "status": "completed", "tag": "1800b505-397e-4bfe-846d-aabd3fa8087b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:05.188218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-238355921", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:05.208550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ef2e531a-a183-470e-9d73-7a48088eade4 req-4820809c-ed57-4a49-8a1f-f236b67d08ac service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:05.209192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ef2e531a-a183-470e-9d73-7a48088eade4 req-4820809c-ed57-4a49-8a1f-f236b67d08ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:05.209799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ef2e531a-a183-470e-9d73-7a48088eade4 req-4820809c-ed57-4a49-8a1f-f236b67d08ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:05.224723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ef2e531a-a183-470e-9d73-7a48088eade4 req-4820809c-ed57-4a49-8a1f-f236b67d08ac service nova] Creating event network-vif-plugged:1800b505-397e-4bfe-846d-aabd3fa8087b for instance 8dd6470d-2444-4729-9eb9-26609bc154d9 on n-h2-781139-2 Oct 03 14:43:05.231719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ef2e531a-a183-470e-9d73-7a48088eade4 req-4820809c-ed57-4a49-8a1f-f236b67d08ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061570 Oct 03 14:43:05.232900 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1328/2677] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:05.240071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fa0ec722-54e7-445b-b7f7-c5f54e88d015 req-caeff994-362f-4b9d-ae0f-0402636b1341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "67029309-c63a-423b-b036-5bd8407234e6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:05.250279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:05.253232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fa0ec722-54e7-445b-b7f7-c5f54e88d015 req-caeff994-362f-4b9d-ae0f-0402636b1341 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:05.254219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fa0ec722-54e7-445b-b7f7-c5f54e88d015 req-caeff994-362f-4b9d-ae0f-0402636b1341 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:05.254866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fa0ec722-54e7-445b-b7f7-c5f54e88d015 req-caeff994-362f-4b9d-ae0f-0402636b1341 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:05.273307 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fa0ec722-54e7-445b-b7f7-c5f54e88d015 req-caeff994-362f-4b9d-ae0f-0402636b1341 service nova] Creating event network-changed:67029309-c63a-423b-b036-5bd8407234e6 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:43:05.280140 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fa0ec722-54e7-445b-b7f7-c5f54e88d015 req-caeff994-362f-4b9d-ae0f-0402636b1341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045352 Oct 03 14:43:05.291694 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1329/2678] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:05.297893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:05.298963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:05.306860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:05.307422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:05.307960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:05.309028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:05.309610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:05.310101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:05.320888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:43:05.674310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:05.702484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:05.716052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:05.737640 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd5fc710-65d4-4188-9f99-eec9091f1253 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.426823 Oct 03 14:43:05.739879 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1330/2679] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:05 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:05.758113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63215708-bf54-4f33-91d7-f113b970df32 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:05.759893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63215708-bf54-4f33-91d7-f113b970df32 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:05.902888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63215708-bf54-4f33-91d7-f113b970df32 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:05.910734 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63215708-bf54-4f33-91d7-f113b970df32 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1214 microversion: 2.1 time: 0.166648 Oct 03 14:43:05.915263 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1331/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:05 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:05.938760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:05.941303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:05.951700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:05.952392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:05.953404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:05.966917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:05.967393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:05.967834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.164650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:43:06.165217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:43:06.165559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:43:06.166475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:43:06.167067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:43:06.170904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:06.181589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.191037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.195367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.200168 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d36f0827-b00f-4a75-b77e-f693c2588882 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1316 microversion: 2.21 time: 0.281345 Oct 03 14:43:06.202383 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1332/2681] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:05 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:06.210913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:06.211905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:06.219999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.220729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.231455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.236043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.236470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.238889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.239831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.241083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.242472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.244719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.245650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.246722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.301595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:06.318302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:06.345887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:43:06.349465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:43:06.408420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.424010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.435912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.441140 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a3ca52b8-057d-4f5b-b6d7-186e47983719 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381468 Oct 03 14:43:06.450626 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1350/2682] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:43:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:43:06.462569 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04c8e5ca-f897-4af2-9f1b-8434f5d4164d tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.256354 Oct 03 14:43:06.469115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:06.469906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:06.478268 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1333/2683] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:06 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:06.494988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.495540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:06.496763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:06.496887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.497737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.500258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.501361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.502902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.505016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.505684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.506935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.506935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.507616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.508144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.618355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.650383 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e223740-9ccb-4b1c-84fe-00ac80db557d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1266 microversion: 2.1 time: 0.197540 Oct 03 14:43:06.651181 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1351/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:06 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:06.685606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2c2271e-c17e-4771-b9cd-8d3bdc84e481 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:06.686244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2c2271e-c17e-4771-b9cd-8d3bdc84e481 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:06.821559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.839680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9131d4d-7a30-4ca5-a98f-0a14c294a276 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1316 microversion: 2.1 time: 0.359032 Oct 03 14:43:06.841423 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1334/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:06 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:06.867346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:06.867944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:06.917320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2c2271e-c17e-4771-b9cd-8d3bdc84e481 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:06.919176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.922602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.925897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.927181 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2c2271e-c17e-4771-b9cd-8d3bdc84e481 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1216 microversion: 2.1 time: 0.249883 Oct 03 14:43:06.928228 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1352/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:06 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1216 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:06.929753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.930533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.931191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.941623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:06.950215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:06.978433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.978981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.979474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:06.980234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:06.980695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:06.981159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.337534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.359086 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-85ec6ac0-7afc-4f88-b909-69da3767d3a8 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1266 microversion: 2.1 time: 0.422482 Oct 03 14:43:07.359694 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1353/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:06 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:07.424865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:07.425798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:07.447270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.449120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.450803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.453609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.455476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.456843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.594271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.604105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.605613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.606817 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19ee3934-6284-4d8c-bb5c-fc9834d03064 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.760689 Oct 03 14:43:07.607384 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1335/2688] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:06 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:07.651750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:07.652636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:07.665657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.666463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.667098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.667998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.668631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.669271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.835460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.846714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.854183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.870066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b61df8e-7aff-4549-8b55-8af311a2687c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.261631 Oct 03 14:43:07.871143 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1336/2689] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:07 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:07.876014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:07.876919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:07.884159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.894112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.896266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.898726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.899432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.900264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.931179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.940024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.947861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:07.949441 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-57c93d2a-9bba-4e16-88b5-51b982f10226 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.588769 Oct 03 14:43:07.953895 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1354/2690] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:07 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:07.959178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:07.965695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:07.977258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.979660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.988202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:07.989323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:07.990004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:07.991425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.322459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:08.333061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-167f777b-678d-4e10-aee4-c5d946362112 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1308 microversion: 2.1 time: 0.459020 Oct 03 14:43:08.339907 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1337/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:07 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:08.346382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:08.348479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:08.362040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.364404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.366919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.372368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.373093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.373877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.551950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:08.559895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37a5d117-d5b3-4ca1-9f5f-7d59057d7ed9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1268 microversion: 2.1 time: 0.218584 Oct 03 14:43:08.578872 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1338/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:08 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1268 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:08.591123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:08.591789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:08.605964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.606636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.606891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.607625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.608074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.608503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.613017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:08.623614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5fb461d3-4376-4b52-b7f2-ddebb93f6c29 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1466 microversion: 2.1 time: 0.668171 Oct 03 14:43:08.625819 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1355/2693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:07 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1466 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:08.637256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:08.638273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:08.660241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.661915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.662843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.663947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.664588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.665217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.759149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:08.767699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39361df0-3f0f-4864-80bb-b2e26772018f tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1272 microversion: 2.1 time: 0.187545 Oct 03 14:43:08.781185 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1339/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:08 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:08.781185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1038785293", "metadata": {"image_type": "test"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:08.789665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:08.805054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.805923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.806374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.807107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:08.807573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:08.808007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:08.891912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Getting quotas for project 93c499a00f3842bd8c6512a4e06c2945. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:08.907400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Getting quotas for user c90e0563672845d0ad07db3f935eed70 and project 93c499a00f3842bd8c6512a4e06c2945. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:09.344857 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4638be80-d22a-4485-8b07-3339f66ae911 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "POST /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9/action" status: 202 len: 0 microversion: 2.1 time: 0.570019 Oct 03 14:43:09.345970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1340/2695] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:43:08 2022] POST /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:43:09.355768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:09.356486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:09.367983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:09.369132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:09.369720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:09.371629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:09.372307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:09.373469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:09.549109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:09.563940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:09.566491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:09.574534 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8eb33db-f670-421b-beb1-432e7bdf7b08 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.226385 Oct 03 14:43:09.593017 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1341/2696] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:09 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:09.608570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:09.609980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:09.620160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:09.621183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:09.621849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:09.623761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:09.624612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:09.625307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:09.656437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:09.674261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:09.696515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:09.701892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:09.703742 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3db15e5b-91e8-48b8-a273-69e21d0257c5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 1.070813 Oct 03 14:43:09.720887 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1356/2697] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:08 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:43:09.742056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24056c44-3269-47f4-9c15-69a7167883d0 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230666940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:09.836556 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24056c44-3269-47f4-9c15-69a7167883d0 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 200 len: 1420 microversion: 2.1 time: 0.114114 Oct 03 14:43:09.844743 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1357/2698] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:09 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:09.851784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:09.852589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:09.862139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:09.862900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:09.863334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:09.864108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:09.864476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:09.864944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.066601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.076132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.078247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.079902 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46040b6e-c4fe-41ab-be7f-24babe0fa7d5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.485518 Oct 03 14:43:10.081027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1342/2699] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:09 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:10.086580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:10.087708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:10.094284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.094953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.095994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.097607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.098244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.098824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.250140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.259181 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00076170-a2cc-4e4e-a60f-7096f6996e6f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1274 microversion: 2.1 time: 0.176750 Oct 03 14:43:10.260040 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1343/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:10 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:10.264321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:10.264953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:10.285711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.286214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.286666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.287577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.301710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.302178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.356051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.364191 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5687d281-667e-44f4-be9a-486df4e7efd5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1308 microversion: 2.1 time: 0.517151 Oct 03 14:43:10.377681 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1358/2701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:09 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:10.608010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:10.609015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:10.615966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.629072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.630601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.640583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.643352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.650921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.698361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.711170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d043df16-7002-4f1d-91a8-6b35371fca98 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.448139 Oct 03 14:43:10.713679 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1344/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:10 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:10.742644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:10.743273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:10.763885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.764387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.764860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.765613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:10.774993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:10.775564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:10.823869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.836158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.841777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:10.865429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-917cf725-ce03-4ec9-a77c-01c656aa8eb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.261123 Oct 03 14:43:10.866577 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1359/2703] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:10 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:11.028405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-80f9cd19-a6c2-4114-8c70-aaf4d8edd923 req-85de2c70-266b-45b0-9547-2e6da3ea94a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25abf273-edc1-4dec-91b1-c025ebffebdc", "tag": "bbd99c3a-75f5-4179-b17d-e28be8949f55"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:11.046354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-80f9cd19-a6c2-4114-8c70-aaf4d8edd923 req-85de2c70-266b-45b0-9547-2e6da3ea94a7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.047000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-80f9cd19-a6c2-4114-8c70-aaf4d8edd923 req-85de2c70-266b-45b0-9547-2e6da3ea94a7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.047527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-80f9cd19-a6c2-4114-8c70-aaf4d8edd923 req-85de2c70-266b-45b0-9547-2e6da3ea94a7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.082172 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-80f9cd19-a6c2-4114-8c70-aaf4d8edd923 req-85de2c70-266b-45b0-9547-2e6da3ea94a7 service nova] Creating event network-changed:bbd99c3a-75f5-4179-b17d-e28be8949f55 for instance 25abf273-edc1-4dec-91b1-c025ebffebdc on n-h2-781139-2 Oct 03 14:43:11.087438 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-80f9cd19-a6c2-4114-8c70-aaf4d8edd923 req-85de2c70-266b-45b0-9547-2e6da3ea94a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219455 Oct 03 14:43:11.088505 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1360/2704] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:11.093754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09c4503f-7774-487e-8aa9-512377e4d8df tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb23030ac10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:11.162092 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-09c4503f-7774-487e-8aa9-512377e4d8df tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 200 len: 1420 microversion: 2.1 time: 0.072061 Oct 03 14:43:11.170406 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1361/2705] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:11 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:11.177618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f3eb2323-694b-4de4-a1fc-5494f7a62ba2 req-bd706dc9-57e5-4c9f-b544-dd238d81029b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7d61fb8-583d-4696-ab65-cdd03107edce", "tag": "45447be6-6219-4aa5-9e66-a22e4adc5279"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:11.202092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3eb2323-694b-4de4-a1fc-5494f7a62ba2 req-bd706dc9-57e5-4c9f-b544-dd238d81029b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.213088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3eb2323-694b-4de4-a1fc-5494f7a62ba2 req-bd706dc9-57e5-4c9f-b544-dd238d81029b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.213649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3eb2323-694b-4de4-a1fc-5494f7a62ba2 req-bd706dc9-57e5-4c9f-b544-dd238d81029b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.238410 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f3eb2323-694b-4de4-a1fc-5494f7a62ba2 req-bd706dc9-57e5-4c9f-b544-dd238d81029b service nova] Creating event network-changed:45447be6-6219-4aa5-9e66-a22e4adc5279 for instance a7d61fb8-583d-4696-ab65-cdd03107edce on n-h1-781139-2 Oct 03 14:43:11.251920 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f3eb2323-694b-4de4-a1fc-5494f7a62ba2 req-bd706dc9-57e5-4c9f-b544-dd238d81029b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080040 Oct 03 14:43:11.252817 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1362/2706] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:11.264829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:11.265991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:11.280205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.283404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.284184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.285159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.287067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.287915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.305090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:11.412427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:11.429969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:11.431676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:11.433675 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-182bbdf1-5dab-4a6d-8dff-8b4a0aa52784 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.698627 Oct 03 14:43:11.434783 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1345/2707] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:10 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:11.442969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:11.443472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:11.451018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.451678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.452122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.452887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.453378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.454472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.575553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:11.585496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b30e4fa7-2a42-4303-95b9-351589073710 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1274 microversion: 2.1 time: 0.148412 Oct 03 14:43:11.605771 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1346/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:11 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:11.617507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:11.618745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:11.633649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.634517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.635179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.636274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.636968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.637599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.879242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:11.891352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:11.893170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:11.894487 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0792ca7b-de6d-484c-b64e-7cee18a08029 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.640229 Oct 03 14:43:11.895667 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1363/2709] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:11 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:11.900575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e118a2fb-4051-47f6-8810-c57c5721ea01 req-7d2bef44-9d8d-4c19-898f-dba678f80778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "name": "network-vif-plugged", "status": "completed", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:11.910996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e118a2fb-4051-47f6-8810-c57c5721ea01 req-7d2bef44-9d8d-4c19-898f-dba678f80778 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.911735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e118a2fb-4051-47f6-8810-c57c5721ea01 req-7d2bef44-9d8d-4c19-898f-dba678f80778 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.912298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e118a2fb-4051-47f6-8810-c57c5721ea01 req-7d2bef44-9d8d-4c19-898f-dba678f80778 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.928071 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e118a2fb-4051-47f6-8810-c57c5721ea01 req-7d2bef44-9d8d-4c19-898f-dba678f80778 service nova] Creating event network-vif-plugged:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:43:11.933781 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e118a2fb-4051-47f6-8810-c57c5721ea01 req-7d2bef44-9d8d-4c19-898f-dba678f80778 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036723 Oct 03 14:43:11.934589 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1364/2710] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:11.941676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:11.942550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:11.949273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.949969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.950584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:11.951436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:11.952082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:11.952687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.130752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.156025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e5cbbb1-828b-4ede-9730-c3d467014187 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1308 microversion: 2.1 time: 0.546890 Oct 03 14:43:12.156836 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1347/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:11 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:12.164633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:12.165411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:12.185292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.187780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.188843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.194097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.194957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.195603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.288227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.298363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.299863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.306795 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9daec1bb-f57d-41d9-a4b5-cd2cf210bece tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.146174 Oct 03 14:43:12.319322 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1348/2712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:12 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:12.319322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ce4e46a-1788-4b9a-9075-110ef411aa4e tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb2300f43a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:12.367696 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ce4e46a-1788-4b9a-9075-110ef411aa4e tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 200 len: 1420 microversion: 2.1 time: 0.058651 Oct 03 14:43:12.379993 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1349/2713] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:12 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:12.463011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:12.468269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:12.479210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.487384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.488390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.490274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.491207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.491795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.556256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.578799 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5571325-9e8b-4764-9d7d-6f068cf838fb tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.642697 Oct 03 14:43:12.581715 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1365/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:11 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:12.612020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:12.612649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:12.627381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.627381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.627381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.627381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.627381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.627381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.926685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.942239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.943883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.949260 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31a3ac6f-8b61-40e6-976b-1ab6bf58e246 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.487264 Oct 03 14:43:12.950260 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1350/2715] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:12 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:43:12.963441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:12.964064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:12.973552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.974042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.974486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.975202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:12.975687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:12.976627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:12.978374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:12.989053 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-054ce201-00fe-47d7-8096-25a6c4170163 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1316 microversion: 2.1 time: 0.380793 Oct 03 14:43:12.990394 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1366/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:12 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:13.186683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:13.187445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:13.197363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:13.198190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:13.198845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:13.199788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:13.200303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:13.200891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:13.344163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:13.355633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:13.366947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:13.368415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cb423b0-0ac1-408c-90d0-936fecda937e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.417102 Oct 03 14:43:13.369531 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1351/2717] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:12 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:13.374302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:13.377615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:13.398352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:13.399118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:13.399723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:13.400604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:13.401255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:13.401884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:13.468413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:13.483783 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b725f313-410a-4dc8-b765-8e94107ac192 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1308 microversion: 2.1 time: 0.303668 Oct 03 14:43:13.485038 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1367/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:13 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:13.494044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b260e6c1-ecdd-42be-b90b-4c46d00c4442 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb23066f670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:13.634115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:13.651236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:13.655624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:13.668128 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b260e6c1-ecdd-42be-b90b-4c46d00c4442 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 200 len: 1420 microversion: 2.1 time: 0.181122 Oct 03 14:43:13.670552 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1368/2719] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:13 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:13.694913 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e57f8ee-cfe9-480a-879d-768387478bb3 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.324008 Oct 03 14:43:13.698461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1352/2720] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:13 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:13.710800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:13.711441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:13.729840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:13.730345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:13.730790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:13.732791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:13.733313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:13.734231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:13.954333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4d443d9e-deca-423d-b37b-1059f797714c req-8f3cddf0-9bdf-467a-a1fe-80228216de74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd6470d-2444-4729-9eb9-26609bc154d9", "name": "network-vif-plugged", "status": "completed", "tag": "1800b505-397e-4bfe-846d-aabd3fa8087b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:13.970246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4d443d9e-deca-423d-b37b-1059f797714c req-8f3cddf0-9bdf-467a-a1fe-80228216de74 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:13.977731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4d443d9e-deca-423d-b37b-1059f797714c req-8f3cddf0-9bdf-467a-a1fe-80228216de74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:13.980088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4d443d9e-deca-423d-b37b-1059f797714c req-8f3cddf0-9bdf-467a-a1fe-80228216de74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.018681 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4d443d9e-deca-423d-b37b-1059f797714c req-8f3cddf0-9bdf-467a-a1fe-80228216de74 service nova] Creating event network-vif-plugged:1800b505-397e-4bfe-846d-aabd3fa8087b for instance 8dd6470d-2444-4729-9eb9-26609bc154d9 on n-h2-781139-2 Oct 03 14:43:14.030578 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4d443d9e-deca-423d-b37b-1059f797714c req-8f3cddf0-9bdf-467a-a1fe-80228216de74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080241 Oct 03 14:43:14.031481 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1353/2721] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:43:14.039955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:14.041223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:14.047610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.048281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.048528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.049349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.049807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.050332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.073976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:14.086687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-840e829f-f43e-4de4-a702-7789257d8dad tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.415325 Oct 03 14:43:14.088616 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1369/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:13 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:14.095931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:14.099091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:14.106015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.106935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.107581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.108528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.109380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.110010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.423307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:14.443125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:14.449381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:14.451119 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-441b129a-acb5-4561-a7c2-56579a5be37c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.418458 Oct 03 14:43:14.452243 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1354/2723] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:14 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:14.479959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-49af8c67-6589-40d4-a9dc-022a3908e8c7 req-fbaa75a8-fe0c-4a01-b84a-db7831ebca5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e64173-e4e0-47f2-8264-e91013915ea4", "tag": "3ef65292-b860-46cf-b937-4f30e3fa0ec8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:14.503918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49af8c67-6589-40d4-a9dc-022a3908e8c7 req-fbaa75a8-fe0c-4a01-b84a-db7831ebca5d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.504407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49af8c67-6589-40d4-a9dc-022a3908e8c7 req-fbaa75a8-fe0c-4a01-b84a-db7831ebca5d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.504860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-49af8c67-6589-40d4-a9dc-022a3908e8c7 req-fbaa75a8-fe0c-4a01-b84a-db7831ebca5d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.557366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-49af8c67-6589-40d4-a9dc-022a3908e8c7 req-fbaa75a8-fe0c-4a01-b84a-db7831ebca5d service nova] Creating event network-changed:3ef65292-b860-46cf-b937-4f30e3fa0ec8 for instance d1e64173-e4e0-47f2-8264-e91013915ea4 on n-h1-781139-2 Oct 03 14:43:14.568897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-49af8c67-6589-40d4-a9dc-022a3908e8c7 req-fbaa75a8-fe0c-4a01-b84a-db7831ebca5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099998 Oct 03 14:43:14.569739 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1355/2724] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:14.574914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:14.583062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:14.604979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.605497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.607831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.607831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.608965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.609459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.639371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:14.649755 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ccc83ede-b7e3-442d-9455-bd97328796a5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1316 microversion: 2.1 time: 0.559628 Oct 03 14:43:14.653244 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1370/2725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:14 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:14.672102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:14.672718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:14.692918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.692918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.692918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.692918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:14.692918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:14.693445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:14.999193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:15.660841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:15.670051 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e34c0f6-7393-4375-8db2-f195f91545f9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1308 microversion: 2.1 time: 1.001578 Oct 03 14:43:15.693367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1371/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:14 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1308 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:15.698735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c8dfeb7-47c2-449a-8c47-e3dbb2770aa7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb23058aa60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:15.910573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:15.987397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:16.016646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:16.018345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:16.019575 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfd780c6-d7bc-4340-a64a-04ed615caf04 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 1.448841 Oct 03 14:43:16.043284 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1356/2727] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:14 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:16.056617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:16.057305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:16.069887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:16.070381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:16.070816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:16.071528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:16.071979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:16.072402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:16.276252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:16.353594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:16.369714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:16.376481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:16.393287 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ca446e9-73fd-4eb5-9402-b9402128e6a9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.346073 Oct 03 14:43:16.396057 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1357/2728] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:16 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:16.412116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ca56b6af-94ad-4b6e-8b39-5d3353e268ac req-36c35957-51b0-4ecb-9b95-edb29e7ea443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc064e15-e471-4aea-9ae4-545bad8c989b", "tag": "4487e7c4-5fab-4cbb-9678-885d73834e9f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:16.442743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ca56b6af-94ad-4b6e-8b39-5d3353e268ac req-36c35957-51b0-4ecb-9b95-edb29e7ea443 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:16.443233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ca56b6af-94ad-4b6e-8b39-5d3353e268ac req-36c35957-51b0-4ecb-9b95-edb29e7ea443 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:16.443676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ca56b6af-94ad-4b6e-8b39-5d3353e268ac req-36c35957-51b0-4ecb-9b95-edb29e7ea443 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:16.490666 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ca56b6af-94ad-4b6e-8b39-5d3353e268ac req-36c35957-51b0-4ecb-9b95-edb29e7ea443 service nova] Creating event network-changed:4487e7c4-5fab-4cbb-9678-885d73834e9f for instance cc064e15-e471-4aea-9ae4-545bad8c989b on n-h2-781139-2 Oct 03 14:43:16.504258 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ca56b6af-94ad-4b6e-8b39-5d3353e268ac req-36c35957-51b0-4ecb-9b95-edb29e7ea443 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106674 Oct 03 14:43:16.521638 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1358/2729] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:16.527353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:16.530165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:16.535841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:16.536572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:16.537049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:16.537785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:16.538248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:16.538677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:16.922418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=22 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:17.072831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:17.087573 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0b4e58d-1e5a-4e7b-bdf7-ce46f937fa30 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.564553 Oct 03 14:43:17.088441 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1359/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:16 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:17.094799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:17.109903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:17.127759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:17.128635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:17.129277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:17.131567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:17.134149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:17.134830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:17.531991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:17.543518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:17.545429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:17.547460 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89f4364a-91f5-437e-ba14-30978e5ebd47 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.456414 Oct 03 14:43:17.562540 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1360/2731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:17 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:17.577607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:17.578739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:17.586464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:17.587303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:17.587953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:17.588899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:17.589626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:17.590259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:17.804240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:17.823716 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9e6b171-5091-4079-9bf9-1976c171e56a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1316 microversion: 2.1 time: 0.259808 Oct 03 14:43:17.824328 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1361/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:17 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:17.831091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:17.832087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:17.844305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:17.845198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:17.845842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:17.846886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:17.847547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:17.848174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:17.860791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:18.102234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:18.128275 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b75a9b9-f30a-40ad-a1e4-bead557a0a92 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1308 microversion: 2.1 time: 0.292617 Oct 03 14:43:18.128275 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1362/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:17 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:18.143922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-36187fde-26b8-4598-8a39-70d519f5b980 req-3344f312-e5c5-4217-b355-753dc5e7bac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25abf273-edc1-4dec-91b1-c025ebffebdc", "name": "network-vif-plugged", "status": "completed", "tag": "bbd99c3a-75f5-4179-b17d-e28be8949f55"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:18.174192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36187fde-26b8-4598-8a39-70d519f5b980 req-3344f312-e5c5-4217-b355-753dc5e7bac4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:18.174192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36187fde-26b8-4598-8a39-70d519f5b980 req-3344f312-e5c5-4217-b355-753dc5e7bac4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:18.174192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36187fde-26b8-4598-8a39-70d519f5b980 req-3344f312-e5c5-4217-b355-753dc5e7bac4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:18.220440 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-36187fde-26b8-4598-8a39-70d519f5b980 req-3344f312-e5c5-4217-b355-753dc5e7bac4 service nova] Creating event network-vif-plugged:bbd99c3a-75f5-4179-b17d-e28be8949f55 for instance 25abf273-edc1-4dec-91b1-c025ebffebdc on n-h2-781139-2 Oct 03 14:43:18.294407 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-36187fde-26b8-4598-8a39-70d519f5b980 req-3344f312-e5c5-4217-b355-753dc5e7bac4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168163 Oct 03 14:43:18.295423 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1363/2734] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:18.311589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:18.313471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:18.334397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:18.335333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:18.336646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:18.338465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:18.339726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:18.340350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:18.717837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:18.733355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:18.734601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:18.735896 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65e36008-3c75-40a9-92ea-78afc16c71e3 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.439296 Oct 03 14:43:18.737406 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1364/2735] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:18 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:18.752068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:18.752972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:18.772605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:18.772841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:18.773181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:18.773904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:18.774355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:18.774781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:18.918714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:18.928351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:18.929708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:18.935604 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2608616-7b1a-4634-9de6-bfdfeb5515dd tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.197168 Oct 03 14:43:18.936426 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1365/2736] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:18 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:18.940917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:18.941499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:18.947886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:18.949409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:18.949409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:18.949612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:18.949957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:18.950393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.225855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.238683 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-521e2e59-18f1-4c43-af72-dae251c691cf tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.301343 Oct 03 14:43:19.253938 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1366/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:18 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:19.253938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:19.253938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:19.253938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.253938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.253938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.254663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.255305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.255795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.481783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.492264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.493763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.507025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-24fb7bdb-41f8-42bc-86ef-6d7b8ba449b9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.254321 Oct 03 14:43:19.507025 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1367/2738] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:19 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:19.529323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:19.529658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:19.532855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:19.537761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.538291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.538732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.539447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.539909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.540334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.734483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.740071 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c8dfeb7-47c2-449a-8c47-e3dbb2770aa7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 200 len: 1420 microversion: 2.1 time: 4.045226 Oct 03 14:43:19.742283 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1372/2739] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:15 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 1420 bytes in 4048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:19.743103 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fa6d4ca-a128-46bb-b8bc-4601e7038ef4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1316 microversion: 2.1 time: 0.233807 Oct 03 14:43:19.750999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:19.751839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:19.753343 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1368/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:19 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:19.761298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.762085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.763007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.763931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.764621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:19.765122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.765341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:19.767179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.774091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.774858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.775307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.784417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.784953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.787993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.950449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.963238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.966292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:19.968111 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4341692-1cef-4397-941c-e2f04ce46697 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.207079 Oct 03 14:43:19.970373 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1369/2741] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:19 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:43:19.975591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:19.976678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:19.985970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.987936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.988618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:19.990138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:19.990829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:19.991478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:20.079647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.106307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.108900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.110462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.116670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90a267ea-6113-44d2-b283-264ecd57709a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1308 microversion: 2.1 time: 0.371984 Oct 03 14:43:20.120477 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddb31480-017f-4f17-bfe5-b86834dcb4cf tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1555 microversion: 2.91 time: 0.148707 Oct 03 14:43:20.124983 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1370/2742] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:19 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:20.131731 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1373/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:19 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:20.263296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:20.263928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:20.273263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:20.275875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:20.276318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:20.277075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:20.277534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:20.278089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:20.346484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b70a9285-efcd-4f0e-b058-66f167cbcc44 req-a7534004-e055-4058-b0e5-b9e374297c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d61fb8-583d-4696-ab65-cdd03107edce", "name": "network-vif-plugged", "status": "completed", "tag": "45447be6-6219-4aa5-9e66-a22e4adc5279"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:20.380489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b70a9285-efcd-4f0e-b058-66f167cbcc44 req-a7534004-e055-4058-b0e5-b9e374297c5c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:20.382191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b70a9285-efcd-4f0e-b058-66f167cbcc44 req-a7534004-e055-4058-b0e5-b9e374297c5c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:20.382803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b70a9285-efcd-4f0e-b058-66f167cbcc44 req-a7534004-e055-4058-b0e5-b9e374297c5c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:20.440082 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b70a9285-efcd-4f0e-b058-66f167cbcc44 req-a7534004-e055-4058-b0e5-b9e374297c5c service nova] Creating event network-vif-plugged:45447be6-6219-4aa5-9e66-a22e4adc5279 for instance a7d61fb8-583d-4696-ab65-cdd03107edce on n-h1-781139-2 Oct 03 14:43:20.446459 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b70a9285-efcd-4f0e-b058-66f167cbcc44 req-a7534004-e055-4058-b0e5-b9e374297c5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104538 Oct 03 14:43:20.448089 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1374/2744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:43:20.486208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.506355 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d797e29e-344c-45b7-b3a7-b70732bd3e10 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.248209 Oct 03 14:43:20.507656 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1371/2745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:20 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:20.523505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:20.524416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:20.533188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:20.533863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:20.534479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:20.535205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:20.535665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:20.536088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:20.755888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9dbaacd9-71f0-4b0d-870c-33e56ada7a2c tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230a41550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:20.866478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.884301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.886365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:20.888665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de43f36b-148f-4b4e-970c-b781ee48b457 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.368989 Oct 03 14:43:20.889487 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1375/2746] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:20 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:20.896781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:20.897662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:20.905971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:20.906689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:20.907281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:20.917261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:20.918057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:20.918667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:21.136078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:21.157833 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4e018d0-acc5-450e-b8c1-0688cc14beb5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1316 microversion: 2.1 time: 0.265672 Oct 03 14:43:21.158790 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1376/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:20 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:21.164476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:21.165342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:21.183631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:21.184176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:21.185915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:21.186739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:21.187202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:21.187813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:21.440850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:21.450434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:21.452739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:21.454178 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5e6f23c-641e-4cc7-8d9d-8691c7c281b9 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.294274 Oct 03 14:43:21.455354 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1377/2748] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:21 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:21.460762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:21.461901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:21.468350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:21.469158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:21.469813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:21.470741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:21.471422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:21.472284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:21.900682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:21.915100 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c97baaf7-0c6b-48f3-868f-440ddb12a736 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1490 microversion: 2.1 time: 0.458425 Oct 03 14:43:21.916205 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1378/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:21 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1490 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:21.924396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:21.927337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:21.941239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:21.946771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:21.947543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:21.948579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:21.949296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:21.949941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:22.068770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:22.086377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:22.088608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:22.099452 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ed5c7f8-c8ca-4774-9ba6-d4603b717336 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1537 microversion: 2.91 time: 0.181868 Oct 03 14:43:22.113873 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1379/2750] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:21 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:22.132733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:22.134150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:22.145560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:22.149621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:22.150331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:22.151376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:22.154324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:22.155043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:22.401217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:22.417322 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fa29c7b6-2f59-4ba9-a93a-13068e928a5d tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.301849 Oct 03 14:43:22.417836 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1380/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:22 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:22.426953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:22.427844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:22.444511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:22.447713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:22.448165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:22.450999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:22.451492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:22.452419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:22.851054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:22.876185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:22.881199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:22.885412 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3739b4b-c055-401e-b4ff-62f63fc2c687 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.466268 Oct 03 14:43:22.890120 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1381/2752] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:22 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:22.896554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1173025874"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:22.900118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:22.908362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:22.909930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:22.911179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:22.912171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:22.912866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:22.914183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:22.979078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:23.038305 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d83770bf-830b-4285-8ed9-8cd38cf8d27a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "PUT /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1076 microversion: 2.1 time: 0.146667 Oct 03 14:43:23.039537 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1382/2753] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:43:22 2022] PUT /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1076 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:23.045048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:23.045863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:23.055402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.056070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.056612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.057688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.059366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.059366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.464536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:23.474065 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7512f85-8870-477f-baaa-83f83547fe23 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1316 microversion: 2.1 time: 0.433152 Oct 03 14:43:23.478537 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1383/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:23 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:23.485371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-72ef4a43-9087-45ff-9b4c-cb37c9fb54ea req-5f82f850-6b94-4795-832e-c4e1b8277552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc064e15-e471-4aea-9ae4-545bad8c989b", "name": "network-vif-plugged", "status": "completed", "tag": "4487e7c4-5fab-4cbb-9678-885d73834e9f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:23.505702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72ef4a43-9087-45ff-9b4c-cb37c9fb54ea req-5f82f850-6b94-4795-832e-c4e1b8277552 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.505702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72ef4a43-9087-45ff-9b4c-cb37c9fb54ea req-5f82f850-6b94-4795-832e-c4e1b8277552 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.505702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72ef4a43-9087-45ff-9b4c-cb37c9fb54ea req-5f82f850-6b94-4795-832e-c4e1b8277552 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.537094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-72ef4a43-9087-45ff-9b4c-cb37c9fb54ea req-5f82f850-6b94-4795-832e-c4e1b8277552 service nova] Creating event network-vif-plugged:4487e7c4-5fab-4cbb-9678-885d73834e9f for instance cc064e15-e471-4aea-9ae4-545bad8c989b on n-h2-781139-2 Oct 03 14:43:23.537094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-72ef4a43-9087-45ff-9b4c-cb37c9fb54ea req-5f82f850-6b94-4795-832e-c4e1b8277552 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041628 Oct 03 14:43:23.537094 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1384/2755] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:23.547855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:23.552749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:23.581784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.582383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.582918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.583741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:23.584300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:23.585551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:23.953916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:23.964429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:23.974893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:23.976594 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a9c32596-7521-4e9b-9dea-6298f1173966 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1358 microversion: 2.21 time: 0.452319 Oct 03 14:43:23.977778 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1385/2756] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:23 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:23.994816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:24.011139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:24.020655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.021562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.022249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:24.023185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.024036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.024956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:24.214105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:24.231526 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ca6bc6b-a815-429e-b274-833e5fb53542 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1502 microversion: 2.1 time: 0.252358 Oct 03 14:43:24.232983 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1386/2757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:23 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:24.238640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:24.241705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:24.248885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.249535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.250097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:24.250814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.251271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.251699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:24.355643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:24.367746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:24.369503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:24.377964 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3dd9fcc2-3ea4-4202-89c6-db1d0ab55ec0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1480 microversion: 2.91 time: 0.143272 Oct 03 14:43:24.378768 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1387/2758] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:24 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1480 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:24.410970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:24.411600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:24.434811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.435310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.435742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:24.436448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.436890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.437319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:24.630036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:24.649212 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e9f1729-9c35-4043-a864-2c62694de327 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.251813 Oct 03 14:43:24.660952 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1388/2759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:24 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:24.672486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:24.673312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:24.680107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.680597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.681062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:24.681767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:24.682379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:24.682841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:25.485105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:25.496520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:25.498063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:25.499340 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-62e677be-1f23-4a48-9c3e-bf6eef1e3451 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.848576 Oct 03 14:43:25.499903 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1389/2760] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:24 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:25.504741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:25.505384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:25.518976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:25.519752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:25.520194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:25.520910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:25.521396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:25.521833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:25.668781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:25.677893 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4e4d944f-84a5-4b9f-96b3-79676ede6f49 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1502 microversion: 2.1 time: 0.176933 Oct 03 14:43:25.688957 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1390/2761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:25 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:25.700400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:25.700400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:25.704708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:25.705613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:25.706154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:25.706686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:25.707124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:25.707545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:25.773396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-781139-2". {{(pid=128868) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 14:43:25.886717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f0b7d7d-cd16-40f1-a11a-c0e8c7f2a8b8 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action" status: 202 len: 0 microversion: 2.91 time: 0.205532 Oct 03 14:43:25.888093 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1391/2762] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:43:25 2022] POST /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:43:25.894394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:25.897306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:25.912388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:25.923102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:25.923398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:25.923961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:25.925428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:25.925943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:25.926358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:26.123803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:26.133938 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-782b00ae-ea1b-4061-b102-0c8aa5834859 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1466 microversion: 2.1 time: 0.244045 Oct 03 14:43:26.151835 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1392/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:25 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1466 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:26.155967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:26.156582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:26.169276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:26.170118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:26.170728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:26.171604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:26.172288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:26.175350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:26.372485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:26.382108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:26.384355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:26.385579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4cef9f0-ea8b-4d99-be2f-ea06509fc663 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1552 microversion: 2.21 time: 0.248116 Oct 03 14:43:26.404095 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1393/2764] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:26 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1552 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:26.411533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-aa69e086-aa6e-4a5e-88f4-f07e597a9504 req-48f9aa01-290d-40de-8a3b-0f9ad30a33d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e64173-e4e0-47f2-8264-e91013915ea4", "name": "network-vif-plugged", "status": "completed", "tag": "3ef65292-b860-46cf-b937-4f30e3fa0ec8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:26.422587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa69e086-aa6e-4a5e-88f4-f07e597a9504 req-48f9aa01-290d-40de-8a3b-0f9ad30a33d7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:26.423064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa69e086-aa6e-4a5e-88f4-f07e597a9504 req-48f9aa01-290d-40de-8a3b-0f9ad30a33d7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:26.424381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa69e086-aa6e-4a5e-88f4-f07e597a9504 req-48f9aa01-290d-40de-8a3b-0f9ad30a33d7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:26.437648 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-aa69e086-aa6e-4a5e-88f4-f07e597a9504 req-48f9aa01-290d-40de-8a3b-0f9ad30a33d7 service nova] Creating event network-vif-plugged:3ef65292-b860-46cf-b937-4f30e3fa0ec8 for instance d1e64173-e4e0-47f2-8264-e91013915ea4 on n-h1-781139-2 Oct 03 14:43:26.443722 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-aa69e086-aa6e-4a5e-88f4-f07e597a9504 req-48f9aa01-290d-40de-8a3b-0f9ad30a33d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037574 Oct 03 14:43:26.448554 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1394/2765] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:26.458584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:26.458872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:26.466905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:26.467471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:26.467732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:26.468468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:26.468918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:26.469623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:26.665942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:26.688512 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2caa5b90-1174-4705-aa42-be3416ba29a7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.236115 Oct 03 14:43:26.691285 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1395/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:26 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:26.703065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b69676bd-9c9f-410a-ba62-91696744f431 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:26.713749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b69676bd-9c9f-410a-ba62-91696744f431 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:26.718595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b69676bd-9c9f-410a-ba62-91696744f431 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:26.719299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b69676bd-9c9f-410a-ba62-91696744f431 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:26.859949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b69676bd-9c9f-410a-ba62-91696744f431 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Going to try to stop instance {{(pid=128868) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:43:26.995225 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b69676bd-9c9f-410a-ba62-91696744f431 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "POST /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc/action" status: 202 len: 0 microversion: 2.1 time: 0.297498 Oct 03 14:43:26.999988 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1396/2767] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:43:26 2022] POST /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:43:27.017153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:27.018067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:27.041223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.041223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.041223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:27.041223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.041223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.041223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:27.179700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:27.193259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:27.195064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:27.202911 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d004676d-79a3-45fb-84ca-475d0902f9b6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1488 microversion: 2.91 time: 0.201443 Oct 03 14:43:27.203955 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1397/2768] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:26 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1488 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:27.270944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:27.271790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:27.279249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.279897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.280491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:27.281281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.281668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.282087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:27.286785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:27.532338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cbfc72e8-0038-4807-8836-a0cdcc470c29 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1617 microversion: 2.1 time: 0.322336 Oct 03 14:43:27.533301 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1398/2769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:27 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1617 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:27.558397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:27.559911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:27.572200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.574982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.575598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:27.577154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.580437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.581203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:27.619840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:43:27.758278 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3c031106-209f-449f-b341-a4e0b5177303 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 204 len: 0 microversion: 2.21 time: 0.220643 Oct 03 14:43:27.766282 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1399/2770] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:43:27 2022] DELETE /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:43:27.777925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:27.778468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:27.787915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.788418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.788860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:27.789673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:27.790182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:27.791155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.036493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.053172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.055936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.057695 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-67999b2d-c028-4b5b-80f7-c034ebb8b212 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.291878 Oct 03 14:43:28.058689 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1400/2771] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:27 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:28.073220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:28.074006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:28.084815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.085523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.086202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.087323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.087901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.088411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.207371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9dbaacd9-71f0-4b0d-870c-33e56ada7a2c tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 200 len: 1429 microversion: 2.1 time: 7.455491 Oct 03 14:43:28.211768 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1372/2772] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:20 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 1429 bytes in 7460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:43:28.244658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05f308d5-dfaa-4afa-aa59-b3af8acb6f76 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: .version_select at 0x7fb230a0fca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1294144755", "policies": ["affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:28.287981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-05f308d5-dfaa-4afa-aa59-b3af8acb6f76 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:28.298818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-05f308d5-dfaa-4afa-aa59-b3af8acb6f76 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:28.324193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.348965 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ee57a9b-8b30-4922-bb14-52c9135d05a5 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.276642 Oct 03 14:43:28.348965 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1401/2773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:28 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:28.364010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:28.364792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:28.375960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.376494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.377042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.384618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.385143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.385597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.393982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-05f308d5-dfaa-4afa-aa59-b3af8acb6f76 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:28.406324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-05f308d5-dfaa-4afa-aa59-b3af8acb6f76 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:28.430106 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05f308d5-dfaa-4afa-aa59-b3af8acb6f76 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.214408 Oct 03 14:43:28.439545 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1373/2774] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Oct 3 14:43:28 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:28.462639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:28.463345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:28.480658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.481188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.481658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.482416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.482860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.483319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.598207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.617634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5108da8f-b97b-4faa-8d17-eb4c4ce85676 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1314 microversion: 2.1 time: 0.277336 Oct 03 14:43:28.618676 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1402/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:28 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:28.634415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b9318d8-2ee8-42a9-b2b7-253f1e2bd3b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb23087ae50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:28.739973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b9318d8-2ee8-42a9-b2b7-253f1e2bd3b2 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 200 len: 1429 microversion: 2.1 time: 0.120188 Oct 03 14:43:28.740579 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1403/2776] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:28 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:28.753146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:28.753768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:28.769549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.770388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.770388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.771125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.771581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.772004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.777355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.797203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.799335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.800671 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-134ca2ae-7e49-43f4-8986-19b40df2c5fa tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1558 microversion: 2.21 time: 0.359545 Oct 03 14:43:28.801330 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1374/2777] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:28 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1558 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:28.816880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1154268475", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c2f453d7-d67b-4bf9-ab8c-93f415b40c62"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:28.872029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.881408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.883592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:28.890979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b09113c1-e683-4526-8d83-3efc5180f468 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1488 microversion: 2.91 time: 0.149369 Oct 03 14:43:28.891179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:43:28.916342 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1404/2778] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:28 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1488 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:28.923402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:28.924352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:28.934495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.936217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.937122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:28.938000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:28.938616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:28.939210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.104078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:29.113649 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-81f003f2-e09b-47ad-b860-f280859b53e7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1466 microversion: 2.1 time: 0.195130 Oct 03 14:43:29.114281 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1405/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:28 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1466 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:29.119441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:29.120147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:29.127585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.128208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.128739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.129557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.130244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.130764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.183913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:43:29.184333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:43:29.184802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:43:29.185229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:43:29.186413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:43:29.214689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.215409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.215615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.216332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.216983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.217570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.239087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:29.245084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:29.259632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Going to run 2 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:43:29.262227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:43:29.308712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128869) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 03 14:43:29.339148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:29.340334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:29.347167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:29.353615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:29.355203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:29.356663 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb0098ee-ec6e-4a64-b867-439c937bbae9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.241199 Oct 03 14:43:29.365009 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1406/2780] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:29 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:29.365009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8fad4f89-e791-4ee4-9fce-ff5c0048e575 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230282c10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:29.411362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:29.418259 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8fad4f89-e791-4ee4-9fce-ff5c0048e575 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/b9a0038d-acfa-4c25-a7f1-6598cf246eca" status: 200 len: 784 microversion: 2.1 time: 0.059016 Oct 03 14:43:29.425129 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1407/2781] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:29 2022] GET /compute/v2.1/images/b9a0038d-acfa-4c25-a7f1-6598cf246eca => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:29.425294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:29.430158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:29.431099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:29.439302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.439981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.440527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.441475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.442065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.442598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.443417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=a49f194d-6be0-48e8-8233-39be860a35a8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:43:29.523335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:29.537537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:29.595818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:29.616841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:29.626206 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f2d0f7a-5b16-4c65-84fe-cad67d33d8d6 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.205219 Oct 03 14:43:29.627212 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1408/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:29 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:29.628282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:43:29.634348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d6cf23bc-dc43-41e3-b98a-77072cc63214 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:29.634659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:43:29.643350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d6cf23bc-dc43-41e3-b98a-77072cc63214 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013978 Oct 03 14:43:29.644431 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1409/2783] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:43:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:29.649369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:29.650150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:29.657099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.657805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.658432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.659453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.660055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.660615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.677941 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90988fe2-e085-4d03-9124-db64152ae749 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.867446 Oct 03 14:43:29.680076 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1375/2784] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:43:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:43:29.685322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c994882-0d98-4b18-86c6-49ac90ac7ae1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230a20a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:29.840045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:29.860163 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-336bbae8-4337-4b50-a245-9a7d383457ef tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1464 microversion: 2.1 time: 0.214467 Oct 03 14:43:29.860799 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1410/2785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:29 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:29.865515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:29.880788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:29.887534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Searching by: {'deleted': False, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:43:29.947113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.949407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.951569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:29.952533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:29.953251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:29.953816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.027889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:43:30.100702 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-017d8860-8888-4f51-a7ff-bb32c3402c1d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.238306 Oct 03 14:43:30.101350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1411/2786] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:43:29 2022] GET /compute/v2.1/servers => generated 1003 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:30.116489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:30.117140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:30.131112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.131766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.132202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.133331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.133855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.152082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.480715 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c994882-0d98-4b18-86c6-49ac90ac7ae1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "DELETE /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 204 len: 0 microversion: 2.1 time: 0.799395 Oct 03 14:43:30.484362 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1376/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:29 2022] DELETE /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:43:30.557543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:30.579885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:30.594171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:30.596200 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72cb8a45-48ee-4d74-b63d-a30b76e92b20 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1558 microversion: 2.21 time: 0.493959 Oct 03 14:43:30.617591 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1412/2788] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:30 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1558 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:30.625710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:30.627069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:30.635205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.635913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.636516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.637396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.638152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.639040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.727892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Calling method '.version_select at 0x7fb2309d5160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:30.740647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.741476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.742103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.761655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.762579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.763506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.794530 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8bd7953-4480-44ea-8dcf-5b547aed7b80 tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/7c3ae16f9bf846cca4c0b07f11c405b6?start=2022-10-02T14%3A43%3A29.877746&end=2022-10-04T14%3A43%3A29.877746" status: 200 len: 647 microversion: 2.1 time: 0.309002 Oct 03 14:43:30.806170 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1377/2789] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Oct 3 14:43:30 2022] GET /compute/v2.1/os-simple-tenant-usage/7c3ae16f9bf846cca4c0b07f11c405b6?start=2022-10-02T14%3A43%3A29.877746&end=2022-10-04T14%3A43%3A29.877746 => generated 647 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:30.807809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d892e8ab-9654-49e3-a143-8a7bff0d0a20 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:30.808469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d892e8ab-9654-49e3-a143-8a7bff0d0a20 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:30.847209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:30.868365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:30.870361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:30.898308 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e19a890d-09de-4788-893f-cd3f044a7fb6 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.263195 Oct 03 14:43:30.900291 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1413/2790] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:30 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:30.912094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:30.916817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:30.938552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.939447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.940135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.941306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:30.941792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:30.942334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:30.943270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d892e8ab-9654-49e3-a143-8a7bff0d0a20 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:30.952430 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d892e8ab-9654-49e3-a143-8a7bff0d0a20 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1219 microversion: 2.1 time: 0.153640 Oct 03 14:43:30.953315 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1378/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:30 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:30.959452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a54649e9-2125-4e73-ac1f-7ca3163d7e41 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230bcc700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:31.038450 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a54649e9-2125-4e73-ac1f-7ca3163d7e41 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] HTTP exception thrown: Image not found. Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a54649e9-2125-4e73-ac1f-7ca3163d7e41 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Request method failure captured: Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 HTTP/1.1 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvThE570ULpRfmTrqUDqwqrAafqQOJEV5PvmDwlLrjTuq7PBbm_udpaxu1NKXpFJXDkjlmiCVHyMRo9mre5CZFNMiIO0gN84tgIG59qSuiQ36inmRzoPTyc3xw_8bvlyYhf9N_TbHjjrtGqiMb8nVOmk-KIaoPvRYU63hAbNrVeSTaY Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 93c499a00f3842bd8c6512a4e06c2945 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93c499a00f3842bd8c6512a4e06c2945", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 93c499a00f3842bd8c6512a4e06c2945 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerTestJSON-37315792-project Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: c90e0563672845d0ad07db3f935eed70 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerTestJSON-37315792-project Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: exception: Image not found. Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '01afcc68-eeb7-4071-82bd-bd08f49dd478'} Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 01afcc68-eeb7-4071-82bd-bd08f49dd478 Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 03 14:43:31.040837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 01afcc68-eeb7-4071-82bd-bd08f49dd478 could not be found. Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a54649e9-2125-4e73-ac1f-7ca3163d7e41 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Returning 404 to user: Image not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a54649e9-2125-4e73-ac1f-7ca3163d7e41 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 404 len: 62 microversion: 2.1 time: 0.087918 Oct 03 14:43:31.047779 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1379/2792] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:30 2022] GET /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:43:31.066728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:31.067613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:31.087316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.088416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.089057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.090981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.091749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.092631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.323477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:31.334012 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84fbf129-318c-4e45-b189-c8013a6d4c08 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.290138 Oct 03 14:43:31.335395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1380/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:31 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:31.341424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '.version_select at 0x7fb2309efa60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:31.354248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.355270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.355951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.387908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.389887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.391201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.418683 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a671a738-6713-4fd4-9ac4-6d784b6bd897 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/7c3ae16f9bf846cca4c0b07f11c405b6?start=2022-10-02T14%3A43%3A29.877746&end=2022-10-04T14%3A43%3A29.877746" status: 200 len: 695 microversion: 2.1 time: 0.081632 Oct 03 14:43:31.419694 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1381/2794] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Oct 3 14:43:31 2022] GET /compute/v2.1/os-simple-tenant-usage/7c3ae16f9bf846cca4c0b07f11c405b6?start=2022-10-02T14%3A43%3A29.877746&end=2022-10-04T14%3A43%3A29.877746 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:31.426408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1761526902"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:31.429277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:31.444131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.445265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.445875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.446673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.447212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.447996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.503590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:31.528740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:31.533032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:31.537471 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a17932c-4a72-4a3f-a36e-75b13bc675ca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.633438 Oct 03 14:43:31.539266 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1414/2795] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:30 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:31.547622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-72efd57c-dcc8-4fc3-acce-e1e76aed89ad req-26851f55-ce48-4bdf-bcc8-a0cf3e877171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7d61fb8-583d-4696-ab65-cdd03107edce", "name": "network-vif-deleted", "tag": "45447be6-6219-4aa5-9e66-a22e4adc5279"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:31.578448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72efd57c-dcc8-4fc3-acce-e1e76aed89ad req-26851f55-ce48-4bdf-bcc8-a0cf3e877171 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.579222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72efd57c-dcc8-4fc3-acce-e1e76aed89ad req-26851f55-ce48-4bdf-bcc8-a0cf3e877171 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.590859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72efd57c-dcc8-4fc3-acce-e1e76aed89ad req-26851f55-ce48-4bdf-bcc8-a0cf3e877171 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.608745 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-72efd57c-dcc8-4fc3-acce-e1e76aed89ad req-26851f55-ce48-4bdf-bcc8-a0cf3e877171 service nova] Creating event network-vif-deleted:45447be6-6219-4aa5-9e66-a22e4adc5279 for instance a7d61fb8-583d-4696-ab65-cdd03107edce on n-h1-781139-2 Oct 03 14:43:31.615810 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-72efd57c-dcc8-4fc3-acce-e1e76aed89ad req-26851f55-ce48-4bdf-bcc8-a0cf3e877171 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074413 Oct 03 14:43:31.616597 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1415/2796] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:31.629537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Calling method '.version_select at 0x7fb2302a2280>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:31.650614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.651109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.651535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.670170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.670562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.671004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.764480 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4361fc22-3bf8-4c46-9db3-aac029e412b1 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "POST /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9/action" status: 202 len: 0 microversion: 2.1 time: 0.341796 Oct 03 14:43:31.765172 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1382/2797] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:43:31 2022] POST /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:43:31.773195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:31.776096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:31.787294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.788041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.788704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.789765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.790362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.791049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.847480 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c4c4804d-103b-4efc-8f36-1aee687b7dfd tempest-TenantUsagesTestJSON-1368827776 tempest-TenantUsagesTestJSON-1368827776-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T14%3A43%3A29.877746&end=2022-10-04T14%3A43%3A29.877746&detailed=1" status: 200 len: 31375 microversion: 2.1 time: 0.225514 Oct 03 14:43:31.849017 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1416/2798] 10.222.0.20 () {58 vars in 1335 bytes} [Mon Oct 3 14:43:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T14%3A43%3A29.877746&end=2022-10-04T14%3A43%3A29.877746&detailed=1 => generated 31375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:43:31.862212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-69ef353c-b8c7-4965-a74f-e47bee6cd50e tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230207b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:31.890545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:31.891163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:31.892963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:31.894797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lazy-loading 'fault' on Instance uuid a7d61fb8-583d-4696-ab65-cdd03107edce {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:43:31.965476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:31.985131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:31.988457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:31.990190 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-015abb28-c5e9-4c5b-9200-b29961341a67 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1348 microversion: 2.21 time: 0.223912 Oct 03 14:43:31.992413 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1383/2799] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:31 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1348 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:31.998690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:31.999378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:32.031297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.032504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.033916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.036056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.036628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.037747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.081314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:43:32.091203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:32.206988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbe8df7a-3e56-4cf2-8e2a-955d9cf7c202 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 204 len: 0 microversion: 2.1 time: 0.211838 Oct 03 14:43:32.212322 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1384/2800] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:43:31 2022] DELETE /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:43:32.224455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:32.233426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:32.247840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.249444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.249444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.251120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.251579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.252113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.365531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:32.378301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:32.384947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:32.401589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97f58a2c-fa3b-4590-941b-1a96880f2580 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.182565 Oct 03 14:43:32.403756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1385/2801] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:32 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:32.412102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:32.412725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:32.445606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.446106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.446545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.447267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.447719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.448142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.544484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:32.555602 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac754528-7aa8-47cc-bb45-8d3815e7dc74 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1271 microversion: 2.1 time: 0.150719 Oct 03 14:43:32.557440 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1386/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:32 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:32.564582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:32.566197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:32.573775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.574273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.574712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.575665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.576267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.576849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.899574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:32.912884 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13773fa1-ccb1-4c94-8202-3daece5ca098 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1470 microversion: 2.1 time: 0.354177 Oct 03 14:43:32.927730 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1387/2803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:32 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:32.927730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:32.927730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:32.932609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.933254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.933770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:32.934723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:32.935392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:32.936039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.109245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.118676 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f879a1c3-b58e-4215-9fba-7a87898d0a40 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.203620 Oct 03 14:43:33.119259 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1388/2804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:32 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:33.124525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:33.125190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:33.131451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.132283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.132776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.133864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.134335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.134754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.356812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.366474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.367918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.369118 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5efba219-3017-4cac-81ef-fa3813668afb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.248902 Oct 03 14:43:33.369693 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1389/2805] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:33 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:33.374026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0acd91bb-9f33-4044-a825-43999b227fbb req-6c389839-9ecb-4996-9beb-8fd0c4a4a78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd6470d-2444-4729-9eb9-26609bc154d9", "name": "network-vif-unplugged", "status": "completed", "tag": "1800b505-397e-4bfe-846d-aabd3fa8087b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:33.385413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0acd91bb-9f33-4044-a825-43999b227fbb req-6c389839-9ecb-4996-9beb-8fd0c4a4a78c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.386016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0acd91bb-9f33-4044-a825-43999b227fbb req-6c389839-9ecb-4996-9beb-8fd0c4a4a78c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.386478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0acd91bb-9f33-4044-a825-43999b227fbb req-6c389839-9ecb-4996-9beb-8fd0c4a4a78c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.399036 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0acd91bb-9f33-4044-a825-43999b227fbb req-6c389839-9ecb-4996-9beb-8fd0c4a4a78c service nova] Creating event network-vif-unplugged:1800b505-397e-4bfe-846d-aabd3fa8087b for instance 8dd6470d-2444-4729-9eb9-26609bc154d9 on n-h2-781139-2 Oct 03 14:43:33.404418 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0acd91bb-9f33-4044-a825-43999b227fbb req-6c389839-9ecb-4996-9beb-8fd0c4a4a78c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033534 Oct 03 14:43:33.408469 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1390/2806] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:33.413856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:33.414744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:33.423045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.424196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.424667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.425468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.425987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.426743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.467368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.468720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.468720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.468946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lazy-loading 'fault' on Instance uuid a7d61fb8-583d-4696-ab65-cdd03107edce {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:43:33.517698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.526149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.527652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.529051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32ca264f-c353-434f-9ed2-d2394be48c15 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1348 microversion: 2.21 time: 0.119240 Oct 03 14:43:33.529617 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1391/2807] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:33 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1348 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:33.552128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:33.553054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:33.571968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.574145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.574828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.576336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.577026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.577595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.654948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.668505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.670015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.683002 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-563db930-65ff-4dc1-9515-229568602af0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.136009 Oct 03 14:43:33.683674 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1392/2808] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:33 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:33.693291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:33.693937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:33.720754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.721367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.721837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.722620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.723086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.723519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.823346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:33.832901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a985a262-abc8-46a2-a602-d0d41b38cda2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1271 microversion: 2.1 time: 0.148148 Oct 03 14:43:33.835748 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1393/2809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:33 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:33.938806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:33.940748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:33.957117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.958107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.958763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:33.959798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:33.960606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:33.961284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.170610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.179638 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2b5e236-3b01-4a57-b4fd-9b06dfa414e7 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1470 microversion: 2.1 time: 0.246452 Oct 03 14:43:34.180588 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1394/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:33 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1470 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:34.185706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:34.186329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:34.192693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.193161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.193635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.194486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.194943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.195369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.379519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.388636 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afb6589c-036c-43cc-8e1f-0bb77a708695 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.206751 Oct 03 14:43:34.391562 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1395/2811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:34 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:34.396715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:34.397433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:34.404394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.404884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.405356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.406056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.406499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.406914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.555928 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-69ef353c-b8c7-4965-a74f-e47bee6cd50e tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1425 microversion: 2.1 time: 2.705680 Oct 03 14:43:34.557684 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1417/2812] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:31 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1425 bytes in 2708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:34.562548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:34.563989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:34.577755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.578498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.579095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.580148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.580851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.581466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.586741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:34.662899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.674531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.676326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.677779 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95eafde8-8ef3-4d8b-9b8d-3f7a7b7ae78a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.285270 Oct 03 14:43:34.678640 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1396/2813] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:34 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:34.702892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:34.703916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:34.711029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.711747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.712354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.713253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.713993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.714561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.749973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.750449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.750879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.751326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lazy-loading 'fault' on Instance uuid a7d61fb8-583d-4696-ab65-cdd03107edce {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:43:34.813719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.823666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.834397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.838316 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b12c3d3-9015-4f19-ab44-6090a1bdf361 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.278865 Oct 03 14:43:34.838921 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1418/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:34 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:34.853723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.853723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ad3ad15-c60e-4a5e-8870-3ecd832f6d6c tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1348 microversion: 2.21 time: 0.146741 Oct 03 14:43:34.853723 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1397/2815] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:34 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1348 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:34.858502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:34.858502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:34.865422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:34.866320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:34.873798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.874094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.874623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.874816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.875068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.875805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.876183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.876308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.876760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.877470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:34.878070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:34.878640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:34.979919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:34.992893 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-65ad043b-30cd-412d-8cc1-bf9d2d3cbd6d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1271 microversion: 2.1 time: 0.136398 Oct 03 14:43:34.993829 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1419/2816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:34 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:35.001076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:35.006574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:35.008441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:35.034900 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f48c9149-f9c4-4b35-8b8e-adf9c491db84 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.182144 Oct 03 14:43:35.044148 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1398/2817] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:34 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:35.202821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:35.203473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:35.211085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.211979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.212797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.213765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.220899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.222633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.407678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:35.414668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:35.415693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:35.418310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-18f768aa-eac1-4ea5-84ae-d7fa28ee393e tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1470 microversion: 2.1 time: 0.219487 Oct 03 14:43:35.420243 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1420/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:35 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1470 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:35.429666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.430168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.430610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.431329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.431832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.432537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.575216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8901001f-2fc0-4737-9500-2c4e8893e98a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb2302e6f70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:35.601933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:35.605682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:35.619214 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74c6b566-f169-463e-878d-9f41e53c9603 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.204405 Oct 03 14:43:35.619214 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1399/2819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:35 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:35.664585 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8901001f-2fc0-4737-9500-2c4e8893e98a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1425 microversion: 2.1 time: 0.094335 Oct 03 14:43:35.681012 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1421/2820] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:35 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1425 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:35.714127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:35.714845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:35.728261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.728765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.729271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.729941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.730379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.730803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.866989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:35.867611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:35.880150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.880754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.881228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.881935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:35.882506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:35.883752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:35.994570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.023708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.026812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.028451 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c781622-164c-43eb-aac2-17f60e21c29a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.322742 Oct 03 14:43:36.040393 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1400/2821] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:35 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:36.066066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:36.066685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:36.073704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.074197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.074628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.075334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.075773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.076188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.120631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.120858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.121724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.122199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lazy-loading 'fault' on Instance uuid a7d61fb8-583d-4696-ab65-cdd03107edce {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:43:36.136220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.148064 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-877575c5-6ba6-4eae-8477-ccc92cab9178 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.283953 Oct 03 14:43:36.162944 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1422/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:35 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:36.183635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:36.184656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:36.200558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.203579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.206831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.208075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.208767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.209455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.222205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.237591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.239037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.250295 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d00f18fa-b0ae-43e2-9310-efbe97f0dcf8 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1348 microversion: 2.21 time: 0.201208 Oct 03 14:43:36.261016 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1401/2823] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:36 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1348 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:36.261016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:36.261016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:36.265241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.265241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.265241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.265241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.265241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.265692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.339051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.370579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3fb38e9c-9233-4901-8d08-67c8eb21e7c4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1271 microversion: 2.1 time: 0.205976 Oct 03 14:43:36.371593 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1423/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:36 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:36.392652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.401793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.403255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.420733 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cdacbde-bf39-48a4-85c5-bb7a9a8ec717 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.168760 Oct 03 14:43:36.421704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1402/2825] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:36 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:36.446717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:36.447907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:36.459656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.462203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.463214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.464793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.466084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.467222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.644460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:36.645405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:36.659454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.660241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.661444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.663361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:36.671992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:36.672739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:36.684221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.700458 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ae6a63e-25a3-4043-b47f-6b109ed4a56a tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1470 microversion: 2.1 time: 0.260536 Oct 03 14:43:36.717550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1424/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:36 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:36.731145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-569ae2f1-6f66-413a-9d00-61260efba67a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230276040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:36.900160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:36.910263 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0d0e218-f7b5-42f2-8925-f2fb8354b563 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.269316 Oct 03 14:43:36.920952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1403/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:36 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:43:37.027009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-64eecf15-b461-4a27-90cc-2b13645a7179 req-60eb363b-85df-49b9-9e85-424010217b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd6470d-2444-4729-9eb9-26609bc154d9", "name": "network-vif-plugged", "status": "completed", "tag": "1800b505-397e-4bfe-846d-aabd3fa8087b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:37.038552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-64eecf15-b461-4a27-90cc-2b13645a7179 req-60eb363b-85df-49b9-9e85-424010217b04 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.039334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-64eecf15-b461-4a27-90cc-2b13645a7179 req-60eb363b-85df-49b9-9e85-424010217b04 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.040249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-64eecf15-b461-4a27-90cc-2b13645a7179 req-60eb363b-85df-49b9-9e85-424010217b04 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.069650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-64eecf15-b461-4a27-90cc-2b13645a7179 req-60eb363b-85df-49b9-9e85-424010217b04 service nova] Creating event network-vif-plugged:1800b505-397e-4bfe-846d-aabd3fa8087b for instance 8dd6470d-2444-4729-9eb9-26609bc154d9 on n-h2-781139-2 Oct 03 14:43:37.079424 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-64eecf15-b461-4a27-90cc-2b13645a7179 req-60eb363b-85df-49b9-9e85-424010217b04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131751 Oct 03 14:43:37.080143 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1404/2828] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:43:37.096062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:37.096979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:37.108577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.109134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.109930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.110862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.111698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.112187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.485305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:37.495406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:37.498920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:37.498920 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5ef6b21-daa8-45c6-833a-b898cd83c415 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.415257 Oct 03 14:43:37.518254 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1405/2829] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:37 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:37.524492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:37.525163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:37.541368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.541875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.542325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.543137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.543596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.544019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.868974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:37.877497 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3639505-5550-429f-b653-2201587ade87 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.357971 Oct 03 14:43:37.894905 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1406/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:37 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:37.901201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:37.902040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:37.909924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.910424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.910871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.911596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.912048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.912477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.949197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:37.949683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:37.950117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:37.950569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lazy-loading 'fault' on Instance uuid a7d61fb8-583d-4696-ab65-cdd03107edce {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:43:38.016706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.028888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.031257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.032618 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8c8d77f-37eb-4e70-a2f2-e4ee00152e7e tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1348 microversion: 2.21 time: 0.136490 Oct 03 14:43:38.033268 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1407/2831] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:37 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1348 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:38.055883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:38.056504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:38.063418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.063943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.064415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:38.065188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.065844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.066287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:38.183580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.191679 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32ea321f-f28d-4e82-895b-59a969c415a3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1271 microversion: 2.1 time: 0.139625 Oct 03 14:43:38.192640 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1408/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:38 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:38.197829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:38.198519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:38.214882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.216120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.216777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:38.217731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.218246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.218738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:38.368899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.379891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.387481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.390823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:38.395779 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29c426f1-e7cb-43c2-9141-c4482f65261f tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.202024 Oct 03 14:43:38.418479 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1409/2833] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:38 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:38.427157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:38.428237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:38.439705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.440643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.441264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:38.442355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.442959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.443655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:38.708029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:38.722546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75aab773-18d8-4c6d-817c-2700f0b0b936 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1470 microversion: 2.1 time: 0.302439 Oct 03 14:43:38.723304 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1410/2834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:38 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:38.743189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:38.743811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:38.750378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.750863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.751298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:38.752377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:38.752828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:38.753265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.005962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.017896 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d1e46c6-c527-400c-8389-cc2a45d8cdd7 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.279481 Oct 03 14:43:39.018895 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1411/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:38 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:39.037617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:39.038316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:39.044326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.044802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.052101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.052848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.053379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.053809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.388592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.410156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.414800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.416538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e928ae6b-74e4-4d2c-81bd-a5132dfd4880 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.396692 Oct 03 14:43:39.430477 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1412/2836] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:39 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:39.452700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:39.453580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:39.463604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.464331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.464997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.465883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.472002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.472650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.653762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.664323 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d04d9535-dc18-4c76-acff-d69952247849 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.225926 Oct 03 14:43:39.665141 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1413/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:39 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:39.709702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:39.710329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:39.737501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.738136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.738666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.739281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.739682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.740113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.814505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.814990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.818149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.820819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lazy-loading 'fault' on Instance uuid a7d61fb8-583d-4696-ab65-cdd03107edce {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:43:39.894923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.903949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.905821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bacca3be013646da8b5c1a2697063909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0b820e921a46c48cbf1fc6af563d5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:39.907768 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb6754c4-b45a-4757-abce-6d82837f010d tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 200 len: 1348 microversion: 2.21 time: 0.211436 Oct 03 14:43:39.908697 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1414/2838] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:39 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 1348 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:39.921272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:39.922890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:39.931488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.932406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.933039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:39.933918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:39.934558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:39.935170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.135423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:40.149784 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a516df2-cc35-49c7-8bb1-ebdcdbaf66ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1271 microversion: 2.1 time: 0.239568 Oct 03 14:43:40.162331 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1415/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:39 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:40.167521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:40.175047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:40.202210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.203310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.206577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.208730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.211357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.212045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.217218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:40.374475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:40.395191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:40.402696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:40.420972 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aee03c1c-949d-4169-b40d-fa2caebda6e0 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.257148 Oct 03 14:43:40.446235 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1416/2840] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:40 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:40.574942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1d2da6d7-80d4-40b6-acff-e9dea1b7183d req-bf6f739e-3849-4638-90aa-5942d50c063d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e64173-e4e0-47f2-8264-e91013915ea4", "name": "network-vif-deleted", "tag": "3ef65292-b860-46cf-b937-4f30e3fa0ec8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:40.596527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1d2da6d7-80d4-40b6-acff-e9dea1b7183d req-bf6f739e-3849-4638-90aa-5942d50c063d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.597042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1d2da6d7-80d4-40b6-acff-e9dea1b7183d req-bf6f739e-3849-4638-90aa-5942d50c063d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.597478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1d2da6d7-80d4-40b6-acff-e9dea1b7183d req-bf6f739e-3849-4638-90aa-5942d50c063d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.629202 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1d2da6d7-80d4-40b6-acff-e9dea1b7183d req-bf6f739e-3849-4638-90aa-5942d50c063d service nova] Creating event network-vif-deleted:3ef65292-b860-46cf-b937-4f30e3fa0ec8 for instance d1e64173-e4e0-47f2-8264-e91013915ea4 on n-h1-781139-2 Oct 03 14:43:40.635946 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1d2da6d7-80d4-40b6-acff-e9dea1b7183d req-bf6f739e-3849-4638-90aa-5942d50c063d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187847 Oct 03 14:43:40.637259 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1417/2841] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:40.644765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:40.645909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:40.653541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.654417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.655779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.657862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.659537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.660118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.702655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.703274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.704463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.706240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lazy-loading 'fault' on Instance uuid d1e64173-e4e0-47f2-8264-e91013915ea4 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:43:40.772646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cd868c67c44856861d76e57a9bb29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ae16f9bf846cca4c0b07f11c405b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:40.784909 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11a11afa-9cdd-47ad-b761-4cfec84144dd tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 200 len: 1304 microversion: 2.1 time: 0.145971 Oct 03 14:43:40.786140 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1418/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:40 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:40.791336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:40.792182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:40.800260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.801027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.801649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.802707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:40.803321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:40.803976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:40.950668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=32 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:41.242274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:41.260305 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-454d55fa-7bbc-4548-934a-d771ae737c9e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.467038 Oct 03 14:43:41.263010 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1419/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:40 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:41.268999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:41.269621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:41.275969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:41.276711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:41.277222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:41.278131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:41.278964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:41.280211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:41.386387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:41.665085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:41.724991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:41.740271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:41.741928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:41.743371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a0982d3-2515-49ca-9624-bed79c5ebcc5 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.479030 Oct 03 14:43:41.757437 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1420/2844] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:41 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:41.766605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:41.766605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:41.778522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:41.779169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:41.779618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:41.790098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:41.790771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:41.792038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.099360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:42.111222 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22342ebb-9321-4316-8637-e2d5b300b1f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.358252 Oct 03 14:43:42.128295 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1421/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:41 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:42.134984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:42.135830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:42.152604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.153390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.154007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.154903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.155512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.156111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.174752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] HTTP exception thrown: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Request method failure captured: Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce HTTP/1.1 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTxWrYDsdSder80VvvxGqWmSnFUHUGQNm9LUEyiYzHk1sjlJaBVHbeL5rK-hdjpCLfEhCC4QMSdJJI_CNLRkXhC90oDWw2F8tC61nyUd8kTMCqxth_bVxzU8ySyBr_XKcddnWJcNttJElsxl_Rp4qpfoRASi1j2Fva74PpwWf3MC9I Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.21 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ca0b820e921a46c48cbf1fc6af563d5e Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca0b820e921a46c48cbf1fc6af563d5e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ca0b820e921a46c48cbf1fc6af563d5e Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsV221TestJSON-607614933-project Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: bacca3be013646da8b5c1a2697063909 Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsV221TestJSON-607614933-project Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a7d61fb8-583d-4696-ab65-cdd03107edce'} Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.178283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:42.183838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.185277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Returning 404 to user: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:43:42.186505 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f20e1aa-3a04-417d-a7cd-f2ab3f5cf589 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 404 len: 111 microversion: 2.21 time: 0.056504 Oct 03 14:43:42.187619 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1422/2846] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:42 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:43:42.193107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:42.193966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:42.202003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.202841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.203574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.205619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.206954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.207812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.545961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:42.557875 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15ba3a1f-4657-44b9-a6f1-d071f3c5421d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.368337 Oct 03 14:43:42.578281 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1423/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:42 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:42.585432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:42.586101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:42.593843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.594318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.594763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.595604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.596177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.596618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.687722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:42.698185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:42.700466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:42.708827 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74c57833-8628-4841-9beb-b2580dc7f1c2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.129119 Oct 03 14:43:42.709829 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1424/2848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:42 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:42.723570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:42.724792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] [instance: d1e64173-e4e0-47f2-8264-e91013915ea4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:42.732370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.733107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.733633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.734461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.734927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.735353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.755351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] HTTP exception thrown: Instance d1e64173-e4e0-47f2-8264-e91013915ea4 could not be found. Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Request method failure captured: Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 HTTP/1.1 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT1Dvh_F7CFUp6rbfLpFpqu5CYS5ESn8ovoWuO7Od8-G3uw_NW12EJHCKvyE_mi9C4EgRx4ogBSazpfbhVwVksVW1uV_q_T_P6bkVTjSEDRNLBXifjLdJ7WBulo5MDl3QmnMv2p-g28ZYrIzKz9r3EYnYg17yHFjXP9TZmxoN2Vmfk Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 7c3ae16f9bf846cca4c0b07f11c405b6 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TenantUsagesTestJSON-1991874083 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c3ae16f9bf846cca4c0b07f11c405b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c3ae16f9bf846cca4c0b07f11c405b6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c3ae16f9bf846cca4c0b07f11c405b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c3ae16f9bf846cca4c0b07f11c405b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TenantUsagesTestJSON-1991874083 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 7c3ae16f9bf846cca4c0b07f11c405b6 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1991874083 Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TenantUsagesTestJSON-1991874083-project Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 27cd868c67c44856861d76e57a9bb29f Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TenantUsagesTestJSON-1991874083-project Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d1e64173-e4e0-47f2-8264-e91013915ea4 could not be found. Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd1e64173-e4e0-47f2-8264-e91013915ea4'} Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e64173-e4e0-47f2-8264-e91013915ea4 could not be found. Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e64173-e4e0-47f2-8264-e91013915ea4 could not be found. Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:42.757272 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e64173-e4e0-47f2-8264-e91013915ea4 could not be found. Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] Returning 404 to user: Instance d1e64173-e4e0-47f2-8264-e91013915ea4 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:43:42.761737 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c6225ed-489e-483e-a41f-074d05bcc5b3 tempest-TenantUsagesTestJSON-1991874083 tempest-TenantUsagesTestJSON-1991874083-project] 10.222.0.20 "GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4" status: 404 len: 111 microversion: 2.1 time: 0.048111 Oct 03 14:43:42.763142 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1425/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:42 2022] GET /compute/v2.1/servers/d1e64173-e4e0-47f2-8264-e91013915ea4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:43:42.768660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '.version_select at 0x7fb234be9550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:42.769344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:42.775830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.776526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.777277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.778533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.779083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.779528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.890630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a6446a2-f5f6-4077-952f-8abfec451a95 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.124307 Oct 03 14:43:42.892833 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1426/2850] 10.222.0.20 () {60 vars in 1337 bytes} [Mon Oct 3 14:43:42 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce/os-instance-actions => generated 611 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:43:42.909122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:42.914909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:42.928497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.929026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.929469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:42.930187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:42.930644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:42.931071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:43.295301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:43.308023 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-144b6df6-f342-46de-8ece-eedeced8fea4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.411992 Oct 03 14:43:43.318165 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1427/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:42 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:43.329607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:43.337605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:43.358818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:43.361930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:43.362975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:43.391774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:43.392991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:43.410085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:43.871088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:43.888781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:43.892511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:43.896793 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3c2479c-45b2-4af4-9e22-6301d370548c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.575633 Oct 03 14:43:43.910976 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1428/2852] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:43 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:43.924885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:43.925780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:43.948918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:43.951650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:43.955459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:43.956564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:43.958074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:43.959099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:43.989170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] HTTP exception thrown: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Request method failure captured: Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce HTTP/1.1 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTxWrYDsdSder80VvvxGqWmSnFUHUGQNm9LUEyiYzHk1sjlJaBVHbeL5rK-hdjpCLfEhCC4QMSdJJI_CNLRkXhC90oDWw2F8tC61nyUd8kTMCqxth_bVxzU8ySyBr_XKcddnWJcNttJElsxl_Rp4qpfoRASi1j2Fva74PpwWf3MC9I Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.21 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ca0b820e921a46c48cbf1fc6af563d5e Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca0b820e921a46c48cbf1fc6af563d5e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ca0b820e921a46c48cbf1fc6af563d5e Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsV221TestJSON-607614933-project Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: bacca3be013646da8b5c1a2697063909 Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsV221TestJSON-607614933-project Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a7d61fb8-583d-4696-ab65-cdd03107edce'} Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:43:44.001821 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Returning 404 to user: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:43:44.005863 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4090c2cd-6a67-4109-8da1-4522254c3f62 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 404 len: 111 microversion: 2.21 time: 0.093243 Oct 03 14:43:44.013431 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1429/2853] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:43:43 2022] DELETE /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:43:44.026222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:44.027397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:44.040148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.041125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.041754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.042621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.043388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.044010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.215955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:44.224728 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-095880bf-7baa-455f-b608-67b1f4bafac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.213086 Oct 03 14:43:44.225999 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1430/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:44 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:44.231122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:44.231973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:44.250597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.251244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.251966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.252916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.253608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.254243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.433105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:44.445442 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-224e3442-a251-4887-b104-3494cc39787e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.218020 Oct 03 14:43:44.446300 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1431/2855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:44 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:44.451220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:44.451825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:44.468402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.468889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.469363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.470115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.470570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.471110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.573550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:44.581706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:44.583295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:44.589666 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cd681d1-52b6-4a1e-bf02-e2651b0f5eac tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.142159 Oct 03 14:43:44.605002 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1432/2856] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:44 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:44.605002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:44.605002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] [instance: a7d61fb8-583d-4696-ab65-cdd03107edce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:44.605002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.605002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.605002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.605679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.606036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.606542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.635907 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] HTTP exception thrown: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Request method failure captured: Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce HTTP/1.1 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvTxWrYDsdSder80VvvxGqWmSnFUHUGQNm9LUEyiYzHk1sjlJaBVHbeL5rK-hdjpCLfEhCC4QMSdJJI_CNLRkXhC90oDWw2F8tC61nyUd8kTMCqxth_bVxzU8ySyBr_XKcddnWJcNttJElsxl_Rp4qpfoRASi1j2Fva74PpwWf3MC9I Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.21 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ca0b820e921a46c48cbf1fc6af563d5e Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ca0b820e921a46c48cbf1fc6af563d5e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ca0b820e921a46c48cbf1fc6af563d5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ca0b820e921a46c48cbf1fc6af563d5e Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-607614933 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-InstanceActionsV221TestJSON-607614933-project Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: bacca3be013646da8b5c1a2697063909 Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-InstanceActionsV221TestJSON-607614933-project Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a7d61fb8-583d-4696-ab65-cdd03107edce'} Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.637783 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] Returning 404 to user: Instance a7d61fb8-583d-4696-ab65-cdd03107edce could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abbd9d0a-aacc-4ba2-a222-09457442b7e5 tempest-InstanceActionsV221TestJSON-607614933 tempest-InstanceActionsV221TestJSON-607614933-project] 10.222.0.20 "GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce" status: 404 len: 111 microversion: 2.21 time: 0.047776 Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1433/2857] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:44 2022] GET /compute/v2.1/servers/a7d61fb8-583d-4696-ab65-cdd03107edce => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:44.654076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:44.660571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.661380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.661573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.665247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:44.665732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:44.673378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:44.967958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:44.976901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-507623c4-cf85-4361-a811-973f2e3a7965 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.330626 Oct 03 14:43:44.982301 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1434/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:44 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:44.987755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:44.988685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:45.015328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:45.016321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:45.017599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:45.020645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:45.022922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:45.022922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:45.439256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:45.446196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:45.452249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:45.462781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:45.466903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b53a7f5-f772-45a8-b7bf-64cac8855cf8 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.483276 Oct 03 14:43:45.469381 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1435/2859] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:44 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:45.478444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0962a028-689a-4623-8112-bf8609e823b9 req-56567863-f1b2-4368-8f25-123e27dbcd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49f194d-6be0-48e8-8233-39be860a35a8", "tag": "7c8471f7-06b5-4f3a-9af8-5375caf73e59"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:45.491322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0962a028-689a-4623-8112-bf8609e823b9 req-56567863-f1b2-4368-8f25-123e27dbcd20 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:45.492368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0962a028-689a-4623-8112-bf8609e823b9 req-56567863-f1b2-4368-8f25-123e27dbcd20 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:45.492820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0962a028-689a-4623-8112-bf8609e823b9 req-56567863-f1b2-4368-8f25-123e27dbcd20 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:45.521977 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0962a028-689a-4623-8112-bf8609e823b9 req-56567863-f1b2-4368-8f25-123e27dbcd20 service nova] Creating event network-changed:7c8471f7-06b5-4f3a-9af8-5375caf73e59 for instance a49f194d-6be0-48e8-8233-39be860a35a8 on n-h1-781139-2 Oct 03 14:43:45.535013 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0962a028-689a-4623-8112-bf8609e823b9 req-56567863-f1b2-4368-8f25-123e27dbcd20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059976 Oct 03 14:43:45.535978 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1436/2860] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:45.542185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:45.543520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:45.552033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:45.552526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:45.552982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:45.553733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:45.554151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:45.554564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:45.825089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:45.839905 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f5036cd-ae6d-474b-96fd-1d9db20984ae tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.302665 Oct 03 14:43:45.863823 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1437/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:45 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:45.870614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:45.871438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:45.879695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:45.880457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:45.881090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:45.881951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:45.882558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:45.883490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:46.361083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:46.374502 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-befe3b0e-d4a9-44a3-b87e-05e2084cb167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.506793 Oct 03 14:43:46.378847 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1438/2862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:45 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:46.387415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:46.388396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:46.400029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:46.400710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:46.401231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:46.403584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:46.404178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:46.404670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:46.459073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:46.689404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=34 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:46.715171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:46.730451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:46.732128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:46.759327 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0447e34-ab05-46df-9702-5cababb7a618 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.378813 Oct 03 14:43:46.759933 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1439/2863] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:46 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:46.769749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:46.780664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:46.794167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:46.794661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:46.795103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:46.795806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:46.796254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:46.796670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:47.209670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:47.224615 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a639ec3c-a981-4e2a-bae4-49f45a0d0e33 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.456638 Oct 03 14:43:47.245395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1440/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:46 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:47.252714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:47.253430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:47.290202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:47.290695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:47.291140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:47.291866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:47.292372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:47.295846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:47.899910 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-569ae2f1-6f66-413a-9d00-61260efba67a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1425 microversion: 2.1 time: 11.180757 Oct 03 14:43:47.908172 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1425/2865] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:36 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1425 bytes in 11182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:47.912558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:47.913789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:47.922598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:47.923187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:47.923631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:47.928448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:47.929026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:47.929471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.198465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.210590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.212164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.213369 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a833c973-175d-40b6-9ecf-77074991e694 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.966908 Oct 03 14:43:48.213983 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1441/2866] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:47 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:48.220958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:48.221578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:48.246956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:48.248905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:48.249575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.250477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:48.251420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:48.252016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.265942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.280361 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe60615e-2a78-4881-a6c3-00ef8d1b68fa tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.371381 Oct 03 14:43:48.281466 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1426/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:47 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:48.317288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5ab00446-8f2a-441c-b99f-50268155fcf7 req-801dbbbb-a05d-49ef-b5bb-d98300e1ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc613fa-3ea2-40fb-9898-87260b37b158", "tag": "4c8a9cf5-7acc-40e3-a7e1-593ffed2746d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:48.341297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ab00446-8f2a-441c-b99f-50268155fcf7 req-801dbbbb-a05d-49ef-b5bb-d98300e1ccfa service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:48.341774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ab00446-8f2a-441c-b99f-50268155fcf7 req-801dbbbb-a05d-49ef-b5bb-d98300e1ccfa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:48.342237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ab00446-8f2a-441c-b99f-50268155fcf7 req-801dbbbb-a05d-49ef-b5bb-d98300e1ccfa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.366525 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5ab00446-8f2a-441c-b99f-50268155fcf7 req-801dbbbb-a05d-49ef-b5bb-d98300e1ccfa service nova] Creating event network-changed:4c8a9cf5-7acc-40e3-a7e1-593ffed2746d for instance 0fc613fa-3ea2-40fb-9898-87260b37b158 on n-h1-781139-2 Oct 03 14:43:48.373327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5ab00446-8f2a-441c-b99f-50268155fcf7 req-801dbbbb-a05d-49ef-b5bb-d98300e1ccfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063786 Oct 03 14:43:48.378232 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1427/2868] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:48.388584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:48.394024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:48.406359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:48.408599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:48.409244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.411460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:48.415332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:48.416212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.550382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.563025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.564709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.573397 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72fd4949-424b-4866-a1e1-d4dcd27f13f8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.191463 Oct 03 14:43:48.585948 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1428/2869] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:48 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:48.601194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:48.602053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:48.611479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:48.612039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:48.612487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.613241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:48.614756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:48.615187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:48.633004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:48.648980 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f05e732-7481-424f-8477-083f8f0b808c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.433897 Oct 03 14:43:48.651025 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1442/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:48 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:48.916709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8a53f9e-9328-427d-b240-4217c9ee27cb tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb234b16280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:48.990609 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8a53f9e-9328-427d-b240-4217c9ee27cb tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1425 microversion: 2.1 time: 0.078715 Oct 03 14:43:48.993023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1443/2871] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:48 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1425 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:43:49.127326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:49.143953 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3cd8dd6b-0774-45b8-9b14-2afd4222149d tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 0.556758 Oct 03 14:43:49.145099 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1429/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:48 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:49.240267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:49.241563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:49.252218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:49.255747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:49.256438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:49.257455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:49.260824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:49.261535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:49.311401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:49.312209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:49.324102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:49.333750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:49.338543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:49.339316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:49.339780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:49.340378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:49.748164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:49.760183 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc0046e2-fca4-436f-be71-6a0c103a3383 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.453408 Oct 03 14:43:49.785799 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1430/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:49 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:43:49.801982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:49.805490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:49.826602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:49.827369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:49.827985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:49.838525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:49.839482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:49.840138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:49.951412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:49.974040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:49.981930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:49.986122 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80e6005a-3fe4-450d-a42b-69337cf14ad6 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.746997 Oct 03 14:43:50.006632 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1444/2874] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:49 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:50.022119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:50.023222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:50.024853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:50.037868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:50.039465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:50.040162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:50.041745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:50.042645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:50.044454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:50.045069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:50.049019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:50.067864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74ff8e9d-5e4e-4500-8b8f-0eaec6007e7e tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.274365 Oct 03 14:43:50.076000 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1431/2875] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:49 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:50.084245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed9cefbf-25b7-45d8-9137-ce60039523b6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb230214790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:50.189920 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed9cefbf-25b7-45d8-9137-ce60039523b6 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1425 microversion: 2.1 time: 0.112452 Oct 03 14:43:50.199092 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1432/2876] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:50 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1425 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:50.222961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:50.224438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:50.256693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:50.262728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:50.267491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:50.271016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:50.271615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:50.272260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:50.740274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:50.767388 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c79739e-7833-44c6-9928-210bcc8a7e12 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.756641 Oct 03 14:43:50.772335 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1445/2877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:50 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:50.801250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:50.802424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:50.819999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:50.820503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:50.821002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:50.821689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:50.822138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:50.822569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:51.205507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:51.236899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c6b653f-27ea-43d1-9d0f-afd463909181 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.440728 Oct 03 14:43:51.239433 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1446/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:50 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:51.244457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:51.245348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:51.251902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:51.254485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:51.255122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:51.256056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:51.256658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:51.257396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:51.394097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:51.403163 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d63e0ee3-3dd7-4ee0-a21f-9bce2aefc734 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1512 microversion: 2.1 time: 1.200260 Oct 03 14:43:51.413137 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1433/2879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:50 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1512 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:51.430165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:51.430894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:51.445244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:51.450905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:51.451449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:51.452254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:51.453312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:51.455449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:51.642439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:51.675024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:51.681350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:51.684240 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05ff2d75-90b5-4032-b497-b8ed4dcbe4f9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.442551 Oct 03 14:43:51.687153 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1447/2880] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:51 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:51.696804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff1d14ab-bed5-406e-a9a3-874a293eede7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb234c0dc10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:51.800466 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff1d14ab-bed5-406e-a9a3-874a293eede7 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1425 microversion: 2.1 time: 0.111711 Oct 03 14:43:51.815331 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1448/2881] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:51 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1425 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:51.824474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:51.827720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:51.865608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:51.868984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:51.869766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:51.873609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:51.874129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:51.876324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:51.937149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:51.969142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:51.993735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:52.012317 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9cb30771-591f-4d64-a57c-0837a80077b8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.590682 Oct 03 14:43:52.015448 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1434/2882] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:51 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:52.266391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:52.267195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:52.279427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.280080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.280674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:52.283651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.284455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.285079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:52.450736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:52.461451 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7939b113-b174-4b31-a946-e70e8d79ff21 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.644455 Oct 03 14:43:52.465278 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1449/2883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:51 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:52.474352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:52.475113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:52.492140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.492602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.493077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:52.494523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.494989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.495419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:52.624760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:52.638641 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f8ce6b1-5b52-46ea-8b5c-31f7c11ec0ba tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.378348 Oct 03 14:43:52.640333 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1435/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:52 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:43:52.664471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2100969566"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:52.667626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:52.679278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.680278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.681553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:52.683139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.685026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.685748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:52.916501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:52.930402 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06f84bc0-ebb4-4e91-8e38-f733b3bb1d84 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1489 microversion: 2.1 time: 0.459502 Oct 03 14:43:52.931280 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1450/2885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:52 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1489 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:52.939734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:52.942995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:52.952905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.953513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.954280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:52.955174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:52.956013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:52.956539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.107934 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-55782439-2932-41ec-8137-133faeedc6cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.447475 Oct 03 14:43:53.112907 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1436/2886] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:43:52 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 03 14:43:53.123456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25f8c155-19f1-4e29-aa38-ec9cee4e4f37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb2302e6a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:53.201827 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25f8c155-19f1-4e29-aa38-ec9cee4e4f37 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1434 microversion: 2.1 time: 0.086420 Oct 03 14:43:53.213638 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1437/2887] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:53 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1434 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:53.220184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1354582776"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:53.225017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:53.236456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.237895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.238532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.239609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.240252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.240861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.366670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b504a135-5cfc-48b2-850e-ffb266ac46a1 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "PUT /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1062 microversion: 2.1 time: 0.151343 Oct 03 14:43:53.379274 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1438/2888] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:43:53 2022] PUT /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1062 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:53.387560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:53.388942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:53.389261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:53.397904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.398669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:53.398937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.399551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.400114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:53.400250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.400712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.401163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.401300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f05d2d1f-e2e7-487c-9c51-618bede5c979 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.468903 Oct 03 14:43:53.410662 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1451/2889] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:52 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:53.415944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c152dac5-fde2-42a8-b464-ce92344aa9ee tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb234a879d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:53.498147 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c152dac5-fde2-42a8-b464-ce92344aa9ee tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 200 len: 1434 microversion: 2.1 time: 0.084396 Oct 03 14:43:53.499962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1452/2890] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:43:53 2022] GET /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 1434 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:53.509525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:53.511007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:53.522110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.522991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.523552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.524633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.525233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.525872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.698343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:53.711039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:53.716778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:53.730031 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34981aa6-669e-4e2b-b14b-b4b3828441e8 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.349268 Oct 03 14:43:53.741593 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1439/2891] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:53 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:53.769359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:53.769872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:53.770752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:53.803497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.808018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.809021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.810898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.812064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.814158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.818970 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f67ffcb-3999-4c84-9417-474dd0995b32 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1489 microversion: 2.1 time: 0.308518 Oct 03 14:43:53.820167 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1453/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:53 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1489 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:53.825069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:53.832728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:53.853118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.856272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.857149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:53.861874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:53.862549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:53.863146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:54.187156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:54.197199 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac01d7e4-5a32-439d-8f5a-2b59d3faebd9 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1466 microversion: 2.1 time: 0.375559 Oct 03 14:43:54.197792 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1454/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:53 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1466 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:54.203042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:54.203933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:54.211093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:54.211858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:54.212445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:54.213363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:54.214839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:54.215474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:54.390307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:54.399742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cabf1b0-bc90-4709-b150-3f84f7aecbbe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1489 microversion: 2.1 time: 0.200704 Oct 03 14:43:54.412951 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1455/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:54 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1489 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:54.412951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c2962ca-1c81-439a-b132-2e9217955f76 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb234c4c790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:54.595175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:54.603488 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e33e3a6-19f1-41bf-b113-be677a1ef37c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.849617 Oct 03 14:43:54.612902 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1440/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:53 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:54.618661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:54.619222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:54.636300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:54.637157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:54.637793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:54.639572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:54.643953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:54.644414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:54.700541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:43:54.783490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:54.848123 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29ad6cd0-e751-47cb-b931-4eb57258416a tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 204 len: 0 microversion: 2.1 time: 0.232162 Oct 03 14:43:54.849661 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1441/2896] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:43:54 2022] DELETE /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:43:54.862078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:54.862801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:54.870070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:54.870573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:54.871015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:54.871778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:54.872232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:54.872834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.139706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.152362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.154119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.155701 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-740e1049-4b1e-4c39-9055-ad48c9b6c122 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.302990 Oct 03 14:43:55.156264 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1442/2897] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:54 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:55.165736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:55.166567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:55.175332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.176133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.176750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.178321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.179745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.180344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.255250 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c2962ca-1c81-439a-b132-2e9217955f76 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "DELETE /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4" status: 204 len: 0 microversion: 2.1 time: 0.853043 Oct 03 14:43:55.256635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1456/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:54 2022] DELETE /compute/v2.1/images/69fa69df-0b8f-4bc9-9ff5-56bd35529df4 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:43:55.262568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:55.263237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:55.269354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:55.275289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.275802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.276232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.276954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.278068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.278665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.283557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:55.319576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.328544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.330645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.336628 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-88b5828a-9c33-4da1-b6c4-f871e400eff2 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.175150 Oct 03 14:43:55.337879 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1443/2899] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:55 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:55.354250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d805069e-0703-49ae-a107-cd0f353b4f23 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '.version_select at 0x7fb23058a670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:55.385782 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d805069e-0703-49ae-a107-cd0f353b4f23 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] HTTP exception thrown: Image not found. Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d805069e-0703-49ae-a107-cd0f353b4f23 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Request method failure captured: Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 HTTP/1.1 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvThE570ULpRfmTrqUDqwqrAafqQOJEV5PvmDwlLrjTuq7PBbm_udpaxu1NKXpFJXDkjlmiCVHyMRo9mre5CZFNMiIO0gN84tgIG59qSuiQ36inmRzoPTyc3xw_8bvlyYhf9N_TbHjjrtGqiMb8nVOmk-KIaoPvRYU63hAbNrVeSTaY Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 93c499a00f3842bd8c6512a4e06c2945 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93c499a00f3842bd8c6512a4e06c2945", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 93c499a00f3842bd8c6512a4e06c2945 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesOneServerTestJSON-37315792-project Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c90e0563672845d0ad07db3f935eed70 Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesOneServerTestJSON-37315792-project Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: exception: Image not found. Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '01afcc68-eeb7-4071-82bd-bd08f49dd478'} Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 01afcc68-eeb7-4071-82bd-bd08f49dd478 to delete Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 01afcc68-eeb7-4071-82bd-bd08f49dd478 could not be found. Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:43:55.389969 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 03 14:43:55.394742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:43:55.398509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d805069e-0703-49ae-a107-cd0f353b4f23 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Returning 404 to user: Image not found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:43:55.399676 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d805069e-0703-49ae-a107-cd0f353b4f23 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "DELETE /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478" status: 404 len: 62 microversion: 2.1 time: 0.060578 Oct 03 14:43:55.403751 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1444/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:55 2022] DELETE /compute/v2.1/images/01afcc68-eeb7-4071-82bd-bd08f49dd478 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:43:55.411247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:55.412071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:55.421512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.422341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.423044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.424123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.424879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.426028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.467936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:43:55.558824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.570681 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-516f52c2-f876-434e-98bc-d36f831104b3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1495 microversion: 2.1 time: 0.312748 Oct 03 14:43:55.573248 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1457/2901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:55 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1495 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:55.597722 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7eab0982-c46c-4d12-aad2-9f7dc09e227b tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 204 len: 0 microversion: 2.1 time: 0.189049 Oct 03 14:43:55.598536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1445/2902] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:43:55 2022] DELETE /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:43:55.607054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:55.607814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:55.618308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.618693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.619131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.619841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.624386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.624835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.630264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:55.630962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:55.645576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.646086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.647792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.647792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:55.647792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:55.648121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:55.842980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.853450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ef9d67b5-8e27-465b-b836-24c044bf0171 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.227332 Oct 03 14:43:55.854286 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1446/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:55 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:55.963400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:55.973081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a073c2cd-403b-4e72-a809-5eecf488ef5d tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1472 microversion: 2.1 time: 0.370326 Oct 03 14:43:55.989299 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1458/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:55 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:56.190165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:56.191024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:56.200288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.201217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.202011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.203190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.203807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.204378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.370403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:56.371170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:56.379048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.379824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.380593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.381782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.383295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.383880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.487109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:56.503444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:56.505671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:56.506906 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-171f350c-e09d-4597-87c7-81b0fa4fd45e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.322708 Oct 03 14:43:56.508847 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1447/2905] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:56 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:56.531562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:56.544360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:56.546340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:56.554864 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f213ae49-6a1b-474a-9144-91c31281edb9 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.188478 Oct 03 14:43:56.556180 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1459/2906] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:56 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:56.595883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:56.596500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:56.604806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.604806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.604806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.605297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.605820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.606172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.853288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:56.867500 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cdf6bec9-6092-4e60-ac0b-29189c82acd8 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1495 microversion: 2.1 time: 0.275544 Oct 03 14:43:56.886763 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1448/2907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:56 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1495 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:56.892081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:56.893345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:56.907215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.908064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.908557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.909366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:56.914339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:56.921724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:56.999403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:57.000278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:57.014804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.015946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.034343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:57.034343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.034343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.034343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:57.203414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:57.216673 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3947a336-1347-4a48-9868-b94f87c5faed tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.328597 Oct 03 14:43:57.218013 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1460/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:56 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:43:57.382997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:57.406328 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-86e45566-16fe-47f7-8ef2-d944bae58959 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1472 microversion: 2.1 time: 0.412179 Oct 03 14:43:57.408991 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1449/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:56 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:43:57.533876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:57.534669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:57.545931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.549538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.550188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:57.551152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.560421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.561242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:57.586404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:57.586970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:57.596064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.596562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.597018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:57.597731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.598196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.598596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:57.809844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:57.830582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:57.833869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:57.846554 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-322fc2ec-94a3-4461-8bb5-e3e976a745de tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.263843 Oct 03 14:43:57.847965 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1450/2910] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:57 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:57.917630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:57.918584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:57.943765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.944427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.945122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:57.946010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:57.946608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:57.948006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:58.714988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:58.731864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:58.737382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:58.740663 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43a96630-9fe4-46ef-b8fb-80b2edc6dcb3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 1.210920 Oct 03 14:43:58.743725 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1461/2911] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:57 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:43:58.784882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:58.787842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:58.802402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:58.813221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:58.813955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:58.816216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:58.816401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e426c64-16fe-440f-9f6d-9d1d10349bc0 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1495 microversion: 2.1 time: 0.925212 Oct 03 14:43:58.816910 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1451/2912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:57 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1495 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:58.826320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:58.833421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:58.840160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:58.841395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:43:58.851601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:58.862140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:58.862625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:58.863073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:58.863786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:43:58.864639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:43:58.864639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:43:59.183089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:43:59.197935 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08ff5037-a72a-47ca-a53c-fbf15e842272 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.452313 Oct 03 14:43:59.217795 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1462/2913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:58 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:43:59.554520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e57cc49b-e1bc-41d7-ae02-b82390a74316 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234b8edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-268309942", "description": "tempest-description-1899135921"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:43:59.968704 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e57cc49b-e1bc-41d7-ae02-b82390a74316 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.748726 Oct 03 14:43:59.971891 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1463/2914] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:43:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:43:59.977317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:43:59.980022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:00.001462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.015468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.017904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.019892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.020535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.021801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.071538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c90e0563672845d0ad07db3f935eed70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c499a00f3842bd8c6512a4e06c2945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:00.086297 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b14ec24-fade-4324-b3d5-7b3703d7c18a tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 200 len: 1472 microversion: 2.1 time: 1.263565 Oct 03 14:44:00.115845 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1452/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:43:58 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 1472 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:00.127373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d4f0aef4-8580-43ac-b2e8-d29447786339 req-f4f9f80d-10f7-47ba-9103-6b196762bb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25abf273-edc1-4dec-91b1-c025ebffebdc", "name": "network-vif-unplugged", "status": "completed", "tag": "bbd99c3a-75f5-4179-b17d-e28be8949f55"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:00.157440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d4f0aef4-8580-43ac-b2e8-d29447786339 req-f4f9f80d-10f7-47ba-9103-6b196762bb0d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.159698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d4f0aef4-8580-43ac-b2e8-d29447786339 req-f4f9f80d-10f7-47ba-9103-6b196762bb0d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.160444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d4f0aef4-8580-43ac-b2e8-d29447786339 req-f4f9f80d-10f7-47ba-9103-6b196762bb0d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.233727 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d4f0aef4-8580-43ac-b2e8-d29447786339 req-f4f9f80d-10f7-47ba-9103-6b196762bb0d service nova] Creating event network-vif-unplugged:bbd99c3a-75f5-4179-b17d-e28be8949f55 for instance 25abf273-edc1-4dec-91b1-c025ebffebdc on n-h2-781139-2 Oct 03 14:44:00.236104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:00.244304 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d4f0aef4-8580-43ac-b2e8-d29447786339 req-f4f9f80d-10f7-47ba-9103-6b196762bb0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125957 Oct 03 14:44:00.246770 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1453/2916] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:00.254651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:00.256727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:00.258264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:00.258662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:00.269572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.270244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.271114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.272352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.273096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.273702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.282756 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c2e8693-c06c-4916-a927-19ce0b9af421 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1546 microversion: 2.91 time: 0.309325 Oct 03 14:44:00.283326 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1464/2917] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:43:59 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1546 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:00.298716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ce223e24-8782-48d8-b2ea-cc3fc73b5add req-13f4bdba-5dbc-47e2-8a32-c8059ee162b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd6470d-2444-4729-9eb9-26609bc154d9", "name": "network-vif-deleted", "tag": "1800b505-397e-4bfe-846d-aabd3fa8087b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:00.333228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce223e24-8782-48d8-b2ea-cc3fc73b5add req-13f4bdba-5dbc-47e2-8a32-c8059ee162b2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.352531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce223e24-8782-48d8-b2ea-cc3fc73b5add req-13f4bdba-5dbc-47e2-8a32-c8059ee162b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.353072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce223e24-8782-48d8-b2ea-cc3fc73b5add req-13f4bdba-5dbc-47e2-8a32-c8059ee162b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.393448 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ce223e24-8782-48d8-b2ea-cc3fc73b5add req-13f4bdba-5dbc-47e2-8a32-c8059ee162b2 service nova] Creating event network-vif-deleted:1800b505-397e-4bfe-846d-aabd3fa8087b for instance 8dd6470d-2444-4729-9eb9-26609bc154d9 on n-h2-781139-2 Oct 03 14:44:00.420546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ce223e24-8782-48d8-b2ea-cc3fc73b5add req-13f4bdba-5dbc-47e2-8a32-c8059ee162b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133856 Oct 03 14:44:00.423297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1465/2918] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:00.436866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:00.437871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:00.446751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.447493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.448109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.449150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.449980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.452215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.509089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:00.509905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:00.510491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:00.511091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lazy-loading 'fault' on Instance uuid 25abf273-edc1-4dec-91b1-c025ebffebdc {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:44:00.591863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:00.602454 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91c6cb45-bac1-4cc5-9387-bfbb92331319 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 200 len: 1310 microversion: 2.1 time: 0.176329 Oct 03 14:44:00.603366 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1466/2919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:00 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 1310 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:00.608771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2614ffcf-6f07-464c-8588-255f4179c921 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234bd6040>, body: {"security_group_rule": {"parent_group_id": "66fae36e-12f9-40db-b36a-17a5c07f575d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:01.039284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:01.056484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:01.059280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:01.059584 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2614ffcf-6f07-464c-8588-255f4179c921 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.454628 Oct 03 14:44:01.064739 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa46446b-5101-4b92-85f4-ed12fa11d242 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.816583 Oct 03 14:44:01.067482 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1467/2921] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:01.067601 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1454/2921] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:00 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:01.077530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-da065879-d8fe-48c0-b121-40c474bb3a6c req-7a6acdb1-c7d6-4f51-be2f-6ea5036281b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25abf273-edc1-4dec-91b1-c025ebffebdc", "name": "network-vif-deleted", "tag": "bbd99c3a-75f5-4179-b17d-e28be8949f55"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:01.081034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:01.081744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:01.097864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da065879-d8fe-48c0-b121-40c474bb3a6c req-7a6acdb1-c7d6-4f51-be2f-6ea5036281b5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.098340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da065879-d8fe-48c0-b121-40c474bb3a6c req-7a6acdb1-c7d6-4f51-be2f-6ea5036281b5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.100276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da065879-d8fe-48c0-b121-40c474bb3a6c req-7a6acdb1-c7d6-4f51-be2f-6ea5036281b5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.100911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.101580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.102111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.102893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.103415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.103909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.133440 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-da065879-d8fe-48c0-b121-40c474bb3a6c req-7a6acdb1-c7d6-4f51-be2f-6ea5036281b5 service nova] Creating event network-vif-deleted:bbd99c3a-75f5-4179-b17d-e28be8949f55 for instance 25abf273-edc1-4dec-91b1-c025ebffebdc on n-h2-781139-2 Oct 03 14:44:01.147028 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-da065879-d8fe-48c0-b121-40c474bb3a6c req-7a6acdb1-c7d6-4f51-be2f-6ea5036281b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069974 Oct 03 14:44:01.147930 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1468/2922] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:01.159682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63b40a90-9f4f-427b-b2ba-19dfe4d2badb tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234a87280>, body: {"security_group_rule": {"parent_group_id": "66fae36e-12f9-40db-b36a-17a5c07f575d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:01.225201 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-63b40a90-9f4f-427b-b2ba-19dfe4d2badb tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: This rule already exists in group 66fae36e-12f9-40db-b36a-17a5c07f575d Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63b40a90-9f4f-427b-b2ba-19dfe4d2badb tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 138 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "66fae36e-12f9-40db-b36a-17a5c07f575d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: exception: This rule already exists in group 66fae36e-12f9-40db-b36a-17a5c07f575d Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': '66fae36e-12f9-40db-b36a-17a5c07f575d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 66fae36e-12f9-40db-b36a-17a5c07f575d Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 66fae36e-12f9-40db-b36a-17a5c07f575d Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:01.227596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:01.232966 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:01.232966 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:01.232966 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 66fae36e-12f9-40db-b36a-17a5c07f575d Oct 03 14:44:01.232966 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.237216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63b40a90-9f4f-427b-b2ba-19dfe4d2badb tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 400 to user: This rule already exists in group 66fae36e-12f9-40db-b36a-17a5c07f575d {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:01.238328 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63b40a90-9f4f-427b-b2ba-19dfe4d2badb tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.089515 Oct 03 14:44:01.239109 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1469/2923] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:01 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:44:01.244048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:01.245507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] [instance: 8dd6470d-2444-4729-9eb9-26609bc154d9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:01.259408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.260335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.261256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.262466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.263105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.263569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.298599 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] HTTP exception thrown: Instance 8dd6470d-2444-4729-9eb9-26609bc154d9 could not be found. Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Request method failure captured: Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 HTTP/1.1 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvThE570ULpRfmTrqUDqwqrAafqQOJEV5PvmDwlLrjTuq7PBbm_udpaxu1NKXpFJXDkjlmiCVHyMRo9mre5CZFNMiIO0gN84tgIG59qSuiQ36inmRzoPTyc3xw_8bvlyYhf9N_TbHjjrtGqiMb8nVOmk-KIaoPvRYU63hAbNrVeSTaY Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 93c499a00f3842bd8c6512a4e06c2945 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_93c499a00f3842bd8c6512a4e06c2945", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/93c499a00f3842bd8c6512a4e06c2945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 93c499a00f3842bd8c6512a4e06c2945 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-37315792 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesOneServerTestJSON-37315792-project Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: c90e0563672845d0ad07db3f935eed70 Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesOneServerTestJSON-37315792-project Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 8dd6470d-2444-4729-9eb9-26609bc154d9 could not be found. Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '8dd6470d-2444-4729-9eb9-26609bc154d9'} Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd6470d-2444-4729-9eb9-26609bc154d9 could not be found. Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd6470d-2444-4729-9eb9-26609bc154d9 could not be found. Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:01.300223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd6470d-2444-4729-9eb9-26609bc154d9 could not be found. Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] Returning 404 to user: Instance 8dd6470d-2444-4729-9eb9-26609bc154d9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:01.304086 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3b4aa4f-52b3-4d3c-bc0e-4885c60b2909 tempest-ImagesOneServerTestJSON-37315792 tempest-ImagesOneServerTestJSON-37315792-project] 10.222.0.20 "GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9" status: 404 len: 111 microversion: 2.1 time: 0.061445 Oct 03 14:44:01.308913 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1470/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:01 2022] GET /compute/v2.1/servers/8dd6470d-2444-4729-9eb9-26609bc154d9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:01.315904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3ce8622-4166-4665-a657-d3593810a06c tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Calling method '.version_select at 0x7fb230a35a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:01.615567 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3ce8622-4166-4665-a657-d3593810a06c tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/fccd7f76-df76-4c4f-95ac-b464924c0090" status: 202 len: 0 microversion: 2.1 time: 0.305544 Oct 03 14:44:01.616470 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1471/2925] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Oct 3 14:44:01 2022] DELETE /compute/v2.1/os-security-group-rules/fccd7f76-df76-4c4f-95ac-b464924c0090 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:44:01.623998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:01.624983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:01.650699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.659235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.661487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.664797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.666821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.667471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.811805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:01.824796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:01.827232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:01.835016 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75d47d65-267c-4588-b804-ba185cc51b03 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1533 microversion: 2.91 time: 0.217191 Oct 03 14:44:01.850511 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1472/2926] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:01 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1533 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:01.871661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:01.872291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:01.899730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.900253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.900706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.909292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:01.909810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:01.910313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:01.944990 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc HTTP/1.1 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '25abf273-edc1-4dec-91b1-c025ebffebdc'} Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:01.949160 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.955215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:01.955215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:01.955215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:01.955215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:01.955215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:01.955215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:01.955215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:01.957866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:01.961984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba78a162-7eb4-412b-9725-89ae43975817 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 404 len: 111 microversion: 2.1 time: 0.107527 Oct 03 14:44:01.977211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1473/2927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:01 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:01.989797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fbf989a-b643-4ada-a4cb-f92d3618f01e tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234c0d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1303562772", "description": "tempest-description-243239076"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:02.242171 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fbf989a-b643-4ada-a4cb-f92d3618f01e tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.263596 Oct 03 14:44:02.243583 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1474/2928] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:44:01 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:02.249759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:02.250840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:02.269828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.270701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.271316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.272219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.273988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.274685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.292346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:02.314825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-549c6157-0d27-4cc4-98e1-52ea539102c5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 1.245883 Oct 03 14:44:02.317391 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1455/2929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:01 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:02.324701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:02.331208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:02.351493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.354108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.355309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.357676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.361899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.364121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.406125 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc HTTP/1.1 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '25abf273-edc1-4dec-91b1-c025ebffebdc'} Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:02.415145 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.420007 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.423156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:02.426888 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b21d2d5-0508-4df4-969e-232b8d1a5ae9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 404 len: 111 microversion: 2.1 time: 0.108124 Oct 03 14:44:02.427875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1456/2930] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:02 2022] DELETE /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:02.434406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:02.435275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:02.443616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.445501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.446293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.447344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.448085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.449226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.517527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] Lazy-loading 'services' on Instance uuid 87b3c599-7ab6-4d1e-8223-0b23c1661c63 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:44:02.546066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a634887e-2061-47da-8617-6bd95601a669 tempest-UnshelveToHostMultiNodesTest-890560647 tempest-UnshelveToHostMultiNodesTest-890560647-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1938 microversion: 2.91 time: 0.300050 Oct 03 14:44:02.548001 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1475/2931] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:02 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1938 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:02.574953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6278aec1-11f2-4634-aa82-5d5b622d1338 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234a87280>, body: {"security_group_rule": {"parent_group_id": "1837263d-2b20-4ff2-8483-01711ff32761", "ip_protocol": "tcp", "from_port": 1372733061, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:02.708815 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6278aec1-11f2-4634-aa82-5d5b622d1338 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: Invalid port range 1372733061:22. Former value cannot be greater than the later Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6278aec1-11f2-4634-aa82-5d5b622d1338 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 146 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "1837263d-2b20-4ff2-8483-01711ff32761", "ip_protocol": "tcp", "from_port": 1372733061, "to_port": 22}} Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid port range 1372733061:22. Former value cannot be greater than the later Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1837263d-2b20-4ff2-8483-01711ff32761', 'ip_protocol': 'tcp', 'from_port': 1372733061, 'to_port': 22}}} Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1372733061:22. Former value cannot be greater than the later Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1372733061:22. Former value cannot be greater than the later Oct 03 14:44:02.711375 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1372733061:22. Former value cannot be greater than the later Oct 03 14:44:02.717078 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.723717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6278aec1-11f2-4634-aa82-5d5b622d1338 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 400 to user: Invalid port range 1372733061:22. Former value cannot be greater than the later {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:02.726796 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6278aec1-11f2-4634-aa82-5d5b622d1338 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.174742 Oct 03 14:44:02.727612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1476/2932] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:02 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:44:02.737043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e38a3ddc-d07e-4a5e-a490-dac770bb943c req-5f3d0234-f9ca-4c1a-9a2d-4c10a4ed925d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-plugged", "status": "completed", "tag": "5390fedc-da97-4712-a8da-7629aee81daf"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:02.762404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e38a3ddc-d07e-4a5e-a490-dac770bb943c req-5f3d0234-f9ca-4c1a-9a2d-4c10a4ed925d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.762887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e38a3ddc-d07e-4a5e-a490-dac770bb943c req-5f3d0234-f9ca-4c1a-9a2d-4c10a4ed925d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.765933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e38a3ddc-d07e-4a5e-a490-dac770bb943c req-5f3d0234-f9ca-4c1a-9a2d-4c10a4ed925d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.783752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e38a3ddc-d07e-4a5e-a490-dac770bb943c req-5f3d0234-f9ca-4c1a-9a2d-4c10a4ed925d service nova] Creating event network-vif-plugged:5390fedc-da97-4712-a8da-7629aee81daf for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:02.792218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:02.795575 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e38a3ddc-d07e-4a5e-a490-dac770bb943c req-5f3d0234-f9ca-4c1a-9a2d-4c10a4ed925d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060990 Oct 03 14:44:02.798741 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1477/2933] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:02.805316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:02.806886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:02.807781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 25abf273-edc1-4dec-91b1-c025ebffebdc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:02.814601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:02.816736 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-125fa347-eb4b-4493-ac98-13643a555a4c tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.387640 Oct 03 14:44:02.822444 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1457/2934] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:02 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:02.830706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:02.831326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.832657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:02.834110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.834796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.836220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.837570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.838146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.841776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.842513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.843282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.843959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.850305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.851131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.861997 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc HTTP/1.1 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '25abf273-edc1-4dec-91b1-c025ebffebdc'} Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.864376 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.869594 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.869594 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.869594 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.869594 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:02.869594 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:02.869594 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. Oct 03 14:44:02.869594 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.871418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 25abf273-edc1-4dec-91b1-c025ebffebdc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:02.884809 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbbb3058-409b-41f5-8f1f-daafc396f000 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc" status: 404 len: 111 microversion: 2.1 time: 0.083105 Oct 03 14:44:02.890473 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1478/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:02 2022] GET /compute/v2.1/servers/25abf273-edc1-4dec-91b1-c025ebffebdc => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:02.906213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc96828b-38f4-4e9a-8c61-170de8a2829d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb230961b80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1140186374", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:02.910178 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bc96828b-38f4-4e9a-8c61-170de8a2829d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: Security group id should be uuid Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc96828b-38f4-4e9a-8c61-170de8a2829d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 131 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1140186374", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group id should be uuid Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1140186374', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:02.912816 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:02.917744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 03 14:44:02.917744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.918906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc96828b-38f4-4e9a-8c61-170de8a2829d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 400 to user: Security group id should be uuid {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:02.919905 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc96828b-38f4-4e9a-8c61-170de8a2829d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.026686 Oct 03 14:44:02.921069 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1479/2936] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:02 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:02.927303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:02.928061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:02.928202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:44:02.931656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:02.937712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.938870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.939498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.940358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:02.941051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:02.942298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:02.964349 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b HTTP/1.1 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '4e8de68b-0c52-4794-a4db-7cade3df7e5b'} Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:02.968982 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:02.974118 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:02.977274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:02.978916 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-667236ed-a034-499f-940c-4266e9591561 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 404 len: 111 microversion: 2.1 time: 0.055468 Oct 03 14:44:02.981300 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1480/2937] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:02 2022] DELETE /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:02.994349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ab7bb67-2dba-4771-9dff-851ae8389822 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234bd6430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1512966642", "description": "tempest-description-1429055114"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:03.116080 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-174a0279-10f5-4130-99bf-8b05129f318c tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 204 len: 0 microversion: 2.91 time: 0.291891 Oct 03 14:44:03.121294 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1458/2938] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:44:02 2022] DELETE /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:44:03.131885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:03.138719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 4e8de68b-0c52-4794-a4db-7cade3df7e5b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:03.145981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.146721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.147307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.148172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.148772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.149414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.166529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b HTTP/1.1 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4e8de68b-0c52-4794-a4db-7cade3df7e5b'} Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.169714 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.175095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.175095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.175095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.175095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:03.175095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:03.175095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. Oct 03 14:44:03.175095 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.179199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 4e8de68b-0c52-4794-a4db-7cade3df7e5b could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:03.182685 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bec86aa5-c261-46fe-a32d-3a4eb342b16e tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b" status: 404 len: 111 microversion: 2.1 time: 0.056106 Oct 03 14:44:03.186525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1459/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:03 2022] GET /compute/v2.1/servers/4e8de68b-0c52-4794-a4db-7cade3df7e5b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:03.198631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:03.200560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:03.216373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.217337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.218011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.221025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.221823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.236009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.452055 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ab7bb67-2dba-4771-9dff-851ae8389822 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.463679 Oct 03 14:44:03.453198 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1481/2940] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:44:02 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:03.466961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:03.467457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:03.485746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:03.497608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.498099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.498546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.499236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.499678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.501604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.517586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:03.524408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:03.534183 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c6ec0e6-957c-4af9-9dc6-5f5c43edabf1 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.346164 Oct 03 14:44:03.535542 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.536340 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1460/2941] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:03 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df HTTP/1.1 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1af6414f-c6d7-4c0a-9215-80a91bbff1df'} Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:03.538181 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5c889af-b2e1-49c8-a90a-4048803d9993 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 404 len: 111 microversion: 2.1 time: 0.076885 Oct 03 14:44:03.542431 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1482/2942] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:03 2022] DELETE /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:03.548552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e2e1674-412c-45a3-acca-9578e6d7ec2b tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb230a35a60>, body: {"security_group_rule": {"parent_group_id": "acd3493a-3680-46f2-a6c6-dbc900c75a87", "ip_protocol": "tempest-999-694000351", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:03.559748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:03.564298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:03.576917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.582387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.583310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.585082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.587671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.588277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.666410 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2e2e1674-412c-45a3-acca-9578e6d7ec2b tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: Invalid IP protocol tempest-999-694000351. Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e2e1674-412c-45a3-acca-9578e6d7ec2b tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 156 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "acd3493a-3680-46f2-a6c6-dbc900c75a87", "ip_protocol": "tempest-999-694000351", "from_port": 22, "to_port": 22}} Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid IP protocol tempest-999-694000351. Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'acd3493a-3680-46f2-a6c6-dbc900c75a87', 'ip_protocol': 'tempest-999-694000351', 'from_port': 22, 'to_port': 22}}} Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-694000351. Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-694000351. Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.668017 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-694000351. Oct 03 14:44:03.672281 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.673952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e2e1674-412c-45a3-acca-9578e6d7ec2b tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 400 to user: Invalid IP protocol tempest-999-694000351. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:03.674967 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e2e1674-412c-45a3-acca-9578e6d7ec2b tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.133940 Oct 03 14:44:03.679898 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1483/2943] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:03 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:03.692868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:03.693841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: 1af6414f-c6d7-4c0a-9215-80a91bbff1df] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:03.716002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.716701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.717336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.720383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:03.722496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:03.723286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:03.752012 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df HTTP/1.1 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1af6414f-c6d7-4c0a-9215-80a91bbff1df'} Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:03.753888 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.758108 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:03.758108 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:03.758108 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:03.758108 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:03.758108 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:03.758108 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. Oct 03 14:44:03.758108 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:03.760059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance 1af6414f-c6d7-4c0a-9215-80a91bbff1df could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:03.761147 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bda2708-b6f1-4d8e-8c1a-7b69f9ec7b25 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df" status: 404 len: 111 microversion: 2.1 time: 0.080064 Oct 03 14:44:03.763029 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1484/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:03 2022] GET /compute/v2.1/servers/1af6414f-c6d7-4c0a-9215-80a91bbff1df => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:03.771596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33aa6442-86f4-4686-9ee0-c7fbbd1eeb61 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb230961550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1477672930", "description": "tempest-description-1085602961"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:04.133263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:04.152885 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2139789-7474-4516-b99b-d3486b96d493 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.596559 Oct 03 14:44:04.155335 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1461/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:03 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:04.183902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:04.184427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:04.190369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:04.194846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.195732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.196332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.197603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.198233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.199014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.224058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 HTTP/1.1 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'b608d4ea-6bc1-4d4b-b383-491340c2dc15'} Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:04.226668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:04.231510 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-737e451d-4015-4db4-a0da-4775108caac4 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 404 len: 111 microversion: 2.1 time: 0.056032 Oct 03 14:44:04.232396 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1462/2946] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:04 2022] DELETE /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:04.250284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:04.251420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:04.268300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.268704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.269594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.270504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.270963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.279029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.280248 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33aa6442-86f4-4686-9ee0-c7fbbd1eeb61 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.515980 Oct 03 14:44:04.281120 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1485/2947] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:44:03 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:04.295551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:04.296410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: b608d4ea-6bc1-4d4b-b383-491340c2dc15] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:04.320895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.321886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.322718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.323579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.324198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.324764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.339670 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 HTTP/1.1 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b608d4ea-6bc1-4d4b-b383-491340c2dc15'} Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.341499 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.346343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.346343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.346343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.346343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:04.346343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:04.346343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. Oct 03 14:44:04.346343 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.347879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance b608d4ea-6bc1-4d4b-b383-491340c2dc15 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:04.348907 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ecae7fa-9fbd-4a7d-a856-0c3927718a51 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15" status: 404 len: 111 microversion: 2.1 time: 0.058178 Oct 03 14:44:04.349995 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1486/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:04 2022] GET /compute/v2.1/servers/b608d4ea-6bc1-4d4b-b383-491340c2dc15 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:04.355316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98ae4887-cf4e-4f8c-8b8a-5acb8b30182d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234a87820>, body: {"security_group_rule": {"parent_group_id": "584ce383-94d5-4e9b-ba7d-542845ad1b2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:04.419504 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-98ae4887-cf4e-4f8c-8b8a-5acb8b30182d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98ae4887-cf4e-4f8c-8b8a-5acb8b30182d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 138 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "584ce383-94d5-4e9b-ba7d-542845ad1b2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': '584ce383-94d5-4e9b-ba7d-542845ad1b2c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 14:44:04.421608 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 03 14:44:04.425425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.427712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98ae4887-cf4e-4f8c-8b8a-5acb8b30182d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:04.428909 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98ae4887-cf4e-4f8c-8b8a-5acb8b30182d tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.077696 Oct 03 14:44:04.434517 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1487/2949] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:04 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:44:04.448318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:04.449768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:04.457603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.458783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.459424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.461120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.461854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.462456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.478835 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 HTTP/1.1 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd582c80c-2b40-485c-bf9b-df042789ad88'} Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:04.480979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.484689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.487349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:04.488414 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5a02141-37b3-4869-9d40-8034f1939176 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 404 len: 111 microversion: 2.1 time: 0.052851 Oct 03 14:44:04.489532 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1488/2950] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:04 2022] DELETE /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:04.503385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0416c6ee-01d5-422f-a34b-dcd382d12cc6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb2310630d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1408941092", "description": "tempest-description-1230082857"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:04.780721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:04.806557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:04.816897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:04.818852 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-848cf68e-397a-41d7-8b90-3674d0983ab9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.580815 Oct 03 14:44:04.832217 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1463/2951] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:04 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:04.849585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:04.851901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: d582c80c-2b40-485c-bf9b-df042789ad88] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:04.880465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.881390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.882192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.883666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.884377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.885088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.914927 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0416c6ee-01d5-422f-a34b-dcd382d12cc6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.423746 Oct 03 14:44:04.918051 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 HTTP/1.1 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'd582c80c-2b40-485c-bf9b-df042789ad88'} Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:04.921598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.926479 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:04.926479 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:04.926479 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:04.926479 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:04.926479 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:04.926479 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. Oct 03 14:44:04.926479 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:04.927517 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1489/2952] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:44:04 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:04.930398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance d582c80c-2b40-485c-bf9b-df042789ad88 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:04.930698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:04.931313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:04.931964 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a147a525-2e3a-43ff-8e2b-897350a93543 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88" status: 404 len: 111 microversion: 2.1 time: 0.097519 Oct 03 14:44:04.942177 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1464/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:04 2022] GET /compute/v2.1/servers/d582c80c-2b40-485c-bf9b-df042789ad88 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:04.948524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.949048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.949492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.950214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.950661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.956043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7d1cca2d-d847-4874-b09f-12e809e5576b req-fd32b4ed-eacb-4244-86f9-5988c0b92278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-plugged", "status": "completed", "tag": "67029309-c63a-423b-b036-5bd8407234e6"}, {"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-plugged", "status": "completed", "tag": "cfca253d-f28f-451d-80fd-bd99585b6293"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:04.957033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:04.977077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7d1cca2d-d847-4874-b09f-12e809e5576b req-fd32b4ed-eacb-4244-86f9-5988c0b92278 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:04.978128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7d1cca2d-d847-4874-b09f-12e809e5576b req-fd32b4ed-eacb-4244-86f9-5988c0b92278 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:04.978771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7d1cca2d-d847-4874-b09f-12e809e5576b req-fd32b4ed-eacb-4244-86f9-5988c0b92278 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.004008 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7d1cca2d-d847-4874-b09f-12e809e5576b req-fd32b4ed-eacb-4244-86f9-5988c0b92278 service nova] Creating event network-vif-plugged:67029309-c63a-423b-b036-5bd8407234e6 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:05.004913 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7d1cca2d-d847-4874-b09f-12e809e5576b req-fd32b4ed-eacb-4244-86f9-5988c0b92278 service nova] Creating event network-vif-plugged:cfca253d-f28f-451d-80fd-bd99585b6293 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:05.012430 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7d1cca2d-d847-4874-b09f-12e809e5576b req-fd32b4ed-eacb-4244-86f9-5988c0b92278 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060457 Oct 03 14:44:05.014063 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1465/2954] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:05.019828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63adb303-623d-448e-8de0-afbe317ac80f tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb2302e6ca0>, body: {"security_group_rule": {"parent_group_id": "33eb8b18-c0b6-4db7-b7ba-b2ecc44d105e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1593572939}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:05.087307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:05.098546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:05.100303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19184a3e475e44aaa6289f0d230a3e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b186be7b6742859294975b2c28319e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:05.113293 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee11031a-eccd-45a2-8fce-87c9752eb994 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 200 len: 1539 microversion: 2.91 time: 0.186254 Oct 03 14:44:05.115947 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1490/2955] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:04 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:05.121573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.122263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:05.129244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.129975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.130574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.131440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.132040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.133049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.154827 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b HTTP/1.1 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a33a24ca-ff38-4431-a385-8131e29d5a3b'} Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:05.156902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.161442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.163326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:05.164357 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b241f25a-4ba4-4469-b43c-69b8164cfef3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 404 len: 111 microversion: 2.1 time: 0.047214 Oct 03 14:44:05.165399 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1491/2956] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:05 2022] DELETE /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:05.177827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.178846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: a33a24ca-ff38-4431-a385-8131e29d5a3b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:05.186293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.187082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.187681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.189071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.189777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.190380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.212995 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b HTTP/1.1 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a33a24ca-ff38-4431-a385-8131e29d5a3b'} Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.215398 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.221171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.221171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.221171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.221171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:05.221171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:05.221171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. Oct 03 14:44:05.221171 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.222388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance a33a24ca-ff38-4431-a385-8131e29d5a3b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:05.224630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f59c84f-5139-4a7b-92b4-2b5250be89f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b" status: 404 len: 111 microversion: 2.1 time: 0.053356 Oct 03 14:44:05.229114 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1492/2957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:05 2022] GET /compute/v2.1/servers/a33a24ca-ff38-4431-a385-8131e29d5a3b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:05.237338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.238283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:05.249272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.249980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.250789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.251672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.252295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.252870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.421598 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-63adb303-623d-448e-8de0-afbe317ac80f tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: Invalid port range 22:1593572939. Valid TCP ports should be between 1-65535 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63adb303-623d-448e-8de0-afbe317ac80f tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 146 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: {"security_group_rule": {"parent_group_id": "33eb8b18-c0b6-4db7-b7ba-b2ecc44d105e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1593572939}} Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid port range 22:1593572939. Valid TCP ports should be between 1-65535 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'security_group_rule': {'parent_group_id': '33eb8b18-c0b6-4db7-b7ba-b2ecc44d105e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1593572939}}} Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1593572939. Valid TCP ports should be between 1-65535 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1593572939. Valid TCP ports should be between 1-65535 Oct 03 14:44:05.424454 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1593572939. Valid TCP ports should be between 1-65535 Oct 03 14:44:05.428344 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.432331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63adb303-623d-448e-8de0-afbe317ac80f tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 400 to user: Invalid port range 22:1593572939. Valid TCP ports should be between 1-65535 {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:05.433347 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63adb303-623d-448e-8de0-afbe317ac80f tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.417856 Oct 03 14:44:05.434069 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1466/2958] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:05 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:44:05.442894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.446515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: fb5e0271-ad7e-47f9-9c0c-740682c373e2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:05.472775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:05.477772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:05.483978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.484793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.486931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.487918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.489332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0fa14579-9d40-449d-806a-810f10c8ea69 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.258818 Oct 03 14:44:05.490511 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1493/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:05 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:05.498735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1574062-bd74-44a1-b272-da56ef3869f6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Action: 'create', calling method: .version_select at 0x7fb234a87c10>, body: {"security_group_rule": {"parent_group_id": "17b983f7-f22c-451e-98e2-9564415acfc7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:05.506509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.508302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.546172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-a1574062-bd74-44a1-b272-da56ef3869f6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:44:05.547099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-a1574062-bd74-44a1-b272-da56ef3869f6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Neutron security group 17b983f7-f22c-451e-98e2-9564415acfc7 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:44:05.549041 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a1574062-bd74-44a1-b272-da56ef3869f6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist Oct 03 14:44:05.549041 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-83b6337d-3aae-4082-9f33-be423e17cf23'] Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1574062-bd74-44a1-b272-da56ef3869f6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 138 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: {"security_group_rule": {"parent_group_id": "17b983f7-f22c-451e-98e2-9564415acfc7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-83b6337d-3aae-4082-9f33-be423e17cf23'] Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'security_group_rule': {'parent_group_id': '17b983f7-f22c-451e-98e2-9564415acfc7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:44:05.551501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83b6337d-3aae-4082-9f33-be423e17cf23'] Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83b6337d-3aae-4082-9f33-be423e17cf23'] Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83b6337d-3aae-4082-9f33-be423e17cf23'] Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-83b6337d-3aae-4082-9f33-be423e17cf23'] Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1574062-bd74-44a1-b272-da56ef3869f6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 404 to user: Security group 17b983f7-f22c-451e-98e2-9564415acfc7 does not exist Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-83b6337d-3aae-4082-9f33-be423e17cf23'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1574062-bd74-44a1-b272-da56ef3869f6 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.065449 Oct 03 14:44:05.558984 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1494/2960] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:44:05 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:05.574266 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.576505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70201157-d27e-4566-b2e8-598689a367de tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Calling method '.version_select at 0x7fb230439e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2 HTTP/1.1 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'fb5e0271-ad7e-47f9-9c0c-740682c373e2'} Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:05.578208 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.584141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.586807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:05.587861 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc4252ad-12b7-4f15-8e99-f0c3b851e644 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2" status: 404 len: 111 microversion: 2.1 time: 0.152667 Oct 03 14:44:05.588619 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1467/2961] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:05 2022] DELETE /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:05.609982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.611608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: fb5e0271-ad7e-47f9-9c0c-740682c373e2] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:05.619838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.620584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.621271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.622187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.622778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-70201157-d27e-4566-b2e8-598689a367de tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:44:05.623475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.625245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.629476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-70201157-d27e-4566-b2e8-598689a367de tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Neutron security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 not found {{(pid=128869) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 03 14:44:05.630269 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-70201157-d27e-4566-b2e8-598689a367de tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] HTTP exception thrown: Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist Oct 03 14:44:05.630269 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-22e5526e-b7d5-49da-8af7-b070ecade819'] Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70201157-d27e-4566-b2e8-598689a367de tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Request method failure captured: Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-group-rules/3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 HTTP/1.1 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvUuhCOeXRm13bqAPyGEExs_3KSd6lizVbqpTwPuaTUNvaLvnMpVgdtsiJJn-wNBUOOWDi7gOjLziEnloquZM57aUI5ho3TIvHE6pQh7LH8tSpiUBl6XWtE72Ep2EVNEtCJ2UCE9i7sC-PFOb0apZoiQSsLQ7t5GMme74NxtjJIRuPc Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b3dc87985b0946ceb2c13333a3b1d0ce", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b3dc87985b0946ceb2c13333a3b1d0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b3dc87985b0946ceb2c13333a3b1d0ce Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa54820bc2b94234bde1d6ee034916d8 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-22e5526e-b7d5-49da-8af7-b070ecade819'] Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3edd70e6-74b5-4850-8bb0-bcc9e2d3c029'} Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:44:05.635264 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e5526e-b7d5-49da-8af7-b070ecade819'] Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e5526e-b7d5-49da-8af7-b070ecade819'] Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e5526e-b7d5-49da-8af7-b070ecade819'] Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22e5526e-b7d5-49da-8af7-b070ecade819'] Oct 03 14:44:05.640919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.645965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70201157-d27e-4566-b2e8-598689a367de tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Returning 404 to user: Security group rule 3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 does not exist Oct 03 14:44:05.645965 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-22e5526e-b7d5-49da-8af7-b070ecade819'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:05.647184 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70201157-d27e-4566-b2e8-598689a367de tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/3edd70e6-74b5-4850-8bb0-bcc9e2d3c029" status: 404 len: 199 microversion: 2.1 time: 0.080676 Oct 03 14:44:05.651927 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1495/2962] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Oct 3 14:44:05 2022] DELETE /compute/v2.1/os-security-group-rules/3edd70e6-74b5-4850-8bb0-bcc9e2d3c029 => generated 199 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:05.660233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49433d16-acaf-40da-9f87-859ef0e2b041 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Calling method '.version_select at 0x7fb230d39670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.715507 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2 HTTP/1.1 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'fb5e0271-ad7e-47f9-9c0c-740682c373e2'} Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:05.729789 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.734328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:05.734328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:05.734328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:05.734328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:05.734328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:05.734328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. Oct 03 14:44:05.734328 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:05.737286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance fb5e0271-ad7e-47f9-9c0c-740682c373e2 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:05.746662 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6701468-65f8-4ff4-ac92-895698291d79 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2" status: 404 len: 111 microversion: 2.1 time: 0.152067 Oct 03 14:44:05.749257 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1468/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:05 2022] GET /compute/v2.1/servers/fb5e0271-ad7e-47f9-9c0c-740682c373e2 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:05.760882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:05.772090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:05.793213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.793838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.799051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.812708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:05.816685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:05.817177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:05.916303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:44:06.134095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49433d16-acaf-40da-9f87-859ef0e2b041 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/33eb8b18-c0b6-4db7-b7ba-b2ecc44d105e" status: 202 len: 0 microversion: 2.1 time: 0.480146 Oct 03 14:44:06.134882 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1496/2964] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:44:05 2022] DELETE /compute/v2.1/os-security-groups/33eb8b18-c0b6-4db7-b7ba-b2ecc44d105e => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:44:06.144638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:06.145963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:06.149821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66225ac4-8417-4159-ad76-e1e67306a10b tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 204 len: 0 microversion: 2.1 time: 0.395246 Oct 03 14:44:06.150892 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1469/2965] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:05 2022] DELETE /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:44:06.157552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5a2d799-deeb-4e1d-99d3-bb0b6c4f001b tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Calling method '.version_select at 0x7fb2301f0790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:06.161101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.162339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.162787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:06.163569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.164017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.166937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:06.528141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:06.544022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:06.546233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:06.549113 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-346640b3-65fd-48fb-9942-2570f9cc4037 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.412938 Oct 03 14:44:06.551015 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1497/2966] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:06 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:06.556612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:06.558862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] [instance: 87b3c599-7ab6-4d1e-8223-0b23c1661c63] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:06.581352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.582128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.582564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:06.583274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.583720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.584138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:06.611398 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] HTTP exception thrown: Instance 87b3c599-7ab6-4d1e-8223-0b23c1661c63 could not be found. Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Request method failure captured: Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 HTTP/1.1 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvR-wIHrSlsiQtSPXFrcpGaHDTzZ-PZlNmJBbc-nrc8Wx9aS8I3NuyaUkCNKpR4g4CtL7EHOyLDj5oazji-jMwyjuL-d2sspUIaJYIAt-bsRp466OetHPVk5TbeDVT_wXbs0k2QThUyegf-eR3EI2m3YV4Fs_cQAB2-TtHNXLdl9pI8 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.91 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 06b186be7b6742859294975b2c28319e Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-444414369 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06b186be7b6742859294975b2c28319e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06b186be7b6742859294975b2c28319e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06b186be7b6742859294975b2c28319e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06b186be7b6742859294975b2c28319e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-444414369 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 06b186be7b6742859294975b2c28319e Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-444414369 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-UnshelveToHostMultiNodesTest-444414369-project Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 19184a3e475e44aaa6289f0d230a3e98 Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-444414369-project Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 87b3c599-7ab6-4d1e-8223-0b23c1661c63 could not be found. Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '87b3c599-7ab6-4d1e-8223-0b23c1661c63'} Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b3c599-7ab6-4d1e-8223-0b23c1661c63 could not be found. Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b3c599-7ab6-4d1e-8223-0b23c1661c63 could not be found. Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:06.612865 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b3c599-7ab6-4d1e-8223-0b23c1661c63 could not be found. Oct 03 14:44:06.617501 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:44:06.617978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] Returning 404 to user: Instance 87b3c599-7ab6-4d1e-8223-0b23c1661c63 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:06.618642 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e683580-0be9-4fed-aa6c-d40ade178c43 tempest-UnshelveToHostMultiNodesTest-444414369 tempest-UnshelveToHostMultiNodesTest-444414369-project] 10.222.0.20 "GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63" status: 404 len: 111 microversion: 2.91 time: 0.066512 Oct 03 14:44:06.620273 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1498/2967] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:06 2022] GET /compute/v2.1/servers/87b3c599-7ab6-4d1e-8223-0b23c1661c63 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:44:06.629715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:06.630329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:06.647043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.648753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.650051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:06.652435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.653250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.654020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:06.803424 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5a2d799-deeb-4e1d-99d3-bb0b6c4f001b tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/584ce383-94d5-4e9b-ba7d-542845ad1b2c" status: 202 len: 0 microversion: 2.1 time: 0.650024 Oct 03 14:44:06.805680 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1470/2968] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:44:06 2022] DELETE /compute/v2.1/os-security-groups/584ce383-94d5-4e9b-ba7d-542845ad1b2c => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:44:06.812795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a52239bb-b028-4086-8cc2-6749da49bec4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230849c10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:06.895579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a52239bb-b028-4086-8cc2-6749da49bec4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/0ac876fd-7c34-41c5-9a78-d65c286a6e59" status: 200 len: 662 microversion: 2.1 time: 0.086777 Oct 03 14:44:06.896497 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1471/2969] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:06 2022] GET /compute/v2.1/images/0ac876fd-7c34-41c5-9a78-d65c286a6e59 => generated 662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:06.924902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:06.929179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:06.952737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.953459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.955717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:06.958228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:06.961386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:06.962156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:07.023476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:07.037366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3ef9ee1-16d1-41c7-a59a-a07305c965fe tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1480 microversion: 2.1 time: 0.411783 Oct 03 14:44:07.037962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1499/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:06 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1480 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:07.069455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77a26dbd-7f8f-45e2-afce-3b987ca11d75 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Calling method '.version_select at 0x7fb234bd61f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:07.399228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:07.411916 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8bf2f13c-ac65-4b67-9484-acd8a979ce14 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.511814 Oct 03 14:44:07.413795 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1472/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:06 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:07.424437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a772b71c-8f5d-4dbb-9c39-cd79b47018ab tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230319a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:07.537992 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77a26dbd-7f8f-45e2-afce-3b987ca11d75 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/acd3493a-3680-46f2-a6c6-dbc900c75a87" status: 202 len: 0 microversion: 2.1 time: 0.480189 Oct 03 14:44:07.539690 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1500/2972] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:44:07 2022] DELETE /compute/v2.1/os-security-groups/acd3493a-3680-46f2-a6c6-dbc900c75a87 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:44:07.545491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-34861c13-65db-4e6c-878b-60f9f7e2f811 req-c1a92918-ef06-41e4-86dd-4ce9f241171e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-plugged", "status": "completed", "tag": "84d54848-c6f3-4db7-b825-aea10dffd716"}, {"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-plugged", "status": "completed", "tag": "12ef2c91-4d07-4180-bd5b-de28f42de817"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:07.555597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a772b71c-8f5d-4dbb-9c39-cd79b47018ab tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/0ac876fd-7c34-41c5-9a78-d65c286a6e59" status: 200 len: 662 microversion: 2.1 time: 0.140687 Oct 03 14:44:07.556629 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1473/2973] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:07 2022] GET /compute/v2.1/images/0ac876fd-7c34-41c5-9a78-d65c286a6e59 => generated 662 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:07.561309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-77b29b25-49be-455b-89b5-d82caa05966e tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Calling method '.version_select at 0x7fb23058c280>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:07.603551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34861c13-65db-4e6c-878b-60f9f7e2f811 req-c1a92918-ef06-41e4-86dd-4ce9f241171e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:07.604120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34861c13-65db-4e6c-878b-60f9f7e2f811 req-c1a92918-ef06-41e4-86dd-4ce9f241171e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:07.604575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34861c13-65db-4e6c-878b-60f9f7e2f811 req-c1a92918-ef06-41e4-86dd-4ce9f241171e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:07.660772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-34861c13-65db-4e6c-878b-60f9f7e2f811 req-c1a92918-ef06-41e4-86dd-4ce9f241171e service nova] Creating event network-vif-plugged:84d54848-c6f3-4db7-b825-aea10dffd716 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:07.662729 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-34861c13-65db-4e6c-878b-60f9f7e2f811 req-c1a92918-ef06-41e4-86dd-4ce9f241171e service nova] Creating event network-vif-plugged:12ef2c91-4d07-4180-bd5b-de28f42de817 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:07.683721 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-34861c13-65db-4e6c-878b-60f9f7e2f811 req-c1a92918-ef06-41e4-86dd-4ce9f241171e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.141199 Oct 03 14:44:07.684624 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1501/2974] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:07.696907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:07.697647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:07.704707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:07.705220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:07.705653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:07.706362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:07.706934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:07.707471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:08.027209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:08.039868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:08.042543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:08.044263 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10b207f1-24dc-4183-8395-bdb0e7bb2395 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.358504 Oct 03 14:44:08.060589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1502/2975] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:07 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:08.081585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:08.084039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:08.095013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:08.096016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:08.097043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:08.098274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:08.098924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:08.099603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:08.376546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72817942188546d9bb9b64e22c121f16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c3c4a89df1341f59f41b7547ebcfa22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:08.386234 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18839a66-0087-4bf5-8743-d321279abac9 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 200 len: 1480 microversion: 2.1 time: 0.327706 Oct 03 14:44:08.404643 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1503/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:08 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 1480 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:08.445211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:08.446433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:08.461742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:08.462547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:08.463191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:08.464114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:08.465287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:08.467890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:08.774251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:08.787979 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49d449a7-1792-4ea9-9ba0-6ef52038f77c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.355348 Oct 03 14:44:08.805961 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1504/2977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:08 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:09.042905 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-77b29b25-49be-455b-89b5-d82caa05966e tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1837263d-2b20-4ff2-8483-01711ff32761" status: 202 len: 0 microversion: 2.1 time: 1.485063 Oct 03 14:44:09.043820 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1474/2978] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:44:07 2022] DELETE /compute/v2.1/os-security-groups/1837263d-2b20-4ff2-8483-01711ff32761 => generated 0 bytes in 1486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:44:09.051513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb1eee8c-5a88-49bd-b5de-6aaf1826bce8 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] Calling method '.version_select at 0x7fb23058c430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:09.251263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-558420779", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "727e60bd-9b1a-4d2d-bfee-b996753158b7"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:09.786563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] validate_networks() for [('727e60bd-9b1a-4d2d-bfee-b996753158b7', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:44:10.372289 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb1eee8c-5a88-49bd-b5de-6aaf1826bce8 tempest-SecurityGroupRulesNegativeTestJSON-1908722030 tempest-SecurityGroupRulesNegativeTestJSON-1908722030-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/66fae36e-12f9-40db-b36a-17a5c07f575d" status: 202 len: 0 microversion: 2.1 time: 1.324452 Oct 03 14:44:10.373848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1475/2979] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:44:09 2022] DELETE /compute/v2.1/os-security-groups/66fae36e-12f9-40db-b36a-17a5c07f575d => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:44:10.380833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:10.381591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:10.398693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:10.399194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:10.400423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:10.401238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:10.402656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:10.403313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:10.693211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:44:10.693637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:44:10.694544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:44:10.695655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:44:10.696402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:44:10.718902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:10.719513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:10.730008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:10.732279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:10.735030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:10.736177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:10.799280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:10.817394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:10.821091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:10.823419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Getting quotas for project 5f749474bd0a44cdbf3cfa73c4169272. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:10.830676 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-152f8e82-9637-4abc-80e3-2ac898777e04 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.448500 Oct 03 14:44:10.833206 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1476/2980] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:10 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:10.838134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-fd3d75b9-c401-4a95-b9dc-1b5a5f6688d0 req-5bc4e499-b778-40e8-81a7-690ddf885953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce43e55f-6e1c-432f-800c-901fb82d1cfd", "name": "network-vif-deleted", "tag": "5da747a3-7eb2-4c7e-bc19-6a1a57538615"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:10.844057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Getting quotas for user a7c1bee4ce4a46bcbd958ac731a5863e and project 5f749474bd0a44cdbf3cfa73c4169272. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:10.861722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Going to run 2 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:44:10.866719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 7aa062ae-d133-4a61-932a-dde14f6b48f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:10.884334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd3d75b9-c401-4a95-b9dc-1b5a5f6688d0 req-5bc4e499-b778-40e8-81a7-690ddf885953 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:10.884818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd3d75b9-c401-4a95-b9dc-1b5a5f6688d0 req-5bc4e499-b778-40e8-81a7-690ddf885953 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:10.885282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fd3d75b9-c401-4a95-b9dc-1b5a5f6688d0 req-5bc4e499-b778-40e8-81a7-690ddf885953 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:10.927910 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-fd3d75b9-c401-4a95-b9dc-1b5a5f6688d0 req-5bc4e499-b778-40e8-81a7-690ddf885953 service nova] Creating event network-vif-deleted:5da747a3-7eb2-4c7e-bc19-6a1a57538615 for instance ce43e55f-6e1c-432f-800c-901fb82d1cfd on n-h2-781139-2 Oct 03 14:44:10.948206 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-fd3d75b9-c401-4a95-b9dc-1b5a5f6688d0 req-5bc4e499-b778-40e8-81a7-690ddf885953 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113490 Oct 03 14:44:10.948833 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1477/2981] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:10.963455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:10.973039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] [instance: ce43e55f-6e1c-432f-800c-901fb82d1cfd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:10.988776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=7aa062ae-d133-4a61-932a-dde14f6b48f3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:10.990654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:10.990976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:10.991417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:10.992135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:10.999224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:10.999709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:11.049691 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] HTTP exception thrown: Instance ce43e55f-6e1c-432f-800c-901fb82d1cfd could not be found. Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Request method failure captured: Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd HTTP/1.1 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvQ-oTlKyG1BouTRzzhb4dvHljdr_jMCYI_n2lCtktAnxTI2Vpa8NlJp7R1p-dB2od6dcn-x7W2JR0OCtF-nyzcpUwyER7wVp2MvnzwFKwZTVg_Mv_tna4cWF-ow6OVNjG0OqNwvAvweRfYrPzFDdSgseg4-VitxFJ2LIefEKq5rBeg Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c3c4a89df1341f59f41b7547ebcfa22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c3c4a89df1341f59f41b7547ebcfa22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestJSON-1678559217 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6c3c4a89df1341f59f41b7547ebcfa22 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestJSON-1678559217 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 72817942188546d9bb9b64e22c121f16 Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestJSON-1678559217-project Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ce43e55f-6e1c-432f-800c-901fb82d1cfd could not be found. Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'ce43e55f-6e1c-432f-800c-901fb82d1cfd'} Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce43e55f-6e1c-432f-800c-901fb82d1cfd could not be found. Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce43e55f-6e1c-432f-800c-901fb82d1cfd could not be found. Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:44:11.051545 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce43e55f-6e1c-432f-800c-901fb82d1cfd could not be found. Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] Returning 404 to user: Instance ce43e55f-6e1c-432f-800c-901fb82d1cfd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b94b361-e2af-49b0-b825-1ddf47dfd1f3 tempest-ServersTestJSON-1678559217 tempest-ServersTestJSON-1678559217-project] 10.222.0.20 "GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd" status: 404 len: 111 microversion: 2.1 time: 0.096692 Oct 03 14:44:11.056628 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1478/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:10 2022] GET /compute/v2.1/servers/ce43e55f-6e1c-432f-800c-901fb82d1cfd => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:44:11.075140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15b16a41-c706-449c-a846-a6e565af0dfb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2303191f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:11.115780 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3de07e8c-0e50-44e0-887d-64d6aadbfc40 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095642 Oct 03 14:44:11.137138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1505/2983] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:44:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:44:11.146572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:11.148338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:11.206051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:11.206563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:11.207016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:11.207750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:11.208207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:11.208635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:11.210168 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-15b16a41-c706-449c-a846-a6e565af0dfb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/9649b0cf-2ba8-47f8-b2e8-a27c7409f3ec" status: 200 len: 662 microversion: 2.1 time: 0.145647 Oct 03 14:44:11.211083 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1479/2984] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:11 2022] GET /compute/v2.1/images/9649b0cf-2ba8-47f8-b2e8-a27c7409f3ec => generated 662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:11.230865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c5aaa5e4-3a18-4f74-a7ab-5de54f7ec44d req-373de65a-f4b9-4ae6-be4b-df39f2dfb0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-plugged", "status": "completed", "tag": "f24df28a-2ac7-4b48-9b16-7e4ad927f924"}, {"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-plugged", "status": "completed", "tag": "6d38d07f-4e09-4390-929a-ce568815329f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:11.287325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c5aaa5e4-3a18-4f74-a7ab-5de54f7ec44d req-373de65a-f4b9-4ae6-be4b-df39f2dfb0eb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:11.310638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c5aaa5e4-3a18-4f74-a7ab-5de54f7ec44d req-373de65a-f4b9-4ae6-be4b-df39f2dfb0eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:11.311135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c5aaa5e4-3a18-4f74-a7ab-5de54f7ec44d req-373de65a-f4b9-4ae6-be4b-df39f2dfb0eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:11.362109 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c5aaa5e4-3a18-4f74-a7ab-5de54f7ec44d req-373de65a-f4b9-4ae6-be4b-df39f2dfb0eb service nova] Creating event network-vif-plugged:f24df28a-2ac7-4b48-9b16-7e4ad927f924 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:11.362939 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c5aaa5e4-3a18-4f74-a7ab-5de54f7ec44d req-373de65a-f4b9-4ae6-be4b-df39f2dfb0eb service nova] Creating event network-vif-plugged:6d38d07f-4e09-4390-929a-ce568815329f for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:11.385494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c5aaa5e4-3a18-4f74-a7ab-5de54f7ec44d req-373de65a-f4b9-4ae6-be4b-df39f2dfb0eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.163239 Oct 03 14:44:11.394796 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1480/2985] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:11.410182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:11.432005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:11.433603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Searching by: {'deleted': False, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:44:11.486341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:11.486341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:11.486341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:11.489722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:11.489840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:11.490334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:11.542029 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6569e4e-e884-45a8-a220-a3fd9585dc8d tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.145592 Oct 03 14:44:11.546527 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1481/2986] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:44:11 2022] GET /compute/v2.1/servers => generated 675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:11.558736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e69c8f8-b0f6-4dc5-8372-99689f3f5980 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb23066fca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:11.659536 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e69c8f8-b0f6-4dc5-8372-99689f3f5980 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/9649b0cf-2ba8-47f8-b2e8-a27c7409f3ec" status: 200 len: 662 microversion: 2.1 time: 0.111344 Oct 03 14:44:11.660665 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1482/2987] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:11 2022] GET /compute/v2.1/images/9649b0cf-2ba8-47f8-b2e8-a27c7409f3ec => generated 662 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:11.667747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fa4bf5c-010b-4505-b54f-5036635cc47f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:11.668744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fa4bf5c-010b-4505-b54f-5036635cc47f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:11.975084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fa4bf5c-010b-4505-b54f-5036635cc47f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:11.984281 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fa4bf5c-010b-4505-b54f-5036635cc47f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1219 microversion: 2.1 time: 0.321499 Oct 03 14:44:12.010707 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1483/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:11 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1219 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:12.025343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:12.026457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:12.040962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:12.041793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:12.043431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:12.045797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:12.046483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:12.053620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:12.111050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:12.124115 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0543f5d4-fbbb-4094-9e2a-a4aa40cf4e4d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.985434 Oct 03 14:44:12.130083 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1506/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:11 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:12.624812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:12.642727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:12.645966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:12.647197 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df5b138a-d50c-4b90-9419-e60bad298bab tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 0.635135 Oct 03 14:44:12.647779 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1484/2990] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:12 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:13.012582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:13.013557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:13.054358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:13.057421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:13.064590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:13.065759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:13.071111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:13.073363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:13.159998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:13.160871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:13.169030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:13.169768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:13.170361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:13.171274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:13.171882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:13.172658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:13.320574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:13.334680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a6ee2c0-9667-44e6-8a57-e755f6b87386 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1223 microversion: 2.1 time: 0.325880 Oct 03 14:44:13.336092 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1507/2991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:13 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1223 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:13.497775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc613fa-3ea2-40fb-9898-87260b37b158", "name": "network-vif-plugged", "status": "completed", "tag": "4c8a9cf5-7acc-40e3-a7e1-593ffed2746d"}, {"server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "name": "network-vif-plugged", "status": "completed", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}, {"server_uuid": "a49f194d-6be0-48e8-8233-39be860a35a8", "name": "network-vif-plugged", "status": "completed", "tag": "7c8471f7-06b5-4f3a-9af8-5375caf73e59"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:13.519670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:13.528388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:13.529399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:13.529950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:13.578133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] Creating event network-vif-plugged:4c8a9cf5-7acc-40e3-a7e1-593ffed2746d for instance 0fc613fa-3ea2-40fb-9898-87260b37b158 on n-h1-781139-2 Oct 03 14:44:13.585507 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] Creating event network-vif-plugged:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:44:13.587380 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] Creating event network-vif-plugged:7c8471f7-06b5-4f3a-9af8-5375caf73e59 for instance a49f194d-6be0-48e8-8233-39be860a35a8 on n-h1-781139-2 Oct 03 14:44:13.620307 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-43f3ae64-a3d7-4cd8-bb04-a16e64b44b56 req-2d8d00e0-115c-4bc1-b01b-85dc59ff10cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.127074 Oct 03 14:44:13.625884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1508/2992] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:13.678622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:13.679279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:13.688245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:13.688519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:13.688901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:13.704181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:13.708512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:13.709180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:14.041510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:14.060097 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46c4c468-8fe2-4c4a-9418-f6d536e6ec73 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.904958 Oct 03 14:44:14.064690 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1485/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:13 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:14.343505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b37217c-bee5-4517-883e-a8e58eb5a478 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb23084ff70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:14.459293 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b37217c-bee5-4517-883e-a8e58eb5a478 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6d570762-7b8d-4555-a4c0-902b3e6ee614" status: 200 len: 662 microversion: 2.1 time: 0.121193 Oct 03 14:44:14.474019 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1486/2994] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:14 2022] GET /compute/v2.1/images/6d570762-7b8d-4555-a4c0-902b3e6ee614 => generated 662 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:14.488945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:14.497955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:14.534870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:14.535369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:14.537708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:14.539580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:14.540056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:14.540486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:14.690404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:14.705756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:14.720751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:14.722581 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-259c563d-de7e-40f4-9b00-9a6449addc13 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1874 microversion: 2.42 time: 1.050499 Oct 03 14:44:14.723389 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1509/2995] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:13 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1874 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:44:14.747963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34524cc5-173e-4da3-a792-748d74677381 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234ae9040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:14.806770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34524cc5-173e-4da3-a792-748d74677381 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6d570762-7b8d-4555-a4c0-902b3e6ee614" status: 200 len: 662 microversion: 2.1 time: 0.065874 Oct 03 14:44:14.807720 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1510/2996] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:14 2022] GET /compute/v2.1/images/6d570762-7b8d-4555-a4c0-902b3e6ee614 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:15.047109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1092315695", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:15.176903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:44:15.245171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:15.260795 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2b292523-8819-4553-9d03-8e68edfbdcaa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1271 microversion: 2.1 time: 0.784679 Oct 03 14:44:15.262854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1487/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:14 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1271 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:15.274583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:15.277636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:15.297900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:15.299925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:15.300575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:15.302978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:15.304131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:15.305186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:15.824234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:15.828577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:15.845159 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b85386d-52cc-4aa6-b950-b964110850e5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1319 microversion: 2.1 time: 0.579080 Oct 03 14:44:15.845784 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1488/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:15 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:15.864574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:15.865280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:15.893392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:15.895492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:15.896312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:15.898122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:15.899592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:15.901468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:16.021252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:44:16.021771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:44:16.022140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:44:16.022545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:44:16.022950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:44:16.048489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:16.051063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:16.051509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:16.052258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:16.056496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:16.057054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:16.117946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Getting quotas for project f7d6918f8cd24dd4b7dc07a82685f5e9. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:16.126522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Getting quotas for user cc28214adc984a20b2b5cd1c7b6e628c and project f7d6918f8cd24dd4b7dc07a82685f5e9. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:16.164627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:44:16.166365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:16.259906 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68e3335f-415f-40bf-98ce-10ed2e219519 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220134 Oct 03 14:44:16.261138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1511/2999] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:44:16.289176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:16.293829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:16.309620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:16.310114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:16.325209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:16.326161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:16.326650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:16.329014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:16.481559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:16.508379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:16.518486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:16.526573 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d32f05c1-b616-4f40-b7c7-a67ebcd66658 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2830 microversion: 2.42 time: 0.671100 Oct 03 14:44:16.540954 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1489/3000] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:44:15 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2830 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:16.545461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1075372664", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:16.646463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:44:17.302541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:17.338773 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e02018e7-ded8-4fa4-96f2-e150c85569e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1277 microversion: 2.1 time: 1.049389 Oct 03 14:44:17.350626 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1512/3001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:16 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1277 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:17.379714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:17.394444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:17.424886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:17.432278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:17.436327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:17.442204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:17.448118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:17.453370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:18.153526 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a96fe060-523b-4126-acea-7a89247e2224 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.797828 Oct 03 14:44:18.167859 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1513/3002] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:44:17 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a/os-interface => generated 1830 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:44:18.177261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:18.179839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:18.199550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:18.201887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:18.202965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:18.204547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:18.205239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:18.206338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:18.803347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:44:18.804671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:44:18.805403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:44:18.806598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:44:18.807308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:44:18.837391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:18.838548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:18.840312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:18.842186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:18.845470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:18.846199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:18.898398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Getting quotas for project f7d6918f8cd24dd4b7dc07a82685f5e9. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:18.918332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Getting quotas for user cc28214adc984a20b2b5cd1c7b6e628c and project f7d6918f8cd24dd4b7dc07a82685f5e9. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:18.959093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:44:18.968127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:19.101590 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dcb93445-9163-430a-bfc4-de41ddf0a3b5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572799 Oct 03 14:44:19.105418 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1490/3003] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:44:19.117699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:19.120843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:19.162488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:19.163525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:19.166864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:19.170009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:19.170751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:19.172852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:19.430413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:19.441738 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f05deea1-cf24-45c5-bc3c-59d5515c9bd7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1277 microversion: 2.1 time: 0.334874 Oct 03 14:44:19.449457 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1491/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:19 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:19.457776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac51735d-3139-4df5-8cd6-a52c3fad1a81 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:19.460265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac51735d-3139-4df5-8cd6-a52c3fad1a81 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:19.640482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ac51735d-3139-4df5-8cd6-a52c3fad1a81 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:19.657324 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac51735d-3139-4df5-8cd6-a52c3fad1a81 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1218 microversion: 2.1 time: 0.206218 Oct 03 14:44:19.658633 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1492/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:19 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:19.800221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:19.808662 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd9d1f5d-f699-48b7-8930-d0d8c66c9898 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1468 microversion: 2.1 time: 1.639270 Oct 03 14:44:19.809309 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1514/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:18 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1468 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:19.834947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:19.836204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:19.843485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:19.860534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:19.861044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:19.861832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:19.862303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:19.862739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:20.472095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:20.472881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:20.482827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:20.494194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:20.496590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:20.498631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:20.502682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:20.505488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:20.673102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:20.691693 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b067da62-7831-4f5a-b780-f7413486fda3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 200 len: 1469 microversion: 2.1 time: 0.860837 Oct 03 14:44:20.693468 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1493/3007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:19 2022] GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 1469 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:20.707864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:20.708530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:20.728185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:20.728961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:20.732361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:20.733802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:20.736570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:20.737427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:20.782611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:20.794523 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea56eb94-951e-463c-bfc0-4c73511a96aa tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1277 microversion: 2.1 time: 0.326334 Oct 03 14:44:20.795131 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1515/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:20 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1277 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:20.805207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:20.814127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:20.823278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Searching by: {'reservation_id': 'r-805kr8m4', 'deleted': False, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:44:20.838637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:20.844837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:20.845721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:20.848431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:20.851279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:20.851941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:21.066641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:44:21.178669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:21.194607 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed80c45c-d183-48b9-93a5-31ee4ef2a363 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1270 microversion: 2.1 time: 0.498155 Oct 03 14:44:21.214852 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1494/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:20 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1270 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:21.265013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:21.293836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:21.308041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:21.309705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:21.821894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:21.822745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:21.833770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:21.848705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:21.849797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:21.851072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:21.851885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:21.852639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:22.381929 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0407ec00-1a54-42b5-ac97-d4de9d06d72e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-805kr8m4" status: 200 len: 2930 microversion: 2.1 time: 1.580551 Oct 03 14:44:22.384601 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1516/3010] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 3 14:44:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-805kr8m4 => generated 2930 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:22.401751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:22.402729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:22.415127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:22.418959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:22.419689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:22.420746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:22.421433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:22.422085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:22.661488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:22.671452 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c624f629-f370-48c7-8be3-9e56b2c3207a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.854024 Oct 03 14:44:22.676021 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1495/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:21 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:22.689062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c71482d-ccb8-414a-8405-48f29a7de0e9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:22.738680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.server_groups [None req-1c71482d-ccb8-414a-8405-48f29a7de0e9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Querying cell 54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) for 2 instances {{(pid=128868) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 14:44:22.739770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c71482d-ccb8-414a-8405-48f29a7de0e9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:22.740434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c71482d-ccb8-414a-8405-48f29a7de0e9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:22.741212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c71482d-ccb8-414a-8405-48f29a7de0e9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:22.808195 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c71482d-ccb8-414a-8405-48f29a7de0e9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/c2f453d7-d67b-4bf9-ab8c-93f415b40c62" status: 200 len: 266 microversion: 2.1 time: 0.129937 Oct 03 14:44:22.814508 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1496/3012] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:44:22 2022] GET /compute/v2.1/os-server-groups/c2f453d7-d67b-4bf9-ab8c-93f415b40c62 => generated 266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:22.826753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:22.828273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:22.840910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:22.842526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:22.843320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:22.844191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:22.853276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:22.854045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:23.453125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:23.479707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c717c025-8999-44d1-9b2b-6566b94caf79 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1276 microversion: 2.1 time: 1.093690 Oct 03 14:44:23.482346 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1517/3013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:22 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1276 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:23.707649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:23.709200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:23.729688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:23.730520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:23.731878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:23.733145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:23.734395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:23.735603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:23.785918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:23.961199 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-926a731a-1191-4098-830e-d3600a31836f tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 200 len: 1619 microversion: 2.1 time: 1.140098 Oct 03 14:44:23.961810 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1497/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:22 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 1619 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:23.975747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-99413306-8c47-4907-8002-ab6e48aca771 req-bdccede8-a277-4fb7-9b27-4b83c71f81d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "tag": "f24df28a-2ac7-4b48-9b16-7e4ad927f924"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:24.011494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-99413306-8c47-4907-8002-ab6e48aca771 req-bdccede8-a277-4fb7-9b27-4b83c71f81d5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:24.017643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-99413306-8c47-4907-8002-ab6e48aca771 req-bdccede8-a277-4fb7-9b27-4b83c71f81d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:24.021722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-99413306-8c47-4907-8002-ab6e48aca771 req-bdccede8-a277-4fb7-9b27-4b83c71f81d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:24.088775 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-99413306-8c47-4907-8002-ab6e48aca771 req-bdccede8-a277-4fb7-9b27-4b83c71f81d5 service nova] Creating event network-changed:f24df28a-2ac7-4b48-9b16-7e4ad927f924 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:44:24.111671 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-99413306-8c47-4907-8002-ab6e48aca771 req-bdccede8-a277-4fb7-9b27-4b83c71f81d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145308 Oct 03 14:44:24.112303 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1498/3015] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:24.132900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:24.147198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:24.176463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:24.178476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:24.180552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:24.184176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:24.187425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:24.200513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:24.275896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:24.287344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34d49052-b64d-489b-a373-723c01e1e194 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.590130 Oct 03 14:44:24.288859 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1518/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:23 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:24.507648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:24.508525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:24.517911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:24.518416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:24.518861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:24.523735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:24.524281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:24.524712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:24.697679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:24.710232 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f95bf058-9e80-4ccc-8f46-ac37903ed794 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1276 microversion: 2.1 time: 0.206878 Oct 03 14:44:24.710897 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1519/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:24 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:25.314816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:25.315445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:25.323175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:25.324041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:25.324148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:25.324828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:25.325306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:25.325731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:25.701538 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9dc86d3c-8a00-4ded-afe3-d6ba92aeab0d tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 200 len: 1620 microversion: 2.1 time: 1.576095 Oct 03 14:44:25.703803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1499/3018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:24 2022] GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 1620 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:25.731335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-138e86fa-5435-4f97-9c4e-870568688c3e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: .version_select at 0x7fb2308880d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-847096977", "policies": ["anti-affinity"]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:25.766509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-138e86fa-5435-4f97-9c4e-870568688c3e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:25.772888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-138e86fa-5435-4f97-9c4e-870568688c3e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:25.857692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:25.887635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-138e86fa-5435-4f97-9c4e-870568688c3e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:25.910009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-138e86fa-5435-4f97-9c4e-870568688c3e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:25.940878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-138e86fa-5435-4f97-9c4e-870568688c3e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.213720 Oct 03 14:44:25.961579 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1500/3019] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Oct 3 14:44:25 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:25.966962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:25.977937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:25.985775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:25.986523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:25.987167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:25.988422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:25.989290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:25.989896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:26.135317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:26.153760 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-263bbab8-1537-4090-9181-246a611e5019 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.843994 Oct 03 14:44:26.154665 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1520/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:25 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:26.159707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d9cb5605-96f7-430a-a4bb-701ca2bd21c7 req-8a781809-baf3-4bc9-8933-43c9fc9b94ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa062ae-d133-4a61-932a-dde14f6b48f3", "tag": "83321157-a80d-4d63-b6c1-cc6ec0dfd89f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:26.182933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d9cb5605-96f7-430a-a4bb-701ca2bd21c7 req-8a781809-baf3-4bc9-8933-43c9fc9b94ae service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:26.183801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d9cb5605-96f7-430a-a4bb-701ca2bd21c7 req-8a781809-baf3-4bc9-8933-43c9fc9b94ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:26.184384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d9cb5605-96f7-430a-a4bb-701ca2bd21c7 req-8a781809-baf3-4bc9-8933-43c9fc9b94ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:26.206404 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d9cb5605-96f7-430a-a4bb-701ca2bd21c7 req-8a781809-baf3-4bc9-8933-43c9fc9b94ae service nova] Creating event network-changed:83321157-a80d-4d63-b6c1-cc6ec0dfd89f for instance 7aa062ae-d133-4a61-932a-dde14f6b48f3 on n-h2-781139-2 Oct 03 14:44:26.222128 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d9cb5605-96f7-430a-a4bb-701ca2bd21c7 req-8a781809-baf3-4bc9-8933-43c9fc9b94ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065871 Oct 03 14:44:26.223273 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1521/3021] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:26.239491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-568564259", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "606cc9b3-e8bc-44e8-b50c-b56066b5d85b"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:26.323445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:44:26.678527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:44:26.679232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:44:26.679800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:44:26.680114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:44:26.680524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:44:26.706747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:26.707491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:26.708158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:26.709172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:26.709790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:26.710481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:26.766599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:26.784493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:26.818625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Going to run 2 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:44:26.825220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:27.011740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:27.020903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:27.082223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:27.090208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:27.111229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=31ca3b05-1932-4369-b562-7389f07c88fe,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:27.237124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:27.245932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:27.265284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:27.283586 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7f152c7-4ffd-4975-922d-dec01fb6e5dd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 1.320605 Oct 03 14:44:27.292951 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1501/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:25 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:27.320397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:27.324218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:27.334613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:27.349843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:27.352990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:27.353791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:27.354989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:27.357508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:27.358270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:27.426427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:27.454918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'server_group_members'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:27.568884 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ededc432-5a3d-40f3-960e-45ef589613f5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.344144 Oct 03 14:44:27.572182 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1522/3023] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:44:26 2022] POST /compute/v2.1/servers => generated 32 bytes in 1348 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:44:27.589715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:27.604047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:27.606590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Searching by: {'deleted': False, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:44:27.663919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:27.668687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:27.669224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:27.672880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:27.676819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:27.677429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:27.678775 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8c03ba4-d5c4-4bdd-bf92-861f7b02fd19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.384592 Oct 03 14:44:27.679968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:27.685349 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1502/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:27 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:27.763562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:44:27.833992 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ec7bd4d-5324-4213-beab-541963140078 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.260190 Oct 03 14:44:27.841873 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1523/3025] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:44:27 2022] GET /compute/v2.1/servers => generated 1663 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:27.850091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aba96ac1-a796-4613-a321-cea84b860369 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:27.851542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aba96ac1-a796-4613-a321-cea84b860369 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:27.863448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dc66b915-edc7-44a0-9d77-6929576bde83 req-e6b87a7b-ca0a-404a-a2cd-80189cd3cb9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1", "tag": "88432805-1cd9-4545-b41c-15ee430ac3d2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:27.887664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc66b915-edc7-44a0-9d77-6929576bde83 req-e6b87a7b-ca0a-404a-a2cd-80189cd3cb9e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:27.888165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc66b915-edc7-44a0-9d77-6929576bde83 req-e6b87a7b-ca0a-404a-a2cd-80189cd3cb9e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:27.888649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc66b915-edc7-44a0-9d77-6929576bde83 req-e6b87a7b-ca0a-404a-a2cd-80189cd3cb9e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:27.927401 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dc66b915-edc7-44a0-9d77-6929576bde83 req-e6b87a7b-ca0a-404a-a2cd-80189cd3cb9e service nova] Creating event network-changed:88432805-1cd9-4545-b41c-15ee430ac3d2 for instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 on n-h2-781139-2 Oct 03 14:44:27.948961 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dc66b915-edc7-44a0-9d77-6929576bde83 req-e6b87a7b-ca0a-404a-a2cd-80189cd3cb9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089263 Oct 03 14:44:27.949377 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1524/3026] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:44:28.161895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aba96ac1-a796-4613-a321-cea84b860369 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:28.184963 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aba96ac1-a796-4613-a321-cea84b860369 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1218 microversion: 2.1 time: 0.338676 Oct 03 14:44:28.188651 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1503/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:27 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1218 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:28.319327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:28.320405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:28.334944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:28.335434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:28.335874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:28.336588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:28.337061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:28.337478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:28.712212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:28.715412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:28.743766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:28.744280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:28.748892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:28.749873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:28.750348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:28.753602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:28.889721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:29.600804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:29.611864 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75ba779c-3885-432a-b546-11e98154f8fe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 1.296921 Oct 03 14:44:29.612480 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1525/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:28 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:29.624888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:29.628792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:29.646641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:29.649662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:29.651537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:29.656640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:29.657376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:29.657991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:29.883565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:29.895438 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f9c5e145-9557-4db0-bff4-580cd9177699 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 1.189410 Oct 03 14:44:29.897101 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1504/3029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:28 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:29.945821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:29.958844 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a003c87a-05b0-4a9f-a339-4a7948a2893c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1270 microversion: 2.1 time: 0.345250 Oct 03 14:44:29.959417 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1526/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:29 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1270 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:29.985872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c992864f-6c20-43e7-8ccb-06d59e096e30 req-0f64015e-737c-4d00-8702-b0d08cd7e183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dcd21f4-56d1-49e8-8d9d-e1610481c3e8", "tag": "c82f3a3e-6280-47e4-8d68-712c265da167"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:30.007701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c992864f-6c20-43e7-8ccb-06d59e096e30 req-0f64015e-737c-4d00-8702-b0d08cd7e183 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:30.008502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c992864f-6c20-43e7-8ccb-06d59e096e30 req-0f64015e-737c-4d00-8702-b0d08cd7e183 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:30.009145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c992864f-6c20-43e7-8ccb-06d59e096e30 req-0f64015e-737c-4d00-8702-b0d08cd7e183 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:30.039279 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c992864f-6c20-43e7-8ccb-06d59e096e30 req-0f64015e-737c-4d00-8702-b0d08cd7e183 service nova] Creating event network-changed:c82f3a3e-6280-47e4-8d68-712c265da167 for instance 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 on n-h2-781139-2 Oct 03 14:44:30.049599 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c992864f-6c20-43e7-8ccb-06d59e096e30 req-0f64015e-737c-4d00-8702-b0d08cd7e183 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067389 Oct 03 14:44:30.054972 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1505/3031] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:30.642866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:30.644763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:30.658215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:30.664052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:30.664810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:30.665876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:30.669330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:30.670579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:30.929820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:30.931348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:30.945406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:30.945904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:30.946348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:30.951390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:30.954349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:30.955261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:31.714135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:31.730549 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c21f7ce8-997d-4cb0-a298-d4d2bc782316 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 1.092629 Oct 03 14:44:31.731985 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1527/3032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:30 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:31.751280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:31.752511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:31.773571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:31.774095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:31.775750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:31.781508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:31.782368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:31.783182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:31.880463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:31.903395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2469e19-0531-460f-a69b-6b175c2c33a6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1276 microversion: 2.1 time: 0.169058 Oct 03 14:44:31.905832 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1528/3033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:31 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:31.919216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b939b60a-41e0-4380-9fad-da906c42b20b req-adbebde3-979c-4f3a-9243-3aa566e2de9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5551a2d-d830-4659-86a3-517e278ac8e9", "tag": "1978cd53-c8d1-46ad-9e17-feb4deb818da"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:31.953687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b939b60a-41e0-4380-9fad-da906c42b20b req-adbebde3-979c-4f3a-9243-3aa566e2de9f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:31.957133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b939b60a-41e0-4380-9fad-da906c42b20b req-adbebde3-979c-4f3a-9243-3aa566e2de9f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:31.957651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b939b60a-41e0-4380-9fad-da906c42b20b req-adbebde3-979c-4f3a-9243-3aa566e2de9f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:31.984182 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b939b60a-41e0-4380-9fad-da906c42b20b req-adbebde3-979c-4f3a-9243-3aa566e2de9f service nova] Creating event network-changed:1978cd53-c8d1-46ad-9e17-feb4deb818da for instance d5551a2d-d830-4659-86a3-517e278ac8e9 on n-h1-781139-2 Oct 03 14:44:31.992705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b939b60a-41e0-4380-9fad-da906c42b20b req-adbebde3-979c-4f3a-9243-3aa566e2de9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085235 Oct 03 14:44:31.994264 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1529/3034] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:32.745360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:32.755105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:32.755816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:32.760434 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-854687b1-350e-4244-ab89-031598de4a3f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 1.840632 Oct 03 14:44:32.764029 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1506/3035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:30 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:32.781537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:32.782157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:32.782807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:32.783907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:32.784810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:32.786040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:32.929850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:32.930881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:32.955960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:32.956826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:32.957984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:32.959277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:32.960141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:32.961237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:33.148552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:33.175365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:33.183967 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bf81386f-1647-401f-84ac-4e3c49d37912 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1276 microversion: 2.1 time: 0.257256 Oct 03 14:44:33.187851 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1507/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:32 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:33.192350 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d93817ef-137e-4787-abb3-965221fecf98 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.436260 Oct 03 14:44:33.198126 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1530/3037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:32 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:33.579127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:33.580013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:33.594840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:33.595651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:33.596883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:33.599081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:33.599576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:33.600015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:33.792693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:33.793515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:33.806876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:33.807448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:33.808026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:33.809167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:33.809688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:33.810117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:34.476607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:34.495194 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74837d77-84ac-403c-8f54-fd959d8ab849 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.712017 Oct 03 14:44:34.497922 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1531/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:33 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:34.511805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:34.515562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:34.529430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:34.532664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:34.533424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:34.535232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:34.537076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:34.537866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:34.695792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:34.714265 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c15c3c7-0f03-4d57-ad99-deafa23740e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1276 microversion: 2.1 time: 0.212944 Oct 03 14:44:34.715547 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1532/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:34 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:34.727181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:34.731842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:34.747539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:34.748081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:34.748826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:34.751017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:34.751498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:34.753049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:34.797686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:34.817597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ceabf38-3104-4a0a-819b-ecae52c5576c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 1.238803 Oct 03 14:44:34.822487 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1508/3040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:33 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:34.846563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-779300986"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:34.849951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:34.857592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:34.858994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:34.860526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:34.861779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:34.862466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:34.863105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:35.158794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:35.222907 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46928da9-6c0f-4d1e-b6c4-2bf4a3236081 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.381394 Oct 03 14:44:35.228632 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1509/3041] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:44:34 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 03 14:44:35.251774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:35.252947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:35.268596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:35.272559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:35.273276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:35.275049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:35.279708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:35.281017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:35.685269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:35.698551 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-945a3d7d-ee71-4f82-8958-d57146b8c5ec tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.981626 Oct 03 14:44:35.699332 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1533/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:34 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:35.732855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:35.735472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:35.752653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:35.761309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:35.767845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:35.770539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:35.771435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:35.774928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:36.067404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:36.083039 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ac0a3e7-db97-439c-994b-ad09210e3a5d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.849856 Oct 03 14:44:36.083967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1510/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:35 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:36.093568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:36.094445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:36.103822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:36.105520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:36.106473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:36.106966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:36.107926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:36.108958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:36.109603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:36.120401 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a818a6e6-e045-4209-958f-b82e938d3b52 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.400851 Oct 03 14:44:36.123234 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1534/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:35 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:36.632535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d417a930-5065-4c5f-a89a-cea8328d50db req-7d689c26-5069-4d3c-9848-9a85356bcdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa062ae-d133-4a61-932a-dde14f6b48f3", "name": "network-vif-plugged", "status": "completed", "tag": "83321157-a80d-4d63-b6c1-cc6ec0dfd89f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:36.652138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d417a930-5065-4c5f-a89a-cea8328d50db req-7d689c26-5069-4d3c-9848-9a85356bcdaa service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:36.653304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d417a930-5065-4c5f-a89a-cea8328d50db req-7d689c26-5069-4d3c-9848-9a85356bcdaa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:36.654398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d417a930-5065-4c5f-a89a-cea8328d50db req-7d689c26-5069-4d3c-9848-9a85356bcdaa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:36.673318 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d417a930-5065-4c5f-a89a-cea8328d50db req-7d689c26-5069-4d3c-9848-9a85356bcdaa service nova] Creating event network-vif-plugged:83321157-a80d-4d63-b6c1-cc6ec0dfd89f for instance 7aa062ae-d133-4a61-932a-dde14f6b48f3 on n-h2-781139-2 Oct 03 14:44:36.681876 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d417a930-5065-4c5f-a89a-cea8328d50db req-7d689c26-5069-4d3c-9848-9a85356bcdaa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053440 Oct 03 14:44:36.683287 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1535/3045] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:44:36.698254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:36.725056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:36.726373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:36.738679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:36.738922 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0d382f74-ebe4-4f81-b837-cc03aa193c66 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.653612 Oct 03 14:44:36.739332 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1511/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:36 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:36.758160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:36.759160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:36.760219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:36.761023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:36.761597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:37.113226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:37.113903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:37.127687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:37.132611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:37.133432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:37.134812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:37.136441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:37.137198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:37.178386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:37.198343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b031df68-9942-464d-937a-8b8a4ddb71bb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.478084 Oct 03 14:44:37.219846 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1536/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:36 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:37.234085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:37.235245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:37.246854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:37.247397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:37.247835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:37.248855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:37.249331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:37.253194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:37.445212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:37.455200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35c94c6c-0f78-4436-a955-b9f93c114290 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.232887 Oct 03 14:44:37.470940 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1537/3048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:37 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:37.770378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:37.771037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:37.773290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:37.776904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:37.789859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:37.791130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:37.791571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:37.792868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:37.794290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:37.797082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:37.803502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:38.142267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:38.152079 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3acd3ee1-aa10-4c4b-bc67-a54afd981d37 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.390489 Oct 03 14:44:38.153128 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1538/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:37 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:38.183214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=20 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:38.229936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:38.230730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:38.246181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:38.246798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:38.247567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:38.248367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:38.248891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:38.249485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:38.392870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:38.413539 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-41f3fd2a-c8ed-43e5-85b7-c61fdee3922d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 1.305470 Oct 03 14:44:38.417504 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1512/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:37 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:38.492239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:38.502061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:38.502596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:38.509600 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bc4b398-2884-4a03-b478-734fb993abc4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.284238 Oct 03 14:44:38.511051 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1539/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:38 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:38.521947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:38.522654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:38.523159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:38.524344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:38.525249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:38.525779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:38.748730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1835e34b-1eb8-4781-acab-8554add8573b req-2d0970cd-0411-4900-8039-679e69e90579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "name": "network-vif-unplugged", "status": "completed", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:38.799205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1835e34b-1eb8-4781-acab-8554add8573b req-2d0970cd-0411-4900-8039-679e69e90579 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:38.799849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1835e34b-1eb8-4781-acab-8554add8573b req-2d0970cd-0411-4900-8039-679e69e90579 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:38.800102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1835e34b-1eb8-4781-acab-8554add8573b req-2d0970cd-0411-4900-8039-679e69e90579 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:38.816957 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1835e34b-1eb8-4781-acab-8554add8573b req-2d0970cd-0411-4900-8039-679e69e90579 service nova] Creating event network-vif-unplugged:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:44:38.822562 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1835e34b-1eb8-4781-acab-8554add8573b req-2d0970cd-0411-4900-8039-679e69e90579 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078182 Oct 03 14:44:38.824041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1540/3052] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:44:39.182672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:39.183655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:39.193106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:39.194159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:39.194851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:39.204483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:39.205883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:39.207354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:39.481992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:39.492013 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2ad31b5-6cb3-48f0-a1db-0eecdb673637 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.316510 Oct 03 14:44:39.494736 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1541/3053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:39 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:39.512169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:39.516370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:39.517607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:39.523043 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a41babd-4659-45b2-8778-73794d2830ac tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 1.045738 Oct 03 14:44:39.537093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:39.537352 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1513/3054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:38 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:39.537457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:39.537457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:39.537457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:39.537457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:39.537457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:39.546967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:39.548127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:39.558128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:39.567127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:39.567673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:39.568694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:39.569204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:39.569749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:39.740586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:39.752151 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-091b6b60-63a1-4477-8af9-fb6b4091c8a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.256112 Oct 03 14:44:39.757738 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1542/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:39 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:40.525778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:40.527121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:40.534490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:40.535548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:40.536227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:40.537818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:40.538618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:40.539265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:40.700000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:40.715127 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e91c49d-431c-4727-91f2-4a285c653760 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 1.172948 Oct 03 14:44:40.717355 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1514/3056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:39 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:40.722524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:40.723312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:40.731223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:40.732085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:40.732810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:40.735337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:40.736700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:40.739811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:41.066719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:41.076427 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c40f8dc-4438-4698-9f39-6215b1dae08d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.555854 Oct 03 14:44:41.077095 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1543/3057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:40 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:41.089580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:41.090112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:41.110445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:41.110919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:41.111355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:41.112174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:41.112626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:41.113067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:41.295550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:41.309024 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d0e260c7-38cc-4762-9efd-6fd6838d53e2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.590230 Oct 03 14:44:41.310723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1515/3058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:40 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:41.326230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d2e8c0f9-8b86-4150-a58f-6cf4284bdbd7 req-95248984-4322-4901-9edd-14d2666f3d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1", "name": "network-vif-plugged", "status": "completed", "tag": "88432805-1cd9-4545-b41c-15ee430ac3d2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:41.347856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d2e8c0f9-8b86-4150-a58f-6cf4284bdbd7 req-95248984-4322-4901-9edd-14d2666f3d3a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:41.353295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d2e8c0f9-8b86-4150-a58f-6cf4284bdbd7 req-95248984-4322-4901-9edd-14d2666f3d3a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:41.353960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d2e8c0f9-8b86-4150-a58f-6cf4284bdbd7 req-95248984-4322-4901-9edd-14d2666f3d3a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:41.382476 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d2e8c0f9-8b86-4150-a58f-6cf4284bdbd7 req-95248984-4322-4901-9edd-14d2666f3d3a service nova] Creating event network-vif-plugged:88432805-1cd9-4545-b41c-15ee430ac3d2 for instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 on n-h2-781139-2 Oct 03 14:44:41.390870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d2e8c0f9-8b86-4150-a58f-6cf4284bdbd7 req-95248984-4322-4901-9edd-14d2666f3d3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078660 Oct 03 14:44:41.400550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1516/3059] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:41.485562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:41.496433 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa3291a7-49fb-4e6f-a7fb-435789e5cda0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1686 microversion: 2.1 time: 0.418153 Oct 03 14:44:41.505142 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1544/3060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:41 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1686 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:41.750689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:41.751392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:41.763271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:41.767835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:41.768438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:41.769411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:41.770041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:41.772089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:41.823383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f6876f07-221e-480c-87a9-70f6618a84be req-19c7b9bc-b4cb-4176-b31c-5847e542d00e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ca3b05-1932-4369-b562-7389f07c88fe", "tag": "840388eb-c55c-4380-8700-3834eb580c61"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:41.844271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f6876f07-221e-480c-87a9-70f6618a84be req-19c7b9bc-b4cb-4176-b31c-5847e542d00e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:41.845224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f6876f07-221e-480c-87a9-70f6618a84be req-19c7b9bc-b4cb-4176-b31c-5847e542d00e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:41.846559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f6876f07-221e-480c-87a9-70f6618a84be req-19c7b9bc-b4cb-4176-b31c-5847e542d00e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:41.873293 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f6876f07-221e-480c-87a9-70f6618a84be req-19c7b9bc-b4cb-4176-b31c-5847e542d00e service nova] Creating event network-changed:840388eb-c55c-4380-8700-3834eb580c61 for instance 31ca3b05-1932-4369-b562-7389f07c88fe on n-h2-781139-2 Oct 03 14:44:41.884532 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f6876f07-221e-480c-87a9-70f6618a84be req-19c7b9bc-b4cb-4176-b31c-5847e542d00e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065323 Oct 03 14:44:41.894467 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1545/3061] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:44:42.105239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:42.106305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:42.117498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:42.120869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:42.121527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:42.124310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:42.125501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:42.132755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:42.472976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:42.484567 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e133d05f-901b-41a3-b72b-d4aba505bc97 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.737950 Oct 03 14:44:42.497689 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1517/3062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:41 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:42.507336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:42.508328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:42.518545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:42.519582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:42.520310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:42.521280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:42.522004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:42.522654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:43.044553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:43.060078 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40b21053-b0ed-46c0-a0e6-3db4324f0031 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.958593 Oct 03 14:44:43.061389 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1546/3063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:42 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:43.066718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:43.067873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:43.074926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:43.075980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:43.077182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:43.078394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:43.079021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:43.079729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:43.258069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:43.288433 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-41bb9df8-9aa4-4c72-8605-ceff3a091732 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.788646 Oct 03 14:44:43.304176 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1518/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:42 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:43.465460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-855a0309-ddd8-4804-b9fc-cdcbd94f4b24 req-0b2daacc-0589-4c2b-9eb6-047c7fb8826c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcd21f4-56d1-49e8-8d9d-e1610481c3e8", "name": "network-vif-plugged", "status": "completed", "tag": "c82f3a3e-6280-47e4-8d68-712c265da167"}, {"server_uuid": "d5551a2d-d830-4659-86a3-517e278ac8e9", "name": "network-vif-plugged", "status": "completed", "tag": "1978cd53-c8d1-46ad-9e17-feb4deb818da"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:43.488099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-855a0309-ddd8-4804-b9fc-cdcbd94f4b24 req-0b2daacc-0589-4c2b-9eb6-047c7fb8826c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:43.488996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-855a0309-ddd8-4804-b9fc-cdcbd94f4b24 req-0b2daacc-0589-4c2b-9eb6-047c7fb8826c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:43.489579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-855a0309-ddd8-4804-b9fc-cdcbd94f4b24 req-0b2daacc-0589-4c2b-9eb6-047c7fb8826c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:43.529510 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-855a0309-ddd8-4804-b9fc-cdcbd94f4b24 req-0b2daacc-0589-4c2b-9eb6-047c7fb8826c service nova] Creating event network-vif-plugged:c82f3a3e-6280-47e4-8d68-712c265da167 for instance 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 on n-h2-781139-2 Oct 03 14:44:43.529839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-855a0309-ddd8-4804-b9fc-cdcbd94f4b24 req-0b2daacc-0589-4c2b-9eb6-047c7fb8826c service nova] Creating event network-vif-plugged:1978cd53-c8d1-46ad-9e17-feb4deb818da for instance d5551a2d-d830-4659-86a3-517e278ac8e9 on n-h1-781139-2 Oct 03 14:44:43.555359 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-855a0309-ddd8-4804-b9fc-cdcbd94f4b24 req-0b2daacc-0589-4c2b-9eb6-047c7fb8826c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094135 Oct 03 14:44:43.557016 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1519/3065] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:44:43.562973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:43.564192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:43.572616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:43.573739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:43.574362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:43.575229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:43.575831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:43.576413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:43.670777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:43.683393 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb633c31-96b9-44ce-a1a5-336442a616a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1686 microversion: 2.1 time: 0.620463 Oct 03 14:44:43.691194 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1547/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:43 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1686 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:44.089272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:44.090570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:44.106650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:44.119945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:44.121939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:44.124085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:44.127964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:44.128815 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0de51c64-e2c3-4e0e-92a7-ab29a5ece302 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.569737 Oct 03 14:44:44.129357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:44.130143 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1520/3067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:43 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:44.131009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:44.143835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-818b5dbe-3c85-4158-bf24-11f598b1738f req-d9235463-d920-44df-b47f-a9c77005fbdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0531b4ab-731f-4324-8b97-e6ea2062f070", "tag": "fc227bf5-4d13-48dd-9526-dcf6a79c8f67"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:44.174729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-818b5dbe-3c85-4158-bf24-11f598b1738f req-d9235463-d920-44df-b47f-a9c77005fbdc service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:44.177520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-818b5dbe-3c85-4158-bf24-11f598b1738f req-d9235463-d920-44df-b47f-a9c77005fbdc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:44.180847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-818b5dbe-3c85-4158-bf24-11f598b1738f req-d9235463-d920-44df-b47f-a9c77005fbdc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:44.226268 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-818b5dbe-3c85-4158-bf24-11f598b1738f req-d9235463-d920-44df-b47f-a9c77005fbdc service nova] Creating event network-changed:fc227bf5-4d13-48dd-9526-dcf6a79c8f67 for instance 0531b4ab-731f-4324-8b97-e6ea2062f070 on n-h1-781139-2 Oct 03 14:44:44.252507 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-818b5dbe-3c85-4158-bf24-11f598b1738f req-d9235463-d920-44df-b47f-a9c77005fbdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105898 Oct 03 14:44:44.256146 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1521/3068] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:44.320994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:44.321746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:44.333377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:44.337844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:44.340280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:44.341588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:44.344108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:44.344761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:44.450718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:44.461812 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e80f1ee7-21d1-4339-8bf8-325d836627b3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.380049 Oct 03 14:44:44.462907 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1548/3069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:44 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:44.574894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:44.591328 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-adc66f88-c756-458e-9733-39e842cfe2d8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.278435 Oct 03 14:44:44.592765 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1522/3070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:44 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:44.725417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:44.727565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:44.745648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:44.746431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:44.747058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:44.748283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:44.749700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:44.750414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:45.031881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:45.044873 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad3c0751-f825-481a-a451-091a355d0d9d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1686 microversion: 2.1 time: 0.326038 Oct 03 14:44:45.055614 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1549/3071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:44 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1686 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:45.153595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:45.154501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:45.162039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:45.162772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:45.163396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:45.164263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:45.164882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:45.165480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:45.485701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:45.486579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:45.498787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:45.500296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:45.501841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:45.502960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:45.504903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:45.506293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:45.606285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:45.622373 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25ab72a6-770d-4d26-ac03-8c0781763a32 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.472460 Oct 03 14:44:45.623577 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1523/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:45 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:45.629482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:45.631072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:45.640236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:45.641172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:45.642113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:45.643548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:45.644146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:45.644665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:46.106194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:46.115987 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e70e4244-29e7-44d5-8e4f-cad88ba7dd78 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.635162 Oct 03 14:44:46.118949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1550/3073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:45 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:46.130965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:46.132025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:46.145178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:46.147671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:46.149463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:46.149917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:46.150637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:46.151089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:46.151623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:46.158376 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-454fd4fc-4be8-4918-a1b4-0456e3e7fc7e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1319 microversion: 2.1 time: 0.533305 Oct 03 14:44:46.159230 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1524/3074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:45 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:46.651237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:46.651881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:46.663945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:46.665299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:46.666417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:46.668655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:46.669542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:46.670896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:46.737418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:46.755844 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0327e7e5-a2c6-42e8-8884-a8b0772923c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1686 microversion: 2.1 time: 0.634618 Oct 03 14:44:46.757573 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1551/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:46 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1686 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:46.914759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f8dd8266-2ee0-4e0e-bf20-b4fcceffbeb0 req-b42c3eec-8800-4051-8174-ed0256601ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "name": "network-vif-plugged", "status": "completed", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:46.941200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f8dd8266-2ee0-4e0e-bf20-b4fcceffbeb0 req-b42c3eec-8800-4051-8174-ed0256601ee9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:46.941807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f8dd8266-2ee0-4e0e-bf20-b4fcceffbeb0 req-b42c3eec-8800-4051-8174-ed0256601ee9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:46.942390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f8dd8266-2ee0-4e0e-bf20-b4fcceffbeb0 req-b42c3eec-8800-4051-8174-ed0256601ee9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:46.988478 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f8dd8266-2ee0-4e0e-bf20-b4fcceffbeb0 req-b42c3eec-8800-4051-8174-ed0256601ee9 service nova] Creating event network-vif-plugged:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:44:47.003786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f8dd8266-2ee0-4e0e-bf20-b4fcceffbeb0 req-b42c3eec-8800-4051-8174-ed0256601ee9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091687 Oct 03 14:44:47.006635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1552/3076] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:47.143607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:47.145336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:47.153995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:47.173893 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c880838a-e665-4d99-872d-5084be0e4a17 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.522649 Oct 03 14:44:47.175496 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1525/3077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:46 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:47.176132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.176910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.178300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.180694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.182293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.183654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.192211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:47.192961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:47.210745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.211276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.211668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.213608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.216894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.217680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.500528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:47.524679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:47.541580 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af65c4dd-609c-45a0-8959-28686e1fa2ea tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.405471 Oct 03 14:44:47.542197 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1553/3078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:47 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:47.557229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce11987e-383f-4685-8948-5ac19b8022e7 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 200 len: 1507 microversion: 2.1 time: 0.368458 Oct 03 14:44:47.565744 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1526/3079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:47 2022] GET /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:47.587811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:47.588434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 7aa062ae-d133-4a61-932a-dde14f6b48f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:47.603839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.604350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.604797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.608474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.608965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.609409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.790960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:47.798979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:47.812990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.814485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.815206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.817091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:47.818008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:47.818743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:47.974767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:47.990448 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb9220dd-7452-4628-9212-4633ff166e89 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/7aa062ae-d133-4a61-932a-dde14f6b48f3" status: 200 len: 1507 microversion: 2.1 time: 0.406882 Oct 03 14:44:47.992977 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1554/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:47 2022] GET /compute/v2.1/servers/7aa062ae-d133-4a61-932a-dde14f6b48f3 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:48.020776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:48.026273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 7aa062ae-d133-4a61-932a-dde14f6b48f3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:48.040737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.044326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.045445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:48.048283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.048980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.055768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:48.095526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 7aa062ae-d133-4a61-932a-dde14f6b48f3] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:44:48.179151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:48.310093 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a88943d5-9069-4803-aecd-c50f4b9a36a1 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7aa062ae-d133-4a61-932a-dde14f6b48f3" status: 204 len: 0 microversion: 2.1 time: 0.292922 Oct 03 14:44:48.311198 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1555/3081] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:48 2022] DELETE /compute/v2.1/servers/7aa062ae-d133-4a61-932a-dde14f6b48f3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:44:48.327195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:48.330486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:48.341472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.343243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.343919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:48.344917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.345626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.346484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:48.569649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:48.606443 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54cc1c90-7ae3-4d22-939b-e1f7d6f84bc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1686 microversion: 2.1 time: 0.823246 Oct 03 14:44:48.607663 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1527/3082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:47 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1686 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:48.629747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:48.630276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:48.651010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.659002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.660047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:48.661071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.662141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.664660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:48.669979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:48.736067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:48.757864 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4102b21-5e40-4cfa-a802-d6501f23ec75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1318 microversion: 2.1 time: 0.442653 Oct 03 14:44:48.759335 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1556/3083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:48 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:48.775569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:44:48.831287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:48.834959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:48.862229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.863116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.863715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:48.866247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:48.866928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:48.867536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:49.121952 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d9e0a395-02be-464e-9c51-06857d1817d2 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8" status: 204 len: 0 microversion: 2.1 time: 0.512811 Oct 03 14:44:49.127424 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1528/3084] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:44:48 2022] DELETE /compute/v2.1/servers/1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:44:49.409819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1498689231", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "727e60bd-9b1a-4d2d-bfee-b996753158b7"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:49.531306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:49.540723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d07f229-33e1-4957-965f-ab2faeea58d9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.765028 Oct 03 14:44:49.553356 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1557/3085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:48 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:49.635922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] validate_networks() for [('727e60bd-9b1a-4d2d-bfee-b996753158b7', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:44:49.637353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:49.638392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:49.666952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:49.667527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:49.667982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:49.673444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:49.676186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:49.678824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:50.678305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:50.707747 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e422df40-0595-4f8a-b706-7f6e6031cd31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 1.074978 Oct 03 14:44:50.713072 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1558/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:49 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:44:50.730175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:50.732668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:50.753950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:50.758032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:50.758954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:50.762852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:50.763686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:50.767560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:51.447064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:51.457040 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c04d1738-447b-4e5c-b71f-729f899c1acb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1468 microversion: 2.1 time: 0.742429 Oct 03 14:44:51.465764 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1559/3087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:50 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1468 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:51.852464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d48fb85-9b87-454a-a207-758d6f9fa624 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb234a87940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-509411953", "description": "tempest-description-943313277"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:52.872160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:44:52.873198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:44:52.874303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:44:52.874935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:44:52.875518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:44:52.924526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:52.936945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:52.942376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:52.951009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:52.955605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:52.957808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:53.083534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Getting quotas for project 5f749474bd0a44cdbf3cfa73c4169272. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:53.115976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Getting quotas for user a7c1bee4ce4a46bcbd958ac731a5863e and project 5f749474bd0a44cdbf3cfa73c4169272. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:53.219151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Going to run 2 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:44:53.234791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:53.424281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=a5b0aaee-0779-4485-ab6b-eb253a86c235,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:53.428236 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d48fb85-9b87-454a-a207-758d6f9fa624 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.957723 Oct 03 14:44:53.430373 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1560/3088] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:44:51 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:53.435582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:53.437171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:53.460588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:53.462544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:53.463186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:53.469695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:53.474827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:53.476498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:53.652082 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3af7ac5e-9d92-4419-9ca9-5be0da3d98d6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.242911 Oct 03 14:44:53.663615 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1529/3089] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:44:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 4264 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 03 14:44:53.688763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:53.690418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:53.712845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:53.735476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:53.736678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:53.740214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:53.750041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:53.751379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:54.196284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:54.217707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16c1f5d4-34ce-4b87-8058-3c847863579c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.782460 Oct 03 14:44:54.242900 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1561/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:53 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:54.257793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:54.259746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:54.277214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:54.278007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:54.278739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:54.279844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:54.281250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:54.282926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:54.291366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:54.304772 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5385b68e-37dc-4190-a041-c428eaa04a90 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 1467 microversion: 2.1 time: 0.635427 Oct 03 14:44:54.305803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1530/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:53 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 1467 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:54.316989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6cd2aad4-28ed-4cd0-9695-a744b43625fc req-819a50ca-e8c7-4aaa-ae9c-5734364a7db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa062ae-d133-4a61-932a-dde14f6b48f3", "name": "network-vif-deleted", "tag": "83321157-a80d-4d63-b6c1-cc6ec0dfd89f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:54.340063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cd2aad4-28ed-4cd0-9695-a744b43625fc req-819a50ca-e8c7-4aaa-ae9c-5734364a7db8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:54.341665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cd2aad4-28ed-4cd0-9695-a744b43625fc req-819a50ca-e8c7-4aaa-ae9c-5734364a7db8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:54.342553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cd2aad4-28ed-4cd0-9695-a744b43625fc req-819a50ca-e8c7-4aaa-ae9c-5734364a7db8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:54.378262 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6cd2aad4-28ed-4cd0-9695-a744b43625fc req-819a50ca-e8c7-4aaa-ae9c-5734364a7db8 service nova] Creating event network-vif-deleted:83321157-a80d-4d63-b6c1-cc6ec0dfd89f for instance 7aa062ae-d133-4a61-932a-dde14f6b48f3 on n-h2-781139-2 Oct 03 14:44:54.398626 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6cd2aad4-28ed-4cd0-9695-a744b43625fc req-819a50ca-e8c7-4aaa-ae9c-5734364a7db8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089848 Oct 03 14:44:54.399167 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1531/3092] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:54.425295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0bd21571-b06b-4907-86ad-e7a0909ac9e3 req-d41d6ee0-52be-41a7-ae5c-bdcb5d2bd707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ca3b05-1932-4369-b562-7389f07c88fe", "name": "network-vif-plugged", "status": "completed", "tag": "840388eb-c55c-4380-8700-3834eb580c61"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:54.458315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0bd21571-b06b-4907-86ad-e7a0909ac9e3 req-d41d6ee0-52be-41a7-ae5c-bdcb5d2bd707 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:54.489411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0bd21571-b06b-4907-86ad-e7a0909ac9e3 req-d41d6ee0-52be-41a7-ae5c-bdcb5d2bd707 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:54.489411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0bd21571-b06b-4907-86ad-e7a0909ac9e3 req-d41d6ee0-52be-41a7-ae5c-bdcb5d2bd707 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:54.519579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0bd21571-b06b-4907-86ad-e7a0909ac9e3 req-d41d6ee0-52be-41a7-ae5c-bdcb5d2bd707 service nova] Creating event network-vif-plugged:840388eb-c55c-4380-8700-3834eb580c61 for instance 31ca3b05-1932-4369-b562-7389f07c88fe on n-h2-781139-2 Oct 03 14:44:54.534352 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0bd21571-b06b-4907-86ad-e7a0909ac9e3 req-d41d6ee0-52be-41a7-ae5c-bdcb5d2bd707 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119658 Oct 03 14:44:54.535156 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1532/3093] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:54.557477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c66a11e8-7472-408d-b6bb-6c66c0e4f042 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb23089b9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2120219085", "description": "tempest-description-1983285943"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:55.015659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:55.037108 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9f70489-c3ba-4bee-9553-b5a73874caaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.790636 Oct 03 14:44:55.038066 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1562/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:54 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:55.049386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:55.074556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:55.075808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Searching by: {'deleted': False, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:44:55.135968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:55.136669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:55.137242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:55.138078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:55.138702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:55.139339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:55.178311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:44:55.222369 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b05b772-6c03-45ab-8c83-48236f98286a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.181545 Oct 03 14:44:55.223441 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1563/3095] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:44:55 2022] GET /compute/v2.1/servers => generated 673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:55.234736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-06d2fa37-33e7-4745-87c8-298f2bf81e5b req-82c69141-52a6-4d5b-b3fc-bb99ce353407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcd21f4-56d1-49e8-8d9d-e1610481c3e8", "name": "network-vif-deleted", "tag": "c82f3a3e-6280-47e4-8d68-712c265da167"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:55.252399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-06d2fa37-33e7-4745-87c8-298f2bf81e5b req-82c69141-52a6-4d5b-b3fc-bb99ce353407 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:55.254548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-06d2fa37-33e7-4745-87c8-298f2bf81e5b req-82c69141-52a6-4d5b-b3fc-bb99ce353407 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:55.255666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-06d2fa37-33e7-4745-87c8-298f2bf81e5b req-82c69141-52a6-4d5b-b3fc-bb99ce353407 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:55.276855 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-06d2fa37-33e7-4745-87c8-298f2bf81e5b req-82c69141-52a6-4d5b-b3fc-bb99ce353407 service nova] Creating event network-vif-deleted:c82f3a3e-6280-47e4-8d68-712c265da167 for instance 1dcd21f4-56d1-49e8-8d9d-e1610481c3e8 on n-h2-781139-2 Oct 03 14:44:55.285180 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-06d2fa37-33e7-4745-87c8-298f2bf81e5b req-82c69141-52a6-4d5b-b3fc-bb99ce353407 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060257 Oct 03 14:44:55.286310 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1564/3096] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:55.294605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1513169034"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:55.298462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:55.309728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:55.313631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:55.314629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:55.316123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:55.317823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:55.318580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:55.319413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:55.504380 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c66a11e8-7472-408d-b6bb-6c66c0e4f042 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.955310 Oct 03 14:44:55.505967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1533/3097] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:44:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:44:55.516356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cabf34b5-fa8a-449c-b400-2b6a86dc816e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:55.521316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cabf34b5-fa8a-449c-b400-2b6a86dc816e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:55.533047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:55.735600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cabf34b5-fa8a-449c-b400-2b6a86dc816e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:55.747658 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cabf34b5-fa8a-449c-b400-2b6a86dc816e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1218 microversion: 2.1 time: 0.239944 Oct 03 14:44:55.748769 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1534/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:55 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:55.761723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:55.764318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:55.792043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:55.793590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:55.794208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:55.797168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:55.802899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:55.807116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:55.970284 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b623e39f-49d7-47db-b484-cbf3c08a80ee tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "POST /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1/action" status: 202 len: 0 microversion: 2.1 time: 0.676528 Oct 03 14:44:55.971160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1565/3099] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:44:55 2022] POST /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:44:55.994999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1896022525", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "a6abdc5d-92e2-4981-9b71-44c3cc5ea3ec"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:56.196535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] validate_networks() for [('a6abdc5d-92e2-4981-9b71-44c3cc5ea3ec', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:44:56.266391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:56.277099 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3de4a60d-93e0-4510-b60e-77d8c25b4ce3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.526276 Oct 03 14:44:56.289991 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1535/3100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:55 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:56.300550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-385e78d2-d95e-41ac-a213-1f0b2d5b48dc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2309684c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:56.359771 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-385e78d2-d95e-41ac-a213-1f0b2d5b48dc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657" status: 200 len: 1455 microversion: 2.1 time: 0.068481 Oct 03 14:44:56.361144 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1536/3101] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:56 2022] GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:56.367210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:56.368019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:56.376322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:56.377347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:56.378260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:56.379360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:56.380001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:56.380828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:56.738405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:56.749910 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f1bc307-6338-4a76-bda8-169423489863 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.387519 Oct 03 14:44:56.750743 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1537/3102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:56 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:56.783358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:56.786846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:56.802464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:56.803045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:56.803511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:56.804259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:56.807575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:56.808239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:56.998191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:57.022154 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6189c120-c776-4be4-a2c7-46e93bd9cff6 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1214 microversion: 2.1 time: 0.248662 Oct 03 14:44:57.022759 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1538/3103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:56 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:57.166444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b2523084-e6da-4274-8166-a427b5fd69b4 req-a19d21dc-b189-4a46-b831-13d9e4bdd6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0531b4ab-731f-4324-8b97-e6ea2062f070", "name": "network-vif-plugged", "status": "completed", "tag": "fc227bf5-4d13-48dd-9526-dcf6a79c8f67"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:44:57.184143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b2523084-e6da-4274-8166-a427b5fd69b4 req-a19d21dc-b189-4a46-b831-13d9e4bdd6e9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:57.184907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b2523084-e6da-4274-8166-a427b5fd69b4 req-a19d21dc-b189-4a46-b831-13d9e4bdd6e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:57.193155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b2523084-e6da-4274-8166-a427b5fd69b4 req-a19d21dc-b189-4a46-b831-13d9e4bdd6e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:57.269562 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b2523084-e6da-4274-8166-a427b5fd69b4 req-a19d21dc-b189-4a46-b831-13d9e4bdd6e9 service nova] Creating event network-vif-plugged:fc227bf5-4d13-48dd-9526-dcf6a79c8f67 for instance 0531b4ab-731f-4324-8b97-e6ea2062f070 on n-h1-781139-2 Oct 03 14:44:57.279119 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b2523084-e6da-4274-8166-a427b5fd69b4 req-a19d21dc-b189-4a46-b831-13d9e4bdd6e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116329 Oct 03 14:44:57.279490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1539/3104] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:44:57.315267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:57.316016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:57.346646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:57.347147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:57.360133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:57.361232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:57.363237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:57.363480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:58.047506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:44:58.048584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:44:58.049430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:44:58.050080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:44:58.050715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:44:58.063524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:58.064236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:58.064993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:58.066073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:58.066721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:58.067562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:58.090722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Getting quotas for project c96c546d1de748f2bffb076294563a51. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:44:58.111975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Getting quotas for user 9c4d609f3be34d37936ff6970113e911 and project c96c546d1de748f2bffb076294563a51. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:44:58.137361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:58.146250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:44:58.148784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:44:58.149891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a7eb9b17-307a-4b80-a4ed-a7c8bd627c93 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 0.850758 Oct 03 14:44:58.151427 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1540/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:57 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:58.179513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4eb5ef0a-433d-4ba5-a544-291633f1f461 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2302a2b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:58.314506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4eb5ef0a-433d-4ba5-a544-291633f1f461 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657" status: 200 len: 1455 microversion: 2.1 time: 0.161697 Oct 03 14:44:58.315732 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7b20ca4-5d77-44a7-acc7-f376ce2a795d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.325705 Oct 03 14:44:58.316478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1541/3106] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:58 2022] GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:58.323680 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1566/3107] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:44:58.343570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:58.344314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:58.348755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:58.352955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:58.365644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:58.366130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:58.366565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:58.379080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:58.379569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:58.389940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:58.428216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:58.435184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:58.436829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:58.445509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:58.447008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:58.456440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:59.011324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:59.022649 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41ab67b5-8313-402c-aaa5-47c33c2640a3 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1270 microversion: 2.1 time: 0.697606 Oct 03 14:44:59.025769 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1567/3108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:58 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1270 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:59.036604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4878a8e4-360c-491e-8dcc-e582ef0d885c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:59.037371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4878a8e4-360c-491e-8dcc-e582ef0d885c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:59.278705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:59.294563 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd2aa9b1-20ee-442c-b776-34ffc88d20e3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.971783 Oct 03 14:44:59.298485 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1542/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:58 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:59.329602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:44:59.334126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:44:59.359108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:59.365700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:59.369473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:59.372243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:44:59.379086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:44:59.379838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:44:59.520599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4878a8e4-360c-491e-8dcc-e582ef0d885c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:44:59.527906 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4878a8e4-360c-491e-8dcc-e582ef0d885c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1216 microversion: 2.1 time: 0.497661 Oct 03 14:44:59.528478 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1568/3110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:59 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1216 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:44:59.550509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-024dd21b-a039-41fa-918c-e6aa10080aef tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb22bf139d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:00.662299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:00.672969 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8e14cf7-1189-4fa9-9052-d604ea87ac0f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1318 microversion: 2.1 time: 1.364846 Oct 03 14:45:00.678863 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1543/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:44:59 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1318 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:00.696560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:00.713129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:00.788463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:00.790670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:00.794650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:00.801679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:00.809632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:00.815954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:01.350629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:01.365826 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-503d310c-abf4-4e59-b1a4-e01d0fae6a10 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1276 microversion: 2.1 time: 0.685369 Oct 03 14:45:01.376760 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1544/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:00 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1276 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:01.408450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:01.409140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:01.461623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:01.462178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:01.462587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:01.479211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:01.479728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:01.480206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:03.039185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:03.477595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:03.503839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb3bff33-b2fb-42b9-9162-04382c4ba95e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 2.119659 Oct 03 14:45:03.530741 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1545/3113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:01 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:03.550396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:03.560905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:03.598330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:03.601790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:03.604389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:03.610645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:03.613856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:03.614329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:03.872352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:03.923067 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b14c764-2cdb-4de6-b5bc-dd0a225b753a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1274 microversion: 2.1 time: 0.389845 Oct 03 14:45:03.930136 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1546/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:03 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1274 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:03.960285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:03.964438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:03.995709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:03.998049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:04.000735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:04.005954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:04.009112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:04.010457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:04.720719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:04.733843 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b5dafd2-2f7c-49ff-8d33-64a6c2d49fbc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1468 microversion: 2.1 time: 0.796906 Oct 03 14:45:04.734772 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1547/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:03 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1468 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:04.749064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:04.750001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:04.784196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:04.784717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:04.829429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:04.830375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:04.830888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:04.831354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:04.972757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-024dd21b-a039-41fa-918c-e6aa10080aef tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657" status: 200 len: 1455 microversion: 2.1 time: 5.430757 Oct 03 14:45:04.981091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1569/3116] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:44:59 2022] GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657 => generated 1455 bytes in 5440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:04.997951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:05.000370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:05.009652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:05.010501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:05.021254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:05.023668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:05.027643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:05.028297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:05.740622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:05.909322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:05.924716 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f03425d1-2e94-4adb-94c1-d4efbf5dddf9 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1318 microversion: 2.1 time: 1.188558 Oct 03 14:45:05.926635 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1548/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:04 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1318 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:05.944308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:05.953432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:05.982063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:05.983245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:05.983955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:05.985163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:05.985869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:05.986508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:06.245333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:06.262136 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acc5fc1d-8730-446e-993d-a389d7634264 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 1.274119 Oct 03 14:45:06.266147 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1570/3118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:04 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:06.286569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:06.287464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:06.318696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:06.319469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:06.321727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:06.331625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:06.332495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:06.333210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:06.869160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:06.873559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:06.886158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66f0735f-730e-4e5c-8980-ad502fa30bad tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 200 len: 1468 microversion: 2.1 time: 0.947357 Oct 03 14:45:06.889011 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1549/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:05 2022] GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 1468 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:06.900350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-30aaade0-5a0a-446a-a569-37ba44aa4de2 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230dfe790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:08.078389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:08.226350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:08.244281 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a285e05-eed2-4503-b4a9-c2bb5fc58380 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 1.971136 Oct 03 14:45:08.264423 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1571/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:06 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:08.296801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f3e7553d-8ac9-43ad-aabb-d178e387628d req-075c1ab3-9358-4fe3-96b3-8c9d2ecb59a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1", "name": "network-vif-plugged", "status": "completed", "tag": "88432805-1cd9-4545-b41c-15ee430ac3d2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:08.379154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3e7553d-8ac9-43ad-aabb-d178e387628d req-075c1ab3-9358-4fe3-96b3-8c9d2ecb59a4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:08.383994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3e7553d-8ac9-43ad-aabb-d178e387628d req-075c1ab3-9358-4fe3-96b3-8c9d2ecb59a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:08.385473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f3e7553d-8ac9-43ad-aabb-d178e387628d req-075c1ab3-9358-4fe3-96b3-8c9d2ecb59a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:08.453518 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f3e7553d-8ac9-43ad-aabb-d178e387628d req-075c1ab3-9358-4fe3-96b3-8c9d2ecb59a4 service nova] Creating event network-vif-plugged:88432805-1cd9-4545-b41c-15ee430ac3d2 for instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 on n-h2-781139-2 Oct 03 14:45:08.484808 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f3e7553d-8ac9-43ad-aabb-d178e387628d req-075c1ab3-9358-4fe3-96b3-8c9d2ecb59a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218774 Oct 03 14:45:08.501243 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1572/3121] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:08.524079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:08.543462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:08.546238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Searching by: {'reservation_id': 'r-rtjjpgjm', 'deleted': False, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:45:08.569309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:08.570742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:08.571692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:08.572632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:08.573239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:08.573737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:08.698377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:45:08.860281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:08.886253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:08.887998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:08.889983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:10.738752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0fd9d2a-1e22-4997-95fc-330293dc550e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-rtjjpgjm" status: 200 len: 2929 microversion: 2.1 time: 2.235754 Oct 03 14:45:10.740855 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1573/3122] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 3 14:45:08 2022] GET /compute/v2.1/servers/detail?reservation_id=r-rtjjpgjm => generated 2929 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:10.746332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:10.747607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:10.766692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:10.769096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:10.770447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:10.774281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:10.775061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:10.775732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:10.833492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:11.443378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:11.506889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47635d65-a4fb-4222-b4ef-6131e4eeb5cc tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1318 microversion: 2.1 time: 0.763491 Oct 03 14:45:11.523766 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1574/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:10 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1318 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:11.535801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:11.537035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:11.551387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:11.557889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:11.567768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:11.570477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:11.571944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:11.573241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:12.245511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:12.254220 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9346389-c8d6-4e83-ab3a-bac6725248ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.728118 Oct 03 14:45:12.255489 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1575/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:11 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:12.287334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-57e4ba87-ee11-4f0d-b50d-23165a343340 req-56234962-47ea-48a3-8992-6676f0a80a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b0aaee-0779-4485-ab6b-eb253a86c235", "tag": "5b4071f4-64cf-4d7c-bab9-1d819eeface4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:12.317891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-57e4ba87-ee11-4f0d-b50d-23165a343340 req-56234962-47ea-48a3-8992-6676f0a80a78 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:12.318270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-57e4ba87-ee11-4f0d-b50d-23165a343340 req-56234962-47ea-48a3-8992-6676f0a80a78 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:12.318683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-57e4ba87-ee11-4f0d-b50d-23165a343340 req-56234962-47ea-48a3-8992-6676f0a80a78 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:12.354079 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-57e4ba87-ee11-4f0d-b50d-23165a343340 req-56234962-47ea-48a3-8992-6676f0a80a78 service nova] Creating event network-changed:5b4071f4-64cf-4d7c-bab9-1d819eeface4 for instance a5b0aaee-0779-4485-ab6b-eb253a86c235 on n-h2-781139-2 Oct 03 14:45:12.392069 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-57e4ba87-ee11-4f0d-b50d-23165a343340 req-56234962-47ea-48a3-8992-6676f0a80a78 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133788 Oct 03 14:45:12.395230 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1576/3125] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:12.412430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:12.413425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:12.471593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:12.471593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:12.471593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:12.471593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:12.471593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:12.471593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:13.140896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:13.151975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b2d791d-40aa-48d5-85d9-ac5d69534837 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 0.755373 Oct 03 14:45:13.162445 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1577/3126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:12 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:13.180493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f16ffeb-6a43-45f5-8d81-ca561900a7d5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:13.217294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.server_groups [None req-8f16ffeb-6a43-45f5-8d81-ca561900a7d5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Querying cell 54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) for 2 instances {{(pid=128869) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 14:45:13.218623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-6a43-45f5-8d81-ca561900a7d5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:13.221501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-6a43-45f5-8d81-ca561900a7d5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:13.222410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-6a43-45f5-8d81-ca561900a7d5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:13.347273 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f16ffeb-6a43-45f5-8d81-ca561900a7d5 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/606cc9b3-e8bc-44e8-b50c-b56066b5d85b" status: 200 len: 270 microversion: 2.1 time: 0.181617 Oct 03 14:45:13.359567 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1578/3127] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:45:13 2022] GET /compute/v2.1/os-server-groups/606cc9b3-e8bc-44e8-b50c-b56066b5d85b => generated 270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:13.381816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:13.385008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:13.414552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:13.415628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:13.417132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:13.419502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:13.420733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:13.424354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:14.481825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:14.506886 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d08546f-dbcd-407c-8c23-f4f2800412fb tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1318 microversion: 2.1 time: 1.145362 Oct 03 14:45:14.523590 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1579/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:13 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:14.532031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-18769414-e4d5-4e90-b61f-a52d215e8d1b req-1bc63a29-260d-432b-b333-3c8e72916cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c015e80-474a-459f-9583-6b3779c6e75a", "tag": "327bd8c3-af71-407a-b4aa-617ab5c46b76"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:14.553921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18769414-e4d5-4e90-b61f-a52d215e8d1b req-1bc63a29-260d-432b-b333-3c8e72916cad service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:14.555536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18769414-e4d5-4e90-b61f-a52d215e8d1b req-1bc63a29-260d-432b-b333-3c8e72916cad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:14.556374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18769414-e4d5-4e90-b61f-a52d215e8d1b req-1bc63a29-260d-432b-b333-3c8e72916cad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:14.578834 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-18769414-e4d5-4e90-b61f-a52d215e8d1b req-1bc63a29-260d-432b-b333-3c8e72916cad service nova] Creating event network-changed:327bd8c3-af71-407a-b4aa-617ab5c46b76 for instance 5c015e80-474a-459f-9583-6b3779c6e75a on n-h2-781139-2 Oct 03 14:45:14.584061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-18769414-e4d5-4e90-b61f-a52d215e8d1b req-1bc63a29-260d-432b-b333-3c8e72916cad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058925 Oct 03 14:45:14.584664 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1580/3129] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:14.590311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:14.591155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:14.598485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:14.599172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:14.599606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:14.600655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:14.600980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:14.601407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:15.185811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:15.207924 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6543513-d7a7-41df-9d6d-8cf27e73f772 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.615072 Oct 03 14:45:15.209115 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1581/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:14 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:15.218226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:15.225839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:15.249442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:15.250090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:15.250380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:15.251111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:15.251590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:15.262407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:15.869088 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-767b298b-24fa-4dbb-aed3-c1621a8a0dfc tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 200 len: 1619 microversion: 2.1 time: 0.655267 Oct 03 14:45:15.889973 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1582/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:15 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 1619 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:15.902058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:15.905909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:15.926731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:15.929466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:15.930840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:15.933377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:15.940793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:15.942645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:15.981714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=29 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:16.267224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:16.275931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-930cc4c0-9430-452c-ba27-42661c8a7a67 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 0.384607 Oct 03 14:45:16.295420 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1583/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:15 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:16.308654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:16.310974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:16.324118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:16.325699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:16.330554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:16.334256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:16.337093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:16.339581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:16.809762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:16.826157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:16.828919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:16.830835 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2580ccfa-e511-4767-a4d2-88a1397ebc7f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2949 microversion: 2.42 time: 0.533250 Oct 03 14:45:16.831778 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1584/3133] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:45:16 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2949 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:45:16.874788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:16.877305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:16.883119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:16.883843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:16.884655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:16.885932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:16.886450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:16.887019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:17.087117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:17.103786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2ea39b6-4d27-4aae-ae3c-157b0088cc09 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1318 microversion: 2.1 time: 0.231579 Oct 03 14:45:17.118276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1585/3134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:16 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:17.127256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:17.128319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:17.136492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:17.137394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:17.138137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:17.139205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:17.139915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:17.140532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:17.427927 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72150e88-9d23-4b9d-bf95-1da7b99311b4 tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 200 len: 1619 microversion: 2.1 time: 0.308312 Oct 03 14:45:17.429658 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1586/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:17 2022] GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 1619 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:17.435378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:17.436387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:17.445902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:17.447890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:17.448778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:17.450803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:17.451988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:17.453684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:17.848167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:17.857439 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2119beee-5c4d-4f72-84e4-92357dbb79fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.426535 Oct 03 14:45:17.858038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1587/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:17 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:17.893748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-599a527a-be10-4f9e-901a-aa932ab567e2 req-0b286b70-7ce7-45f7-9516-e1c2921847cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b85d32-1351-4c48-baea-9768ea97bd4d", "tag": "6e5facc4-ebaf-4a5c-acfc-18ef07b5a3e2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:17.909578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-599a527a-be10-4f9e-901a-aa932ab567e2 req-0b286b70-7ce7-45f7-9516-e1c2921847cf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:17.910254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-599a527a-be10-4f9e-901a-aa932ab567e2 req-0b286b70-7ce7-45f7-9516-e1c2921847cf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:17.911026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-599a527a-be10-4f9e-901a-aa932ab567e2 req-0b286b70-7ce7-45f7-9516-e1c2921847cf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:17.943712 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-599a527a-be10-4f9e-901a-aa932ab567e2 req-0b286b70-7ce7-45f7-9516-e1c2921847cf service nova] Creating event network-changed:6e5facc4-ebaf-4a5c-acfc-18ef07b5a3e2 for instance 23b85d32-1351-4c48-baea-9768ea97bd4d on n-h2-781139-2 Oct 03 14:45:17.956227 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-599a527a-be10-4f9e-901a-aa932ab567e2 req-0b286b70-7ce7-45f7-9516-e1c2921847cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070092 Oct 03 14:45:17.958587 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1588/3137] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:17.971061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:17.972850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:17.988994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:17.989798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:17.990651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:17.993441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:17.997737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:17.997737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:18.412512 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-172ee127-0bff-40e8-9a31-6303ff7439d3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.451977 Oct 03 14:45:18.413173 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1589/3138] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:45:17 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a/os-interface => generated 1830 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:45:18.418891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:18.421551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:18.441168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:18.442191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:18.442848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:18.446524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:18.447213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:18.447819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:18.642277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:18.764346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:18.774616 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f373f7e-605f-4b1e-8432-1d898c898454 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 0.360307 Oct 03 14:45:18.775220 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1590/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:18 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:18.780169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a9608170-5b33-4e8e-b5cc-b6385ba6da38 req-66c174ca-fd54-44ce-ab52-9f16cd10f7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b0aaee-0779-4485-ab6b-eb253a86c235", "name": "network-vif-plugged", "status": "completed", "tag": "5b4071f4-64cf-4d7c-bab9-1d819eeface4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:18.793240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a9608170-5b33-4e8e-b5cc-b6385ba6da38 req-66c174ca-fd54-44ce-ab52-9f16cd10f7ab service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:18.793714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a9608170-5b33-4e8e-b5cc-b6385ba6da38 req-66c174ca-fd54-44ce-ab52-9f16cd10f7ab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:18.794138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a9608170-5b33-4e8e-b5cc-b6385ba6da38 req-66c174ca-fd54-44ce-ab52-9f16cd10f7ab service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:18.811969 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a9608170-5b33-4e8e-b5cc-b6385ba6da38 req-66c174ca-fd54-44ce-ab52-9f16cd10f7ab service nova] Creating event network-vif-plugged:5b4071f4-64cf-4d7c-bab9-1d819eeface4 for instance a5b0aaee-0779-4485-ab6b-eb253a86c235 on n-h2-781139-2 Oct 03 14:45:18.837994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a9608170-5b33-4e8e-b5cc-b6385ba6da38 req-66c174ca-fd54-44ce-ab52-9f16cd10f7ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061286 Oct 03 14:45:18.838806 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1591/3140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:18.846172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1208513775", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "cc064e15-e471-4aea-9ae4-545bad8c989b"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:18.878112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:19.716856 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-30aaade0-5a0a-446a-a569-37ba44aa4de2 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657" status: 200 len: 1455 microversion: 2.1 time: 12.826362 Oct 03 14:45:19.719422 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1550/3141] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:06 2022] GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657 => generated 1455 bytes in 12830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:19.739870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:19.741653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:19.751912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:19.752700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:19.753488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:19.755220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:19.755896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:19.758146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:20.068846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:20.078088 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0c92368-4294-40f7-ba7c-4fccd004b778 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1318 microversion: 2.1 time: 0.357409 Oct 03 14:45:20.083525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1551/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:19 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:20.088773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:20.100589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:20.114194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:20.114962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:20.115616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:20.116355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:20.116822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:20.117276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:20.562171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:20.574903 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f596decb-520b-4357-a309-0bec3f42815e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.489804 Oct 03 14:45:20.575521 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1552/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:20 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:20.623837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:20.626998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:20.654909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:20.656280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:20.656878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:20.657855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:20.658568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:20.659226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:21.041998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:21.059059 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e23a2f3-6d06-4385-894b-64cce1d61cd9 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 0.442638 Oct 03 14:45:21.060285 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1553/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:20 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:21.094637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92d7dff0-824b-404b-825b-afb623fea2c2 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb231144310>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:24.861496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:45:24.936129 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92d7dff0-824b-404b-825b-afb623fea2c2 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657" status: 200 len: 1464 microversion: 2.1 time: 3.873686 Oct 03 14:45:24.945396 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1554/3145] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:21 2022] GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657 => generated 1464 bytes in 3876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:24.948389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:24.952559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:24.965685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:24.966669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:24.967306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:24.968208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:24.971934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:24.977297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.169011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:45:25.169842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:45:25.170479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:45:25.171221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:45:25.171796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:45:25.184697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.185724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.186329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.187232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.187839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.188345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:25.188763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.198002 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-812ccb84-c756-4fa6-af1c-09c9baca262e tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1318 microversion: 2.1 time: 0.260111 Oct 03 14:45:25.212808 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1555/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:24 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:25.212808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:25.212808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:25.226417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.229924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.230409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.232840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.233515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.234009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.234935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:45:25.241755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:45:25.258019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:45:25.261729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:45:25.374612 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13bf5c17-4234-4a8d-bc74-08fa9a91541b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.534653 Oct 03 14:45:25.375839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1592/3147] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:45:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 6537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:45:25.391580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:25.392648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:25.399809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:25.401835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.402765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.404315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.405267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.405882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.406561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.492564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:25.504350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-30fa1bfe-e06a-417f-bb46-5c7e23d14cd2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1681 microversion: 2.1 time: 0.304234 Oct 03 14:45:25.517222 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1556/3148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:25 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1681 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:25.528453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-10f76afe-192f-4e3e-930e-900e0cf0f5ed req-64d3fc7d-19aa-43ad-ae0e-9f20932f6644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b85d32-1351-4c48-baea-9768ea97bd4d", "name": "network-vif-plugged", "status": "completed", "tag": "6e5facc4-ebaf-4a5c-acfc-18ef07b5a3e2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:25.558590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10f76afe-192f-4e3e-930e-900e0cf0f5ed req-64d3fc7d-19aa-43ad-ae0e-9f20932f6644 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.559632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10f76afe-192f-4e3e-930e-900e0cf0f5ed req-64d3fc7d-19aa-43ad-ae0e-9f20932f6644 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.560338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-10f76afe-192f-4e3e-930e-900e0cf0f5ed req-64d3fc7d-19aa-43ad-ae0e-9f20932f6644 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.617105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-10f76afe-192f-4e3e-930e-900e0cf0f5ed req-64d3fc7d-19aa-43ad-ae0e-9f20932f6644 service nova] Creating event network-vif-plugged:6e5facc4-ebaf-4a5c-acfc-18ef07b5a3e2 for instance 23b85d32-1351-4c48-baea-9768ea97bd4d on n-h2-781139-2 Oct 03 14:45:25.642334 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-10f76afe-192f-4e3e-930e-900e0cf0f5ed req-64d3fc7d-19aa-43ad-ae0e-9f20932f6644 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121891 Oct 03 14:45:25.642972 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1557/3149] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:25.656995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:25.667699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d6960ad-f9f5-4645-a56c-30a00faeab03 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 0.282860 Oct 03 14:45:25.668594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb7de0f1-bcef-4046-8c8a-01ceeab5b218 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230a98700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:25.669698 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1593/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:25 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:25.675955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fa497fe-e2b2-49e3-a708-b21e589127d0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:25.676823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3fa497fe-e2b2-49e3-a708-b21e589127d0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:25.778913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3fa497fe-e2b2-49e3-a708-b21e589127d0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:25.787320 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fa497fe-e2b2-49e3-a708-b21e589127d0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1217 microversion: 2.1 time: 0.115778 Oct 03 14:45:25.790731 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1594/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:25 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:25.832764 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb7de0f1-bcef-4046-8c8a-01ceeab5b218 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657" status: 200 len: 1464 microversion: 2.1 time: 0.184513 Oct 03 14:45:25.833486 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1558/3152] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:25 2022] GET /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:25.849502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:25.850114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:25.862573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.863293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.863640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:25.864545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:25.865438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:25.865940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:26.117046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:26.125354 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b77de684-e37c-4c3b-a08a-a5a3fbe6d4e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 1467 microversion: 2.1 time: 0.281631 Oct 03 14:45:26.137328 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1595/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:25 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 1467 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:26.150242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-751322113"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:26.153881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:26.167029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:26.167523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:26.167957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:26.168648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:26.175734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:26.176673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:26.220462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:26.221458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:26.230652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:26.231138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:26.236019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:26.236858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:26.237509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:26.237928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:26.247545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:26.430319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:26.440786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d930fd17-8167-4cc9-9f4e-39e00ec18726 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1318 microversion: 2.1 time: 0.224337 Oct 03 14:45:26.441629 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1596/3154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:26 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:26.528917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:26.529798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:26.548004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:26.548502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:26.552977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:26.553758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:26.554210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:26.554639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.154240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:27.166318 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8296497-cb59-4c26-8519-2b58bab18434 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.640646 Oct 03 14:45:27.167514 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1597/3155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:26 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:27.196816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:27.197545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:27.205078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.206016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.206543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.207741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.208248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.209558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.421338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:27.440128 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8415ecb-14b9-474f-925d-3af1789beb02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 0.271214 Oct 03 14:45:27.445038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1598/3156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:27 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:27.450505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:27.451587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:27.458013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.458780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.459421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.463061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.463788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.464424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.551408 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-381ab9c5-e5da-4c09-b85a-da6a3bf5973c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "POST /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9/action" status: 202 len: 0 microversion: 2.1 time: 1.404697 Oct 03 14:45:27.553812 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1559/3157] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:45:26 2022] POST /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9/action => generated 0 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 14:45:27.567357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:27.571198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:27.573355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:27.581848 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7a26424-1c65-43f8-a1be-63d51ac9de4e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1269 microversion: 2.1 time: 0.135287 Oct 03 14:45:27.582587 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1599/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:27 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:27.588273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40d4bfed-cea4-416f-a3c9-40a7f06db6ea tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb22be06a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:27.605256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.606420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.608314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.612735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.613630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.614286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.655028 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40d4bfed-cea4-416f-a3c9-40a7f06db6ea tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.070364 Oct 03 14:45:27.656315 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1600/3159] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:27 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:27.661858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:27.662659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:27.675858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.676616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.677406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:27.678965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:27.692623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:27.693424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.019218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:28.054466 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23fdef93-546b-4b4c-a88a-8f044c42a23e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.396893 Oct 03 14:45:28.058878 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1601/3160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:27 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:28.088800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-bd61bdad-4068-406e-b8e6-04bd1e8e5276 req-90d6fc22-d1ce-46ed-9429-0bc0ad3d8183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c015e80-474a-459f-9583-6b3779c6e75a", "name": "network-vif-plugged", "status": "completed", "tag": "327bd8c3-af71-407a-b4aa-617ab5c46b76"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:28.115222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bd61bdad-4068-406e-b8e6-04bd1e8e5276 req-90d6fc22-d1ce-46ed-9429-0bc0ad3d8183 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:28.115408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bd61bdad-4068-406e-b8e6-04bd1e8e5276 req-90d6fc22-d1ce-46ed-9429-0bc0ad3d8183 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:28.115843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bd61bdad-4068-406e-b8e6-04bd1e8e5276 req-90d6fc22-d1ce-46ed-9429-0bc0ad3d8183 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.144064 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-bd61bdad-4068-406e-b8e6-04bd1e8e5276 req-90d6fc22-d1ce-46ed-9429-0bc0ad3d8183 service nova] Creating event network-vif-plugged:327bd8c3-af71-407a-b4aa-617ab5c46b76 for instance 5c015e80-474a-459f-9583-6b3779c6e75a on n-h2-781139-2 Oct 03 14:45:28.151409 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-bd61bdad-4068-406e-b8e6-04bd1e8e5276 req-90d6fc22-d1ce-46ed-9429-0bc0ad3d8183 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077915 Oct 03 14:45:28.152700 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1602/3161] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:28.370974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:28.385060 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc021252-5774-4c3f-b90f-fdcd27d71b19 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 200 len: 1507 microversion: 2.1 time: 0.829948 Oct 03 14:45:28.389889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1560/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:27 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 1507 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:28.413847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:28.416707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:28.428009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:28.429404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:28.430129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.431702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:28.432406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:28.433070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.471421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:28.472039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:28.496603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:28.497132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:28.511123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.525373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:28.533107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:28.534030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.647839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:28.665335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-efc299d5-6b91-4255-96f3-57961ca78f39 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235" status: 200 len: 1507 microversion: 2.1 time: 0.256761 Oct 03 14:45:28.666231 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1603/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:28 2022] GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:28.678167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:28.679355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:28.697949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:28.701086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:28.705603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.706373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:28.706843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:28.707275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:28.841473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:28.857192 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d670c2f-7c52-42dc-a9dd-3f157ce812b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1275 microversion: 2.1 time: 0.189364 Oct 03 14:45:28.858323 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1604/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:28 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:28.863172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-24e85d06-2b39-4272-800c-801a2272647e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234ae9f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:29.293409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:29.311955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-73325642-0b37-46b3-bb8f-a38c175cc376 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1316 microversion: 2.1 time: 0.849540 Oct 03 14:45:29.327507 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1561/3165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:28 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:29.335720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:29.336232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:29.362468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:29.362873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:29.363352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:29.364061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:29.364521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:29.364977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:29.403259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:45:29.623793 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1edbc19f-51b1-4993-9f8b-a90303b8107a tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235" status: 204 len: 0 microversion: 2.1 time: 0.297053 Oct 03 14:45:29.624555 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1562/3166] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:45:29 2022] DELETE /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:45:29.657571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:29.659060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:29.671405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:29.674120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:29.675363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:29.676272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:29.676890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:29.677555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:29.733601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:45:29.936116 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ecb79e78-20f7-4400-ae9a-a7552474a9e8 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 204 len: 0 microversion: 2.1 time: 0.298282 Oct 03 14:45:29.937231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1563/3167] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:45:29 2022] DELETE /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:45:29.943908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:29.945081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:29.952771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:29.953666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:29.954422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:29.955444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:29.956431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:29.957140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:30.346811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:30.354862 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc6198a7-70ab-4ac2-b743-c14df62f3190 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.415958 Oct 03 14:45:30.377290 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1564/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:29 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:30.382606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:30.385494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:30.399554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:30.401693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:30.403015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:30.405659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:30.407692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:30.408299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:30.456099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:30.699268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:30.712951 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87a76a7c-6446-4632-95bc-6e0e4e6b22be tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235" status: 200 len: 1513 microversion: 2.1 time: 0.334471 Oct 03 14:45:30.716358 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1565/3169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:30 2022] GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 => generated 1513 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:30.748739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-bbf1fe29-5d31-4a98-a1ec-1c43c381f2f9 req-b926b5ed-661a-47ff-bce2-905d589a96fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1", "name": "network-vif-unplugged", "status": "completed", "tag": "88432805-1cd9-4545-b41c-15ee430ac3d2"}, {"server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "name": "network-vif-unplugged", "status": "completed", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:30.791907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bbf1fe29-5d31-4a98-a1ec-1c43c381f2f9 req-b926b5ed-661a-47ff-bce2-905d589a96fc service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:30.792413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bbf1fe29-5d31-4a98-a1ec-1c43c381f2f9 req-b926b5ed-661a-47ff-bce2-905d589a96fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:30.794924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bbf1fe29-5d31-4a98-a1ec-1c43c381f2f9 req-b926b5ed-661a-47ff-bce2-905d589a96fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:30.839617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-bbf1fe29-5d31-4a98-a1ec-1c43c381f2f9 req-b926b5ed-661a-47ff-bce2-905d589a96fc service nova] Creating event network-vif-unplugged:88432805-1cd9-4545-b41c-15ee430ac3d2 for instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 on n-h2-781139-2 Oct 03 14:45:30.840582 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-bbf1fe29-5d31-4a98-a1ec-1c43c381f2f9 req-b926b5ed-661a-47ff-bce2-905d589a96fc service nova] Creating event network-vif-unplugged:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:45:30.851777 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-bbf1fe29-5d31-4a98-a1ec-1c43c381f2f9 req-b926b5ed-661a-47ff-bce2-905d589a96fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.123950 Oct 03 14:45:30.853053 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1566/3170] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:30.872146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:30.873079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:30.896209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:30.896708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:30.897177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:30.907293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:30.911705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:30.912223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:31.260073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:31.278705 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-96d7e119-cf3a-465b-b7ff-4cd5dd60434e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1503 microversion: 2.1 time: 0.418892 Oct 03 14:45:31.280783 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1567/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:30 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:31.304672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-509411953"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:31.305254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:31.320196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:31.324964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:31.325674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:31.326618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:31.327280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:31.327713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:31.679805 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-24e85d06-2b39-4272-800c-801a2272647e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 2.820153 Oct 03 14:45:31.689148 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1605/3172] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:28 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 2830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:31.694059 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.network.security_group_api [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Adding security group 266b037e-7970-469b-8951-5746d7f93c1c to port 327bd8c3-af71-407a-b4aa-617ab5c46b76 Oct 03 14:45:31.696044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:31.696667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:31.705163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:31.706053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:31.706503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:31.707212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:31.707922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:31.708704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:31.917678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:31.943637 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8213452d-dc0f-41e5-8059-820d5086e1eb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.248003 Oct 03 14:45:31.946392 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1606/3173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:31 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:31.963004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d272f377-1623-404c-9f1f-8605eca71d7c req-03518c85-6fe3-4da1-a810-06538127b3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c955fddf-0aa8-4d03-899f-5a279d5bd731", "tag": "7a8040c9-7ffa-4072-af5c-7db245ae0faa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:31.987875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d272f377-1623-404c-9f1f-8605eca71d7c req-03518c85-6fe3-4da1-a810-06538127b3f7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:31.989153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d272f377-1623-404c-9f1f-8605eca71d7c req-03518c85-6fe3-4da1-a810-06538127b3f7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:31.990352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d272f377-1623-404c-9f1f-8605eca71d7c req-03518c85-6fe3-4da1-a810-06538127b3f7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.024433 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d272f377-1623-404c-9f1f-8605eca71d7c req-03518c85-6fe3-4da1-a810-06538127b3f7 service nova] Creating event network-changed:7a8040c9-7ffa-4072-af5c-7db245ae0faa for instance c955fddf-0aa8-4d03-899f-5a279d5bd731 on n-h1-781139-2 Oct 03 14:45:32.031407 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d272f377-1623-404c-9f1f-8605eca71d7c req-03518c85-6fe3-4da1-a810-06538127b3f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082639 Oct 03 14:45:32.032620 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1607/3174] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:32.038952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:32.040098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:32.048205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.049283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.050124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.052762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.053447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.054073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.492706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:32.504200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f249ddc-c888-47b2-8db5-960a94e927a0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.469971 Oct 03 14:45:32.505394 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1608/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:32 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:32.511745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:32.513122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:32.519711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.520521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.521210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.522144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.522974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.523619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.637197 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed290dfa-7103-4e99-abb5-9d733d702468 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a/action" status: 202 len: 0 microversion: 2.1 time: 1.336754 Oct 03 14:45:32.638897 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1568/3176] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:45:31 2022] POST /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a/action => generated 0 bytes in 1340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:45:32.645773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:32.649556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:32.670035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.677655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.679167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.681761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.682503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.684602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.942420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:32.953689 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1f5cb76-8de9-479c-a1d1-88a92eb940c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.313176 Oct 03 14:45:32.954871 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1569/3177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:32 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:32.960228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2120219085"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:32.961119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:32.970791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.971660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.972496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:32.973953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:32.974876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:32.975569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:33.038741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:33.048573 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16f3c9a7-65b7-4859-8903-344d65a290fe tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235" status: 200 len: 1513 microversion: 2.1 time: 0.541426 Oct 03 14:45:33.057301 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1609/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:32 2022] GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 => generated 1513 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:33.062589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b31b34cc-23c7-46f5-b66f-bda63445ebf8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb22bf55d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:33.151162 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.network.security_group_api [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Adding security group 5092b417-747f-4204-8c69-0a931c7abfc4 to port 327bd8c3-af71-407a-b4aa-617ab5c46b76 Oct 03 14:45:33.158145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b31b34cc-23c7-46f5-b66f-bda63445ebf8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.099407 Oct 03 14:45:33.165910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1610/3179] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:33 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:33.165910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:33.165910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:33.190250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:33.190749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:33.191185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:33.191897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:33.192432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:33.192858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:33.696793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:33.709667 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66a3c22a-c82d-4a8a-a470-cfef9da9fdfb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.549537 Oct 03 14:45:33.720949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1611/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:33 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:33.728791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:33.728791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:33.744367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:33.744773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:33.747766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:33.750151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:33.751732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:33.752171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:33.806802 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4933a3bc-0f55-418d-9ff9-924a4ee92ebf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a/action" status: 202 len: 0 microversion: 2.1 time: 0.850585 Oct 03 14:45:33.807448 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1570/3181] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:45:32 2022] POST /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:45:33.816594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:33.817181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:33.832877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:33.833465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:33.836733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:33.839690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:33.840181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:33.840617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:34.252131 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc14e149-4a99-4c57-9a87-b677677e8136 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.439765 Oct 03 14:45:34.253284 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1571/3182] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 3 14:45:33 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a/os-security-groups => generated 1157 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:34.258703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-93831a75-2579-4ffd-acb1-c78d80476c0b req-932f1b50-7622-447f-a513-84d32d6f4b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c015e80-474a-459f-9583-6b3779c6e75a", "tag": "327bd8c3-af71-407a-b4aa-617ab5c46b76"}, {"name": "network-changed", "server_uuid": "5c015e80-474a-459f-9583-6b3779c6e75a", "tag": "327bd8c3-af71-407a-b4aa-617ab5c46b76"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:34.277186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-93831a75-2579-4ffd-acb1-c78d80476c0b req-932f1b50-7622-447f-a513-84d32d6f4b89 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:34.277757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-93831a75-2579-4ffd-acb1-c78d80476c0b req-932f1b50-7622-447f-a513-84d32d6f4b89 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:34.278276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-93831a75-2579-4ffd-acb1-c78d80476c0b req-932f1b50-7622-447f-a513-84d32d6f4b89 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:34.295995 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-93831a75-2579-4ffd-acb1-c78d80476c0b req-932f1b50-7622-447f-a513-84d32d6f4b89 service nova] Creating event network-changed:327bd8c3-af71-407a-b4aa-617ab5c46b76 for instance 5c015e80-474a-459f-9583-6b3779c6e75a on n-h2-781139-2 Oct 03 14:45:34.296611 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-93831a75-2579-4ffd-acb1-c78d80476c0b req-932f1b50-7622-447f-a513-84d32d6f4b89 service nova] Creating event network-changed:327bd8c3-af71-407a-b4aa-617ab5c46b76 for instance 5c015e80-474a-459f-9583-6b3779c6e75a on n-h2-781139-2 Oct 03 14:45:34.302477 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-93831a75-2579-4ffd-acb1-c78d80476c0b req-932f1b50-7622-447f-a513-84d32d6f4b89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047638 Oct 03 14:45:34.303412 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1572/3183] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:34.313923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:34.315404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:34.322639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:34.323527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:34.324179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:34.325231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:34.326060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:34.326706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:34.448419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:34.459686 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8db7acc7-32c9-4a47-b1b8-92adf196ee90 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.746448 Oct 03 14:45:34.477031 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1612/3184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:33 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:34.477031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ec0ed84-dfc7-440c-8142-7a02233a827e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230439040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:34.558665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:34.574492 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f920be0-aa77-4928-82a7-0bbd0318d846 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235" status: 200 len: 1471 microversion: 2.1 time: 0.265045 Oct 03 14:45:34.576187 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ec0ed84-dfc7-440c-8142-7a02233a827e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.108475 Oct 03 14:45:34.576770 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1613/3185] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:34 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:34.594565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d95a3666-d6ae-496e-94ba-f2abf905cc43 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb22bf55040>, body: {"security_group": {"name": " tempest-securitygroup -968093061 ", "description": "tempest-description-936543771"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:34.597938 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1573/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:34 2022] GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:34.618457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-bf1e7d6c-85e1-4adc-826e-68872f6a9e56 req-ed2178e1-fdc2-4223-83d7-0fd384f00dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b0aaee-0779-4485-ab6b-eb253a86c235", "name": "network-vif-deleted", "tag": "5b4071f4-64cf-4d7c-bab9-1d819eeface4"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:34.659649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bf1e7d6c-85e1-4adc-826e-68872f6a9e56 req-ed2178e1-fdc2-4223-83d7-0fd384f00dc0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:34.664388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bf1e7d6c-85e1-4adc-826e-68872f6a9e56 req-ed2178e1-fdc2-4223-83d7-0fd384f00dc0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:34.667913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bf1e7d6c-85e1-4adc-826e-68872f6a9e56 req-ed2178e1-fdc2-4223-83d7-0fd384f00dc0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:34.711936 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-bf1e7d6c-85e1-4adc-826e-68872f6a9e56 req-ed2178e1-fdc2-4223-83d7-0fd384f00dc0 service nova] Creating event network-vif-deleted:5b4071f4-64cf-4d7c-bab9-1d819eeface4 for instance a5b0aaee-0779-4485-ab6b-eb253a86c235 on n-h2-781139-2 Oct 03 14:45:34.733179 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-bf1e7d6c-85e1-4adc-826e-68872f6a9e56 req-ed2178e1-fdc2-4223-83d7-0fd384f00dc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130548 Oct 03 14:45:34.742447 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1574/3187] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:34.772157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:34.775026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:34.809839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:34.817563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:34.819796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:34.821962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:34.825254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:34.832576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.067609 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a11e031-4d46-4a59-94d4-71913fc1f6fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.320633 Oct 03 14:45:35.068426 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1575/3188] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:45:34 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:45:35.080324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:35.082687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:35.099087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:35.099592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:35.101729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.105422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:35.105906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:35.106374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.217084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:35.342867 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d95a3666-d6ae-496e-94ba-f2abf905cc43 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.756898 Oct 03 14:45:35.343574 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1614/3189] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:45:34 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:35.355008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:35.356073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:35.364851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:35.374890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:35.375399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:35.375974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.376835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:35.377162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:35.377753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.378071 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5437962d-71f6-40bd-9ba3-78c240f91d94 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.308383 Oct 03 14:45:35.378677 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1576/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:35 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:35.397094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9a1ffa0d-a3df-4dc4-89f4-fb62f1274917 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230839af0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:35.467421 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9a1ffa0d-a3df-4dc4-89f4-fb62f1274917 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7" status: 200 len: 222 microversion: 2.1 time: 0.087601 Oct 03 14:45:35.468285 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1577/3191] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:45:35 2022] GET /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7 => generated 222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:35.490682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b23c61b-c69c-4262-9a1d-de2a9787c963 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230a5ee50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:35.619812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:35.633267 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a46c12c-4e7c-4887-8f98-3d84035d3386 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1670 microversion: 2.1 time: 0.288246 Oct 03 14:45:35.637055 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1615/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:35 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1670 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:35.659605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83c3a80b-1c85-4103-a787-82d366faf119 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230439160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:35.754424 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83c3a80b-1c85-4103-a787-82d366faf119 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.115676 Oct 03 14:45:35.757818 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1616/3193] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:35 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:35.769677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:35.771873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:35.786356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:35.789470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:35.803042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:35.803743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.804847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:35.805613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:35.806270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.900320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:35.901411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:35.902237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:35.903062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lazy-loading 'fault' on Instance uuid a5b0aaee-0779-4485-ab6b-eb253a86c235 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:45:35.975083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7c1bee4ce4a46bcbd958ac731a5863e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f749474bd0a44cdbf3cfa73c4169272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:35.991514 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c471640b-d2ed-44c7-b8b6-b438e772e9a5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235" status: 200 len: 1308 microversion: 2.1 time: 0.228504 Oct 03 14:45:35.992152 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1617/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:35 2022] GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:36.364249 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b23c61b-c69c-4262-9a1d-de2a9787c963 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7" status: 202 len: 0 microversion: 2.1 time: 0.881921 Oct 03 14:45:36.366879 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1578/3195] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:45:35 2022] DELETE /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7 => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:45:36.374816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81a00d36-61ad-4f81-b047-082d443929a6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb234bb3820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:36.401888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:36.403762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:36.432318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:36.434024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-81a00d36-61ad-4f81-b047-082d443929a6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:45:36.435563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-81a00d36-61ad-4f81-b047-082d443929a6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:45:36.436187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:36.436626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:36.437287 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-81a00d36-61ad-4f81-b047-082d443929a6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:45:36.437287 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-4eb08d85-cea2-4df8-bbbc-35c53040c9c5'] Oct 03 14:45:36.437608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:36.438066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:36.438496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81a00d36-61ad-4f81-b047-082d443929a6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7 HTTP/1.1 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-4eb08d85-cea2-4df8-bbbc-35c53040c9c5'] Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '58f32a18-4d0f-4d64-9c7d-8d1c404542c7'} Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:45:36.440353 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eb08d85-cea2-4df8-bbbc-35c53040c9c5'] Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eb08d85-cea2-4df8-bbbc-35c53040c9c5'] Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eb08d85-cea2-4df8-bbbc-35c53040c9c5'] Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eb08d85-cea2-4df8-bbbc-35c53040c9c5'] Oct 03 14:45:36.445698 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:36.462793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81a00d36-61ad-4f81-b047-082d443929a6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:45:36.462793 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-4eb08d85-cea2-4df8-bbbc-35c53040c9c5'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:36.464434 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81a00d36-61ad-4f81-b047-082d443929a6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7" status: 404 len: 194 microversion: 2.1 time: 0.094194 Oct 03 14:45:36.465569 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1618/3196] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:45:36 2022] GET /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:45:36.476138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5ef47a2-82e2-4767-b2e9-da35b6e1d1ca tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb230439b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1417307603", "description": "tempest-description-30946682"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:36.779641 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5ef47a2-82e2-4767-b2e9-da35b6e1d1ca tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.308470 Oct 03 14:45:36.780257 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1619/3197] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:45:36 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:36.785942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:36.786567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:36.805334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:36.807502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:36.809142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:36.810605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:36.811516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:36.814079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:36.927754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:36.954839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0ff758f6-c8c7-413c-8ce3-7f68fcc648d8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.557400 Oct 03 14:45:36.958256 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1579/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:36 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:36.971836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cebeeaf1-b901-495c-9bfe-bda6c89ab5ed tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb2306d1550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1580062133", "description": "tempest-description-1310203296"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:37.251579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:37.262317 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-872b953d-dd10-4c57-99a7-aff59c36e13a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1670 microversion: 2.1 time: 0.480568 Oct 03 14:45:37.273851 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1620/3199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:36 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1670 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:37.286182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93577e0c-f417-410a-a93e-7354d244e6aa tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234ae9940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:37.342458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93577e0c-f417-410a-a93e-7354d244e6aa tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.060711 Oct 03 14:45:37.343910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1621/3200] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:37 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:37.350044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e9a6b6b1-80e2-4bf8-894b-27ea6b6fbc80 req-71639ee7-b385-4e8e-bdb7-812dbf12bc31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b85d32-1351-4c48-baea-9768ea97bd4d", "name": "network-vif-deleted", "tag": "6e5facc4-ebaf-4a5c-acfc-18ef07b5a3e2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:37.363145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e9a6b6b1-80e2-4bf8-894b-27ea6b6fbc80 req-71639ee7-b385-4e8e-bdb7-812dbf12bc31 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.363740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e9a6b6b1-80e2-4bf8-894b-27ea6b6fbc80 req-71639ee7-b385-4e8e-bdb7-812dbf12bc31 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.364229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e9a6b6b1-80e2-4bf8-894b-27ea6b6fbc80 req-71639ee7-b385-4e8e-bdb7-812dbf12bc31 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:37.378518 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e9a6b6b1-80e2-4bf8-894b-27ea6b6fbc80 req-71639ee7-b385-4e8e-bdb7-812dbf12bc31 service nova] Creating event network-vif-deleted:6e5facc4-ebaf-4a5c-acfc-18ef07b5a3e2 for instance 23b85d32-1351-4c48-baea-9768ea97bd4d on n-h2-781139-2 Oct 03 14:45:37.384950 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e9a6b6b1-80e2-4bf8-894b-27ea6b6fbc80 req-71639ee7-b385-4e8e-bdb7-812dbf12bc31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039420 Oct 03 14:45:37.386169 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1622/3201] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:37.392436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:37.393778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: a5b0aaee-0779-4485-ab6b-eb253a86c235] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:37.401260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.402076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.403589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:37.404745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.406235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.406888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:37.408637 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cebeeaf1-b901-495c-9bfe-bda6c89ab5ed tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.449229 Oct 03 14:45:37.409798 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1580/3202] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:45:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:37.448810 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] HTTP exception thrown: Instance a5b0aaee-0779-4485-ab6b-eb253a86c235 could not be found. Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Request method failure captured: Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 HTTP/1.1 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvU45je4hqs3M_XXhsE-cABAX5JNxcPsYW3_gl5iI_Sh3B-E8sUIuelHeSESXdKxZ4XyViFHQ6FhdU3UOLWAAx6uDkuKZ2yyaBB9mX4HH-JVvyHqXhyl-kcIvxicJTzAthbr36bTtWUxH6sb88RAbfSruBTJCzSuWztw-JPVCcVQ25g Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 5f749474bd0a44cdbf3cfa73c4169272 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-MultipleCreateTestJSON-1399864753 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f749474bd0a44cdbf3cfa73c4169272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f749474bd0a44cdbf3cfa73c4169272", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f749474bd0a44cdbf3cfa73c4169272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f749474bd0a44cdbf3cfa73c4169272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-MultipleCreateTestJSON-1399864753 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 5f749474bd0a44cdbf3cfa73c4169272 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1399864753 Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-MultipleCreateTestJSON-1399864753-project Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: a7c1bee4ce4a46bcbd958ac731a5863e Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-MultipleCreateTestJSON-1399864753-project Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a5b0aaee-0779-4485-ab6b-eb253a86c235 could not be found. Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a5b0aaee-0779-4485-ab6b-eb253a86c235'} Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b0aaee-0779-4485-ab6b-eb253a86c235 could not be found. Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b0aaee-0779-4485-ab6b-eb253a86c235 could not be found. Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:37.454720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b0aaee-0779-4485-ab6b-eb253a86c235 could not be found. Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Returning 404 to user: Instance a5b0aaee-0779-4485-ab6b-eb253a86c235 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:37.458909 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fddb7fa-0e8e-44b6-a0f8-e5f62bc31fc5 tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235" status: 404 len: 111 microversion: 2.1 time: 0.069656 Oct 03 14:45:37.466312 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1623/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:37 2022] GET /compute/v2.1/servers/a5b0aaee-0779-4485-ab6b-eb253a86c235 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:45:37.477308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-986c7558-d1fe-4af2-a70c-d3b55714fa62 req-64cd0395-2e0c-42a2-83e8-c640ed1785a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5551a2d-d830-4659-86a3-517e278ac8e9", "name": "network-vif-plugged", "status": "completed", "tag": "1978cd53-c8d1-46ad-9e17-feb4deb818da"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:37.499666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-986c7558-d1fe-4af2-a70c-d3b55714fa62 req-64cd0395-2e0c-42a2-83e8-c640ed1785a8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.501773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-986c7558-d1fe-4af2-a70c-d3b55714fa62 req-64cd0395-2e0c-42a2-83e8-c640ed1785a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.503409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-986c7558-d1fe-4af2-a70c-d3b55714fa62 req-64cd0395-2e0c-42a2-83e8-c640ed1785a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:37.508125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:37.518104 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-986c7558-d1fe-4af2-a70c-d3b55714fa62 req-64cd0395-2e0c-42a2-83e8-c640ed1785a8 service nova] Creating event network-vif-plugged:1978cd53-c8d1-46ad-9e17-feb4deb818da for instance d5551a2d-d830-4659-86a3-517e278ac8e9 on n-h1-781139-2 Oct 03 14:45:37.524135 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-986c7558-d1fe-4af2-a70c-d3b55714fa62 req-64cd0395-2e0c-42a2-83e8-c640ed1785a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056147 Oct 03 14:45:37.525368 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1624/3204] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:37.532499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9dcfd54-ddb8-4f3e-98ce-0a6734506605 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb22bf55f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-167462729", "description": "tempest-description-596178272"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:37.791699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9dcfd54-ddb8-4f3e-98ce-0a6734506605 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.258963 Oct 03 14:45:37.792948 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1625/3205] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:45:37 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:37.802971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:37.803730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] [instance: 23b85d32-1351-4c48-baea-9768ea97bd4d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:37.813005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.814412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.814866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:37.815628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.816077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.816505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:37.825547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db518163-c524-4dea-b42d-6c64b0308987 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Action: 'create', calling method: .version_select at 0x7fb230f55820>, body: {"keypair": {"name": "tempest-keypair-1479336741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8diCfc4JFCJAkhFJt1rQ2m6LzzdN/KOft3sBLppuW1CcTGbw5C8GMSjpzAMHmyT4AH3IEWwbBYS9CEjMr298qNuZg7j+SsiqNIBsEKdY6IAN+V+OID/mDtLqMGIKSB1g=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:37.842691 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] HTTP exception thrown: Instance 23b85d32-1351-4c48-baea-9768ea97bd4d could not be found. Oct 03 14:45:37.844210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-db518163-c524-4dea-b42d-6c64b0308987 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Getting quotas for project c20da25d14b5454592756373984b0b59. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Request method failure captured: Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d HTTP/1.1 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvU45je4hqs3M_XXhsE-cABAX5JNxcPsYW3_gl5iI_Sh3B-E8sUIuelHeSESXdKxZ4XyViFHQ6FhdU3UOLWAAx6uDkuKZ2yyaBB9mX4HH-JVvyHqXhyl-kcIvxicJTzAthbr36bTtWUxH6sb88RAbfSruBTJCzSuWztw-JPVCcVQ25g Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 5f749474bd0a44cdbf3cfa73c4169272 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-MultipleCreateTestJSON-1399864753 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f749474bd0a44cdbf3cfa73c4169272"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f749474bd0a44cdbf3cfa73c4169272", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f749474bd0a44cdbf3cfa73c4169272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f749474bd0a44cdbf3cfa73c4169272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-MultipleCreateTestJSON-1399864753 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 5f749474bd0a44cdbf3cfa73c4169272 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1399864753 Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-MultipleCreateTestJSON-1399864753-project Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: a7c1bee4ce4a46bcbd958ac731a5863e Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-MultipleCreateTestJSON-1399864753-project Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 23b85d32-1351-4c48-baea-9768ea97bd4d could not be found. Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '23b85d32-1351-4c48-baea-9768ea97bd4d'} Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b85d32-1351-4c48-baea-9768ea97bd4d could not be found. Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b85d32-1351-4c48-baea-9768ea97bd4d could not be found. Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:37.845399 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b85d32-1351-4c48-baea-9768ea97bd4d could not be found. Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:37.850188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] Returning 404 to user: Instance 23b85d32-1351-4c48-baea-9768ea97bd4d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:37.850782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-db518163-c524-4dea-b42d-6c64b0308987 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Getting quotas for user b310d519aab7472abec9c2e76d501f06 and project c20da25d14b5454592756373984b0b59. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:45:37.850880 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ad912ab-7669-4a6e-b7b8-7e0bb0e9030f tempest-MultipleCreateTestJSON-1399864753 tempest-MultipleCreateTestJSON-1399864753-project] 10.222.0.20 "GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d" status: 404 len: 111 microversion: 2.1 time: 0.055706 Oct 03 14:45:37.851200 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1626/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:37 2022] GET /compute/v2.1/servers/23b85d32-1351-4c48-baea-9768ea97bd4d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:45:37.859168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab54ec94-cd44-42f2-a630-ffaeffeb07d8 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230fc64c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:37.882169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db518163-c524-4dea-b42d-6c64b0308987 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.470479 Oct 03 14:45:37.883399 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1581/3207] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:45:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:37.981682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:37.982494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:37.989072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.989864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.990542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:37.991646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:37.992316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:37.993055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:38.248882 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab54ec94-cd44-42f2-a630-ffaeffeb07d8 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.396418 Oct 03 14:45:38.249530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1627/3208] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:45:37 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:38.265268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99205545-4695-467e-bc29-9ad904cef52c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb22bf55b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:38.611938 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99205545-4695-467e-bc29-9ad904cef52c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce" status: 202 len: 0 microversion: 2.1 time: 0.351157 Oct 03 14:45:38.612529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1628/3209] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:45:38 2022] DELETE /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:45:38.617398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:38.618246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:38.625961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:38.626654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:38.627267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:38.628145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:38.628841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:38.629458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:38.678692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:38.694642 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d81ab041-a74d-49d3-9fd6-0e690c5ca9cc tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.717167 Oct 03 14:45:38.695929 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1582/3210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:37 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:38.712405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0ebadc14-df40-4442-aa47-8b181e8c532a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230c73040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:38.786999 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0ebadc14-df40-4442-aa47-8b181e8c532a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.087767 Oct 03 14:45:38.790449 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1583/3211] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:38 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:38.798162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aefba29d-d6f8-497e-a468-b05db8927229 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230ded940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:38.851454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:38.862359 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ad178d9-9bb4-4f0d-8fa3-e50e906d4c3f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.248488 Oct 03 14:45:38.862943 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1629/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:38 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:38.889230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:38.891971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:38.896541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-aefba29d-d6f8-497e-a468-b05db8927229 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:45:38.897195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.security_group_api [None req-aefba29d-d6f8-497e-a468-b05db8927229 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group 00015c85-0f56-4e1c-bf9c-38a00250ebce not found {{(pid=128868) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:45:38.897731 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-aefba29d-d6f8-497e-a468-b05db8927229 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:45:38.897731 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-3e02ad68-6468-4855-be3f-88863b159761'] Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aefba29d-d6f8-497e-a468-b05db8927229 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce HTTP/1.1 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: exception: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-3e02ad68-6468-4855-be3f-88863b159761'] Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '00015c85-0f56-4e1c-bf9c-38a00250ebce'} Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:45:38.899797 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e02ad68-6468-4855-be3f-88863b159761'] Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e02ad68-6468-4855-be3f-88863b159761'] Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e02ad68-6468-4855-be3f-88863b159761'] Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e02ad68-6468-4855-be3f-88863b159761'] Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aefba29d-d6f8-497e-a468-b05db8927229 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-3e02ad68-6468-4855-be3f-88863b159761'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:38.904374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aefba29d-d6f8-497e-a468-b05db8927229 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce" status: 404 len: 194 microversion: 2.1 time: 0.109904 Oct 03 14:45:38.908591 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1584/3213] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:45:38 2022] GET /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:45:38.916695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:38.917391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-694c6692-11f7-4fa1-a4b2-1dc808de1a90 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230978a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:38.918818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:38.921515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:38.922713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:38.924107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:38.926520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:39.017587 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3237ee36-c337-4aaa-823d-2233c9530aa7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 200 len: 324 microversion: 2.1 time: 0.134361 Oct 03 14:45:39.018753 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1630/3214] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:45:38 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 324 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:45:39.029241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:39.030227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:39.050384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:39.051154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:39.051756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:39.053616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:39.055895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:39.058800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:39.343657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:39.353854 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c277c03-c2e7-4eb9-a23c-24d023bca9c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.329558 Oct 03 14:45:39.358460 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1631/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:39 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:39.389353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:39.391092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:39.401779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:39.404290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:39.406003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:39.406960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:39.409695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:39.410476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:39.569210 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-694c6692-11f7-4fa1-a4b2-1dc808de1a90 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130" status: 202 len: 0 microversion: 2.1 time: 0.662217 Oct 03 14:45:39.573472 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1585/3216] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:45:38 2022] DELETE /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130 => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:45:39.579344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12e42aaa-8586-4443-b567-7a9eeba5015a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb2302823a0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:39.627727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-12e42aaa-8586-4443-b567-7a9eeba5015a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:45:39.628749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.security_group_api [None req-12e42aaa-8586-4443-b567-7a9eeba5015a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group d389227e-e1e7-48a3-a074-d5427f236130 not found {{(pid=128868) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:45:39.629464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-12e42aaa-8586-4443-b567-7a9eeba5015a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:45:39.629464 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-8ae93128-cdc1-4639-b431-bdc9662663bf'] Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12e42aaa-8586-4443-b567-7a9eeba5015a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130 HTTP/1.1 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: exception: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-8ae93128-cdc1-4639-b431-bdc9662663bf'] Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'd389227e-e1e7-48a3-a074-d5427f236130'} Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:45:39.632731 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae93128-cdc1-4639-b431-bdc9662663bf'] Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae93128-cdc1-4639-b431-bdc9662663bf'] Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae93128-cdc1-4639-b431-bdc9662663bf'] Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae93128-cdc1-4639-b431-bdc9662663bf'] Oct 03 14:45:39.637132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:45:39.642248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12e42aaa-8586-4443-b567-7a9eeba5015a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:45:39.642248 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-8ae93128-cdc1-4639-b431-bdc9662663bf'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:39.643631 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12e42aaa-8586-4443-b567-7a9eeba5015a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130" status: 404 len: 194 microversion: 2.1 time: 0.068711 Oct 03 14:45:39.647931 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1586/3217] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:45:39 2022] GET /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:45:39.658469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d3b4079-432c-4ff9-b4dd-8d72a2cc4a3c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230ccd9d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:39.706647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:39.719315 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5dd9ecc-0639-4395-9b99-f96b8c6c35ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.334978 Oct 03 14:45:39.720703 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1632/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:39 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:39.733423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:39.733423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:39.752447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:39.753723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:39.756277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:39.758371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:39.760787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:39.762511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:40.228752 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d3b4079-432c-4ff9-b4dd-8d72a2cc4a3c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a" status: 202 len: 0 microversion: 2.1 time: 0.578556 Oct 03 14:45:40.230304 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1587/3219] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:45:39 2022] DELETE /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:45:40.238782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.241489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:40.264876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:40.271605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:40.272067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:40.306551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:40.307181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:40.308516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:40.368429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:40.394335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-296eb48c-fda4-4aef-81a7-0d8d6b5c6ab4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.670335 Oct 03 14:45:40.412899 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1633/3220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:39 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:40.445980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fb61f1b-1d05-4a41-80f5-ea832472a343 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234bfae50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.551889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fb61f1b-1d05-4a41-80f5-ea832472a343 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.135113 Oct 03 14:45:40.567869 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1634/3221] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:40.573158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aeb4b06-30a7-440b-8920-289f9b0961f1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb234a87430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.609707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-4aeb4b06-30a7-440b-8920-289f9b0961f1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:45:40.610558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-4aeb4b06-30a7-440b-8920-289f9b0961f1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group f6161dda-4614-4f6a-bb7d-4687a442503a not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:45:40.611292 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4aeb4b06-30a7-440b-8920-289f9b0961f1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:45:40.611292 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6b57c9b0-880e-4f4f-a9df-62b116912d1f'] Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aeb4b06-30a7-440b-8920-289f9b0961f1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a HTTP/1.1 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6b57c9b0-880e-4f4f-a9df-62b116912d1f'] Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f6161dda-4614-4f6a-bb7d-4687a442503a'} Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:45:40.613598 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b57c9b0-880e-4f4f-a9df-62b116912d1f'] Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b57c9b0-880e-4f4f-a9df-62b116912d1f'] Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b57c9b0-880e-4f4f-a9df-62b116912d1f'] Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b57c9b0-880e-4f4f-a9df-62b116912d1f'] Oct 03 14:45:40.619560 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:45:40.623945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aeb4b06-30a7-440b-8920-289f9b0961f1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:45:40.623945 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6b57c9b0-880e-4f4f-a9df-62b116912d1f'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:45:40.625579 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4aeb4b06-30a7-440b-8920-289f9b0961f1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a" status: 404 len: 194 microversion: 2.1 time: 0.056382 Oct 03 14:45:40.627882 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1635/3222] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:45:40.635229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-632ddfc2-4fd6-4028-89f4-de987800777b req-88fbf33e-4dfb-4d67-b5e9-ab1a640981f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c955fddf-0aa8-4d03-899f-5a279d5bd731", "name": "network-vif-plugged", "status": "completed", "tag": "7a8040c9-7ffa-4072-af5c-7db245ae0faa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:40.648594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-632ddfc2-4fd6-4028-89f4-de987800777b req-88fbf33e-4dfb-4d67-b5e9-ab1a640981f2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:40.649378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-632ddfc2-4fd6-4028-89f4-de987800777b req-88fbf33e-4dfb-4d67-b5e9-ab1a640981f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:40.649979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-632ddfc2-4fd6-4028-89f4-de987800777b req-88fbf33e-4dfb-4d67-b5e9-ab1a640981f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:40.666357 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-632ddfc2-4fd6-4028-89f4-de987800777b req-88fbf33e-4dfb-4d67-b5e9-ab1a640981f2 service nova] Creating event network-vif-plugged:7a8040c9-7ffa-4072-af5c-7db245ae0faa for instance c955fddf-0aa8-4d03-899f-5a279d5bd731 on n-h1-781139-2 Oct 03 14:45:40.675503 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-632ddfc2-4fd6-4028-89f4-de987800777b req-88fbf33e-4dfb-4d67-b5e9-ab1a640981f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046049 Oct 03 14:45:40.676302 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1636/3223] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:40.683261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14fde831-382c-4112-b5b5-530528142d02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb22be063a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:40.927201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:40.942111 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12eff4ca-a39a-4f70-8d92-5a70006071d1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.709090 Oct 03 14:45:40.944585 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1588/3224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:40.973967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-56908739", "imageRef": "c1e8f613-6326-4bb7-b874-5ca07bd4e059", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2dc1d5ba-04a2-4246-8389-5df79a0c6916"}], "security_groups": [{"name": "tempest-securitygroup--1897901208"}], "key_name": "tempest-keypair-1479336741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:41.062614 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14fde831-382c-4112-b5b5-530528142d02 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.384100 Oct 03 14:45:41.063410 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1637/3225] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:45:40 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:41.076512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:41.077312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:41.086062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:41.086657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:41.087103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:41.090393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:41.091787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:41.092749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:41.268699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] validate_networks() for [('2dc1d5ba-04a2-4246-8389-5df79a0c6916', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:45:41.321910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:41.340175 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cd0f35c-d564-4216-a958-0e1df7d96f47 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.267994 Oct 03 14:45:41.341161 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1638/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:41 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:41.346328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd58a586-d393-4d52-b5fe-79665c0cf0c7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb234c0d430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1518097389", "description": "tempest-description-1830117281"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:41.576582 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd58a586-d393-4d52-b5fe-79665c0cf0c7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.233964 Oct 03 14:45:41.591208 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1639/3227] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:45:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:41.597574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:41.598340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:41.607720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:41.608190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:41.609188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:41.624217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:41.625489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:41.626101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:41.883313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:41.892221 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eaa4ef6c-0c14-4e5a-8b54-855b292e6e06 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1317 microversion: 2.1 time: 0.299612 Oct 03 14:45:41.895806 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1640/3228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:41 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:41.904496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1661620274", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "85fcbfd3-3026-41ec-a964-76a31555f33f"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:42.033968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] validate_networks() for [('85fcbfd3-3026-41ec-a964-76a31555f33f', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:45:42.172198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:45:42.172615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:45:42.173119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:45:42.173824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:45:42.174233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:45:42.197257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:42.197918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:42.198367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:42.199506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:42.200175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:42.200540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:42.247519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Getting quotas for project c20da25d14b5454592756373984b0b59. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:45:42.263351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Getting quotas for user b310d519aab7472abec9c2e76d501f06 and project c20da25d14b5454592756373984b0b59. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:45:42.297472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:45:42.300218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c1e8f613-6326-4bb7-b874-5ca07bd4e059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:45:42.365896 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c7029bb-40b3-453b-8425-8c24d338d763 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.396449 Oct 03 14:45:42.367924 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1589/3229] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:45:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:45:42.373461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2429b21f-ad97-4e40-b99b-5ad6ae102245 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230ee0160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:42.467300 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2429b21f-ad97-4e40-b99b-5ad6ae102245 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.097925 Oct 03 14:45:42.468892 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1590/3230] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:42 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:42.484121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3c3456ee-ff85-4e34-aa28-cb0e729ef491 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb230ccd0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1391096239", "description": "tempest-description-293849087"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:42.817717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3c3456ee-ff85-4e34-aa28-cb0e729ef491 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.346706 Oct 03 14:45:42.818423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1591/3231] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:45:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:42.837181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-11e874fc-dddf-418f-ab3f-ee9615873acb tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:42.842112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-11e874fc-dddf-418f-ab3f-ee9615873acb tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:42.866515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:43.026482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-11e874fc-dddf-418f-ab3f-ee9615873acb tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:43.040708 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-11e874fc-dddf-418f-ab3f-ee9615873acb tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1244 microversion: 2.1 time: 0.207788 Oct 03 14:45:43.041589 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1592/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:42 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1244 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:43.048302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:43.048828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:43.068475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:43.069454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:43.070059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:43.070947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:43.071407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:43.071834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:43.484376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:43.494342 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e1e292c2-e8c4-40d1-b52d-b71ccb7f68ff tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1467 microversion: 2.1 time: 0.451678 Oct 03 14:45:43.495220 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1593/3233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:43 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1467 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:43.517257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-121567942", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "a6abdc5d-92e2-4981-9b71-44c3cc5ea3ec"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:43.611373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] validate_networks() for [('a6abdc5d-92e2-4981-9b71-44c3cc5ea3ec', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:45:43.955865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:45:43.957021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:45:43.960176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:45:43.960995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:45:43.961838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:45:43.981322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:43.981960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:43.982471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:43.983342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:43.983958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:43.984650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:44.047321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:45:44.054302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for user 2cd32680b6b342ea962e104cfaf4c311 and project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:45:44.117551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:45:44.128233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:45:44.252902 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f83ac6d-61da-4f53-9e86-97d5c39626de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.354990 Oct 03 14:45:44.261765 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1641/3234] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:45:44.275139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf892f53-7cb9-4b54-8f28-d41b6105ef0f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb22be06d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.400340 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf892f53-7cb9-4b54-8f28-d41b6105ef0f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.141754 Oct 03 14:45:44.401435 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1642/3235] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:44.414660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.417537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:44.439377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:44.440169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:44.440800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:44.443116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:44.443881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:44.444844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:44.485470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:45:44.485973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:45:44.486551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:45:44.487049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:45:44.487919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:45:44.503356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:44.507914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:44.508770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:44.509706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:44.511681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:44.513587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:44.562414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Getting quotas for project c96c546d1de748f2bffb076294563a51. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:45:44.568726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Getting quotas for user 9c4d609f3be34d37936ff6970113e911 and project c96c546d1de748f2bffb076294563a51. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:45:44.585294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:45:44.588179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:45:44.712296 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5cd221ab-4404-437c-a7fc-f638df282584 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215633 Oct 03 14:45:44.718478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1594/3236] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:45:44.739112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.752741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:44.825937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:44.826550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:44.828048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:44.828821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:44.833564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:44.835568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:44.896691 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ae709f8-734a-4815-be36-013963fbfd0e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1618 microversion: 2.1 time: 0.493953 Oct 03 14:45:44.913048 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1643/3237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1618 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:44.913048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fbfdd331-c793-41f2-bbb4-bf5623d3f41d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:44.913048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fbfdd331-c793-41f2-bbb4-bf5623d3f41d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:45.052556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbfdd331-c793-41f2-bbb4-bf5623d3f41d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:45.061563 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fbfdd331-c793-41f2-bbb4-bf5623d3f41d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1215 microversion: 2.1 time: 0.159230 Oct 03 14:45:45.065292 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1644/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:45.078574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c0c71fc-b829-4b4e-b0f2-34e48751c09c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:45.088737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c0c71fc-b829-4b4e-b0f2-34e48751c09c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:45.104797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:45.114926 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7c4b6a18-7c6a-4e42-b605-f56d389a9473 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1296 microversion: 2.1 time: 0.393970 Oct 03 14:45:45.119174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1595/3239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:44 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1296 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:45.293482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1050310803", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["cc064e15-e471-4aea-9ae4-545bad8c989b"]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:45.295887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c0c71fc-b829-4b4e-b0f2-34e48751c09c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:45.316273 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c0c71fc-b829-4b4e-b0f2-34e48751c09c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1215 microversion: 2.1 time: 0.243869 Oct 03 14:45:45.318396 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1645/3240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:45 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:45.418707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d30a9fd2-af0a-4037-89a2-82b28dd45a3b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234a873a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:45.500362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] validate_networks() for None {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:45:45.510823 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d30a9fd2-af0a-4037-89a2-82b28dd45a3b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1454 microversion: 2.1 time: 0.097914 Oct 03 14:45:45.512133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1646/3241] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:45 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:46.091930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:46.093572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:46.114000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.115416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.116363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.127986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.127986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.127986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.265472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:45:46.266308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:45:46.267061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:45:46.267730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:45:46.268457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:45:46.286855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:46.292986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.297828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.297828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.301529 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77b78fa5-072a-499c-a1b6-209e694e7c0e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1267 microversion: 2.1 time: 0.215661 Oct 03 14:45:46.301701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.302210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.302647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.304962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1647/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:46 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:45:46.316754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:46.319404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:46.336700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.350593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.351163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.351937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.352414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.352846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.371591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:45:46.385477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:45:46.435346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:45:46.440048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:45:46.534570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:46.549581 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b30f989-f270-4626-8c0e-0ec18422d891 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1302 microversion: 2.1 time: 0.242877 Oct 03 14:45:46.550628 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1648/3243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:46 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1302 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:46.558433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:46.559904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:46.581659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.582536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.583137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.584098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:46.584715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:46.585442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:46.591737 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0867064a-aeb7-429d-94f8-8982d8efd234 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302724 Oct 03 14:45:46.592811 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1596/3244] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:45:46.613219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-44cbce7e-0bcf-45d8-88e6-89f7b502b42a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230d85ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:46.805167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:46.826341 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4f3e8ce-1a7a-46d5-a1d1-2ff058c63be7 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1211 microversion: 2.1 time: 0.273656 Oct 03 14:45:46.828499 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1649/3245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:46 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1211 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:46.851743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68b7b0c4-2799-4465-95d5-63027d004f17 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:46.854018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68b7b0c4-2799-4465-95d5-63027d004f17 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:46.862392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:47.409009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68b7b0c4-2799-4465-95d5-63027d004f17 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:47.436622 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68b7b0c4-2799-4465-95d5-63027d004f17 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1217 microversion: 2.1 time: 0.572336 Oct 03 14:45:47.454814 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1650/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:46 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1217 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:47.468019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:47.469551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:47.491039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:47.491948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:47.492824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:47.493786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:47.494446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:47.495177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:48.028839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:48.046331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-009c68b1-4e7b-4ad9-9b29-e92421b6a543 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1275 microversion: 2.1 time: 0.589974 Oct 03 14:45:48.047445 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1651/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:47 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1275 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:48.065509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:48.066523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:48.076720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:48.080060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:48.085637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:48.087049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:48.087745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:48.088382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:48.498415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:48.516208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26984605-3793-41ec-a057-c354e7ea5048 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1302 microversion: 2.1 time: 0.464333 Oct 03 14:45:48.518062 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1652/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:48 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1302 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:48.530277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:48.532062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:48.562561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:48.566206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:48.567639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:48.568621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:48.571969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:48.572634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:48.773920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:48.786971 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ec7735b-1f67-484f-898d-6538a0349b7f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1275 microversion: 2.1 time: 0.267758 Oct 03 14:45:48.793833 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1653/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:48 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:48.804208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:48.805301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:48.845235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:48.859201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:48.860235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:48.863479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:48.864137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:48.867668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:49.404198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:49.417899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9816f9cf-9a11-4612-a0ee-ee25ca7ddea0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1269 microversion: 2.1 time: 0.621798 Oct 03 14:45:49.437024 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1654/3250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:48 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1269 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:49.444974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:49.444974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:49.489479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:49.490225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:49.490796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:49.491633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:49.492176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:49.492733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:49.678728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:49.682464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:49.694181 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc5b8c8b-49c6-4adc-8196-67b5986af7f9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1273 microversion: 2.1 time: 0.264798 Oct 03 14:45:49.698964 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1655/3251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:49 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1273 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:49.710443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:49.711329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:49.730499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:49.732540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:49.733655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:49.735248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:49.740050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:49.740737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:50.371858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:50.390984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3fad985-7848-4b07-8326-549ab16a9cff tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.689838 Oct 03 14:45:50.396038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1656/3252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:49 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:50.420520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:50.431914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:50.467047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:50.468483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:50.468970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:50.469771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:50.470216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:50.470653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:50.933445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:50.947793 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d03c854-2856-44e4-b805-8ed29941f43a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1273 microversion: 2.1 time: 0.547998 Oct 03 14:45:50.964001 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1657/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:50 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1273 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:50.976564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:50.978624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:51.028791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:51.029590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:51.033320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:51.035735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:51.041996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:51.042895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:51.231048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:51.245446 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-335bea31-aba3-4f22-9d40-dabb394e8167 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1275 microversion: 2.1 time: 0.279962 Oct 03 14:45:51.248570 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1658/3254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:50 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1275 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:51.268472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:51.270059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:51.288088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:51.289043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:51.290436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:51.293302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:51.294569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:51.296429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:52.275281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:52.283950 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-604d2c08-5e24-43a2-8dac-fc50e906ac79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1315 microversion: 2.1 time: 1.033936 Oct 03 14:45:52.286946 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1659/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:51 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:52.299803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:52.300658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:52.324159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:52.326641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:52.329132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:52.333786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:52.338848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:52.343827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:53.105698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:53.133015 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7aa1e015-97f2-489d-b590-809b8a7cc570 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.834890 Oct 03 14:45:53.143541 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1660/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:52 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:53.183412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:53.185831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:53.218181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:53.229719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:53.235458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:53.238379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:53.245500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:53.247960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:54.032651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:54.106636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:54.141833 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcdf29f0-9237-4190-b884-90868c1c5561 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1315 microversion: 2.1 time: 0.976907 Oct 03 14:45:54.143473 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1661/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:53 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:54.172522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:54.172522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:54.184404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:54.185578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:54.186283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:54.192039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:54.194866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:54.196058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:54.397496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:54.415276 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-408832c7-7dbb-48ab-89bb-000f4881f865 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1275 microversion: 2.1 time: 0.268265 Oct 03 14:45:54.418799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1662/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:54 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:54.436614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:54.438514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:54.461094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:54.463562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:54.466390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:54.469193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:54.473995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:54.475363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:55.004555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:55.020242 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9afd330a-d730-46d7-b92b-0facd8d7dd68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1315 microversion: 2.1 time: 0.597724 Oct 03 14:45:55.023059 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1663/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:54 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:55.035061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:55.036473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:55.056261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:55.059303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:55.060884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:55.063614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:55.064355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:55.065431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:55.553293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:55.578192 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d18c0d5-c74e-4d78-9dbc-1a066ddd7efc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.553599 Oct 03 14:45:55.580202 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1664/3260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:55 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:55.591099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0e7d3cbb-1aaf-4444-af33-41b5bbd8da12 req-929b9789-6204-4560-be30-f9f696201104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c94af6-b9e0-4f15-907a-60f0d062a325", "tag": "d9a86fed-bfe7-4009-bf6e-b08f71f97419"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:55.634780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0e7d3cbb-1aaf-4444-af33-41b5bbd8da12 req-929b9789-6204-4560-be30-f9f696201104 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:55.638485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0e7d3cbb-1aaf-4444-af33-41b5bbd8da12 req-929b9789-6204-4560-be30-f9f696201104 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:55.646986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0e7d3cbb-1aaf-4444-af33-41b5bbd8da12 req-929b9789-6204-4560-be30-f9f696201104 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:55.672208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0e7d3cbb-1aaf-4444-af33-41b5bbd8da12 req-929b9789-6204-4560-be30-f9f696201104 service nova] Creating event network-changed:d9a86fed-bfe7-4009-bf6e-b08f71f97419 for instance 63c94af6-b9e0-4f15-907a-60f0d062a325 on n-h1-781139-2 Oct 03 14:45:55.692782 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0e7d3cbb-1aaf-4444-af33-41b5bbd8da12 req-929b9789-6204-4560-be30-f9f696201104 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108126 Oct 03 14:45:55.694222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1665/3261] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:55.712242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:45:55.728182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:45:55.761910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:55.762827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:55.764704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:55.767879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:55.769113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:55.771786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:56.337415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:56.338677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:56.402928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=24 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:56.524265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:56.592876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:45:56.607473 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32437a0c-cb20-4db1-869b-1153a81b0164 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1315 microversion: 2.1 time: 0.907790 Oct 03 14:45:56.608518 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1666/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:45:55 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:45:56.637340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-91b5e869-71b0-41a8-b9ca-00410d869983 req-51cf5d9b-d21e-4c61-88f7-f6cef9ac336c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bc8d1e-08aa-4b83-9f91-95eb81cae9ce", "tag": "f9661711-cbbc-4465-b00b-feb7089251d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:56.649836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-91b5e869-71b0-41a8-b9ca-00410d869983 req-51cf5d9b-d21e-4c61-88f7-f6cef9ac336c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:45:56.650770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-91b5e869-71b0-41a8-b9ca-00410d869983 req-51cf5d9b-d21e-4c61-88f7-f6cef9ac336c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:45:56.651632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-91b5e869-71b0-41a8-b9ca-00410d869983 req-51cf5d9b-d21e-4c61-88f7-f6cef9ac336c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:45:56.671866 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-91b5e869-71b0-41a8-b9ca-00410d869983 req-51cf5d9b-d21e-4c61-88f7-f6cef9ac336c service nova] Creating event network-changed:f9661711-cbbc-4465-b00b-feb7089251d1 for instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce on n-h2-781139-2 Oct 03 14:45:56.679207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-91b5e869-71b0-41a8-b9ca-00410d869983 req-51cf5d9b-d21e-4c61-88f7-f6cef9ac336c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049403 Oct 03 14:45:56.686351 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1667/3263] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:45:57.168762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-695823977", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:45:57.419748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:01.118813 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-44cbce7e-0bcf-45d8-88e6-89f7b502b42a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1463 microversion: 2.1 time: 14.524872 Oct 03 14:46:01.119607 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1597/3264] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:45:46 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1463 bytes in 14526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:01.135604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:46:01.136164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:46:01.136602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:46:01.137079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:46:01.137494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:46:01.138892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:01.141697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:01.155698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.158207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.158699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.159141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.159297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.159940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.160290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.160420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.160723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.161530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.162933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.165522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.180960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Getting quotas for project 3ba278f2f764406192d828021859b7a4. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:46:01.188635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Getting quotas for user 0e5d07a3c2ce4d679610c85a48b18cdd and project 3ba278f2f764406192d828021859b7a4. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:46:01.205670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:46:01.208536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:46:01.259699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60f57de5-b271-4488-a5d4-0ffc3133c6a1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 4.571456 Oct 03 14:46:01.261071 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1668/3265] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:45:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:46:01.266285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:01.267146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:01.277734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.280843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.281688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.282988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.298865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.299760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.534067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:01.551830 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-62623bc4-a30e-4d77-a473-53cbaade12e3 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.420123 Oct 03 14:46:01.555728 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1598/3266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:01 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:01.569852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:01.571235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:01.589452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:01.619480 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8ab948e-22bf-4765-8895-43967cae6e02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1315 microversion: 2.1 time: 0.356130 Oct 03 14:46:01.623561 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1669/3267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:01 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:01.627647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.629303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.629760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.635644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:01.637069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.638340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.639198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.644896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:01.683613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.685079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.688278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.691957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:01.695154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:01.697736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:01.985632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.001279 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95698e71-d431-4c6e-97d3-22f399a66a00 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1315 microversion: 2.1 time: 0.375782 Oct 03 14:46:02.005195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.006050 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1670/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:01 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:02.015335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-671fa3d1-b6fa-482f-9110-a06fa1c5c857 req-5818dbf9-0e48-408f-b87e-81b24cde99a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9872e40f-2db8-4aec-8013-bbe2d9454398", "tag": "f8f77608-7c7a-47c4-a6a2-1552510237c1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:02.015697 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45d66bb3-fa2d-434d-91a6-a9a3424b0bf9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.457823 Oct 03 14:46:02.018311 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1599/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:01 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:02.039360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d9382292-3347-4300-8d71-9347f00f1fc1 req-e85d59b6-b30d-48d6-8409-1975dad744f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bc8d1e-08aa-4b83-9f91-95eb81cae9ce", "name": "network-vif-plugged", "status": "completed", "tag": "f9661711-cbbc-4465-b00b-feb7089251d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:02.041301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-671fa3d1-b6fa-482f-9110-a06fa1c5c857 req-5818dbf9-0e48-408f-b87e-81b24cde99a5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.041781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-671fa3d1-b6fa-482f-9110-a06fa1c5c857 req-5818dbf9-0e48-408f-b87e-81b24cde99a5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.042211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-671fa3d1-b6fa-482f-9110-a06fa1c5c857 req-5818dbf9-0e48-408f-b87e-81b24cde99a5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.060784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d9382292-3347-4300-8d71-9347f00f1fc1 req-e85d59b6-b30d-48d6-8409-1975dad744f2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.061293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d9382292-3347-4300-8d71-9347f00f1fc1 req-e85d59b6-b30d-48d6-8409-1975dad744f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.061725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d9382292-3347-4300-8d71-9347f00f1fc1 req-e85d59b6-b30d-48d6-8409-1975dad744f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.073073 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-671fa3d1-b6fa-482f-9110-a06fa1c5c857 req-5818dbf9-0e48-408f-b87e-81b24cde99a5 service nova] Creating event network-changed:f8f77608-7c7a-47c4-a6a2-1552510237c1 for instance 9872e40f-2db8-4aec-8013-bbe2d9454398 on n-h2-781139-2 Oct 03 14:46:02.080592 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-671fa3d1-b6fa-482f-9110-a06fa1c5c857 req-5818dbf9-0e48-408f-b87e-81b24cde99a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072942 Oct 03 14:46:02.081844 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1671/3270] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:02.085868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d9382292-3347-4300-8d71-9347f00f1fc1 req-e85d59b6-b30d-48d6-8409-1975dad744f2 service nova] Creating event network-vif-plugged:f9661711-cbbc-4465-b00b-feb7089251d1 for instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce on n-h2-781139-2 Oct 03 14:46:02.097802 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d9382292-3347-4300-8d71-9347f00f1fc1 req-e85d59b6-b30d-48d6-8409-1975dad744f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063076 Oct 03 14:46:02.098566 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1600/3271] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:02.099634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5090137-3d75-48b4-ba37-22fa27e2393b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230439b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:02.112517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4e713ef1-4590-4d6b-8e3d-948b656d5456 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:02.113348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4e713ef1-4590-4d6b-8e3d-948b656d5456 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:02.196580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4e713ef1-4590-4d6b-8e3d-948b656d5456 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.210789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4e713ef1-4590-4d6b-8e3d-948b656d5456 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.215607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4e713ef1-4590-4d6b-8e3d-948b656d5456 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.218274 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4e713ef1-4590-4d6b-8e3d-948b656d5456 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1280 microversion: 2.47 time: 0.113977 Oct 03 14:46:02.220357 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1601/3272] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:02 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:02.231084 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5090137-3d75-48b4-ba37-22fa27e2393b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 200 len: 1463 microversion: 2.1 time: 0.147458 Oct 03 14:46:02.236035 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1672/3273] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:02 2022] GET /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:02.251210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:02.253069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:02.271542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.275721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.276885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.279334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.283908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.287021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.583319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:02.584051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:02.591710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.592338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.593037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.594226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.594778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.595274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.611995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.620538 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-73d67251-0649-4c62-b4a1-31511686acb4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1481 microversion: 2.1 time: 0.374425 Oct 03 14:46:02.633383 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1602/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:02 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1481 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:02.649056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:02.650121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:02.656646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.657219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.657666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.658570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:02.659033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:02.659615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:02.827964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.837690 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb347d56-5118-4527-9af3-22c60f904546 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1315 microversion: 2.1 time: 0.196152 Oct 03 14:46:02.853483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1603/3275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:02 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:02.903488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:02.914104 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-867b28a9-6700-462f-92e0-12ea0fee282a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.335312 Oct 03 14:46:02.915390 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1673/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:02 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:03.034253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:03.034847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:03.039530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:03.040132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:03.041328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.041875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.042239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.042934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.043474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.043896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.046803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.047487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.048100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.048841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.049580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.050006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.187472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:03.194325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:03.198533 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8db4d932-27e5-46b3-8b5a-7b5dd35cdf95 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1315 microversion: 2.1 time: 0.168236 Oct 03 14:46:03.199732 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1604/3277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:03 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:03.204122 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e2d7e74-1634-4d9b-a0f7-6d7d26165ac3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.168375 Oct 03 14:46:03.217568 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1674/3278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:03 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:03.249276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:03.249893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:03.257054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.257545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.263090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.263842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.264573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.265047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.344997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:03.354705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:03.358572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:03.359907 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f4ac571-7c2b-4107-a97e-0fc0d2fe02b9 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1332 microversion: 2.47 time: 0.114952 Oct 03 14:46:03.362262 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1605/3279] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:03 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:03.644133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:03.644766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:03.651848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.652463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.653021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.653733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.654184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.654606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.820021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:03.829061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-326c3328-0d11-4a56-b16a-1a22b942d0e8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1481 microversion: 2.1 time: 0.189101 Oct 03 14:46:03.829665 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1675/3280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:03 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1481 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:03.866475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:03.867803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:03.878433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.878947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.879994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.881142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.881917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.882518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.940503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:03.942187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:03.951207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.952022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.952636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.953562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:03.954169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:03.954778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:03.961485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:04.090619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.112069 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9e59856-90a5-43b7-9e57-64704ba15ffc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1502 microversion: 2.1 time: 0.246180 Oct 03 14:46:04.114268 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1606/3281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:03 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:04.131155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1fe1ac4d-4695-4dc7-bd4e-5e62783eb841 req-95585703-541c-46ab-a2b7-1ef3d5dfa80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f801c9d2-17e3-4e3a-9c79-856ec995115f", "tag": "9d6e70ae-6f8c-4d94-be73-fd8501a1ba66"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:04.157626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1fe1ac4d-4695-4dc7-bd4e-5e62783eb841 req-95585703-541c-46ab-a2b7-1ef3d5dfa80a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.158221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1fe1ac4d-4695-4dc7-bd4e-5e62783eb841 req-95585703-541c-46ab-a2b7-1ef3d5dfa80a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.158759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1fe1ac4d-4695-4dc7-bd4e-5e62783eb841 req-95585703-541c-46ab-a2b7-1ef3d5dfa80a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.177661 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1fe1ac4d-4695-4dc7-bd4e-5e62783eb841 req-95585703-541c-46ab-a2b7-1ef3d5dfa80a service nova] Creating event network-changed:9d6e70ae-6f8c-4d94-be73-fd8501a1ba66 for instance f801c9d2-17e3-4e3a-9c79-856ec995115f on n-h1-781139-2 Oct 03 14:46:04.187033 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1fe1ac4d-4695-4dc7-bd4e-5e62783eb841 req-95585703-541c-46ab-a2b7-1ef3d5dfa80a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071245 Oct 03 14:46:04.189128 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1607/3282] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:04.204288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a558ff66-f34b-416d-9a31-5e9d18612dca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:04.205245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.217028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a558ff66-f34b-416d-9a31-5e9d18612dca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.217532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a558ff66-f34b-416d-9a31-5e9d18612dca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.217976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a558ff66-f34b-416d-9a31-5e9d18612dca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.219806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55de540b-a5a1-4212-9a0e-f412023c05a4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.283484 Oct 03 14:46:04.237805 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1676/3283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:03 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:04.243319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2deebe8c-93a2-4ccf-ae51-7119b9eebc27 req-52aa1df3-cad0-4ec0-9a23-60367386f4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9872e40f-2db8-4aec-8013-bbe2d9454398", "name": "network-vif-plugged", "status": "completed", "tag": "f8f77608-7c7a-47c4-a6a2-1552510237c1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:04.254594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2deebe8c-93a2-4ccf-ae51-7119b9eebc27 req-52aa1df3-cad0-4ec0-9a23-60367386f4a4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.255215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2deebe8c-93a2-4ccf-ae51-7119b9eebc27 req-52aa1df3-cad0-4ec0-9a23-60367386f4a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.256107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2deebe8c-93a2-4ccf-ae51-7119b9eebc27 req-52aa1df3-cad0-4ec0-9a23-60367386f4a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.263798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a558ff66-f34b-416d-9a31-5e9d18612dca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Going to try to stop instance {{(pid=128868) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:46:04.269721 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2deebe8c-93a2-4ccf-ae51-7119b9eebc27 req-52aa1df3-cad0-4ec0-9a23-60367386f4a4 service nova] Creating event network-vif-plugged:f8f77608-7c7a-47c4-a6a2-1552510237c1 for instance 9872e40f-2db8-4aec-8013-bbe2d9454398 on n-h2-781139-2 Oct 03 14:46:04.277199 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2deebe8c-93a2-4ccf-ae51-7119b9eebc27 req-52aa1df3-cad0-4ec0-9a23-60367386f4a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038107 Oct 03 14:46:04.278242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1677/3284] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:04.283857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:04.284915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:04.291464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.292332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.293222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.294134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.294810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.295424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.329391 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a558ff66-f34b-416d-9a31-5e9d18612dca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce/action" status: 202 len: 0 microversion: 2.1 time: 0.137826 Oct 03 14:46:04.331446 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1608/3285] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:46:04 2022] POST /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:04.338259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:04.339423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:04.360113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.364875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.367083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.368295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.369261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.372606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.504539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.513964 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c85979d3-b3be-40b0-841a-165d1203affd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1315 microversion: 2.1 time: 0.234295 Oct 03 14:46:04.514641 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1678/3286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:04 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:04.519527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:04.520383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:04.527856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.529227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.529921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.530706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.531229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.531725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.555167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.563799 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-68d84c6f-ea55-44ad-ab26-80b469ab0648 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.230754 Oct 03 14:46:04.564811 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1609/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:04 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:04.579864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:04.579864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:04.587373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.588065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.589796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.590787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.591319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.591811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.662999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.672026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.674116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.676014 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ecfef53-573c-4819-ad90-8476f6646b90 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1338 microversion: 2.47 time: 0.102860 Oct 03 14:46:04.676902 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1610/3288] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:04 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:04.688331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:04.700879 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63202123-924a-4726-88b4-b252dcdb61af tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.184822 Oct 03 14:46:04.701969 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1679/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:04 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:04.851795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:04.852275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:04.858905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.859385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.859821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:04.860533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:04.861018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:04.861450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.000629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:05.011811 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3aa5969-5412-430c-afda-4853cec1194e tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1481 microversion: 2.1 time: 0.163879 Oct 03 14:46:05.012530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1611/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:04 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1481 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:05.243856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:05.244386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:05.251548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.252040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.252507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.253256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.253729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.254159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.537033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:05.537621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:05.546744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.547443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.548183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.549636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.550248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.550363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:05.550949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.562325 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9b3b655-f306-4739-9e0a-93bdd34a3554 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.322463 Oct 03 14:46:05.569529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1680/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:05 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:05.587529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:05.588167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:05.598849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.599363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.599787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.600698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.601955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.602546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.769042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:05.787242 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3f7706e-2db4-4556-8e94-79c5092ea763 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1315 microversion: 2.1 time: 0.253717 Oct 03 14:46:05.803433 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1612/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:05 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:05.807975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:05.819630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:05.820269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:05.822985 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10f8e83d-528e-49fe-a2f7-6c3d509cbe8f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.238412 Oct 03 14:46:05.827881 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1681/3293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:05 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:05.828497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.829207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.829816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.830671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.831264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.831845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.840975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:05.844032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:05.859693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.861666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.862302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.865064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:05.865787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:05.866446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:05.936751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:05.957955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:05.965382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:05.966840 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6605935b-5ea4-4f30-af8f-69db4df955d2 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1338 microversion: 2.47 time: 0.162101 Oct 03 14:46:05.967436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1613/3294] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:05 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1338 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:06.035729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:06.036324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:06.044421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.044981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.045442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:06.046321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.046965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.047409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:06.074229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:06.082658 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4ec65ed-1894-40a2-8a34-55107186fe31 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.253643 Oct 03 14:46:06.089527 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1682/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:05 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:06.196551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:06.207173 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e622ef4-7172-4497-b038-2731ac3e6915 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1481 microversion: 2.1 time: 0.175523 Oct 03 14:46:06.207915 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1614/3296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:06 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1481 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:06.588259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:06.589228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:06.608999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.609520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.609966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:06.611051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.611501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.611943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:06.778252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:06.788726 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4a431a9-f64e-4129-b306-d05d864115ec tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.204569 Oct 03 14:46:06.789316 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1683/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:06 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:06.815505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:06.816773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:06.823883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.824373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.833663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:06.834439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.834923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.835350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:06.850170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:06.850906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:06.875029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.875678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.876217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:06.877050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:06.879249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:06.881897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.164763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.170374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.174392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:07.180781 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7bc3d6ea-462e-436b-9d96-2bd58e22290b tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1315 microversion: 2.1 time: 0.369541 Oct 03 14:46:07.182220 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1615/3298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:06 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:07.183163 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8bd10cd-5f4d-4fcf-a8c7-75cf29e5d9a9 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.338409 Oct 03 14:46:07.184800 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1684/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:06 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:07.187978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:07.188495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:07.195049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.195769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.196393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.197308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.198123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.198714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.199335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:07.200052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:07.210841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.211471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.212941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.214002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.214773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.216519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.360569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.378784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.381412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.394641 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9e703749-0e97-4375-b4d9-54b1f1e9e626 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1359 microversion: 2.47 time: 0.210801 Oct 03 14:46:07.395403 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1616/3300] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:07 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:07.405866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:07.406635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:07.421598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.422271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.423140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.424229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.425390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.425992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.471099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.483005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c997e31-7ac4-4eef-9d38-f70bdecd7fab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.296324 Oct 03 14:46:07.495375 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1685/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:07 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:07.501643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1117462478"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:07.504248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:07.510965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.511512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.511884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.512615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.513174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.513536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.579099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.588614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12e7e39d-cca1-4868-a070-ed3a9ea8adb1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1481 microversion: 2.1 time: 0.192122 Oct 03 14:46:07.589168 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1617/3302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:07 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1481 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:07.713794 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-786d07c2-57a0-4154-9ba3-f30c7f197ebc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "POST /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926/action" status: 202 len: 52 microversion: 2.47 time: 0.217059 Oct 03 14:46:07.714757 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1686/3303] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:46:07 2022] POST /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926/action => generated 52 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:46:07.726749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:07.727403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:07.735078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.735948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.736436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.737423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.737769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.738187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.764902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:07.813138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:07.814193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:07.821295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.822019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.822464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.823173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.823657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.824183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.864565 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fcb00ec0-f715-4097-8da3-7420b4c2d8c0 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 204 len: 0 microversion: 2.47 time: 0.140737 Oct 03 14:46:07.865586 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1618/3304] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:46:07 2022] DELETE /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 14:46:07.873994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:07.875135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:07.882307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.883048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.883661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.884528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:07.885165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:07.885605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:07.963558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.979664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.981734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:07.984101 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b2c9416-3769-4982-9ab5-71e2a6306b7e tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1365 microversion: 2.47 time: 0.113952 Oct 03 14:46:07.985567 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1619/3305] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:07 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:46:08.086085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:08.097477 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f60870ff-daaa-4ad1-bf3b-1c83c7c75040 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.288434 Oct 03 14:46:08.114126 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1687/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:07 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:08.204590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:08.205399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:08.212078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:08.212357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.212865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:08.213127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.213944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.215109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.215574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.216182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.220456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.221392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.221904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.222681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.223202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.223710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.359321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:08.370305 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5fc821e-4097-45c1-8bad-2c60fd7e0c7a tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1502 microversion: 2.1 time: 0.169484 Oct 03 14:46:08.373199 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1620/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:08 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:08.373510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:08.383087 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-800533c7-5c14-4e72-a815-fa147972be52 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.175068 Oct 03 14:46:08.383825 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1688/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:08 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:08.396807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1518097389"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:08.397467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:08.403802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.404308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.404734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.405457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.405909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.406334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.506179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:08.507074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:08.513797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.514740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.515378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.516060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.516732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.517168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.534333 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.network.security_group_api [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Adding security group a8f64829-f3e8-4d01-a7b8-7b084f66524f to port f8f77608-7c7a-47c4-a6a2-1552510237c1 Oct 03 14:46:08.664663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:08.674788 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44ae46d4-2165-4044-9e3d-3a4fc3800201 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.172821 Oct 03 14:46:08.675399 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1689/3309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:08 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:08.680461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:08.681408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:08.687661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.688352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.689079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.689964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:08.690559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:08.691228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:08.864660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:08.875729 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77b6f36e-fae3-413d-ad0d-18abff69aec9 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1481 microversion: 2.1 time: 0.198098 Oct 03 14:46:08.876854 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1690/3310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:08 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1481 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:08.935937 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-782fd455-fa39-4d6b-af33-131416b1945f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398/action" status: 202 len: 0 microversion: 2.1 time: 0.543444 Oct 03 14:46:08.936590 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1621/3311] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:46:08 2022] POST /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:08.945008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a9864a1-a29b-4392-95f0-f68b2d761049 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb234ae9d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:08.963922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-90f1d00e-02a4-484c-8807-5d73b9e1b22e req-a291f32a-10fb-431f-a1f5-7a23e5e15947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9872e40f-2db8-4aec-8013-bbe2d9454398", "tag": "f8f77608-7c7a-47c4-a6a2-1552510237c1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:09.006504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-90f1d00e-02a4-484c-8807-5d73b9e1b22e req-a291f32a-10fb-431f-a1f5-7a23e5e15947 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.007749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-90f1d00e-02a4-484c-8807-5d73b9e1b22e req-a291f32a-10fb-431f-a1f5-7a23e5e15947 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.011018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-90f1d00e-02a4-484c-8807-5d73b9e1b22e req-a291f32a-10fb-431f-a1f5-7a23e5e15947 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.049300 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-90f1d00e-02a4-484c-8807-5d73b9e1b22e req-a291f32a-10fb-431f-a1f5-7a23e5e15947 service nova] Creating event network-changed:f8f77608-7c7a-47c4-a6a2-1552510237c1 for instance 9872e40f-2db8-4aec-8013-bbe2d9454398 on n-h2-781139-2 Oct 03 14:46:09.055931 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-90f1d00e-02a4-484c-8807-5d73b9e1b22e req-a291f32a-10fb-431f-a1f5-7a23e5e15947 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095992 Oct 03 14:46:09.057034 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1622/3312] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:46:09.063291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:09.064101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:09.070443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.071084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.071613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.072403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.073002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.073634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.170454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-6a9864a1-a29b-4392-95f0-f68b2d761049 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use.", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:09.172031 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6a9864a1-a29b-4392-95f0-f68b2d761049 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use. Oct 03 14:46:09.172031 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-1afc8eb5-a803-44ce-9503-6b3e93d6085c'] Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a9864a1-a29b-4392-95f0-f68b2d761049 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f HTTP/1.1 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: exception: Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use. Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-1afc8eb5-a803-44ce-9503-6b3e93d6085c'] Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a8f64829-f3e8-4d01-a7b8-7b084f66524f'} Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:09.175079 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use. Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1afc8eb5-a803-44ce-9503-6b3e93d6085c'] Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use. Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1afc8eb5-a803-44ce-9503-6b3e93d6085c'] Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use. Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1afc8eb5-a803-44ce-9503-6b3e93d6085c'] Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use. Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1afc8eb5-a803-44ce-9503-6b3e93d6085c'] Oct 03 14:46:09.179892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:09.185296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a9864a1-a29b-4392-95f0-f68b2d761049 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 400 to user: Security Group a8f64829-f3e8-4d01-a7b8-7b084f66524f in use. Oct 03 14:46:09.185296 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-1afc8eb5-a803-44ce-9503-6b3e93d6085c'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:09.186230 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a9864a1-a29b-4392-95f0-f68b2d761049 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f" status: 400 len: 185 microversion: 2.1 time: 0.245090 Oct 03 14:46:09.187813 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1691/3313] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:08 2022] DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f => generated 185 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:46:09.194914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:09.195238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:09.195857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:09.204091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.204850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.205493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.206388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.207037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.207492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.208040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:09.210241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:09.212054 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7eff0abf-a3ad-4915-8ad6-61292b400fe1 tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1365 microversion: 2.47 time: 0.153860 Oct 03 14:46:09.214016 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1623/3314] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:09 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:09.237180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:09.242244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:09.253544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.254041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.254481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.255247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.256076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.256505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.402502 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-575d8009-eced-4e00-8157-637b0d6057c1 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398/action" status: 202 len: 0 microversion: 2.1 time: 0.186785 Oct 03 14:46:09.407455 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1624/3315] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:46:09 2022] POST /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:09.414470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:09.418007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:09.424811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.425686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.426184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.426960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.427667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.428152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.513223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:09.521932 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22381e80-d79e-4e38-9cee-526b25eca773 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.332769 Oct 03 14:46:09.548048 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1692/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:09 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:09.567954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:09.568914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:09.588875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.590907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.591461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.592361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.594738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.595290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.657963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:09.728894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:09.750266 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-313c94cf-4089-4557-85e5-64257f52f475 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.341146 Oct 03 14:46:09.751124 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1625/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:09 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:09.756615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:09.759451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:09.782469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.786089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.786728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.787613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:09.788220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:09.788806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:09.985173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:09.999253 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37520635-0cfc-4f87-9a75-57961677434d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1573 microversion: 2.1 time: 0.449855 Oct 03 14:46:10.013165 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1693/3318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:09 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1573 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:10.017460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:10.018092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:10.024328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:10.026779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.027803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.028431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.029373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.030076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.030664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.297142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:10.308058 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-019fb2d8-f5e0-4b8e-93c7-285da51273bc tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1481 microversion: 2.1 time: 0.297500 Oct 03 14:46:10.314454 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1694/3319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:10 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1481 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:10.320025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:10.321012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:10.341197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.342040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.342681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.344065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.344557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.344999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.423168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:10.450286 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d821ee45-6efb-4f22-bdec-d7d53f414ae5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.695718 Oct 03 14:46:10.461019 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1626/3320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:09 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:10.503420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c41c370d-0015-4aef-9338-07c2d8853222 req-44dcdd4c-bf13-4f67-b4f6-ed982c6a5db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f801c9d2-17e3-4e3a-9c79-856ec995115f", "name": "network-vif-plugged", "status": "completed", "tag": "9d6e70ae-6f8c-4d94-be73-fd8501a1ba66"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:10.504765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:10.515140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:10.516875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e5d07a3c2ce4d679610c85a48b18cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba278f2f764406192d828021859b7a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:10.518538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfb9a748-3c08-4fc8-b16b-6a934359782d tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 200 len: 1365 microversion: 2.47 time: 0.202654 Oct 03 14:46:10.521027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1695/3321] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:10 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:46:10.551848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c41c370d-0015-4aef-9338-07c2d8853222 req-44dcdd4c-bf13-4f67-b4f6-ed982c6a5db1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.552849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c41c370d-0015-4aef-9338-07c2d8853222 req-44dcdd4c-bf13-4f67-b4f6-ed982c6a5db1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.553770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c41c370d-0015-4aef-9338-07c2d8853222 req-44dcdd4c-bf13-4f67-b4f6-ed982c6a5db1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.554633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:10.555550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:10.563885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.565390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.566053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.566986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.567708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.568739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.579009 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c41c370d-0015-4aef-9338-07c2d8853222 req-44dcdd4c-bf13-4f67-b4f6-ed982c6a5db1 service nova] Creating event network-vif-plugged:9d6e70ae-6f8c-4d94-be73-fd8501a1ba66 for instance f801c9d2-17e3-4e3a-9c79-856ec995115f on n-h1-781139-2 Oct 03 14:46:10.590547 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c41c370d-0015-4aef-9338-07c2d8853222 req-44dcdd4c-bf13-4f67-b4f6-ed982c6a5db1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109001 Oct 03 14:46:10.592271 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1627/3322] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:10.786805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:10.788966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:10.803983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.804488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.805879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.806611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:10.807079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:10.807413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:10.807558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:10.817413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e631061b-4387-4b8c-834a-c4f8c9837c4f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.268121 Oct 03 14:46:10.821208 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1696/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:10 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:10.989946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:11.012595 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ec8e4b8-ba4a-4f1f-9858-e6864f2e1ec6 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.241108 Oct 03 14:46:11.013457 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1628/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:10 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:11.024048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:11.024573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:11.032748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.033434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.033876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.034822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.035144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.035570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.172014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:11.200082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:11.268217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:11.276371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d53ed8d-6448-490e-9a9f-217f90725642 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1573 microversion: 2.1 time: 0.256295 Oct 03 14:46:11.289652 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1697/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:11 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1573 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:11.333544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:11.334157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:11.341596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.342237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.343349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.344074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.344532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.346602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.489689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:11.498472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17521b0e-ebc6-4e20-b501-0a63725a26e5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1468 microversion: 2.1 time: 0.168728 Oct 03 14:46:11.499070 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1629/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:11 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:11.522732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1888482331"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:11.527177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:11.535237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.535789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.536221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.536942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.537397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.537818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.710405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:11.711575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:11.718629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.719202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.719648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.720353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.720806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.721260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.743827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:11.780570 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36e0ef54-a6a4-442e-b6c6-b56414d5f230 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "POST /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1/action" status: 202 len: 0 microversion: 2.1 time: 0.263179 Oct 03 14:46:11.781675 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1630/3327] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:46:11 2022] POST /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 03 14:46:11.787025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:11.787736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] [instance: 2c21c4a8-2b8d-4225-8436-1112a15d0926] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:11.796716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.797284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.797735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.799589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.800060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.800492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.819035 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] HTTP exception thrown: Instance 2c21c4a8-2b8d-4225-8436-1112a15d0926 could not be found. Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Request method failure captured: Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 HTTP/1.1 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvWij_XnfVX_09J4-gmP6S03uPdanqcSqP58sVmByHBbItin9E_lgTKMBDc1_w_hb6LXJbAnAYfWcUnDr3HH_p5VY4qpDylBwZV0l1zxJYjhLozFzhRqtqQxvtxKBnSIl_GC1dJ7yetYkus8-QvljQn_IUvqBxi2lsBOdipZHyTv9O4 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.47 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3ba278f2f764406192d828021859b7a4 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAaction247Test-1794062894 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ba278f2f764406192d828021859b7a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ba278f2f764406192d828021859b7a4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ba278f2f764406192d828021859b7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ba278f2f764406192d828021859b7a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAaction247Test-1794062894 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3ba278f2f764406192d828021859b7a4 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAaction247Test-1794062894 Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAaction247Test-1794062894-project Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 0e5d07a3c2ce4d679610c85a48b18cdd Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAaction247Test-1794062894-project Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 2c21c4a8-2b8d-4225-8436-1112a15d0926 could not be found. Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '2c21c4a8-2b8d-4225-8436-1112a15d0926'} Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c21c4a8-2b8d-4225-8436-1112a15d0926 could not be found. Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c21c4a8-2b8d-4225-8436-1112a15d0926 could not be found. Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:11.821103 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c21c4a8-2b8d-4225-8436-1112a15d0926 could not be found. Oct 03 14:46:11.825302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:11.827173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] Returning 404 to user: Instance 2c21c4a8-2b8d-4225-8436-1112a15d0926 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:11.827334 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ffec5095-3d03-44b7-81e3-12369ca5b6cc tempest-ServersAaction247Test-1794062894 tempest-ServersAaction247Test-1794062894-project] 10.222.0.20 "GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926" status: 404 len: 111 microversion: 2.47 time: 0.044355 Oct 03 14:46:11.831502 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1631/3328] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:46:11 2022] GET /compute/v2.1/servers/2c21c4a8-2b8d-4225-8436-1112a15d0926 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:46:11.836129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4fc4d0e-223a-4d22-ba79-a2319aaa09aa tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230a8d820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:11.885101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:11.904530 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4fc4d0e-223a-4d22-ba79-a2319aaa09aa tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.075269 Oct 03 14:46:11.905957 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1632/3329] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:11 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:11.910772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:11.911557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:11.914181 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9806991-0157-4897-a1a0-a461e968d0fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.443667 Oct 03 14:46:11.916314 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1698/3330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:11 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:11.919141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.919811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.920252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:11.921207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:11.921669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:11.922095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:12.035694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:12.036610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:12.049209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:12.051455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:12.052080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:12.054718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:12.055408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:12.057190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:12.075111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:12.083725 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66f06202-d86b-44e5-8cf6-f397cc0db4dd tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.176537 Oct 03 14:46:12.084533 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1633/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:11 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:12.219901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:12.230596 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c0af3d2-8e8f-4cee-afc7-faec4c506ab4 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.198392 Oct 03 14:46:12.231586 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1699/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:12 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:12.301792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:12.302418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:12.305141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:12.312596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:12.313129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:12.313809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:12.314677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:12.315307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:12.315898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:12.524816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:12.533707 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-642ce1ea-5901-48bb-9ddd-f0ab5dc5f0dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1571 microversion: 2.1 time: 0.236868 Oct 03 14:46:12.534308 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1634/3333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:12 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1571 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:12.556202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1391096239"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:12.556984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:12.563598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:12.564093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:12.564710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:12.565619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:12.566075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:12.566786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:12.735975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Adding security group c366ada5-83df-479e-98c7-8a2bfec81900 to port f8f77608-7c7a-47c4-a6a2-1552510237c1 Oct 03 14:46:12.923469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a801e4f-b508-449e-9244-38ecf7cf84b8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230c65b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:12.982256 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a801e4f-b508-449e-9244-38ecf7cf84b8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.064664 Oct 03 14:46:12.988108 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1635/3334] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:12 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:13.002009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:13.004086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:13.019398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.024720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.025226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.025961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.027823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.029310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.165383 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e625715d-44c0-4466-a7f7-9bbd6a3742f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398/action" status: 202 len: 0 microversion: 2.1 time: 0.613112 Oct 03 14:46:13.166288 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1700/3335] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:46:12 2022] POST /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:13.189871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:13.190514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:13.227724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.228002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.228448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.229323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.229867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.230399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.470288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:13.478532 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bfe1188f-f224-4a59-9c84-6ad66ddcaab2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.487343 Oct 03 14:46:13.501742 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1636/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:12 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:13.509429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7e7144a-0e9d-4144-9bb9-6dff93ab34f4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230ee0ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:13.576282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:13.591227 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65524442-761c-4a7b-9c56-933540c68fe9 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.421222 Oct 03 14:46:13.592136 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1701/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:13 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:13.604611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-facf05a0-e64f-41ea-a5bc-c47194e8a661 req-c342b925-8a1e-428c-825f-e6c59f1dbf47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9872e40f-2db8-4aec-8013-bbe2d9454398", "tag": "f8f77608-7c7a-47c4-a6a2-1552510237c1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:13.636374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-facf05a0-e64f-41ea-a5bc-c47194e8a661 req-c342b925-8a1e-428c-825f-e6c59f1dbf47 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.637362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-facf05a0-e64f-41ea-a5bc-c47194e8a661 req-c342b925-8a1e-428c-825f-e6c59f1dbf47 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.638274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-facf05a0-e64f-41ea-a5bc-c47194e8a661 req-c342b925-8a1e-428c-825f-e6c59f1dbf47 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.669866 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-facf05a0-e64f-41ea-a5bc-c47194e8a661 req-c342b925-8a1e-428c-825f-e6c59f1dbf47 service nova] Creating event network-changed:f8f77608-7c7a-47c4-a6a2-1552510237c1 for instance 9872e40f-2db8-4aec-8013-bbe2d9454398 on n-h2-781139-2 Oct 03 14:46:13.682680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-facf05a0-e64f-41ea-a5bc-c47194e8a661 req-c342b925-8a1e-428c-825f-e6c59f1dbf47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089260 Oct 03 14:46:13.685588 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1702/3338] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:13.700601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:13.703347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:13.718963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.728624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.729149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.732960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.733514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.733957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.901557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-d7e7144a-0e9d-4144-9bb9-6dff93ab34f4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use.", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:13.902988 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d7e7144a-0e9d-4144-9bb9-6dff93ab34f4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use. Oct 03 14:46:13.902988 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-aa617b56-89f3-42bb-b666-67be535b3bad'] Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7e7144a-0e9d-4144-9bb9-6dff93ab34f4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900 HTTP/1.1 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: exception: Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use. Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-aa617b56-89f3-42bb-b666-67be535b3bad'] Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c366ada5-83df-479e-98c7-8a2bfec81900'} Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:13.905175 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use. Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa617b56-89f3-42bb-b666-67be535b3bad'] Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use. Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa617b56-89f3-42bb-b666-67be535b3bad'] Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use. Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa617b56-89f3-42bb-b666-67be535b3bad'] Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use. Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa617b56-89f3-42bb-b666-67be535b3bad'] Oct 03 14:46:13.909220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:13.914769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7e7144a-0e9d-4144-9bb9-6dff93ab34f4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 400 to user: Security Group c366ada5-83df-479e-98c7-8a2bfec81900 in use. Oct 03 14:46:13.914769 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-aa617b56-89f3-42bb-b666-67be535b3bad'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:13.916712 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7e7144a-0e9d-4144-9bb9-6dff93ab34f4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900" status: 400 len: 185 microversion: 2.1 time: 0.413599 Oct 03 14:46:13.918145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1637/3339] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:13 2022] DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900 => generated 185 bytes in 415 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:46:13.926767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:13.928632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:13.937301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.938162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.938882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.939834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:13.940489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:13.941174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:13.980131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:14.069325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:14.088287 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c421104-8edd-4908-9a2f-877a45567782 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.398990 Oct 03 14:46:14.090078 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1703/3340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:13 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:14.097607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bb78b35-4354-4ed1-ae60-0a28008f1000 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234b88c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:14.132764 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b94aaee8-2f7a-4fad-a2a4-dcdb4befa5a2 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 204 len: 0 microversion: 2.1 time: 0.209931 Oct 03 14:46:14.136528 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1638/3341] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:13 2022] DELETE /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:14.145071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:14.147889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:14.164402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:14.165663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:14.167207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:14.173505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:14.174254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:14.174912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:14.195598 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bb78b35-4354-4ed1-ae60-0a28008f1000 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.104207 Oct 03 14:46:14.205331 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1704/3342] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:14 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:14.421846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:14.440666 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7ae36f6-8a3c-46af-ad62-173faeb6104e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1646 microversion: 2.1 time: 0.302399 Oct 03 14:46:14.443419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1639/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:14 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1646 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:14.509492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:14.510370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:14.517488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:14.518218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:14.518995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:14.519977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:14.520601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:14.521237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:14.600626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-24feabe7-eea0-4ef7-901f-28f2383ed2b5 req-cb024b52-427d-4c26-9666-07c142abc77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5551a2d-d830-4659-86a3-517e278ac8e9", "name": "network-vif-unplugged", "status": "completed", "tag": "1978cd53-c8d1-46ad-9e17-feb4deb818da"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:14.614429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24feabe7-eea0-4ef7-901f-28f2383ed2b5 req-cb024b52-427d-4c26-9666-07c142abc77f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:14.615449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24feabe7-eea0-4ef7-901f-28f2383ed2b5 req-cb024b52-427d-4c26-9666-07c142abc77f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:14.615942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24feabe7-eea0-4ef7-901f-28f2383ed2b5 req-cb024b52-427d-4c26-9666-07c142abc77f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:14.631784 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-24feabe7-eea0-4ef7-901f-28f2383ed2b5 req-cb024b52-427d-4c26-9666-07c142abc77f service nova] Creating event network-vif-unplugged:1978cd53-c8d1-46ad-9e17-feb4deb818da for instance d5551a2d-d830-4659-86a3-517e278ac8e9 on n-h1-781139-2 Oct 03 14:46:14.638425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-24feabe7-eea0-4ef7-901f-28f2383ed2b5 req-cb024b52-427d-4c26-9666-07c142abc77f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042099 Oct 03 14:46:14.639185 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1640/3344] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:46:14.646777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:14.647488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:14.655891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:14.656383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:14.656815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:14.657549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:14.657994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:14.658412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:14.760089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:14.774887 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab29c244-e733-4a66-ad84-813da4c693c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.270151 Oct 03 14:46:14.778159 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1705/3345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:14 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:14.943985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:14.953986 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2dcaf70-5b97-4278-b113-19331dab48b6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1317 microversion: 2.1 time: 0.313144 Oct 03 14:46:14.954899 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1641/3346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:14 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:15.111946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:15.113250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:15.123068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:15.123890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:15.124504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:15.125385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:15.125923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:15.126422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:15.211659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b1616b8-40a2-4775-bef0-a5a01a6eaf95 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230eedd30>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:15.266696 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b1616b8-40a2-4775-bef0-a5a01a6eaf95 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.058931 Oct 03 14:46:15.267709 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1642/3347] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:15 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:15.358770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:15.375277 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7f93c22-da14-4e13-84fd-7a68f196e33b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.267338 Oct 03 14:46:15.379749 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1706/3348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:15 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:15.469995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:15.471015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:15.479585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:15.480496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:15.481178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:15.482366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:15.483166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:15.483757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:15.799622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:15.801617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:15.829297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:15.831313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:15.832177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:15.833021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:15.833626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:15.834498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.093880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:16.107841 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8bb19bc-9d43-4e5e-b6c5-ccd0cfec5bcb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.311263 Oct 03 14:46:16.112979 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1707/3349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:15 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:16.121202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:16.127839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:16.144798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:16.147340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:16.148801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.149799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:16.154484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:16.154484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.217584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:16.229928 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5933614b-4a2e-405a-8f00-61b2808eb2cf tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1646 microversion: 2.1 time: 0.767003 Oct 03 14:46:16.246706 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1643/3350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:15 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1646 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:16.283333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe3b2c04-71be-454e-8b36-be29cdfd5dfb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230557dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:16.369415 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe3b2c04-71be-454e-8b36-be29cdfd5dfb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.090313 Oct 03 14:46:16.375920 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1644/3351] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:16 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:16.406028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:16.406918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:16.415203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:16.420341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:16.422408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:16.423030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.424758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:16.426008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:16.426199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:16.426470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.436840 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2055513-cd44-49de-be51-2c8f5eca500e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1465 microversion: 2.1 time: 0.321013 Oct 03 14:46:16.438281 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1708/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:16 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1465 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:16.466917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:16.467637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:16.477165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:16.479706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:16.481480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.483785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:16.484520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:16.486308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.722449 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d10abe5c-69ac-4942-9cdd-46bb010d3f5e tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1616 microversion: 2.1 time: 0.259610 Oct 03 14:46:16.723189 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1709/3353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:16 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1616 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:16.731140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9670f3b1-ed33-42f7-928c-9cbc27c455ea req-03234efd-b1dc-4c58-afa8-63398a9536f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1", "name": "network-vif-plugged", "status": "completed", "tag": "88432805-1cd9-4545-b41c-15ee430ac3d2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:16.767523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9670f3b1-ed33-42f7-928c-9cbc27c455ea req-03234efd-b1dc-4c58-afa8-63398a9536f6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:16.768010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9670f3b1-ed33-42f7-928c-9cbc27c455ea req-03234efd-b1dc-4c58-afa8-63398a9536f6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:16.768444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9670f3b1-ed33-42f7-928c-9cbc27c455ea req-03234efd-b1dc-4c58-afa8-63398a9536f6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:16.795266 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9670f3b1-ed33-42f7-928c-9cbc27c455ea req-03234efd-b1dc-4c58-afa8-63398a9536f6 service nova] Creating event network-vif-plugged:88432805-1cd9-4545-b41c-15ee430ac3d2 for instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 on n-h2-781139-2 Oct 03 14:46:16.805046 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9670f3b1-ed33-42f7-928c-9cbc27c455ea req-03234efd-b1dc-4c58-afa8-63398a9536f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080341 Oct 03 14:46:16.806247 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1710/3354] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:16.874569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:16.886158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12d52eaa-e3e8-48dd-8afc-5a37d440152d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.485375 Oct 03 14:46:16.887336 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1645/3355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:16 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:16.976477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1850841517", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cc064e15-e471-4aea-9ae4-545bad8c989b"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:17.083030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:46:17.138130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:17.139689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:17.149360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:17.153671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:17.156635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:17.157924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:17.158676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:17.160432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:17.524499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:17.541021 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83dbc780-1114-4c7f-88a9-29a1113c093e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.406698 Oct 03 14:46:17.545358 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1646/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:17 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:17.557912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:17.559046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:17.581441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:17.582324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:17.582979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:17.583931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:17.584601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:17.585314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:17.686610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:17.687669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:17.690343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:17.691313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lazy-loading 'fault' on Instance uuid 9872e40f-2db8-4aec-8013-bbe2d9454398 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:46:17.994142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:18.009037 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c91d821-2a59-4ae1-ada7-3d082ce5ed5f tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 200 len: 1305 microversion: 2.1 time: 0.461952 Oct 03 14:46:18.010056 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1647/3357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:17 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 1305 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:18.042152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-043e800c-32e7-4790-b0ad-31241de2a379 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230ac28b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:18.145710 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-043e800c-32e7-4790-b0ad-31241de2a379 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.134437 Oct 03 14:46:18.148557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1648/3358] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:18 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:18.155228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-336d4146-de7c-4822-b6cc-2792681a4db4 req-88180ae3-3bd2-4c8c-9334-abfe5af59f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9872e40f-2db8-4aec-8013-bbe2d9454398", "name": "network-vif-deleted", "tag": "f8f77608-7c7a-47c4-a6a2-1552510237c1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:18.222741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-336d4146-de7c-4822-b6cc-2792681a4db4 req-88180ae3-3bd2-4c8c-9334-abfe5af59f76 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:18.223378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-336d4146-de7c-4822-b6cc-2792681a4db4 req-88180ae3-3bd2-4c8c-9334-abfe5af59f76 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:18.223816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-336d4146-de7c-4822-b6cc-2792681a4db4 req-88180ae3-3bd2-4c8c-9334-abfe5af59f76 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:18.265729 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-336d4146-de7c-4822-b6cc-2792681a4db4 req-88180ae3-3bd2-4c8c-9334-abfe5af59f76 service nova] Creating event network-vif-deleted:f8f77608-7c7a-47c4-a6a2-1552510237c1 for instance 9872e40f-2db8-4aec-8013-bbe2d9454398 on n-h2-781139-2 Oct 03 14:46:18.284605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-336d4146-de7c-4822-b6cc-2792681a4db4 req-88180ae3-3bd2-4c8c-9334-abfe5af59f76 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134090 Oct 03 14:46:18.287358 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1649/3359] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:18.302907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:18.306343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:18.324806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:18.326588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:18.327525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:18.330187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:18.332226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:18.332696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:18.611283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:46:18.611853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:46:18.612175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:46:18.612617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:46:18.613151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:46:18.624768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:18.625600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:18.626196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:18.627125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:18.627737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:18.628326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:18.651190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:46:18.663835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Getting quotas for user 30ee77356d97424599b6c5fadfde75ac and project 6ddc9ce67025446b8b961e24a7692c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:46:18.677945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:46:18.680663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:46:18.739263 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10113df8-3d01-4e6d-a72f-8f3cfc0f6c40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767603 Oct 03 14:46:18.740510 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1711/3360] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:46:18.745729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:18.746980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:18.755068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:18.756215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:18.756977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:18.757877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:18.758504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:18.759096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:18.937712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:18.950116 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11db972d-1522-4370-8406-8188a0b7e50d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.208297 Oct 03 14:46:18.956533 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1712/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:18 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:18.961780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a5ff016-ae01-43e7-a67e-838be545133c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:18.962605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a5ff016-ae01-43e7-a67e-838be545133c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:19.120116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a5ff016-ae01-43e7-a67e-838be545133c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:19.135377 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a5ff016-ae01-43e7-a67e-838be545133c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1217 microversion: 2.1 time: 0.177055 Oct 03 14:46:19.141424 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1713/3362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:18 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:19.149552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:19.150260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:19.166631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:19.167162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:19.167941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:19.168608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:19.171231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:19.171758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:19.180756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:19.211612 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 HTTP/1.1 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '9872e40f-2db8-4aec-8013-bbe2d9454398'} Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:19.218879 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:19.223811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:19.223811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:19.223811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:19.223811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:19.223811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:19.223811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:19.223811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:19.228237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:19.232155 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58089d9f-ec67-4ec7-a2cf-1e730ff4c6cc tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 404 len: 111 microversion: 2.1 time: 0.089577 Oct 03 14:46:19.234178 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1714/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:19 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:19.242395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-75224040-aba3-428e-ac13-751fb6a4b59c req-22a0422e-e5bb-43c1-9d6f-81df8e77756c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c94af6-b9e0-4f15-907a-60f0d062a325", "name": "network-vif-plugged", "status": "completed", "tag": "d9a86fed-bfe7-4009-bf6e-b08f71f97419"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:19.267425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-75224040-aba3-428e-ac13-751fb6a4b59c req-22a0422e-e5bb-43c1-9d6f-81df8e77756c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:19.268348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-75224040-aba3-428e-ac13-751fb6a4b59c req-22a0422e-e5bb-43c1-9d6f-81df8e77756c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:19.269001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-75224040-aba3-428e-ac13-751fb6a4b59c req-22a0422e-e5bb-43c1-9d6f-81df8e77756c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:19.298505 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-75224040-aba3-428e-ac13-751fb6a4b59c req-22a0422e-e5bb-43c1-9d6f-81df8e77756c service nova] Creating event network-vif-plugged:d9a86fed-bfe7-4009-bf6e-b08f71f97419 for instance 63c94af6-b9e0-4f15-907a-60f0d062a325 on n-h1-781139-2 Oct 03 14:46:19.308207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-75224040-aba3-428e-ac13-751fb6a4b59c req-22a0422e-e5bb-43c1-9d6f-81df8e77756c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072277 Oct 03 14:46:19.314857 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1715/3364] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:19.324222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25bd3fc6-aeaf-4cbc-ab14-f275cd404fae tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234bfa040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:19.420497 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25bd3fc6-aeaf-4cbc-ab14-f275cd404fae tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.104041 Oct 03 14:46:19.421444 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1716/3365] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:19 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:19.434236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3f581cf-5e3a-4796-b598-03b7ffd17476 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb2309f3940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:19.726504 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3f581cf-5e3a-4796-b598-03b7ffd17476 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f" status: 202 len: 0 microversion: 2.1 time: 0.303626 Oct 03 14:46:19.727142 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1717/3366] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:19 2022] DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:19.736384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bd5323b-1fad-456e-bcd0-f74cd117129c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb2309f3af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:19.858847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:19.873280 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53b09595-a063-426d-affa-1425b7c24c48 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 1.582865 Oct 03 14:46:19.875923 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1650/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:18 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:19.977517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:19.978318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:20.016896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:20.018426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:20.019573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:20.021873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:20.024183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:20.026011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:20.277829 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bd5323b-1fad-456e-bcd0-f74cd117129c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900" status: 202 len: 0 microversion: 2.1 time: 0.546153 Oct 03 14:46:20.278660 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1718/3368] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:19 2022] DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:20.309138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:20.316584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:20.328944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:20.329615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:20.330346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:20.331490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:20.333197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:20.334599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:20.348196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:20.360979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ada2fe7c-239a-4177-a5a4-8293893de85e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.387320 Oct 03 14:46:20.361926 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1651/3369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:19 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:20.382834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e8b62daa-0fe8-4df6-aa84-d68a3657784e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'create', calling method: .version_select at 0x7fb230978a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-12261019", "description": "tempest-description-337959940"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:20.443526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:20.453770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32c557f7-9f33-4f75-85cb-1cbb117f295a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1269 microversion: 2.1 time: 0.166913 Oct 03 14:46:20.454990 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1719/3370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:20 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:20.459748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-772dfa24-e048-49a5-aeed-b6c2d8795142 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2309f35e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:20.533063 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-772dfa24-e048-49a5-aeed-b6c2d8795142 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.076760 Oct 03 14:46:20.534178 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1720/3371] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:20 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:20.719113 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e8b62daa-0fe8-4df6-aa84-d68a3657784e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.355836 Oct 03 14:46:20.719882 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1652/3372] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:46:20 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:20.748253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23a6caa4-6e0e-4499-b2f5-02786beef877 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Action: 'update', calling method: .version_select at 0x7fb234bfa3a0>, body: {"security_group": {"name": "tempest-sg-hth-666047288", "description": "tempest-description-hth-1703846537"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:20.903385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:20.904191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:20.923610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:20.938375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:20.939130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:20.940091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:20.942087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:20.942532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:21.073943 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23a6caa4-6e0e-4499-b2f5-02786beef877 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/88489a44-1f26-4582-8649-6363a5fe6c3a" status: 200 len: 217 microversion: 2.1 time: 0.343076 Oct 03 14:46:21.074553 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1721/3373] 10.222.0.20 () {60 vars in 1290 bytes} [Mon Oct 3 14:46:20 2022] PUT /compute/v2.1/os-security-groups/88489a44-1f26-4582-8649-6363a5fe6c3a => generated 217 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:21.090614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86b3a740-32fd-4975-8019-6646743c16ca tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb22be06280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:21.494327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:21.498693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:21.518529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6ea8808-12e6-40a6-b3f1-5f3fad13adcf tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1370 microversion: 2.1 time: 0.620499 Oct 03 14:46:21.534156 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1653/3374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:20 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1370 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:21.549489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:21.550492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:21.570112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:21.570915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:21.571474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:21.572431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:21.576491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:21.577293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:21.781103 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86b3a740-32fd-4975-8019-6646743c16ca tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/88489a44-1f26-4582-8649-6363a5fe6c3a" status: 200 len: 217 microversion: 2.1 time: 0.697256 Oct 03 14:46:21.790921 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1722/3375] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:46:21 2022] GET /compute/v2.1/os-security-groups/88489a44-1f26-4582-8649-6363a5fe6c3a => generated 217 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:21.790921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:21.790921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:21.798828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:21.799318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:21.799753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:21.800482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:21.800969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:21.801393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:21.965809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:21.978472 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fdfda76-c701-4a13-bb97-ddd2b86b9296 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1275 microversion: 2.1 time: 0.195156 Oct 03 14:46:21.979118 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1723/3376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:21 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:21.994733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e00f3e40-0ab1-479e-8d7d-677e287fbaeb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230de4310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:22.025981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:22.039075 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ae1e9efa-b3c0-4f37-9e79-6eae1bb59fe4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.503415 Oct 03 14:46:22.044768 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1654/3377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:21 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:22.061867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-374492ce-9349-40e5-b9d3-04aacf18a1dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230a011f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:22.092120 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e00f3e40-0ab1-479e-8d7d-677e287fbaeb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.110348 Oct 03 14:46:22.101729 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1724/3378] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:21 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:22.552143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:22.552854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:22.572157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:22.574160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:22.577147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:22.578540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:22.579127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:22.580611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:22.700868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-374492ce-9349-40e5-b9d3-04aacf18a1dd tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/88489a44-1f26-4582-8649-6363a5fe6c3a" status: 202 len: 0 microversion: 2.1 time: 0.656172 Oct 03 14:46:22.701938 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1655/3379] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:22 2022] DELETE /compute/v2.1/os-security-groups/88489a44-1f26-4582-8649-6363a5fe6c3a => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:22.710959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:22.712171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:22.723548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:22.730592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:22.731312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:22.734222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:22.737622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:22.738896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:22.797863 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 HTTP/1.1 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '9872e40f-2db8-4aec-8013-bbe2d9454398'} Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:22.799901 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.804317 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.809811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:22.811068 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-282f449f-37c9-45d8-a6d0-9d0bee33f609 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 404 len: 111 microversion: 2.1 time: 0.104526 Oct 03 14:46:22.812219 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1656/3380] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:22 2022] DELETE /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:46:22.821381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:22.826541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 9872e40f-2db8-4aec-8013-bbe2d9454398] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:22.842611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:22.848032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:22.848755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:22.849683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:22.850298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:22.857219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:22.882747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 HTTP/1.1 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '9872e40f-2db8-4aec-8013-bbe2d9454398'} Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:22.890008 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.894707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:22.894707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:22.894707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:22.894707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:22.894707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:22.894707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. Oct 03 14:46:22.894707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:22.898694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Instance 9872e40f-2db8-4aec-8013-bbe2d9454398 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:22.910081 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c47d0bb-1db9-4f31-a0a8-9277af1a98c6 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398" status: 404 len: 111 microversion: 2.1 time: 0.092408 Oct 03 14:46:22.913584 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1657/3381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:22 2022] GET /compute/v2.1/servers/9872e40f-2db8-4aec-8013-bbe2d9454398 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:22.923244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d33755ab-6fb0-4af4-879f-54b4421db899 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230a76430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:23.001409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-d33755ab-6fb0-4af4-879f-54b4421db899 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:23.002298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.security_group_api [None req-d33755ab-6fb0-4af4-879f-54b4421db899 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group c366ada5-83df-479e-98c7-8a2bfec81900 not found {{(pid=128868) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:46:23.003077 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d33755ab-6fb0-4af4-879f-54b4421db899 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist Oct 03 14:46:23.003077 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-03595ee7-4536-47e8-838b-7d05d5aea938'] Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d33755ab-6fb0-4af4-879f-54b4421db899 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900 HTTP/1.1 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: exception: Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-03595ee7-4536-47e8-838b-7d05d5aea938'] Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c366ada5-83df-479e-98c7-8a2bfec81900'} Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:23.006771 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03595ee7-4536-47e8-838b-7d05d5aea938'] Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03595ee7-4536-47e8-838b-7d05d5aea938'] Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03595ee7-4536-47e8-838b-7d05d5aea938'] Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03595ee7-4536-47e8-838b-7d05d5aea938'] Oct 03 14:46:23.011445 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.016819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d33755ab-6fb0-4af4-879f-54b4421db899 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group c366ada5-83df-479e-98c7-8a2bfec81900 does not exist Oct 03 14:46:23.016819 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-03595ee7-4536-47e8-838b-7d05d5aea938'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:23.016819 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d33755ab-6fb0-4af4-879f-54b4421db899 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900" status: 404 len: 194 microversion: 2.1 time: 0.095811 Oct 03 14:46:23.016819 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1658/3382] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:22 2022] DELETE /compute/v2.1/os-security-groups/c366ada5-83df-479e-98c7-8a2bfec81900 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:46:23.033893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:23.040110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:23.071333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:23.072132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:23.078202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:23.080323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:23.084028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:23.085235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:23.203542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:23.234834 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e2cbe61-ae2e-4fd3-8d3e-49ee28b42d14 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1556 microversion: 2.1 time: 0.689817 Oct 03 14:46:23.243557 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1725/3383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:22 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1556 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:23.278161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-baa88602-0e3c-4fb8-bd96-765dc2adbab3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230bcc550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:23.315977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-baa88602-0e3c-4fb8-bd96-765dc2adbab3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:23.316864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-baa88602-0e3c-4fb8-bd96-765dc2adbab3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group a8f64829-f3e8-4d01-a7b8-7b084f66524f not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:46:23.317670 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-baa88602-0e3c-4fb8-bd96-765dc2adbab3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist Oct 03 14:46:23.317670 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-dacc4a70-c571-4e4d-a39a-06406668d716'] Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-baa88602-0e3c-4fb8-bd96-765dc2adbab3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f HTTP/1.1 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-dacc4a70-c571-4e4d-a39a-06406668d716'] Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a8f64829-f3e8-4d01-a7b8-7b084f66524f'} Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:23.320013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dacc4a70-c571-4e4d-a39a-06406668d716'] Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dacc4a70-c571-4e4d-a39a-06406668d716'] Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dacc4a70-c571-4e4d-a39a-06406668d716'] Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dacc4a70-c571-4e4d-a39a-06406668d716'] Oct 03 14:46:23.324430 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:23.336278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-baa88602-0e3c-4fb8-bd96-765dc2adbab3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group a8f64829-f3e8-4d01-a7b8-7b084f66524f does not exist Oct 03 14:46:23.336278 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-dacc4a70-c571-4e4d-a39a-06406668d716'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:23.337739 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-baa88602-0e3c-4fb8-bd96-765dc2adbab3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f" status: 404 len: 194 microversion: 2.1 time: 0.078397 Oct 03 14:46:23.339008 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1726/3384] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:23 2022] DELETE /compute/v2.1/os-security-groups/a8f64829-f3e8-4d01-a7b8-7b084f66524f => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:23.347598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:23.350179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:23.372631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:23.376284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:23.377058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:23.378037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:23.381553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:23.384283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:23.585155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:23.603505 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5b52bb6c-8af0-4bec-86d4-60dc699e5d91 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1317 microversion: 2.1 time: 0.586082 Oct 03 14:46:23.604117 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1659/3385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:23 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:23.611998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-48a810e6-05f0-4774-a94b-1e1a20e0cc56 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230557dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:23.856421 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-48a810e6-05f0-4774-a94b-1e1a20e0cc56 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.250306 Oct 03 14:46:23.864605 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1660/3386] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:23 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:23.890398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:23.890925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:23.923052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:23.924363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:23.924814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:23.927700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:23.929510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:23.929960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:24.111744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:24.129952 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-258c1d3e-12c4-4010-95cd-bcb89ab4ffc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.788383 Oct 03 14:46:24.133736 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1727/3387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:23 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:24.156440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34edfb92-b84b-481a-abbd-2623d9e41317 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230a20790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:24.342024 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b3bc455-3cb4-4a64-99ff-2348d724b41b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.482243 Oct 03 14:46:24.351262 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1661/3388] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:46:23 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-interface => generated 284 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:24.627339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:24.628511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:24.647161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:24.647643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:24.648082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:24.648796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:24.658302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:24.658797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:24.933682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-34edfb92-b84b-481a-abbd-2623d9e41317 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:24.935079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-34edfb92-b84b-481a-abbd-2623d9e41317 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group f6161dda-4614-4f6a-bb7d-4687a442503a not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:46:24.935857 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-34edfb92-b84b-481a-abbd-2623d9e41317 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:46:24.935857 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-d94f3f57-9667-43f0-b918-fc7ca4863e67'] Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34edfb92-b84b-481a-abbd-2623d9e41317 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a HTTP/1.1 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-d94f3f57-9667-43f0-b918-fc7ca4863e67'] Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f6161dda-4614-4f6a-bb7d-4687a442503a'} Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:24.938240 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d94f3f57-9667-43f0-b918-fc7ca4863e67'] Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d94f3f57-9667-43f0-b918-fc7ca4863e67'] Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d94f3f57-9667-43f0-b918-fc7ca4863e67'] Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d94f3f57-9667-43f0-b918-fc7ca4863e67'] Oct 03 14:46:24.944479 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:24.954467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34edfb92-b84b-481a-abbd-2623d9e41317 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group f6161dda-4614-4f6a-bb7d-4687a442503a does not exist Oct 03 14:46:24.954467 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-d94f3f57-9667-43f0-b918-fc7ca4863e67'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:24.956198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34edfb92-b84b-481a-abbd-2623d9e41317 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a" status: 404 len: 194 microversion: 2.1 time: 0.817960 Oct 03 14:46:24.961182 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1728/3389] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:24 2022] DELETE /compute/v2.1/os-security-groups/f6161dda-4614-4f6a-bb7d-4687a442503a => generated 194 bytes in 826 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:24.973974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d07d310-41a1-42e1-98d0-a38741c42ec8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb23096f310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:25.096817 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d07d310-41a1-42e1-98d0-a38741c42ec8 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.134248 Oct 03 14:46:25.117048 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1729/3390] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:24 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:25.132812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dc5b57a-269d-4085-87de-1a4954974e78 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230bcc550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:25.275430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-2dc5b57a-269d-4085-87de-1a4954974e78 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:25.276370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-2dc5b57a-269d-4085-87de-1a4954974e78 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group d389227e-e1e7-48a3-a074-d5427f236130 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:46:25.278096 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2dc5b57a-269d-4085-87de-1a4954974e78 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:46:25.278096 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6cba34e5-a864-4af3-8294-657dbb50271c'] Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dc5b57a-269d-4085-87de-1a4954974e78 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130 HTTP/1.1 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6cba34e5-a864-4af3-8294-657dbb50271c'] Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd389227e-e1e7-48a3-a074-d5427f236130'} Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:25.280389 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cba34e5-a864-4af3-8294-657dbb50271c'] Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cba34e5-a864-4af3-8294-657dbb50271c'] Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cba34e5-a864-4af3-8294-657dbb50271c'] Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cba34e5-a864-4af3-8294-657dbb50271c'] Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dc5b57a-269d-4085-87de-1a4954974e78 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group d389227e-e1e7-48a3-a074-d5427f236130 does not exist Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-6cba34e5-a864-4af3-8294-657dbb50271c'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2dc5b57a-269d-4085-87de-1a4954974e78 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130" status: 404 len: 194 microversion: 2.1 time: 0.159949 Oct 03 14:46:25.284839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1730/3391] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:25 2022] DELETE /compute/v2.1/os-security-groups/d389227e-e1e7-48a3-a074-d5427f236130 => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:25.302092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:25.302754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:25.313773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:25.314277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:25.314726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:25.315454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:25.315914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:25.330229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:25.455371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:25.471003 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d0254442-0f7f-40f8-a8ac-5720f7cafa6b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1317 microversion: 2.1 time: 0.847624 Oct 03 14:46:25.475656 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1662/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:24 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:25.481345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f28fe1cd-2fd9-4baf-9251-795e000bbaa4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230df28b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:25.541890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-f28fe1cd-2fd9-4baf-9251-795e000bbaa4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:25.542599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.security_group_api [None req-f28fe1cd-2fd9-4baf-9251-795e000bbaa4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group 00015c85-0f56-4e1c-bf9c-38a00250ebce not found {{(pid=128868) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:46:25.543123 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-f28fe1cd-2fd9-4baf-9251-795e000bbaa4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:46:25.543123 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-9256e48d-c5a4-4e6c-84d2-fb1e6f2f9c74'] Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f28fe1cd-2fd9-4baf-9251-795e000bbaa4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce HTTP/1.1 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: exception: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-9256e48d-c5a4-4e6c-84d2-fb1e6f2f9c74'] Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '00015c85-0f56-4e1c-bf9c-38a00250ebce'} Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:25.545376 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9256e48d-c5a4-4e6c-84d2-fb1e6f2f9c74'] Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9256e48d-c5a4-4e6c-84d2-fb1e6f2f9c74'] Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9256e48d-c5a4-4e6c-84d2-fb1e6f2f9c74'] Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9256e48d-c5a4-4e6c-84d2-fb1e6f2f9c74'] Oct 03 14:46:25.550361 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.556731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f28fe1cd-2fd9-4baf-9251-795e000bbaa4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group 00015c85-0f56-4e1c-bf9c-38a00250ebce does not exist Oct 03 14:46:25.556731 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-9256e48d-c5a4-4e6c-84d2-fb1e6f2f9c74'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:25.558433 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f28fe1cd-2fd9-4baf-9251-795e000bbaa4 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce" status: 404 len: 194 microversion: 2.1 time: 0.081535 Oct 03 14:46:25.559682 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1663/3393] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:25 2022] DELETE /compute/v2.1/os-security-groups/00015c85-0f56-4e1c-bf9c-38a00250ebce => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:25.573009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-caca9984-7911-481a-aa3d-1b131903323e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb230eedd30>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:25.653430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-caca9984-7911-481a-aa3d-1b131903323e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:46:25.654444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.security_group_api [None req-caca9984-7911-481a-aa3d-1b131903323e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Neutron security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 not found {{(pid=128868) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:46:25.655193 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-caca9984-7911-481a-aa3d-1b131903323e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:46:25.655193 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-1e229de4-301f-4252-b10c-388dbc4f7721'] Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-caca9984-7911-481a-aa3d-1b131903323e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7 HTTP/1.1 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: exception: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-1e229de4-301f-4252-b10c-388dbc4f7721'] Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '58f32a18-4d0f-4d64-9c7d-8d1c404542c7'} Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:46:25.660273 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e229de4-301f-4252-b10c-388dbc4f7721'] Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e229de4-301f-4252-b10c-388dbc4f7721'] Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e229de4-301f-4252-b10c-388dbc4f7721'] Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e229de4-301f-4252-b10c-388dbc4f7721'] Oct 03 14:46:25.664681 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:25.676333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-caca9984-7911-481a-aa3d-1b131903323e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Security group 58f32a18-4d0f-4d64-9c7d-8d1c404542c7 does not exist Oct 03 14:46:25.676333 n-d-781139-2 devstack@n-api.service[128868]: Neutron server returns request_ids: ['req-1e229de4-301f-4252-b10c-388dbc4f7721'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:25.677646 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-caca9984-7911-481a-aa3d-1b131903323e tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7" status: 404 len: 194 microversion: 2.1 time: 0.113682 Oct 03 14:46:25.678373 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1664/3394] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:25 2022] DELETE /compute/v2.1/os-security-groups/58f32a18-4d0f-4d64-9c7d-8d1c404542c7 => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:25.687444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:25.692919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:25.710483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:25.714843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:25.715584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:25.718703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:25.723458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:25.723902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:25.777995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:25.821164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:25.839312 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c4b3d96-0753-43e0-829c-cca36a464779 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.546856 Oct 03 14:46:25.843254 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1731/3395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:25 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:25.861038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f2c14925-9fb5-4b57-af09-fbbd78fd8657 req-e9638782-21b0-4197-bb4e-fc40b20813a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d215f5f-0d8e-4911-aff2-9debf5723ee9", "tag": "6a8344e0-dedb-4c3d-bb3f-ce2d900d369c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:25.897448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f2c14925-9fb5-4b57-af09-fbbd78fd8657 req-e9638782-21b0-4197-bb4e-fc40b20813a0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:25.899279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f2c14925-9fb5-4b57-af09-fbbd78fd8657 req-e9638782-21b0-4197-bb4e-fc40b20813a0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:25.900910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f2c14925-9fb5-4b57-af09-fbbd78fd8657 req-e9638782-21b0-4197-bb4e-fc40b20813a0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:25.940690 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f2c14925-9fb5-4b57-af09-fbbd78fd8657 req-e9638782-21b0-4197-bb4e-fc40b20813a0 service nova] Creating event network-changed:6a8344e0-dedb-4c3d-bb3f-ce2d900d369c for instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 on n-h2-781139-2 Oct 03 14:46:25.978757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f2c14925-9fb5-4b57-af09-fbbd78fd8657 req-e9638782-21b0-4197-bb4e-fc40b20813a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127898 Oct 03 14:46:25.983219 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1732/3396] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:26.019724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-347c659c-72fe-49e7-a56e-5a6160aae8f3 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 204 len: 0 microversion: 2.1 time: 0.336445 Oct 03 14:46:26.020335 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1665/3397] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:25 2022] DELETE /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:26.030331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:26.031229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:26.046350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:26.059073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:26.060668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:26.063261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:26.064800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:26.070739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:26.118101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7f81092-9c85-4c85-aa3d-9a2e5fc3297a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb23067d700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:26.219720 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7f81092-9c85-4c85-aa3d-9a2e5fc3297a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.107632 Oct 03 14:46:26.221542 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1666/3398] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:26 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:26.498132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:26.499591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:26.510047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:26.513445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:26.514854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:26.517858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:26.518988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:26.519576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:26.666410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:26.675942 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5bb7baac-1299-469e-b8f4-b42ec96ecd5c tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1646 microversion: 2.1 time: 0.650920 Oct 03 14:46:26.681624 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1733/3399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:26 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1646 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:26.789988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:26.805028 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f934ea10-d53a-44a8-875c-f2a503b719a8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1317 microversion: 2.1 time: 0.311578 Oct 03 14:46:26.806958 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1667/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:26 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:26.867020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:26.867955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:26.879374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:26.880603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:26.881281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:26.882399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:26.883018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:26.883604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:27.187629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d5f9b2a3-536a-4fe0-bbd3-1b924e6a010a req-32f8cb05-422d-4f33-81ac-478dbad698f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c94af6-b9e0-4f15-907a-60f0d062a325", "tag": "d9a86fed-bfe7-4009-bf6e-b08f71f97419"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:27.222299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d5f9b2a3-536a-4fe0-bbd3-1b924e6a010a req-32f8cb05-422d-4f33-81ac-478dbad698f5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:27.223175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d5f9b2a3-536a-4fe0-bbd3-1b924e6a010a req-32f8cb05-422d-4f33-81ac-478dbad698f5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:27.223528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d5f9b2a3-536a-4fe0-bbd3-1b924e6a010a req-32f8cb05-422d-4f33-81ac-478dbad698f5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:27.242988 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d5f9b2a3-536a-4fe0-bbd3-1b924e6a010a req-32f8cb05-422d-4f33-81ac-478dbad698f5 service nova] Creating event network-changed:d9a86fed-bfe7-4009-bf6e-b08f71f97419 for instance 63c94af6-b9e0-4f15-907a-60f0d062a325 on n-h1-781139-2 Oct 03 14:46:27.247675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:27.257643 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-898a90aa-e7cc-4237-9cae-d8e0dfefa4d3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.394451 Oct 03 14:46:27.260023 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d5f9b2a3-536a-4fe0-bbd3-1b924e6a010a req-32f8cb05-422d-4f33-81ac-478dbad698f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076577 Oct 03 14:46:27.263188 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1668/3401] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:46:27.265351 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1734/3402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:26 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:27.276471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2616bef4-e23f-405f-a096-9a975940c1f2 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230c65940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:27.383984 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2616bef4-e23f-405f-a096-9a975940c1f2 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.118322 Oct 03 14:46:27.384842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1669/3403] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:27 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:27.707503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:27.708746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:27.722636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:27.730118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:27.731028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:27.734930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:27.740023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:27.743981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:28.267544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-497012612", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "467e2f76-8162-49f4-958c-3f4dac499705"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:28.394082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] validate_networks() for [('467e2f76-8162-49f4-958c-3f4dac499705', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:46:28.580682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:28.591568 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-466ad610-5383-4dbc-8ede-0e07542a9c7d tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1646 microversion: 2.1 time: 0.887955 Oct 03 14:46:28.604949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1735/3404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:27 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1646 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:28.604949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:28.605518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:28.621615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:28.622516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:28.623420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:28.629387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:28.630471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:28.631080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:28.643837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:29.076697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:29.087529 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97ede625-bb52-4945-ba1f-f67f300a6a40 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1317 microversion: 2.1 time: 0.490674 Oct 03 14:46:29.089829 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1736/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:28 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:29.099673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:29.100698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:29.107960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:29.108649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:29.109293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:29.110200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:29.110836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:29.111427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:29.131872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:30.137219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:30.174926 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f6a0bbd-db1e-44e3-9ef1-d27d5bd7f62d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 1.069983 Oct 03 14:46:30.177349 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1737/3406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:29 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:30.206290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86d6a33d-76b9-468b-926f-045b646314e7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2309f7ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:30.330427 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86d6a33d-76b9-468b-926f-045b646314e7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.144797 Oct 03 14:46:30.335024 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1738/3407] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:30 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:30.346854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:30.349891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:30.367083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.368356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.369970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.371665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.373844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.374569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.490977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.491727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.492231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.492885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lazy-loading 'fault' on Instance uuid 5c015e80-474a-459f-9583-6b3779c6e75a {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:46:30.582762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4d609f3be34d37936ff6970113e911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96c546d1de748f2bffb076294563a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:30.594396 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64d072a6-b36e-42f5-a91f-8fcdb6fea8cb tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 200 len: 1306 microversion: 2.1 time: 0.255979 Oct 03 14:46:30.595302 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1739/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:30 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 1306 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:30.600964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-845ac743-6901-4b81-a7df-089f00772b12 req-46d3f16d-2117-4fea-816a-ba1ac2f140a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c015e80-474a-459f-9583-6b3779c6e75a", "name": "network-vif-deleted", "tag": "327bd8c3-af71-407a-b4aa-617ab5c46b76"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:30.621087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-845ac743-6901-4b81-a7df-089f00772b12 req-46d3f16d-2117-4fea-816a-ba1ac2f140a9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.621860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-845ac743-6901-4b81-a7df-089f00772b12 req-46d3f16d-2117-4fea-816a-ba1ac2f140a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.622472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-845ac743-6901-4b81-a7df-089f00772b12 req-46d3f16d-2117-4fea-816a-ba1ac2f140a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.635614 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-845ac743-6901-4b81-a7df-089f00772b12 req-46d3f16d-2117-4fea-816a-ba1ac2f140a9 service nova] Creating event network-vif-deleted:327bd8c3-af71-407a-b4aa-617ab5c46b76 for instance 5c015e80-474a-459f-9583-6b3779c6e75a on n-h2-781139-2 Oct 03 14:46:30.641636 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-845ac743-6901-4b81-a7df-089f00772b12 req-46d3f16d-2117-4fea-816a-ba1ac2f140a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044894 Oct 03 14:46:30.642898 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1740/3409] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:30.648975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:30.650101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:30.658389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.659167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.659798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.660692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.661343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.661957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.878349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:46:30.879369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:46:30.880021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:46:30.881055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:46:30.881701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:46:30.922066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.923722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.926539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.928972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:30.933646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:30.937450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:30.991899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Getting quotas for project 61ac1d0e61084918870fc725e401bfd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:46:31.005489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Getting quotas for user dec2ecc4c6e242efa0f86191f670906c and project 61ac1d0e61084918870fc725e401bfd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:46:31.032438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:46:31.042788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:46:31.147684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b5bf732-bcca-43a8-b36d-e53ae4e1dd35 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.388563 Oct 03 14:46:31.148494 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1670/3410] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:46:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:46:31.159858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-67e18c38-7341-4df0-9e35-e5bb3623579d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:31.161223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-67e18c38-7341-4df0-9e35-e5bb3623579d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:31.198423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:31.248511 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-357f1edb-c1b3-4b8c-bb9c-d4e8b540b44c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1317 microversion: 2.1 time: 0.579476 Oct 03 14:46:31.252748 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1741/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:30 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:31.267914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:31.270173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-67e18c38-7341-4df0-9e35-e5bb3623579d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:31.280418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:31.285563 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-67e18c38-7341-4df0-9e35-e5bb3623579d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1215 microversion: 2.1 time: 0.127076 Oct 03 14:46:31.289176 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1671/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:31 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:31.316625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:31.317169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:31.317621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:31.318359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:31.318820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:31.319254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:31.351885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-216730d2-d9df-4acc-aea5-f95c7bf4638b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230422160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:31.451638 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-216730d2-d9df-4acc-aea5-f95c7bf4638b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.107077 Oct 03 14:46:31.457955 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1672/3413] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:31 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:31.620677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:31.621372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] [instance: 5c015e80-474a-459f-9583-6b3779c6e75a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:31.629885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:31.631202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:31.632537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:31.635346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:31.637109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:31.638385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:31.664592 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] HTTP exception thrown: Instance 5c015e80-474a-459f-9583-6b3779c6e75a could not be found. Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Request method failure captured: Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a HTTP/1.1 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvViFazPwk8YmLIbeb7v6T9Ut26s9PS7rypgGT3BPd3pqujGoyoSbCwQTPUveB2e8nUJtYl3z2irFSm8Mm5vyupbCfQDVYGSDzZdDJUwfDaXnZ__gNd98WihOKNZlPDttLV7Cob3yUK0teLAGuVqZbqq1H_enDlx8Gj_bVlS0qvzjaA Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c96c546d1de748f2bffb076294563a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c96c546d1de748f2bffb076294563a51", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c96c546d1de748f2bffb076294563a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c96c546d1de748f2bffb076294563a51 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-122330755 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9c4d609f3be34d37936ff6970113e911 Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-SecurityGroupsTestJSON-122330755-project Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 5c015e80-474a-459f-9583-6b3779c6e75a could not be found. Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '5c015e80-474a-459f-9583-6b3779c6e75a'} Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c015e80-474a-459f-9583-6b3779c6e75a could not be found. Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c015e80-474a-459f-9583-6b3779c6e75a could not be found. Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:31.673496 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c015e80-474a-459f-9583-6b3779c6e75a could not be found. Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Returning 404 to user: Instance 5c015e80-474a-459f-9583-6b3779c6e75a could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db293d6d-9584-433d-a767-ef8190708655 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a" status: 404 len: 111 microversion: 2.1 time: 0.059349 Oct 03 14:46:31.679527 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1673/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:31 2022] GET /compute/v2.1/servers/5c015e80-474a-459f-9583-6b3779c6e75a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:46:31.684524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8d76295c-0444-4ceb-82dd-3f92d95b7d24 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb234ac4700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:31.981143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:32.001650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21c5f0a4-f5c9-4735-b6db-8ccd92899e79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.747700 Oct 03 14:46:32.017150 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1742/3415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:31 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:32.251712 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8d76295c-0444-4ceb-82dd-3f92d95b7d24 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5092b417-747f-4204-8c69-0a931c7abfc4" status: 202 len: 0 microversion: 2.1 time: 0.544380 Oct 03 14:46:32.251712 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1674/3416] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:31 2022] DELETE /compute/v2.1/os-security-groups/5092b417-747f-4204-8c69-0a931c7abfc4 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:32.252190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3fb9056-72d5-416d-9ecf-d1c3e485f892 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] Calling method '.version_select at 0x7fb234bfa040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:32.302964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:32.303902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:32.337753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:32.339313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:32.342433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:32.343874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:32.344484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:32.345078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:32.641356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3fb9056-72d5-416d-9ecf-d1c3e485f892 tempest-SecurityGroupsTestJSON-122330755 tempest-SecurityGroupsTestJSON-122330755-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/266b037e-7970-469b-8951-5746d7f93c1c" status: 202 len: 0 microversion: 2.1 time: 0.410921 Oct 03 14:46:32.643205 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1743/3417] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:46:32 2022] DELETE /compute/v2.1/os-security-groups/266b037e-7970-469b-8951-5746d7f93c1c => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:46:32.648416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:32.649356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:32.663938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:32.672005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:32.673814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:32.677814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:32.679629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:32.681142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:32.828544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:32.836136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:32.842855 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bae47f81-1f71-4abd-bb82-fa6e5cc49275 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1317 microversion: 2.1 time: 0.544354 Oct 03 14:46:32.848791 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c3ba269-d7e8-404d-b254-3ee11ae3b549 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1211 microversion: 2.1 time: 0.203894 Oct 03 14:46:32.849300 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1744/3418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:32 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1211 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:32.860107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c8c2f4c9-551c-4670-85cb-25b619823b0e req-00b9c7fa-ea05-47c8-9035-2ea88623c7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d215f5f-0d8e-4911-aff2-9debf5723ee9", "name": "network-vif-plugged", "status": "completed", "tag": "6a8344e0-dedb-4c3d-bb3f-ce2d900d369c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:32.870963 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1675/3419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:32 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:32.880721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90a85eb9-b8e5-4c67-8300-f6659111386d tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234aac790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:32.899030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c8c2f4c9-551c-4670-85cb-25b619823b0e req-00b9c7fa-ea05-47c8-9035-2ea88623c7e9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:32.899710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c8c2f4c9-551c-4670-85cb-25b619823b0e req-00b9c7fa-ea05-47c8-9035-2ea88623c7e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:32.900182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c8c2f4c9-551c-4670-85cb-25b619823b0e req-00b9c7fa-ea05-47c8-9035-2ea88623c7e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:32.935415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c8c2f4c9-551c-4670-85cb-25b619823b0e req-00b9c7fa-ea05-47c8-9035-2ea88623c7e9 service nova] Creating event network-vif-plugged:6a8344e0-dedb-4c3d-bb3f-ce2d900d369c for instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 on n-h2-781139-2 Oct 03 14:46:32.942324 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90a85eb9-b8e5-4c67-8300-f6659111386d tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.070126 Oct 03 14:46:32.943666 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1676/3420] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:32 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:32.954832 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c8c2f4c9-551c-4670-85cb-25b619823b0e req-00b9c7fa-ea05-47c8-9035-2ea88623c7e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100069 Oct 03 14:46:32.959033 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1745/3421] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:33.029471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:33.030066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:33.040853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:33.042601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:33.043512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:33.044655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:33.045308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:33.046276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:33.405916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:33.414967 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3a040a5-c6a8-4a48-aaa3-84c53d63c4cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.390419 Oct 03 14:46:33.418460 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1677/3422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:33 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:33.879169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:33.881129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:33.902455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:33.905447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:33.925288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:33.925884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:33.928782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:33.929350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:33.929927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:33.930669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:33.934419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:33.938096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:33.938913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:33.940193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:33.940840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:33.949711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:34.107597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:34.112297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:34.129305 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-024a4f49-1cc6-41c1-9bd6-22f80f530004 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1285 microversion: 2.1 time: 0.244278 Oct 03 14:46:34.130981 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1746/3423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:33 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:34.140721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ec07505-c8f6-43ba-a281-0cf0077559cf tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230de43a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:34.204698 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ec07505-c8f6-43ba-a281-0cf0077559cf tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.072375 Oct 03 14:46:34.205763 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1747/3424] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:34 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:34.226970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:34.235435 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-667b1e59-e76d-4cb2-960c-ebf83582514a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1317 microversion: 2.1 time: 0.342445 Oct 03 14:46:34.242366 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1678/3425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:33 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:34.445257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:34.445896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:34.475201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:34.475710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:34.476156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:34.476889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:34.477380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:34.477809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:34.907307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:34.920979 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa8c40b6-cca0-4c32-952a-94a3ecb756b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1512 microversion: 2.1 time: 0.480200 Oct 03 14:46:34.925319 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1748/3426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:34 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:35.156685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:35.157591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:35.177106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.177521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.184557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:35.185628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.186261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.186870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:35.219764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-880deffc-e3a5-4768-90ea-71489b853491 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2309f3700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:35.309581 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-880deffc-e3a5-4768-90ea-71489b853491 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.093566 Oct 03 14:46:35.311534 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1749/3427] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:35 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:35.331679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:35.332315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:35.358351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:35.366452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.366975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.367426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:35.368189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.368631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.370626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:35.374416 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e56c520-c811-47b7-bc79-509dd7b3b029 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1273 microversion: 2.1 time: 0.222228 Oct 03 14:46:35.376597 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1679/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:35 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:35.750002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:35.762250 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-183c72d6-d3cb-4dae-8612-634a213a2c7f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1466 microversion: 2.1 time: 0.449425 Oct 03 14:46:35.784618 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1750/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:35 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1466 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:35.786125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:35.786999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:35.797822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.799621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.801159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:35.802161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.802784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.803383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:35.953213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:35.954489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:35.957533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:35.967224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.967720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.968154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:35.977446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:35.978198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:35.978806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.069477 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a8d915d-7bf8-48a9-ab67-5123be2320ea tempest-ServersOnMultiNodesTest-1241926900 tempest-ServersOnMultiNodesTest-1241926900-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1617 microversion: 2.1 time: 0.286218 Oct 03 14:46:36.071308 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1680/3430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:35 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1617 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:36.100358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:36.109682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:36.131309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.131942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.132471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.133364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.133941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.136337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.170686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:36.257246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:36.321831 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7876c54a-b6c1-48f1-ae4f-f554bd030f99 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 204 len: 0 microversion: 2.1 time: 0.227204 Oct 03 14:46:36.326293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1681/3431] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:36 2022] DELETE /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:36.332498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6d1d0577-2138-4e3f-9985-783b01d1a945 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234b60a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:36.447371 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6d1d0577-2138-4e3f-9985-783b01d1a945 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.119321 Oct 03 14:46:36.448069 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1682/3432] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:36 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:36.450019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:36.464192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:36.465167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:36.469861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01ad51c2-2c69-4b67-8187-a44744a5d3c2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1489 microversion: 2.1 time: 0.515938 Oct 03 14:46:36.473882 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1751/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:35 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1489 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:36.486410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.486980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.487425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.488143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.488593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.492084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:36.494785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.498575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:36.514392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.516050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.516750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.518025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.518905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.519588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.853829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:36.867987 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e1b20d6f-b549-4e62-bddb-0ff133d9f017 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1472 microversion: 2.1 time: 0.410999 Oct 03 14:46:36.868600 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1683/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:36 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1472 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:36.878069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:36.883579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:36.903385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.903889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.904327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:36.905080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:36.905536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:36.905963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:37.042545 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bd663fd5-27e5-471e-9b02-f250d0f8ff59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 200 len: 194 microversion: 2.1 time: 0.172128 Oct 03 14:46:37.043243 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1684/3435] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:46:36 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 194 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:37.054612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:37.055571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:37.083509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:37.095345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:37.095909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:37.096835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:37.097341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:37.097613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:37.313947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:37.326212 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-989904bb-04a0-472c-aae7-0646d3f7500f tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.848028 Oct 03 14:46:37.340984 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1752/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:36 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:37.417897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:37.434022 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e2651ef-774c-471a-9ac8-351771cb9834 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.384595 Oct 03 14:46:37.434628 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1685/3437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:37 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:37.464742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e81ad7b9-8529-45d8-910b-393f6dcdac76 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234b60c10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:37.470267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:37.471274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:37.494148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:37.494754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:37.495207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:37.495948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:37.496401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:37.496826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:37.529457 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e81ad7b9-8529-45d8-910b-393f6dcdac76 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.069213 Oct 03 14:46:37.532136 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1686/3438] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:37 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:37.896624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:37.897392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:37.924012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:37.925093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:37.925768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:37.926845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:37.927496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:37.928250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:38.068052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:38.083794 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20f2919d-b632-45a4-b866-10ecb98c6123 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.623572 Oct 03 14:46:38.086105 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1753/3439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:37 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:38.111876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:38.111876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:38.124021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:38.124530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:38.125037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:38.125742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:38.126191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:38.126619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:38.250406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:38.266280 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8621c1b2-c7d8-411c-8198-2670ef75b17a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1472 microversion: 2.1 time: 0.371602 Oct 03 14:46:38.279649 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1687/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:37 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:38.351514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:38.352137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:38.360049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:38.360523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:38.364350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:38.365181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:38.365656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:38.366085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:38.481985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:38.495283 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8136825d-23f0-4a29-ba5c-24dba58230b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.389286 Oct 03 14:46:38.498349 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1754/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:38 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:38.536148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:38.539161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:38.555306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:38.557533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:38.558281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:38.559351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:38.560054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:38.560706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:38.825554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:38.840500 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-086d8248-6632-4419-b1f7-44a73a7f085e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.488749 Oct 03 14:46:38.842466 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1688/3442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:38 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:38.851626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a201cabd-ffe5-4665-8992-fc7a9b554c22 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230e65940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:38.943743 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a201cabd-ffe5-4665-8992-fc7a9b554c22 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1455 microversion: 2.1 time: 0.099768 Oct 03 14:46:38.945140 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1689/3443] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:38 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:38.981502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:39.016081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aae14ddc-655a-4cbd-8832-c27ef0af7558 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.476151 Oct 03 14:46:39.028957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1755/3444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:38 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:39.258459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-962027355", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "85fcbfd3-3026-41ec-a964-76a31555f33f"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:39.292424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:39.293227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:39.308218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:39.310720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:39.316737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:39.317504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:39.319621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:39.320180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:39.397476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] validate_networks() for [('85fcbfd3-3026-41ec-a964-76a31555f33f', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:46:39.500785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:39.513491 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01c022c3-6e8a-4a97-99eb-10ddf7270db8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1430 microversion: 2.1 time: 0.225470 Oct 03 14:46:39.533561 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1756/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:39 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1430 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:39.714652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-75735e55-4cf6-4df7-8234-3c3b92153563 req-cca24e07-36a7-4946-96fd-38f7a2c2c0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3641e0c-506d-4093-88c0-7379317a4e7e", "tag": "2532125e-a025-4528-9846-a7cb0b1ec5ce"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:39.746685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-75735e55-4cf6-4df7-8234-3c3b92153563 req-cca24e07-36a7-4946-96fd-38f7a2c2c0e5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:39.750332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-75735e55-4cf6-4df7-8234-3c3b92153563 req-cca24e07-36a7-4946-96fd-38f7a2c2c0e5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:39.751664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-75735e55-4cf6-4df7-8234-3c3b92153563 req-cca24e07-36a7-4946-96fd-38f7a2c2c0e5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:39.786343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-75735e55-4cf6-4df7-8234-3c3b92153563 req-cca24e07-36a7-4946-96fd-38f7a2c2c0e5 service nova] Creating event network-changed:2532125e-a025-4528-9846-a7cb0b1ec5ce for instance b3641e0c-506d-4093-88c0-7379317a4e7e on n-h2-781139-2 Oct 03 14:46:39.796046 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-75735e55-4cf6-4df7-8234-3c3b92153563 req-cca24e07-36a7-4946-96fd-38f7a2c2c0e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085806 Oct 03 14:46:39.799553 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1757/3446] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:46:39.870430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:39.879200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:39.894113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:39.897318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:39.898038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:39.899211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:39.900000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:39.901131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.405855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:40.418678 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48e57bdd-84f7-45ad-b869-efc66c5ab2b4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.554774 Oct 03 14:46:40.433408 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1758/3447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:39 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:40.446905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-764e5e6b-b7d4-4339-b703-461afac96c11 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230b13280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:40.517315 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-764e5e6b-b7d4-4339-b703-461afac96c11 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1464 microversion: 2.1 time: 0.081028 Oct 03 14:46:40.519084 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1759/3448] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:40 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1464 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:40.523740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2532a096-02f4-4b33-8b8a-87932fa13894 req-60dc0abc-aee6-46ea-9a35-4ffde0c4e87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d215f5f-0d8e-4911-aff2-9debf5723ee9", "name": "network-vif-deleted", "tag": "6a8344e0-dedb-4c3d-bb3f-ce2d900d369c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:40.535461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2532a096-02f4-4b33-8b8a-87932fa13894 req-60dc0abc-aee6-46ea-9a35-4ffde0c4e87b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.536244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2532a096-02f4-4b33-8b8a-87932fa13894 req-60dc0abc-aee6-46ea-9a35-4ffde0c4e87b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.537239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2532a096-02f4-4b33-8b8a-87932fa13894 req-60dc0abc-aee6-46ea-9a35-4ffde0c4e87b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.551802 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2532a096-02f4-4b33-8b8a-87932fa13894 req-60dc0abc-aee6-46ea-9a35-4ffde0c4e87b service nova] Creating event network-vif-deleted:6a8344e0-dedb-4c3d-bb3f-ce2d900d369c for instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 on n-h2-781139-2 Oct 03 14:46:40.557981 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2532a096-02f4-4b33-8b8a-87932fa13894 req-60dc0abc-aee6-46ea-9a35-4ffde0c4e87b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Oct 03 14:46:40.559011 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1760/3449] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:40.564620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4f40a83-f9a1-4be9-9b5f-f8bfd80cd83a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2310adf70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:40.629903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4f40a83-f9a1-4be9-9b5f-f8bfd80cd83a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 200 len: 1464 microversion: 2.1 time: 0.069278 Oct 03 14:46:40.631194 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1761/3450] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:40 2022] GET /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 1464 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:40.636631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:40.637408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:40.643996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.644492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.645671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.646450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.646944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.647574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.689621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.690026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.690656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.691124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lazy-loading 'fault' on Instance uuid 9d215f5f-0d8e-4911-aff2-9debf5723ee9 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:46:40.719165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:46:40.719697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:46:40.720266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:46:40.720771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:46:40.721379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:46:40.738025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.738606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.739101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.739888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.740383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.740815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.767812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:46:40.775077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for user 2cd32680b6b342ea962e104cfaf4c311 and project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:46:40.799982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:40.806539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:46:40.809910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:46:40.851310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:40.866062 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97dd6dba-49a3-43b2-ad71-14c4fa147d7e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 200 len: 1307 microversion: 2.1 time: 0.233493 Oct 03 14:46:40.867201 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1762/3451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:40 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:40.877875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:40.882091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:40.895096 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fda11c7-9d81-4a89-82f0-51a9fee32f3d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640006 Oct 03 14:46:40.897495 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1690/3452] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:46:40.915796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.916796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.917637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.918572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:40.919289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:40.919881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:40.938189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e604afc-0c07-483a-aef6-9d3c7898fb49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:40.939977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e604afc-0c07-483a-aef6-9d3c7898fb49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:41.199037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e604afc-0c07-483a-aef6-9d3c7898fb49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:41.224192 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e604afc-0c07-483a-aef6-9d3c7898fb49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1214 microversion: 2.1 time: 0.304663 Oct 03 14:46:41.225145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1691/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:40 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:41.328499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:41.339960 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20372ce0-901b-4ceb-9f5a-ef57a65c7dd1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 1467 microversion: 2.1 time: 0.468917 Oct 03 14:46:41.342473 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1763/3454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:40 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 1467 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:41.377416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2de13d29-8835-4e75-acd2-7886b3d74d16 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234b77ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.446144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.446756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:41.455921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:41.456700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:41.457326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:41.458232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:41.459600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:41.459969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:41.520247 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2de13d29-8835-4e75-acd2-7886b3d74d16 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-10-03T14%3A44%3A12Z" status: 200 len: 2329 microversion: 2.1 time: 0.154576 Oct 03 14:46:41.525430 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1692/3455] 10.222.0.20 () {58 vars in 1199 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/images?changes-since=2022-10-03T14%3A44%3A12Z => generated 2329 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:41.543288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8843ac49-83d6-4573-83fe-577793bb2435 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234adaf70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.649254 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8843ac49-83d6-4573-83fe-577793bb2435 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1301605580" status: 200 len: 485 microversion: 2.1 time: 0.115684 Oct 03 14:46:41.649949 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1693/3456] 10.222.0.20 () {58 vars in 1231 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1301605580 => generated 485 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:41.663501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ad607d1f-f58f-408b-8133-9bc7ef591120 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230df28b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.675786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:41.685224 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d2c45f4-8f5f-45d3-bc9d-2934ada3d22e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.243139 Oct 03 14:46:41.685813 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1764/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:41.766422 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ad607d1f-f58f-408b-8133-9bc7ef591120 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?server=e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 958 microversion: 2.1 time: 0.107190 Oct 03 14:46:41.767200 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1694/3458] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/images?server=e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 958 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:41.790286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15f36135-47fe-498f-b626-75d6ba49c7e6 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2309d51f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.844756 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15f36135-47fe-498f-b626-75d6ba49c7e6 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 484 microversion: 2.1 time: 0.066395 Oct 03 14:46:41.852508 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1765/3459] 10.222.0.20 () {58 vars in 1317 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9 => generated 484 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:41.858235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9ec0adc-0054-40e1-80d8-a77ca06bc1cd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234b77670>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.896806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.897972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 9d215f5f-0d8e-4911-aff2-9debf5723ee9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:41.912379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:41.912880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:41.913344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:41.914055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:41.914509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:41.914963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:41.919139 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d9ec0adc-0054-40e1-80d8-a77ca06bc1cd tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 484 microversion: 2.1 time: 0.064782 Oct 03 14:46:41.919969 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1695/3460] 10.222.0.20 () {58 vars in 1303 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9 => generated 484 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:41.931203 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 could not be found. Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 HTTP/1.1 Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 could not be found. Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '9d215f5f-0d8e-4911-aff2-9debf5723ee9'} Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 could not be found. Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 could not be found. Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:41.933305 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 could not be found. Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance 9d215f5f-0d8e-4911-aff2-9debf5723ee9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0636d808-ef5b-4f64-8678-1dc43ac59a11 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9" status: 404 len: 111 microversion: 2.1 time: 0.042752 Oct 03 14:46:41.938561 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1766/3461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/servers/9d215f5f-0d8e-4911-aff2-9debf5723ee9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:41.941923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6facd03d-5880-47cd-8937-f8c94004cf51 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230422b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.944255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:41.944762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:41.951657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:41.952267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:41.952843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:41.953821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:41.954439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:41.955027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:41.984482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:42.084788 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b46a3fec-febd-4b0d-aad9-5018dddcecba tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 204 len: 0 microversion: 2.1 time: 0.144524 Oct 03 14:46:42.086314 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1767/3462] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:41 2022] DELETE /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:42.100833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.101905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:42.103863 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6facd03d-5880-47cd-8937-f8c94004cf51 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3708 microversion: 2.1 time: 0.174018 Oct 03 14:46:42.105161 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1696/3463] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:46:41 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:42.109124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:42.109776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:42.110299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:42.111097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:42.111801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:42.112533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:42.126437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb86c773-e225-44f2-86ba-8cf4060035f0 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb231144940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.134227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:42.259841 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb86c773-e225-44f2-86ba-8cf4060035f0 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.141908 Oct 03 14:46:42.262795 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1697/3464] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:42.270677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.271503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:42.289971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:42.293646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:42.294270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:42.297665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:42.298556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:42.299203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:42.409935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:42.420574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7c221352-2039-445e-9181-984bfcf1a7b0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1218 microversion: 2.1 time: 0.156204 Oct 03 14:46:42.433997 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1698/3465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:42.443933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b921ad7-0574-446b-88e4-bb2b200854d5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230e65940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.457187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:42.470984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-823da360-734d-42b6-bd77-3e0196b75f9d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1471 microversion: 2.1 time: 0.380045 Oct 03 14:46:42.472254 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1768/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:42.519234 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b921ad7-0574-446b-88e4-bb2b200854d5 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.083554 Oct 03 14:46:42.520367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1699/3467] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:42.533804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e454cca-c52b-44aa-876d-61454d3d3a75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2309c1ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.692813 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e454cca-c52b-44aa-876d-61454d3d3a75 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-10-03T14%3A44%3A05Z" status: 200 len: 7023 microversion: 2.1 time: 0.163110 Oct 03 14:46:42.700700 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1769/3468] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-03T14%3A44%3A05Z => generated 7023 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:42.722179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.723237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:42.726409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d26a1e6-dc33-41ec-a95e-ce8cbf189ad7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230a69ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.733259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:42.736507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:42.737598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:42.738435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:42.739065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:42.739654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:42.786836 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d26a1e6-dc33-41ec-a95e-ce8cbf189ad7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1301605580" status: 200 len: 665 microversion: 2.1 time: 0.065083 Oct 03 14:46:42.788272 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1770/3469] 10.222.0.20 () {58 vars in 1252 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1301605580 => generated 665 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:42.803538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f17fdc61-94f4-4a26-a087-859ea34666df tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230282670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.875237 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f17fdc61-94f4-4a26-a087-859ea34666df tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1466 microversion: 2.1 time: 0.075776 Oct 03 14:46:42.875930 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1771/3470] 10.222.0.20 () {58 vars in 1338 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1466 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:42.894738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-24e1f2ff-f5fd-4f6d-a487-f8e902352770 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230239550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:42.957716 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-24e1f2ff-f5fd-4f6d-a487-f8e902352770 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1466 microversion: 2.1 time: 0.068154 Oct 03 14:46:42.958418 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1772/3471] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2Fd5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1466 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:42.979164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc4e656e-381a-454f-b116-7fc7f03a8527 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230260ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:43.079962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:43.099746 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-addc7d0b-755d-4270-80da-6313ddbdfa0d tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.395846 Oct 03 14:46:43.125678 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1700/3472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:43.145610 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc4e656e-381a-454f-b116-7fc7f03a8527 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7798 microversion: 2.1 time: 0.171381 Oct 03 14:46:43.146596 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1773/3473] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 3 14:46:42 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7798 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:43.172066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98ebe83a-5df4-4682-970e-24e3e00f906f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb23062b3a0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:43.278571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98ebe83a-5df4-4682-970e-24e3e00f906f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.110212 Oct 03 14:46:43.284986 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1701/3474] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 3 14:46:43 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:43.302293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f7cfe70-b9a1-4b3b-a7bc-9e23a8be4806 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234bd6430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:43.368530 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f7cfe70-b9a1-4b3b-a7bc-9e23a8be4806 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/b9a0038d-acfa-4c25-a7f1-6598cf246eca" status: 200 len: 784 microversion: 2.1 time: 0.069997 Oct 03 14:46:43.369061 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1774/3475] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 3 14:46:43 2022] GET /compute/v2.1/images/b9a0038d-acfa-4c25-a7f1-6598cf246eca => generated 784 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:43.386370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6eec6162-71c0-4d14-b5be-6e237f545215 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2304224c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:43.448255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:43.449104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:43.464554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:43.465386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:43.467536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:43.468414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:43.469019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:43.471008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:43.482152 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6eec6162-71c0-4d14-b5be-6e237f545215 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.100539 Oct 03 14:46:43.482590 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1702/3476] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 14:46:43 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:43.503897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:43.506025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:43.512831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:43.513572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:43.514169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:43.515966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:43.516583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:43.517262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:43.561667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:43.571184 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f4c387f-c2b0-42a7-b709-9d0af42339db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1284 microversion: 2.1 time: 0.128226 Oct 03 14:46:43.572507 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1775/3477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:43 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:43.577641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4595cdb-327a-4781-94b5-8ef22f6e5217 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230b13dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:43.785733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:43.804145 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72e4f3e3-1046-409c-9cea-d115fe5c5e5b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1471 microversion: 2.1 time: 0.304994 Oct 03 14:46:43.811133 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1703/3478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:43 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:44.127614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:44.128948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:44.138671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:44.139157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:44.139598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:44.140300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:44.140745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:44.141932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:44.656480 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4595cdb-327a-4781-94b5-8ef22f6e5217 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a" status: 204 len: 0 microversion: 2.1 time: 1.081213 Oct 03 14:46:44.658222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1776/3479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:43 2022] DELETE /compute/v2.1/images/73f91ffe-323c-4a49-a8f5-92ca389f679a => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:44.668636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ac3e27f3-30f7-40e9-8193-6068f487e4da req-eecf6c7e-8431-4d07-bc0d-d9c91e00ed00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1", "name": "network-vif-unplugged", "status": "completed", "tag": "88432805-1cd9-4545-b41c-15ee430ac3d2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:44.687113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ac3e27f3-30f7-40e9-8193-6068f487e4da req-eecf6c7e-8431-4d07-bc0d-d9c91e00ed00 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:44.688958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ac3e27f3-30f7-40e9-8193-6068f487e4da req-eecf6c7e-8431-4d07-bc0d-d9c91e00ed00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:44.690258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ac3e27f3-30f7-40e9-8193-6068f487e4da req-eecf6c7e-8431-4d07-bc0d-d9c91e00ed00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:44.705455 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ac3e27f3-30f7-40e9-8193-6068f487e4da req-eecf6c7e-8431-4d07-bc0d-d9c91e00ed00 service nova] Creating event network-vif-unplugged:88432805-1cd9-4545-b41c-15ee430ac3d2 for instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 on n-h2-781139-2 Oct 03 14:46:44.713805 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ac3e27f3-30f7-40e9-8193-6068f487e4da req-eecf6c7e-8431-4d07-bc0d-d9c91e00ed00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050688 Oct 03 14:46:44.714727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1777/3480] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:44.723022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:44.724122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:44.733388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:44.734000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:44.734662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:44.735618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:44.736494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:44.737498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:44.757972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:44.771836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-09e2370a-ee98-465b-a0e5-62e085491d85 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.645944 Oct 03 14:46:44.775981 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1704/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:44 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:44.785679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3dbc83ce-1b88-4d04-b91e-3085ae59ded3 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230422d30>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:45.313665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:45.325610 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4add2f47-9eef-4668-b60e-899492c9bbb1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1272 microversion: 2.1 time: 0.605970 Oct 03 14:46:45.326283 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1778/3482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:44 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1272 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:45.337152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:45.337733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:45.350778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:45.351286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:45.351678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:45.352386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:45.352835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:45.353276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:45.690183 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3dbc83ce-1b88-4d04-b91e-3085ae59ded3 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8" status: 204 len: 0 microversion: 2.1 time: 0.912780 Oct 03 14:46:45.695346 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1705/3483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:44 2022] DELETE /compute/v2.1/images/c925160e-b927-48ae-915c-8de17f935fb8 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:45.705027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-872dc552-415e-4128-969d-eee73eec818b req-7cbe7eac-e550-4403-b3fe-8c128cad03f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f801c9d2-17e3-4e3a-9c79-856ec995115f", "name": "network-vif-deleted", "tag": "9d6e70ae-6f8c-4d94-be73-fd8501a1ba66"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:45.723997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-872dc552-415e-4128-969d-eee73eec818b req-7cbe7eac-e550-4403-b3fe-8c128cad03f4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:45.724814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-872dc552-415e-4128-969d-eee73eec818b req-7cbe7eac-e550-4403-b3fe-8c128cad03f4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:45.725550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-872dc552-415e-4128-969d-eee73eec818b req-7cbe7eac-e550-4403-b3fe-8c128cad03f4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:45.788614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-872dc552-415e-4128-969d-eee73eec818b req-7cbe7eac-e550-4403-b3fe-8c128cad03f4 service nova] Creating event network-vif-deleted:9d6e70ae-6f8c-4d94-be73-fd8501a1ba66 for instance f801c9d2-17e3-4e3a-9c79-856ec995115f on n-h1-781139-2 Oct 03 14:46:45.804705 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-872dc552-415e-4128-969d-eee73eec818b req-7cbe7eac-e550-4403-b3fe-8c128cad03f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104435 Oct 03 14:46:45.806110 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1706/3484] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:45.816201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:45.818867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09fd3c85-a19b-4bae-86b2-9453cefe536d tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230968820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:45.826683 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-786d20bf-4f25-4306-a526-a7cb1c787dca tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 200 len: 1429 microversion: 2.1 time: 0.499298 Oct 03 14:46:45.844901 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1779/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:45 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 1429 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:45.858643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:45.859574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:45.875171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:45.878584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:45.879232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:45.880482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:45.884786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:45.885483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:46.463967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:46.478870 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4cd111d1-fece-4eb4-bc53-e79569a220bd tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.629523 Oct 03 14:46:46.481140 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1780/3486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:45 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:46.496552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:46.497680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:46.512505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:46.513316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:46.524475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:46.526063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:46.526824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:46.527555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:46.721904 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-09fd3c85-a19b-4bae-86b2-9453cefe536d tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657" status: 204 len: 0 microversion: 2.1 time: 0.913414 Oct 03 14:46:46.722622 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1707/3487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:45 2022] DELETE /compute/v2.1/images/6fd403c1-97e0-4c8a-8b2f-6821eb8c7657 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:46.732452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:46.733921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:46.747765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:46.748880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:46.749568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:46.750615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:46.752515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:46.753349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:46.795677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:46.918878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:46.933825 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f295d26-aa11-41bc-bb20-98e2b3612ac4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.450946 Oct 03 14:46:46.934500 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1781/3488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:46 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:46.958476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:46.959102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: f801c9d2-17e3-4e3a-9c79-856ec995115f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:46.966250 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3868855f-116a-4778-8cb6-28240fdb1401 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 204 len: 0 microversion: 2.1 time: 0.239232 Oct 03 14:46:46.967117 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1708/3489] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:46 2022] DELETE /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:46.972792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e4fe4595-17a0-405d-a012-67896e9e561b req-35c4207a-2079-479b-8030-d2c9e546a60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3641e0c-506d-4093-88c0-7379317a4e7e", "name": "network-vif-plugged", "status": "completed", "tag": "2532125e-a025-4528-9846-a7cb0b1ec5ce"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:46.985402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e4fe4595-17a0-405d-a012-67896e9e561b req-35c4207a-2079-479b-8030-d2c9e546a60b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:46.986088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e4fe4595-17a0-405d-a012-67896e9e561b req-35c4207a-2079-479b-8030-d2c9e546a60b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:46.987056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e4fe4595-17a0-405d-a012-67896e9e561b req-35c4207a-2079-479b-8030-d2c9e546a60b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.008668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.011746 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e4fe4595-17a0-405d-a012-67896e9e561b req-35c4207a-2079-479b-8030-d2c9e546a60b service nova] Creating event network-vif-plugged:2532125e-a025-4528-9846-a7cb0b1ec5ce for instance b3641e0c-506d-4093-88c0-7379317a4e7e on n-h2-781139-2 Oct 03 14:46:47.020867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.021365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.022501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.025529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.026455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.027913 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e4fe4595-17a0-405d-a012-67896e9e561b req-35c4207a-2079-479b-8030-d2c9e546a60b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059240 Oct 03 14:46:47.031375 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1709/3490] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:47.044155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:47.045315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:47.061959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.062767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.064384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.069991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.070480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.070919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.077318 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance f801c9d2-17e3-4e3a-9c79-856ec995115f could not be found. Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f HTTP/1.1 Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance f801c9d2-17e3-4e3a-9c79-856ec995115f could not be found. Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f801c9d2-17e3-4e3a-9c79-856ec995115f'} Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f801c9d2-17e3-4e3a-9c79-856ec995115f could not be found. Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f801c9d2-17e3-4e3a-9c79-856ec995115f could not be found. Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:47.083100 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f801c9d2-17e3-4e3a-9c79-856ec995115f could not be found. Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance f801c9d2-17e3-4e3a-9c79-856ec995115f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:47.089801 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8315bf7b-7f2b-44a9-998f-ab3e00de5c90 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f" status: 404 len: 111 microversion: 2.1 time: 0.130706 Oct 03 14:46:47.097854 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1782/3491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:46 2022] GET /compute/v2.1/servers/f801c9d2-17e3-4e3a-9c79-856ec995115f => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:47.102940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:47.103442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:47.113162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.113667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.114381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.115097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.115549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.115972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.156492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:47.269996 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0cc8d80-9766-4cc6-b055-8adcbbd1a599 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 204 len: 0 microversion: 2.1 time: 0.170576 Oct 03 14:46:47.271490 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1783/3492] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:47 2022] DELETE /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:47.285038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:47.286224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:47.296207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.298011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.299230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.299937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.301444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.302244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.425350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:47.438220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35eea412-e8af-4227-acd9-6d357d74f983 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1474 microversion: 2.1 time: 0.405423 Oct 03 14:46:47.453970 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1710/3493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:47 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1474 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:47.506192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:47.506823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:47.516324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.516819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.517285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.518533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.518533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.524912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.629428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:47.639104 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29e510cb-d139-4774-8f33-adc834f46d7d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1473 microversion: 2.1 time: 0.362327 Oct 03 14:46:47.640381 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1784/3494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:47 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:47.843330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1aa6098d-83d9-4759-a918-b2ca6692b3ab req-afe5949b-82ee-4cae-9df2-48726d51ef2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960d5b6b-7d39-46bb-ba46-3ce634f28f32", "tag": "94dcf015-9131-4d7f-bab0-622a075ed756"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:47.858840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1aa6098d-83d9-4759-a918-b2ca6692b3ab req-afe5949b-82ee-4cae-9df2-48726d51ef2a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.859321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1aa6098d-83d9-4759-a918-b2ca6692b3ab req-afe5949b-82ee-4cae-9df2-48726d51ef2a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.860644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1aa6098d-83d9-4759-a918-b2ca6692b3ab req-afe5949b-82ee-4cae-9df2-48726d51ef2a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.875564 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1aa6098d-83d9-4759-a918-b2ca6692b3ab req-afe5949b-82ee-4cae-9df2-48726d51ef2a service nova] Creating event network-changed:94dcf015-9131-4d7f-bab0-622a075ed756 for instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 on n-h2-781139-2 Oct 03 14:46:47.883171 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1aa6098d-83d9-4759-a918-b2ca6692b3ab req-afe5949b-82ee-4cae-9df2-48726d51ef2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045411 Oct 03 14:46:47.884015 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1785/3495] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:47.960037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:47.962386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:47.974911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.975462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:47.978964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.980495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:47.983896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:47.984180 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-763f40d3-3aeb-4e0f-bd26-8f69af116da8 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1315 microversion: 2.1 time: 0.484325 Oct 03 14:46:47.988024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:47.989460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:48.008961 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1711/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:47 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:48.234650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:48.243115 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85218c67-3f99-4c58-9baa-b2c491a069ec tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.288323 Oct 03 14:46:48.257722 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1786/3497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:47 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:48.470724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:48.471731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:48.515686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:48.516479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:48.517193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:48.518195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:48.518713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:48.519205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:48.668565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:48.669479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:48.677682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:48.678072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:48.678522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:48.679301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:48.680056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:48.680649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:48.838692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:48.848070 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d82a294-a652-4802-aa48-1adaba590c8f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1473 microversion: 2.1 time: 0.183847 Oct 03 14:46:48.848996 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1787/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:48 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:48.875148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:48.884330 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-22ee9d13-3789-4b32-a523-aec454029a3a tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1474 microversion: 2.1 time: 0.424007 Oct 03 14:46:48.885328 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1712/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:48 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1474 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:49.014737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.015647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:49.037395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.045042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.045502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.046269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.046724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.047155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.251585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:49.260792 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f4242d2-b005-4e3a-ba1d-88b5472bcca4 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1503 microversion: 2.1 time: 0.250392 Oct 03 14:46:49.288627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.290011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:49.296830 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1788/3500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:49 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1503 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:49.302514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.304597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.305356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.306045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.307361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.308043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.308845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:49.309563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.328370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.335590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.336205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.337471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.338058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.338498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.440401 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86680ac8-4309-4e0f-a663-f156692109db tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.141750 Oct 03 14:46:49.447297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1789/3501] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 3 14:46:49 2022] DELETE /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e/os-server-password => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:49.453312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.453896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:49.468744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.469301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.469854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.471159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.472109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.472554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.510640 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3352c75-5a43-4515-9e22-dc771c43056e tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.061955 Oct 03 14:46:49.518166 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1790/3502] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 3 14:46:49 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e/os-server-password => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:46:49.523605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.524207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:49.531856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.532524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.533442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.533940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.534403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.534832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.566746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:49.576534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:49.657261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:49.673553 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00280e1e-56b4-4adc-b945-d8fd86d22edc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.392691 Oct 03 14:46:49.674598 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1713/3503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:49 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:49.714453 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b341ca8c-e046-48c8-813e-cafe071b260c tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 204 len: 0 microversion: 2.1 time: 0.194607 Oct 03 14:46:49.715500 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1791/3504] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:49 2022] DELETE /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:49.724376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.725424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:49.738123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.738630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.739070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.739788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.740240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.740682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.751331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:49.879471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:49.882098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:49.896873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.897356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.897806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:49.900206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:49.902337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:49.905242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:50.139192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:50.147927 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-792a41d1-b9cf-4709-889c-c48646aec84b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1473 microversion: 2.1 time: 0.276415 Oct 03 14:46:50.148845 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1792/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:49 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:50.153622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:50.154543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:50.160917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:50.161448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:50.161894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:50.162596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:50.163050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:50.163526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:50.272008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:50.280135 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70f4c479-480b-4301-b3fd-8be848879904 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1509 microversion: 2.1 time: 0.560448 Oct 03 14:46:50.281323 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1714/3506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:49 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1509 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:50.366789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:50.376329 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55c656f7-39d5-4ea9-97d3-a438be4d23b7 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1474 microversion: 2.1 time: 0.226393 Oct 03 14:46:50.377850 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1793/3507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:50 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1474 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:50.695976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:50.696580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:50.717331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:50.718007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:50.718594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:50.719456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:50.720050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:50.720622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:50.759243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:51.180989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:51.181657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:51.195783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:51.201701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:51.202163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:51.202928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:51.203387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:51.203819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:51.214617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=16 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:51.405248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:51.415732 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d12ea9ad-b4c8-4e74-8b2d-7ebc943dde29 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.723484 Oct 03 14:46:51.429932 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1715/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:50 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:51.442987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:51.443984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:51.452284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:51.453201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:51.453920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:51.454942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:51.456241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:51.456949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:51.512945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:51.533609 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bf90249-5c5a-4e32-90fd-85cf171587de tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1473 microversion: 2.1 time: 0.357807 Oct 03 14:46:51.534241 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1794/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:51 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:51.562677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:51.569600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:51.587670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:51.589606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:51.590066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:51.590818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:51.592800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:51.593494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:51.921659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:51.933488 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e18ad62-e0a0-4186-a459-62d5b812ca4c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1474 microversion: 2.1 time: 0.384733 Oct 03 14:46:51.938427 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1795/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:51 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:52.454258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:52.454895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:52.473627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:52.476735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:52.477607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:52.481531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:52.484137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:52.485542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:52.691457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec2ecc4c6e242efa0f86191f670906c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ac1d0e61084918870fc725e401bfd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:52.715521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fa4cae6-85d2-463b-a9e9-aaa986c69589 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 200 len: 1509 microversion: 2.1 time: 1.278175 Oct 03 14:46:52.716586 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1716/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:51 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 1509 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:52.723536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b5102dc7-ffeb-4d34-8dea-af76877d6d7c req-84f31659-9f53-4804-ad44-61b0476f7e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3641e0c-506d-4093-88c0-7379317a4e7e", "name": "network-vif-deleted", "tag": "2532125e-a025-4528-9846-a7cb0b1ec5ce"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:52.740999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b5102dc7-ffeb-4d34-8dea-af76877d6d7c req-84f31659-9f53-4804-ad44-61b0476f7e74 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:52.741881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b5102dc7-ffeb-4d34-8dea-af76877d6d7c req-84f31659-9f53-4804-ad44-61b0476f7e74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:52.742644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b5102dc7-ffeb-4d34-8dea-af76877d6d7c req-84f31659-9f53-4804-ad44-61b0476f7e74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:52.761731 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b5102dc7-ffeb-4d34-8dea-af76877d6d7c req-84f31659-9f53-4804-ad44-61b0476f7e74 service nova] Creating event network-vif-deleted:2532125e-a025-4528-9846-a7cb0b1ec5ce for instance b3641e0c-506d-4093-88c0-7379317a4e7e on n-h2-781139-2 Oct 03 14:46:52.769507 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b5102dc7-ffeb-4d34-8dea-af76877d6d7c req-84f31659-9f53-4804-ad44-61b0476f7e74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051059 Oct 03 14:46:52.771741 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1717/3512] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:52.779830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:52.782238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:52.793840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:52.794775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:52.795491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:52.796705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:52.797475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:52.798622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:53.058414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:53.076384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e0bc526-6880-46f5-9297-0bc27b632ed4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1431 microversion: 2.1 time: 0.299889 Oct 03 14:46:53.077772 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1718/3513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:52 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1431 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:53.086581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-28878ac0-71d6-438f-8451-7aa45922b3ac req-f6fd1aae-ca1f-4d55-97d7-53951f8a6cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5551a2d-d830-4659-86a3-517e278ac8e9", "name": "network-vif-deleted", "tag": "1978cd53-c8d1-46ad-9e17-feb4deb818da"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:53.124020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28878ac0-71d6-438f-8451-7aa45922b3ac req-f6fd1aae-ca1f-4d55-97d7-53951f8a6cfd service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:53.125417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28878ac0-71d6-438f-8451-7aa45922b3ac req-f6fd1aae-ca1f-4d55-97d7-53951f8a6cfd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:53.126218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28878ac0-71d6-438f-8451-7aa45922b3ac req-f6fd1aae-ca1f-4d55-97d7-53951f8a6cfd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:53.176651 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-28878ac0-71d6-438f-8451-7aa45922b3ac req-f6fd1aae-ca1f-4d55-97d7-53951f8a6cfd service nova] Creating event network-vif-deleted:1978cd53-c8d1-46ad-9e17-feb4deb818da for instance d5551a2d-d830-4659-86a3-517e278ac8e9 on n-h1-781139-2 Oct 03 14:46:53.210961 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-28878ac0-71d6-438f-8451-7aa45922b3ac req-f6fd1aae-ca1f-4d55-97d7-53951f8a6cfd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131675 Oct 03 14:46:53.211903 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1719/3514] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:53.219288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:53.221303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:53.236760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:53.238471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:53.238935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:53.239705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:53.240157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:53.251855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:53.319537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:53.320207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:53.320793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:53.321452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lazy-loading 'fault' on Instance uuid d5551a2d-d830-4659-86a3-517e278ac8e9 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:46:53.418306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:53.431611 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06aafc84-6ebd-437e-a996-394305a56ed3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.983825 Oct 03 14:46:53.447827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:53.461849 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1796/3515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:52 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:53.470553 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-10d4cab7-cafe-4892-a241-2d7fdf851257 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 200 len: 1308 microversion: 2.1 time: 0.247952 Oct 03 14:46:53.473959 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1720/3516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:53 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:53.751655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:53.752297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] [instance: b3641e0c-506d-4093-88c0-7379317a4e7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:53.773378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:53.773989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:53.775265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:53.777340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:53.781094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:53.781806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:53.817882 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] HTTP exception thrown: Instance b3641e0c-506d-4093-88c0-7379317a4e7e could not be found. Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Request method failure captured: Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e HTTP/1.1 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvXDZ9sbRaowVOU2cHvCfkE6bOE6t5PPTluttGakLSJTUHJ0mK2FLOXGHF9RkjLVAIjYmeSImFaCc1Iwhc3OhaoiHwAZ_NoenDSLlkGtoYmWK0c56FbPGqXutUinGqnZjBsO0Zx_m2aTrL9ylDSIIdD9HobGBZ8gBEFop5c0yfFpa10 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 61ac1d0e61084918870fc725e401bfd1 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerPasswordTestJSON-195970761 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/61ac1d0e61084918870fc725e401bfd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_61ac1d0e61084918870fc725e401bfd1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61ac1d0e61084918870fc725e401bfd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61ac1d0e61084918870fc725e401bfd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerPasswordTestJSON-195970761 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 61ac1d0e61084918870fc725e401bfd1 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerPasswordTestJSON-195970761 Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerPasswordTestJSON-195970761-project Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: dec2ecc4c6e242efa0f86191f670906c Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerPasswordTestJSON-195970761-project Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b3641e0c-506d-4093-88c0-7379317a4e7e could not be found. Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b3641e0c-506d-4093-88c0-7379317a4e7e'} Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3641e0c-506d-4093-88c0-7379317a4e7e could not be found. Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3641e0c-506d-4093-88c0-7379317a4e7e could not be found. Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:53.821481 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3641e0c-506d-4093-88c0-7379317a4e7e could not be found. Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] Returning 404 to user: Instance b3641e0c-506d-4093-88c0-7379317a4e7e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:53.827223 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff265093-f2ac-49d3-a312-a8ebf3677f18 tempest-ServerPasswordTestJSON-195970761 tempest-ServerPasswordTestJSON-195970761-project] 10.222.0.20 "GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e" status: 404 len: 111 microversion: 2.1 time: 0.084928 Oct 03 14:46:53.828228 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1797/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:53 2022] GET /compute/v2.1/servers/b3641e0c-506d-4093-88c0-7379317a4e7e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:54.105259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:54.110279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:54.123331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.123817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.124794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.126285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.126974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.127680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.183494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.184534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.185232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.185839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lazy-loading 'fault' on Instance uuid c955fddf-0aa8-4d03-899f-5a279d5bd731 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:46:54.252432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:54.270159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-45e5a59e-4a37-42af-b338-7a344001ce64 req-3be2163a-6eb3-443d-ac0b-a7550203eefb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960d5b6b-7d39-46bb-ba46-3ce634f28f32", "name": "network-vif-plugged", "status": "completed", "tag": "94dcf015-9131-4d7f-bab0-622a075ed756"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:54.276092 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b9188894-244e-46aa-bd36-46059bff1904 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 200 len: 1307 microversion: 2.1 time: 0.175879 Oct 03 14:46:54.277854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1721/3518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:54 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 1307 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:54.288855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45e5a59e-4a37-42af-b338-7a344001ce64 req-3be2163a-6eb3-443d-ac0b-a7550203eefb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.289360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45e5a59e-4a37-42af-b338-7a344001ce64 req-3be2163a-6eb3-443d-ac0b-a7550203eefb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.296299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45e5a59e-4a37-42af-b338-7a344001ce64 req-3be2163a-6eb3-443d-ac0b-a7550203eefb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.310993 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-45e5a59e-4a37-42af-b338-7a344001ce64 req-3be2163a-6eb3-443d-ac0b-a7550203eefb service nova] Creating event network-vif-plugged:94dcf015-9131-4d7f-bab0-622a075ed756 for instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 on n-h2-781139-2 Oct 03 14:46:54.317935 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-45e5a59e-4a37-42af-b338-7a344001ce64 req-3be2163a-6eb3-443d-ac0b-a7550203eefb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052867 Oct 03 14:46:54.319361 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1798/3519] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:46:54.472157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:54.472771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:54.486370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.487104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.487567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.488316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.488767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.490171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.500557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:54.501987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: d5551a2d-d830-4659-86a3-517e278ac8e9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:54.513515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.517705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.522316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.523357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.523996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.524588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.558157 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] HTTP exception thrown: Instance d5551a2d-d830-4659-86a3-517e278ac8e9 could not be found. Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Request method failure captured: Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 HTTP/1.1 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvU0hLoxc6mIt144ygAIUFyHZT-qUnCVasFFITL8r71WuNmUd6Lwp7V53OPun31ZUam308PqXH5t7wPvYCd05uTJPx0PcL3ymD8uTbNuobgluOufJjN7IlKE8mutxVdlc9wvYT4duhl5E46UfsOfRpSLurbQTPqa9Jzb0Cu6k1Miq3I Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f7d6918f8cd24dd4b7dc07a82685f5e9 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ListImageFiltersTestJSON-1712368687 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7d6918f8cd24dd4b7dc07a82685f5e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7d6918f8cd24dd4b7dc07a82685f5e9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7d6918f8cd24dd4b7dc07a82685f5e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7d6918f8cd24dd4b7dc07a82685f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ListImageFiltersTestJSON-1712368687 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f7d6918f8cd24dd4b7dc07a82685f5e9 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1712368687 Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ListImageFiltersTestJSON-1712368687-project Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cc28214adc984a20b2b5cd1c7b6e628c Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ListImageFiltersTestJSON-1712368687-project Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d5551a2d-d830-4659-86a3-517e278ac8e9 could not be found. Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd5551a2d-d830-4659-86a3-517e278ac8e9'} Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5551a2d-d830-4659-86a3-517e278ac8e9 could not be found. Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5551a2d-d830-4659-86a3-517e278ac8e9 could not be found. Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:54.559858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5551a2d-d830-4659-86a3-517e278ac8e9 could not be found. Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:54.568092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Returning 404 to user: Instance d5551a2d-d830-4659-86a3-517e278ac8e9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:54.573768 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3ce127a-65ab-4698-ae43-1b4ac4b3b9c4 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9" status: 404 len: 111 microversion: 2.1 time: 0.065644 Oct 03 14:46:54.574965 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1799/3520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:54 2022] GET /compute/v2.1/servers/d5551a2d-d830-4659-86a3-517e278ac8e9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:46:54.582818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:54.586072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:54.608798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.609336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.609755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.610469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.611104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.611677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.661531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:54.784395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:54.787270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:54.802389 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03096ea4-b8e3-49f9-a72d-6f83d7741160 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.334102 Oct 03 14:46:54.802996 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1722/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:54 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:54.828093 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e01b2830-2aba-4c7a-ad7b-322e2f079f6f tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 204 len: 0 microversion: 2.1 time: 0.248647 Oct 03 14:46:54.834132 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1800/3522] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:54 2022] DELETE /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:54.838673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:54.839241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:54.857994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.858795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.859507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:54.860550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:54.861083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:54.861664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.146980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:55.156079 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9e9010b4-2cae-41d2-aa36-8455f4a63043 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 1473 microversion: 2.1 time: 0.321763 Oct 03 14:46:55.162212 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1723/3523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:54 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:55.299576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:55.300311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: c955fddf-0aa8-4d03-899f-5a279d5bd731] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:55.310446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.310865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.313424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.314395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.314865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.316724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.353612 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance c955fddf-0aa8-4d03-899f-5a279d5bd731 could not be found. Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 HTTP/1.1 Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance c955fddf-0aa8-4d03-899f-5a279d5bd731 could not be found. Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c955fddf-0aa8-4d03-899f-5a279d5bd731'} Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c955fddf-0aa8-4d03-899f-5a279d5bd731 could not be found. Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c955fddf-0aa8-4d03-899f-5a279d5bd731 could not be found. Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:46:55.355665 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c955fddf-0aa8-4d03-899f-5a279d5bd731 could not be found. Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance c955fddf-0aa8-4d03-899f-5a279d5bd731 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:46:55.360761 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3643d00-ac55-4d92-90a6-21621dacdde6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731" status: 404 len: 111 microversion: 2.1 time: 0.061918 Oct 03 14:46:55.361555 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1801/3524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:55 2022] GET /compute/v2.1/servers/c955fddf-0aa8-4d03-899f-5a279d5bd731 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:46:55.368043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:55.368542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:55.376382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.376891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.377545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.378492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.379152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.380215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.424873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-52a1c76a-1832-403c-890e-0b95856abdb9 req-61fcc3f9-1fce-4dc3-a967-ad9c3567e1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c955fddf-0aa8-4d03-899f-5a279d5bd731", "name": "network-vif-deleted", "tag": "7a8040c9-7ffa-4072-af5c-7db245ae0faa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:55.425666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:55.436825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-52a1c76a-1832-403c-890e-0b95856abdb9 req-61fcc3f9-1fce-4dc3-a967-ad9c3567e1a4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.437711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-52a1c76a-1832-403c-890e-0b95856abdb9 req-61fcc3f9-1fce-4dc3-a967-ad9c3567e1a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.438575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-52a1c76a-1832-403c-890e-0b95856abdb9 req-61fcc3f9-1fce-4dc3-a967-ad9c3567e1a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.454475 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-52a1c76a-1832-403c-890e-0b95856abdb9 req-61fcc3f9-1fce-4dc3-a967-ad9c3567e1a4 service nova] Creating event network-vif-deleted:7a8040c9-7ffa-4072-af5c-7db245ae0faa for instance c955fddf-0aa8-4d03-899f-5a279d5bd731 on n-h1-781139-2 Oct 03 14:46:55.462906 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-52a1c76a-1832-403c-890e-0b95856abdb9 req-61fcc3f9-1fce-4dc3-a967-ad9c3567e1a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041684 Oct 03 14:46:55.464693 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1802/3525] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:46:55.594332 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ee935343-d63a-41d9-a77e-85cc30a3113f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 204 len: 0 microversion: 2.1 time: 0.229172 Oct 03 14:46:55.595013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1724/3526] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:55 2022] DELETE /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:55.606082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:55.607281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:55.616901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.617963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.618602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.631687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.633508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.635296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.674414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:46:55.830023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:55.830847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:55.842397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.842722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.845392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.847755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.848724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.850861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.870664 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18bfee44-e238-460d-b90c-2724f241949c tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 204 len: 0 microversion: 2.1 time: 0.270177 Oct 03 14:46:55.874666 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1803/3527] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:46:55 2022] DELETE /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:46:55.889865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:55.890871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:55.902613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.903743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.906404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:55.907895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:55.912664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:55.913741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:56.339236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:56.367507 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3862dfb-31b4-4836-9597-c5a58436b68c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.537432 Oct 03 14:46:56.378248 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1725/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:55 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:56.382567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:56.382766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:56.383546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:56.393919 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83aaa1cd-2598-4cc2-9700-76106e3a8ec8 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 200 len: 1474 microversion: 2.1 time: 0.517550 Oct 03 14:46:56.395102 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1804/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:55 2022] GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 1474 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:56.400181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:56.401214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:56.402002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:56.403206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:56.403805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:56.404368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:56.763872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:56.773929 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63d67617-1f45-4e52-89c5-4b0c6ab76a6c tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 1473 microversion: 2.1 time: 0.402287 Oct 03 14:46:56.774803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1726/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:56 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 1473 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:57.392408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:57.393047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:57.404520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:57.411303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:57.411906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:57.413734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:57.413734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:57.413734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:57.419630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:57.420330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:57.433488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:57.433973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:57.434403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:57.435118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:57.435565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:57.435984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:57.986795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:58.000354 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-48a27b7d-5395-4bbe-a6b7-055114896df0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 200 len: 1474 microversion: 2.1 time: 0.584563 Oct 03 14:46:58.015698 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1727/3531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:57 2022] GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 1474 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:46:58.015698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:58.015698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:58.030597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:58.031438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:58.031568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:58.032284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:58.033266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:58.038602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:58.255529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:58.265762 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0238ba9-7957-432f-bf53-c31f298824d4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1314 microversion: 2.1 time: 0.877776 Oct 03 14:46:58.277578 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1805/3532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:57 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:58.477060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:58.487982 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12bf6552-8fa1-43da-a16f-5a979cd67e67 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 1473 microversion: 2.1 time: 0.484516 Oct 03 14:46:58.488574 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1728/3533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:58 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:59.025885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:59.026505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:59.044747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.045276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.045716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.046431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.047068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.047654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.094920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:59.294033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c3e61b65-0b74-476d-882f-4d1b4896a72d req-67608a76-b4c7-4566-a147-6994e27471b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0531b4ab-731f-4324-8b97-e6ea2062f070", "name": "network-vif-deleted", "tag": "fc227bf5-4d13-48dd-9526-dcf6a79c8f67"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:59.322721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c3e61b65-0b74-476d-882f-4d1b4896a72d req-67608a76-b4c7-4566-a147-6994e27471b2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.326505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c3e61b65-0b74-476d-882f-4d1b4896a72d req-67608a76-b4c7-4566-a147-6994e27471b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.327730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c3e61b65-0b74-476d-882f-4d1b4896a72d req-67608a76-b4c7-4566-a147-6994e27471b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.344979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c3e61b65-0b74-476d-882f-4d1b4896a72d req-67608a76-b4c7-4566-a147-6994e27471b2 service nova] Creating event network-vif-deleted:fc227bf5-4d13-48dd-9526-dcf6a79c8f67 for instance 0531b4ab-731f-4324-8b97-e6ea2062f070 on n-h1-781139-2 Oct 03 14:46:59.373153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c3e61b65-0b74-476d-882f-4d1b4896a72d req-67608a76-b4c7-4566-a147-6994e27471b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086063 Oct 03 14:46:59.374355 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1729/3534] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:46:59.389536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:59.393418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:59.408144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.410169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.410882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.414260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.414967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.416429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.452733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:59.682446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:59.703156 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd9db661-5f59-4476-ab6e-35fa6720219b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1500 microversion: 2.1 time: 0.325992 Oct 03 14:46:59.721022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1730/3535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:59 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1500 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:59.741802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:46:59.744970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:46:59.761670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.762694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.763178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.763920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.764375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.764799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.840628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:46:59.841328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:46:59.841935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:46:59.842549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lazy-loading 'fault' on Instance uuid e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:46:59.925626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc28214adc984a20b2b5cd1c7b6e628c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d6918f8cd24dd4b7dc07a82685f5e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:46:59.966578 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9cada0d2-83ec-4b80-b942-404d027baffe tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 200 len: 1308 microversion: 2.1 time: 0.244300 Oct 03 14:46:59.976998 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1731/3536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:59 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:46:59.990724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:46:59.993237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:00.000778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:00.001562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:00.002158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:00.003055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:00.003670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:00.004257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:00.189521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-60f36349-2dc2-4d6e-a6af-26c144bbc64b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.206595 Oct 03 14:47:00.190807 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1732/3537] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:46:59 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:47:00.605221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:00.615922 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d361af42-8aa1-4f0a-befd-b158289ee91a tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 200 len: 1474 microversion: 2.1 time: 1.594055 Oct 03 14:47:00.617047 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1806/3538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:46:59 2022] GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 1474 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:00.970304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ee61c9f5-5eda-4597-a796-33047b38999c req-47afa827-bbbc-456c-9fcc-7c89b4d258e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ca3b05-1932-4369-b562-7389f07c88fe", "name": "network-vif-deleted", "tag": "840388eb-c55c-4380-8700-3834eb580c61"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:00.998912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:01.001980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] [instance: e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:01.024695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.027724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.028917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.031165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.032918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ee61c9f5-5eda-4597-a796-33047b38999c req-47afa827-bbbc-456c-9fcc-7c89b4d258e9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.033753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ee61c9f5-5eda-4597-a796-33047b38999c req-47afa827-bbbc-456c-9fcc-7c89b4d258e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.034197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.034898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.035016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ee61c9f5-5eda-4597-a796-33047b38999c req-47afa827-bbbc-456c-9fcc-7c89b4d258e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.066984 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ee61c9f5-5eda-4597-a796-33047b38999c req-47afa827-bbbc-456c-9fcc-7c89b4d258e9 service nova] Creating event network-vif-deleted:840388eb-c55c-4380-8700-3834eb580c61 for instance 31ca3b05-1932-4369-b562-7389f07c88fe on n-h2-781139-2 Oct 03 14:47:01.078110 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ee61c9f5-5eda-4597-a796-33047b38999c req-47afa827-bbbc-456c-9fcc-7c89b4d258e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116416 Oct 03 14:47:01.079109 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1733/3539] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:01.084617 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] HTTP exception thrown: Instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 could not be found. Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Request method failure captured: Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 HTTP/1.1 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvU0hLoxc6mIt144ygAIUFyHZT-qUnCVasFFITL8r71WuNmUd6Lwp7V53OPun31ZUam308PqXH5t7wPvYCd05uTJPx0PcL3ymD8uTbNuobgluOufJjN7IlKE8mutxVdlc9wvYT4duhl5E46UfsOfRpSLurbQTPqa9Jzb0Cu6k1Miq3I Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f7d6918f8cd24dd4b7dc07a82685f5e9 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ListImageFiltersTestJSON-1712368687 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f7d6918f8cd24dd4b7dc07a82685f5e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f7d6918f8cd24dd4b7dc07a82685f5e9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7d6918f8cd24dd4b7dc07a82685f5e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f7d6918f8cd24dd4b7dc07a82685f5e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ListImageFiltersTestJSON-1712368687 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f7d6918f8cd24dd4b7dc07a82685f5e9 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1712368687 Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ListImageFiltersTestJSON-1712368687-project Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cc28214adc984a20b2b5cd1c7b6e628c Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ListImageFiltersTestJSON-1712368687-project Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 could not be found. Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1'} Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 could not be found. Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 could not be found. Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:01.088877 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 could not be found. Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:01.096345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Returning 404 to user: Instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:01.097656 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-175f2301-5557-4184-83eb-78639539b13b tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1" status: 404 len: 111 microversion: 2.1 time: 0.106693 Oct 03 14:47:01.097918 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1807/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:00 2022] GET /compute/v2.1/servers/e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:47:01.111713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0d26b9e4-5dce-44b4-89f9-cd021653fe76 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb2306a6f70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:01.222526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:01.227109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:01.243274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.245858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.246514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.249718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.250537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.253806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.391477 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63e6ea07-b82b-4367-938f-58b2b5a3f1bd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.193054 Oct 03 14:47:01.395446 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1808/3541] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:01 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:47:01.436335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-bfc2db6c-3b04-4f62-9aa5-723a41b301cb req-8863f042-13b1-412a-a9a0-8e75faa99b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1", "name": "network-vif-deleted", "tag": "88432805-1cd9-4545-b41c-15ee430ac3d2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:01.458417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bfc2db6c-3b04-4f62-9aa5-723a41b301cb req-8863f042-13b1-412a-a9a0-8e75faa99b0f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.461120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bfc2db6c-3b04-4f62-9aa5-723a41b301cb req-8863f042-13b1-412a-a9a0-8e75faa99b0f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.465562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-bfc2db6c-3b04-4f62-9aa5-723a41b301cb req-8863f042-13b1-412a-a9a0-8e75faa99b0f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.495786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-bfc2db6c-3b04-4f62-9aa5-723a41b301cb req-8863f042-13b1-412a-a9a0-8e75faa99b0f service nova] Creating event network-vif-deleted:88432805-1cd9-4545-b41c-15ee430ac3d2 for instance e7dcf0e9-ce46-4d43-b06f-3bf5f94714f1 on n-h2-781139-2 Oct 03 14:47:01.504421 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-bfc2db6c-3b04-4f62-9aa5-723a41b301cb req-8863f042-13b1-412a-a9a0-8e75faa99b0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072033 Oct 03 14:47:01.507095 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1809/3542] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:47:01.644871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:01.646942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:01.662164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.662674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.663124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.667908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.669743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.672744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.732755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:01.733528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:01.734133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:01.734854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lazy-loading 'fault' on Instance uuid 31ca3b05-1932-4369-b562-7389f07c88fe {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:01.850032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:01.863085 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f27f673f-0bf7-42e6-9224-a293dce813b2 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 200 len: 1308 microversion: 2.1 time: 0.225384 Oct 03 14:47:01.864039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1810/3543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:01 2022] GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:47:01.991598 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0d26b9e4-5dce-44b4-89f9-cd021653fe76 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/images/6d570762-7b8d-4555-a4c0-902b3e6ee614" status: 204 len: 0 microversion: 2.1 time: 0.888211 Oct 03 14:47:01.992321 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1734/3544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:01 2022] DELETE /compute/v2.1/images/6d570762-7b8d-4555-a4c0-902b3e6ee614 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:02.008376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14c5b12c-930e-425f-a39c-1234629d81fb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb230a53160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:02.369574 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14c5b12c-930e-425f-a39c-1234629d81fb tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/images/9649b0cf-2ba8-47f8-b2e8-a27c7409f3ec" status: 204 len: 0 microversion: 2.1 time: 0.372406 Oct 03 14:47:02.380529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1811/3545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:01 2022] DELETE /compute/v2.1/images/9649b0cf-2ba8-47f8-b2e8-a27c7409f3ec => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:02.382240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-447ad94f-7082-4c84-9e7d-5d01acb403e1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] Calling method '.version_select at 0x7fb234ada160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:02.407567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:02.411889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:02.436368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:02.436869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:02.438636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:02.440493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:02.442501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:02.444116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:02.546509 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e09e183e-ea31-4cb5-acdd-210226a30d63 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.144338 Oct 03 14:47:02.551315 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1812/3546] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:02 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:47:02.826743 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-447ad94f-7082-4c84-9e7d-5d01acb403e1 tempest-ListImageFiltersTestJSON-1712368687 tempest-ListImageFiltersTestJSON-1712368687-project] 10.222.0.20 "DELETE /compute/v2.1/images/0ac876fd-7c34-41c5-9a78-d65c286a6e59" status: 204 len: 0 microversion: 2.1 time: 0.451485 Oct 03 14:47:02.831797 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1735/3547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:02 2022] DELETE /compute/v2.1/images/0ac876fd-7c34-41c5-9a78-d65c286a6e59 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:02.889415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:02.891883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 31ca3b05-1932-4369-b562-7389f07c88fe] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:02.903043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:02.904073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:02.908149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:02.910215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:02.911058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:02.911737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:02.934560 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance 31ca3b05-1932-4369-b562-7389f07c88fe could not be found. Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe HTTP/1.1 Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 31ca3b05-1932-4369-b562-7389f07c88fe could not be found. Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '31ca3b05-1932-4369-b562-7389f07c88fe'} Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ca3b05-1932-4369-b562-7389f07c88fe could not be found. Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ca3b05-1932-4369-b562-7389f07c88fe could not be found. Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:02.939767 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ca3b05-1932-4369-b562-7389f07c88fe could not be found. Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:02.945336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance 31ca3b05-1932-4369-b562-7389f07c88fe could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:02.947183 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f63228f-4a3a-45d2-98ec-d9be08570590 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe" status: 404 len: 111 microversion: 2.1 time: 0.063341 Oct 03 14:47:02.951399 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1813/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:02 2022] GET /compute/v2.1/servers/31ca3b05-1932-4369-b562-7389f07c88fe => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:47:02.960463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:02.961309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0531b4ab-731f-4324-8b97-e6ea2062f070] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:03.003193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:03.007201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:03.009119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:03.012150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:03.013321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:03.014415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:03.061044 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance 0531b4ab-731f-4324-8b97-e6ea2062f070 could not be found. Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 HTTP/1.1 Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 0531b4ab-731f-4324-8b97-e6ea2062f070 could not be found. Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '0531b4ab-731f-4324-8b97-e6ea2062f070'} Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0531b4ab-731f-4324-8b97-e6ea2062f070 could not be found. Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0531b4ab-731f-4324-8b97-e6ea2062f070 could not be found. Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:03.068010 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:03.073469 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:03.073469 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:03.073469 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:03.073469 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:03.073469 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:03.073469 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0531b4ab-731f-4324-8b97-e6ea2062f070 could not be found. Oct 03 14:47:03.073469 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:03.077094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance 0531b4ab-731f-4324-8b97-e6ea2062f070 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:03.079164 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ca162934-24bc-4ab1-a97e-e2ba87fa2062 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070" status: 404 len: 111 microversion: 2.1 time: 0.125713 Oct 03 14:47:03.091198 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1736/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:02 2022] GET /compute/v2.1/servers/0531b4ab-731f-4324-8b97-e6ea2062f070 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:47:03.103624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-969eb917-0ea8-4595-8e9d-b57139967ab0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:03.153308 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-969eb917-0ea8-4595-8e9d-b57139967ab0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [872bb6e8-db13-48b6-8058-7944b349ec71] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 14:47:03.558786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:03.561435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:03.577270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:03.577972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:03.579675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:03.582488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:03.583380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:03.586679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:03.650385 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa44629e-a9fe-46d7-b523-bec65f933f93 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.095844 Oct 03 14:47:03.651715 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1737/3550] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:03 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:47:04.165546 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-969eb917-0ea8-4595-8e9d-b57139967ab0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [872bb6e8-db13-48b6-8058-7944b349ec71] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38410. Oct 03 14:47:04.174697 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-969eb917-0ea8-4595-8e9d-b57139967ab0 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/606cc9b3-e8bc-44e8-b50c-b56066b5d85b" status: 204 len: 0 microversion: 2.1 time: 1.089835 Oct 03 14:47:04.175485 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1814/3551] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:47:03 2022] DELETE /compute/v2.1/os-server-groups/606cc9b3-e8bc-44e8-b50c-b56066b5d85b => generated 0 bytes in 1092 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:04.185491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:04.186188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:04.200068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:04.201469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:04.202089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:04.202935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:04.209418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:04.220616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:04.306850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:47:04.538589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:04.554495 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f9b96bc-0cd6-4a38-97bc-0ecfd0aed44f tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 204 len: 0 microversion: 2.1 time: 0.371514 Oct 03 14:47:04.560320 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1738/3552] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:47:04 2022] DELETE /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:04.564686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:04.565617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:04.578889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:04.581252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:04.596049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:04.599551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:04.601307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:04.604495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:04.665557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:04.671664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:04.711479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:04.713767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:04.717482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:04.718371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:04.723602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:04.724845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:04.746640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:47:04.857208 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3a90960a-e7c2-412f-b0d9-5bfdb578adf5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.197758 Oct 03 14:47:04.858483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1739/3553] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:04 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:47:04.996594 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e023bfc-6d15-42f6-87ea-1f1f042c953e tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 204 len: 0 microversion: 2.1 time: 0.435821 Oct 03 14:47:04.997589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1815/3554] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:47:04 2022] DELETE /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:05.008054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:05.009017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:05.044472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:05.046903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:05.047736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:05.048847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:05.050178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:05.051871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:05.439171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:05.448809 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7bba91f-af5d-4148-9c1c-d1b49a780596 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 200 len: 1475 microversion: 2.1 time: 0.446508 Oct 03 14:47:05.449428 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1740/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:05 2022] GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:05.870803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:05.874293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:05.886468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:05.887791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:05.890234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:05.891747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:05.892712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:05.894325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:05.946862 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0e320d8-02b4-4777-9fdc-e9712047cf33 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.081249 Oct 03 14:47:05.948178 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1816/3556] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:05 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:47:06.474245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:06.475411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:06.484172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:06.484847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:06.485472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:06.486731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:06.487343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:06.487928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:06.859785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:06.869233 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b8d39525-5052-43c6-865d-f44988866685 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 200 len: 1475 microversion: 2.1 time: 0.398708 Oct 03 14:47:06.877810 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1741/3557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:06 2022] GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:06.958282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:06.960627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:06.975793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:06.976285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:06.979134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:06.980143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:06.981596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:06.996721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:07.100007 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68f10e98-e13e-4879-a4d5-965a833bfb75 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.145303 Oct 03 14:47:07.101267 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1817/3558] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:06 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:47:07.904253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:07.904857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:07.924828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:07.925349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:07.925782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:07.926548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:07.927188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:07.927793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:08.112595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:08.114957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:08.135037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:08.135537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:08.135972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:08.140735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:08.141464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:08.142053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:08.232815 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef565783-14ec-4e06-85fe-c4dc3e9eb037 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 14 microversion: 2.1 time: 0.121351 Oct 03 14:47:08.258857 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1818/3559] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:08 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:47:09.023068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:09.036743 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-740c322b-7617-4975-8b0a-d5c4380f6ffb tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 200 len: 1475 microversion: 2.1 time: 1.136641 Oct 03 14:47:09.056311 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1742/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:07 2022] GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 1475 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:09.276094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:09.313784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:09.371044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:09.378110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:09.378965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:09.385162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:09.386299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:09.388478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:09.529651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ad912136-de53-4448-9322-8c4f837dc414 req-5ea406f4-2489-45d0-8afc-08c834551d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49f194d-6be0-48e8-8233-39be860a35a8", "name": "network-vif-deleted", "tag": "7c8471f7-06b5-4f3a-9af8-5375caf73e59"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:09.557095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b02ade27-c6af-4b1a-ab1b-cb9d73ee73db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action" status: 200 len: 8206 microversion: 2.1 time: 0.310036 Oct 03 14:47:09.558743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1819/3561] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:09 2022] POST /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32/action => generated 8206 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:09.580992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:09.588544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:09.623724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad912136-de53-4448-9322-8c4f837dc414 req-5ea406f4-2489-45d0-8afc-08c834551d6b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:09.629986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:09.630742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:09.631337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:09.632877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:09.642954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:09.643655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:09.668018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad912136-de53-4448-9322-8c4f837dc414 req-5ea406f4-2489-45d0-8afc-08c834551d6b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:09.673158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad912136-de53-4448-9322-8c4f837dc414 req-5ea406f4-2489-45d0-8afc-08c834551d6b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.048s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:09.765280 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ad912136-de53-4448-9322-8c4f837dc414 req-5ea406f4-2489-45d0-8afc-08c834551d6b service nova] Creating event network-vif-deleted:7c8471f7-06b5-4f3a-9af8-5375caf73e59 for instance a49f194d-6be0-48e8-8233-39be860a35a8 on n-h1-781139-2 Oct 03 14:47:09.797279 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ad912136-de53-4448-9322-8c4f837dc414 req-5ea406f4-2489-45d0-8afc-08c834551d6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266153 Oct 03 14:47:09.801215 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1743/3562] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:10.077047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:10.078958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:10.094994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:10.095495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:10.108798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:10.110608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:10.114317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:10.117634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:10.280175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:10.280692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:10.281175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:10.281644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lazy-loading 'fault' on Instance uuid a49f194d-6be0-48e8-8233-39be860a35a8 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:10.460463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:10.478301 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-192c7bde-21be-4a3c-ac39-dd6b1705d6d6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 200 len: 1309 microversion: 2.1 time: 0.416406 Oct 03 14:47:10.479708 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1744/3563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:10 2022] GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:11.404292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:11.414129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c99e89bc-79de-4914-ab38-2450b989ae68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 1.849232 Oct 03 14:47:11.420104 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1820/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:09 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:11.450645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:11.451423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:11.481376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.486387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.486854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.487615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.489270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.491526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.506833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:11.507926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: a49f194d-6be0-48e8-8233-39be860a35a8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:11.523071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.523690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.524234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.525131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.527033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.529484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.563744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance a49f194d-6be0-48e8-8233-39be860a35a8 could not be found. Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 HTTP/1.1 Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a49f194d-6be0-48e8-8233-39be860a35a8 could not be found. Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a49f194d-6be0-48e8-8233-39be860a35a8'} Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a49f194d-6be0-48e8-8233-39be860a35a8 could not be found. Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a49f194d-6be0-48e8-8233-39be860a35a8 could not be found. Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:11.569179 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.576260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:11.576260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:11.576260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:11.576260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:11.576260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:11.576260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a49f194d-6be0-48e8-8233-39be860a35a8 could not be found. Oct 03 14:47:11.576260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.579542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance a49f194d-6be0-48e8-8233-39be860a35a8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:11.586101 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb1b7590-0fde-4083-a38b-f6461fd4bef6 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8" status: 404 len: 111 microversion: 2.1 time: 0.083952 Oct 03 14:47:11.587137 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1821/3565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:11 2022] GET /compute/v2.1/servers/a49f194d-6be0-48e8-8233-39be860a35a8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:47:11.599519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:11.601996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: 0fc613fa-3ea2-40fb-9898-87260b37b158] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:11.612325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.613097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.614005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.614988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.615685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.616332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.633583 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance 0fc613fa-3ea2-40fb-9898-87260b37b158 could not be found. Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 HTTP/1.1 Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 0fc613fa-3ea2-40fb-9898-87260b37b158 could not be found. Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '0fc613fa-3ea2-40fb-9898-87260b37b158'} Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc613fa-3ea2-40fb-9898-87260b37b158 could not be found. Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc613fa-3ea2-40fb-9898-87260b37b158 could not be found. Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:11.635750 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.639920 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:11.639920 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:11.639920 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:11.639920 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:11.639920 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:11.639920 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc613fa-3ea2-40fb-9898-87260b37b158 could not be found. Oct 03 14:47:11.639920 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:11.643237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance 0fc613fa-3ea2-40fb-9898-87260b37b158 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:11.644379 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db7930ed-1b06-4528-8ed8-bc2a6151b823 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158" status: 404 len: 111 microversion: 2.1 time: 0.052107 Oct 03 14:47:11.648631 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1822/3566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:11 2022] GET /compute/v2.1/servers/0fc613fa-3ea2-40fb-9898-87260b37b158 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:47:11.654666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a88b2e5-d59d-4140-80ee-a031c88ba6e4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:11.700600 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a88b2e5-d59d-4140-80ee-a031c88ba6e4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c2f453d7-d67b-4bf9-ab8c-93f415b40c62" status: 204 len: 0 microversion: 2.1 time: 0.050362 Oct 03 14:47:11.710922 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1823/3567] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:47:11 2022] DELETE /compute/v2.1/os-server-groups/c2f453d7-d67b-4bf9-ab8c-93f415b40c62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:11.722995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:11.732509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:11.750988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.751494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.751940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.752953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.753431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.753863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.801510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:47:11.892436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:11.911415 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0cc89e4-7e89-41bb-90ed-32e28de6e107 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.463088 Oct 03 14:47:11.929843 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1745/3568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:11 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:11.939184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:11.940079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:11.948629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.949481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.950084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:11.950974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:11.951698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:11.952339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:12.071290 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50145c2e-3b8c-4054-9b71-000888d5c91d tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 204 len: 0 microversion: 2.1 time: 0.357909 Oct 03 14:47:12.072576 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1824/3569] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:47:11 2022] DELETE /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:47:12.081276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c9ded98b-ee0b-415f-ac6d-f9420ade762f req-6594e400-980f-481e-8176-989ccf11865b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc613fa-3ea2-40fb-9898-87260b37b158", "name": "network-vif-deleted", "tag": "4c8a9cf5-7acc-40e3-a7e1-593ffed2746d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:12.113221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9ded98b-ee0b-415f-ac6d-f9420ade762f req-6594e400-980f-481e-8176-989ccf11865b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:12.113792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9ded98b-ee0b-415f-ac6d-f9420ade762f req-6594e400-980f-481e-8176-989ccf11865b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:12.114234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c9ded98b-ee0b-415f-ac6d-f9420ade762f req-6594e400-980f-481e-8176-989ccf11865b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:12.153507 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c9ded98b-ee0b-415f-ac6d-f9420ade762f req-6594e400-980f-481e-8176-989ccf11865b service nova] Creating event network-vif-deleted:4c8a9cf5-7acc-40e3-a7e1-593ffed2746d for instance 0fc613fa-3ea2-40fb-9898-87260b37b158 on n-h1-781139-2 Oct 03 14:47:12.160792 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c9ded98b-ee0b-415f-ac6d-f9420ade762f req-6594e400-980f-481e-8176-989ccf11865b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085931 Oct 03 14:47:12.163627 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1825/3570] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:12.174285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:12.175848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:12.190162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:12.192531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:12.193242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:12.194147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:12.194747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:12.195350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:12.549127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:12.564405 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bfa13ec3-7186-4c9c-b46c-e2cb3d6bc00c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.627487 Oct 03 14:47:12.565376 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1746/3571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:11 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:12.592229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:12.593186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:12.602651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:12.605979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:12.606596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:12.608821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:12.609795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:12.615400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:12.914222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:12.929345 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-978ece71-0191-4aa2-8912-68c9b83ed99d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.339176 Oct 03 14:47:12.932490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1747/3572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:12 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:47:12.962417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:12.965430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:12.966143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:12.975092 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b775967-4862-495c-b864-098c323108b4 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1472 microversion: 2.1 time: 0.809896 Oct 03 14:47:12.979703 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1826/3573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:12 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1472 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:12.995464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:12.995464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:12.995464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:12.995464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:12.995464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:12.995464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:13.107327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Locking {{(pid=128868) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 03 14:47:13.163214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:13.224448 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-461af742-20e7-4860-928b-083f1cf459eb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.269865 Oct 03 14:47:13.226694 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1748/3574] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:12 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:13.236092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:13.236714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:13.246824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:13.248779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:13.250543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:13.252373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:13.253641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:13.264448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:13.767644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:13.778257 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85de109c-438a-4c95-af9b-477e50f7a58d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.547375 Oct 03 14:47:13.779426 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1827/3575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:13 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:13.809715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:13.830603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:13.832504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:13.833888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:13.873794 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] HTTP exception thrown: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 is locked Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Request method failure captured: Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action HTTP/1.1 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvSFsPGcfHTyiIVdt9ONxDnLmtREv_MdG2_9wLLGecv0dxj_HABKVJIJwZMg32BcUeg-88n0l_OlMPTus0PqS7uL1gc_aa3dUl-4njIH_WFw8PQpnIWNqnMvrvWrqhBf6wBkgvignqGoulxT_XesLr5FXyHVndy31ho7QskYmDphbUI Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b183c9eff5e549478b3d8de2fe72ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-996527410 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2cd32680b6b342ea962e104cfaf4c311 Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: {"os-stop": {}} Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 is locked Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '931c2fbe-6c74-4e2a-9d69-996fcb544f90', 'body': {'os-stop': {}}} Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 is locked Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 is locked Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 is locked Oct 03 14:47:13.875946 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:13.882358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Returning 409 to user: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 is locked {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:13.883382 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5f088ce-a8ba-406f-940d-6f7bda5418dd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 409 len: 107 microversion: 2.1 time: 0.084798 Oct 03 14:47:13.899984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:13.901889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:13.907137 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1749/3576] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:13 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 107 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:47:13.935585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:13.937958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:13.938596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:13.939816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:13.941318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:13.941995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:13.967749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:14.003782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:14.004814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:14.025822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:14.026644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:14.027249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:14.028129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:14.028741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:14.029427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:14.063700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Unlocking {{(pid=128869) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 03 14:47:14.155568 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f01fc2d-64ed-47ca-a399-9a93ca6fe72f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.264029 Oct 03 14:47:14.157968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1828/3577] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:13 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:14.167162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aed3fd76-943a-4203-8268-4d6769fb5630 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:14.192141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed3fd76-943a-4203-8268-4d6769fb5630 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:14.193074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed3fd76-943a-4203-8268-4d6769fb5630 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:14.193797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aed3fd76-943a-4203-8268-4d6769fb5630 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:14.222181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aed3fd76-943a-4203-8268-4d6769fb5630 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:47:14.314802 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aed3fd76-943a-4203-8268-4d6769fb5630 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.153465 Oct 03 14:47:14.318210 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1829/3578] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:14 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:14.333498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:14.334247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:14.341594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:14.342266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:14.342706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:14.344071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:14.344259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:14.344681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:14.484134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:14.497369 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9fe61756-6639-42e8-9f28-9402c78b9cc7 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1472 microversion: 2.1 time: 0.498403 Oct 03 14:47:14.497978 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1750/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:13 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1472 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:15.582516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:15.586214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:15.593575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:15.594351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:15.595749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:15.596645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:15.597316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:15.597905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:15.877279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ee77356d97424599b6c5fadfde75ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddc9ce67025446b8b961e24a7692c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:15.899617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6a96303e-e44d-437e-9e9b-d6ed7f79afa1 tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 200 len: 1430 microversion: 2.1 time: 0.378231 Oct 03 14:47:15.906408 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1751/3580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:15 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 1430 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:15.934320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:15.944348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-fe6af0cd-6741-4783-8c5f-3b27c2b39db2 req-4c530bf7-562a-4d03-bc61-856f55b18d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc064e15-e471-4aea-9ae4-545bad8c989b", "name": "network-vif-deleted", "tag": "4487e7c4-5fab-4cbb-9678-885d73834e9f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:15.946780 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-194af882-fcfc-4182-9351-6e62a485c95f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 1.621930 Oct 03 14:47:15.947664 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1830/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:14 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:15.983899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fe6af0cd-6741-4783-8c5f-3b27c2b39db2 req-4c530bf7-562a-4d03-bc61-856f55b18d8f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:15.985536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fe6af0cd-6741-4783-8c5f-3b27c2b39db2 req-4c530bf7-562a-4d03-bc61-856f55b18d8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:15.986896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fe6af0cd-6741-4783-8c5f-3b27c2b39db2 req-4c530bf7-562a-4d03-bc61-856f55b18d8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:16.021198 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-fe6af0cd-6741-4783-8c5f-3b27c2b39db2 req-4c530bf7-562a-4d03-bc61-856f55b18d8f service nova] Creating event network-vif-deleted:4487e7c4-5fab-4cbb-9678-885d73834e9f for instance cc064e15-e471-4aea-9ae4-545bad8c989b on n-h2-781139-2 Oct 03 14:47:16.027863 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-fe6af0cd-6741-4783-8c5f-3b27c2b39db2 req-4c530bf7-562a-4d03-bc61-856f55b18d8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111019 Oct 03 14:47:16.029402 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1752/3582] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:16.935610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:16.936987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] [instance: cc064e15-e471-4aea-9ae4-545bad8c989b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:16.950599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:16.951333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:16.954985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:16.956032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:16.956659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:16.957313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:16.975421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:16.976138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:16.990761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:16.994907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:16.995411 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] HTTP exception thrown: Instance cc064e15-e471-4aea-9ae4-545bad8c989b could not be found. Oct 03 14:47:16.995638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Request method failure captured: Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b HTTP/1.1 Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvT18-tplUx8zja_BygPKToJc_cVQFvNiHDsYb6XY0tlD1RBSKFgJRAsRh9-tL2RxWIBc28g4Po9iqzwtK1mr8RP26RwUfLtFuoxRPo9pwsi3XSIvVYbf3pg8dNwoKBQr5Zr4wghiBJ9AbEbg21lZDJFv6jF_qiEnn-rK9i1WYR-cpc Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ddc9ce67025446b8b961e24a7692c4d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ddc9ce67025446b8b961e24a7692c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 6ddc9ce67025446b8b961e24a7692c4d Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1635378527 Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 30ee77356d97424599b6c5fadfde75ac Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersOnMultiNodesTest-1635378527-project Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance cc064e15-e471-4aea-9ae4-545bad8c989b could not be found. Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'cc064e15-e471-4aea-9ae4-545bad8c989b'} Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc064e15-e471-4aea-9ae4-545bad8c989b could not be found. Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc064e15-e471-4aea-9ae4-545bad8c989b could not be found. Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:16.998015 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:17.003189 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:17.003189 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:17.003189 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:17.003189 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:17.003189 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:17.003189 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc064e15-e471-4aea-9ae4-545bad8c989b could not be found. Oct 03 14:47:17.003189 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:17.008342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] Returning 404 to user: Instance cc064e15-e471-4aea-9ae4-545bad8c989b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:17.012291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:17.012965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:17.013847 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9731e44d-de3f-4d15-bf4b-8b8a0e2fe01b tempest-ServersOnMultiNodesTest-1635378527 tempest-ServersOnMultiNodesTest-1635378527-project] 10.222.0.20 "GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b" status: 404 len: 111 microversion: 2.1 time: 0.083076 Oct 03 14:47:17.015131 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1831/3583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:16 2022] GET /compute/v2.1/servers/cc064e15-e471-4aea-9ae4-545bad8c989b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:47:17.021588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:17.398532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:17.417309 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59241a74-2d48-4882-8a65-275494b5fdf8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.440453 Oct 03 14:47:17.418050 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1753/3584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:16 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:47:18.443975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:18.445201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:18.468052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:18.470526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:18.471225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:18.480434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:18.481386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:18.482572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:19.827355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:19.863566 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5c1dd92-d432-4ed3-9b57-a17fd518e4f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 1.424192 Oct 03 14:47:19.864396 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1832/3585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:18 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:20.891997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:20.893512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:20.908287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:20.910814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:20.916068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:20.929687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:20.932476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:20.937933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:21.498261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:21.512453 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fa5f5d48-28e1-459a-ab90-ff449d258bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.625029 Oct 03 14:47:21.512943 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1754/3586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:20 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:22.391950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1101071141", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "b1ebfae4-f4f5-44a4-980a-819eff135ccb"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:22.410807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:DELETE=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:22.515760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] validate_networks() for [('b1ebfae4-f4f5-44a4-980a-819eff135ccb', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:47:22.536414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:22.537917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:22.551173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:22.552018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:22.552541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:22.553355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:22.553899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:22.554380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:22.840346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:22.853399 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5a3c317-3d1b-477e-ab6c-100803a797a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.319292 Oct 03 14:47:22.855176 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1755/3587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:22 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:24.178053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:24.178932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:24.187510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.188682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.190486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.192801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.193831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.194602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.228066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:47:24.320810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:47:24.324412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:47:24.325209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:47:24.327541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:47:24.328403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:47:24.375285 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-881a2024-b572-4346-be6b-a2adab584b0e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 204 len: 0 microversion: 2.42 time: 0.831785 Oct 03 14:47:24.378034 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1756/3588] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:47:23 2022] DELETE /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 0 bytes in 835 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:24.389553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.393790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.395067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.396140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.396433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:24.397105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.397263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:24.397898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.414573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.415483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.416300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.417241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.419226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.420804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.461063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Getting quotas for project de61ad14d5544ded9d0694097d237219. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:47:24.470794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Getting quotas for user 4e444169c7084eb8acb5e1f79af8566c and project de61ad14d5544ded9d0694097d237219. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:47:24.503740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:47:24.515633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:47:24.609116 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-122a6a7c-1b45-49e4-b8a3-46ded4f9c36c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.500971 Oct 03 14:47:24.616326 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1833/3589] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:47:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:47:24.696057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:24.709995 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4c30bf16-47fe-4e50-91f4-24f343b82232 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.329101 Oct 03 14:47:24.715455 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b305b3a-5983-4fdb-bf62-314b0e1da420 tempest-TenantUsagesNegativeTestJSON-1365475932 tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-02T14%3A47%3A24.042854&end=2022-10-04T14%3A47%3A24.042854" status: 404 len: 112 microversion: - time: 0.097574 Oct 03 14:47:24.722587 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1834/3590] 10.222.0.20 () {58 vars in 1316 bytes} [Mon Oct 3 14:47:24 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-02T14%3A47%3A24.042854&end=2022-10-04T14%3A47%3A24.042854 => generated 112 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 14:47:24.724817 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1757/3591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:24 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:24.728327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:24.733854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:24.737283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-21c5876d-c23f-4328-a372-ed603e2e23db tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:24.738850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-21c5876d-c23f-4328-a372-ed603e2e23db tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:24.748850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.749623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.750290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.756850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:24.757566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:24.758206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:24.865689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-21c5876d-c23f-4328-a372-ed603e2e23db tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:24.881997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-21c5876d-c23f-4328-a372-ed603e2e23db tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:24.887176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-21c5876d-c23f-4328-a372-ed603e2e23db tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:24.890689 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-21c5876d-c23f-4328-a372-ed603e2e23db tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1262 microversion: 2.26 time: 0.164227 Oct 03 14:47:24.894480 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1758/3592] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:24 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:24.952595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4191fd34-1abb-4877-960d-21c87ef44e2c tempest-TenantUsagesNegativeTestJSON-1365475932 tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin] Calling method '.version_select at 0x7fb23067db80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:24.971117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-4191fd34-1abb-4877-960d-21c87ef44e2c tempest-TenantUsagesNegativeTestJSON-1365475932 tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4191fd34-1abb-4877-960d-21c87ef44e2c tempest-TenantUsagesNegativeTestJSON-1365475932 tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin] Request method failure captured: Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-simple-tenant-usage/4cde395c53f247b1b7a00e688d9e959e?start=2022-10-04T14%3A47%3A24.042854&end=2022-10-02T14%3A47%3A24.042854 HTTP/1.1 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvX713iiM7kFQEGSefNLpG_Mb0wk4PEUHhnY-KW9Wcv-Wll8KvA8NSsARYWzIFj1qypdpSmoyWfATrByC-ChuROP3qaRRJA8tUhhMCbccaaUvMFIoC36BtmN_ME3hJUIQ7MBQtSV6Gd-TsTqJbbrNEzzBTWh4nn3800Rh3Yo72t1D6Q Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 0131e458b37c4fdc84dd549da213d866 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1365475932 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0131e458b37c4fdc84dd549da213d866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0131e458b37c4fdc84dd549da213d866", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0131e458b37c4fdc84dd549da213d866"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0131e458b37c4fdc84dd549da213d866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1365475932 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 0131e458b37c4fdc84dd549da213d866 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1365475932 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 93c9c3b09dd24433aa4b17f3b9ff8247 Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid start time. The start time cannot occur after the end time. Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4cde395c53f247b1b7a00e688d9e959e'} Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 03 14:47:24.990132 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:24.994854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4191fd34-1abb-4877-960d-21c87ef44e2c tempest-TenantUsagesNegativeTestJSON-1365475932 tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:24.994854 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4191fd34-1abb-4877-960d-21c87ef44e2c tempest-TenantUsagesNegativeTestJSON-1365475932 tempest-TenantUsagesNegativeTestJSON-1365475932-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/4cde395c53f247b1b7a00e688d9e959e?start=2022-10-04T14%3A47%3A24.042854&end=2022-10-02T14%3A47%3A24.042854" status: 400 len: 111 microversion: 2.1 time: 0.070188 Oct 03 14:47:24.994854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1759/3593] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Oct 3 14:47:24 2022] GET /compute/v2.1/os-simple-tenant-usage/4cde395c53f247b1b7a00e688d9e959e?start=2022-10-04T14%3A47%3A24.042854&end=2022-10-02T14%3A47%3A24.042854 => generated 111 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:47:25.264168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-557fc5cf-8f2a-4c19-8fc7-38aa6ba44f93 tempest-TenantUsagesNegativeTestJSON-1155990140 tempest-TenantUsagesNegativeTestJSON-1155990140-project] Calling method '.version_select at 0x7fb230422f70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:25.272195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-557fc5cf-8f2a-4c19-8fc7-38aa6ba44f93 tempest-TenantUsagesNegativeTestJSON-1155990140 tempest-TenantUsagesNegativeTestJSON-1155990140-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'ecdff42b984f4559bc2b904bd1fa3d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde395c53f247b1b7a00e688d9e959e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-557fc5cf-8f2a-4c19-8fc7-38aa6ba44f93 tempest-TenantUsagesNegativeTestJSON-1155990140 tempest-TenantUsagesNegativeTestJSON-1155990140-project] Request method failure captured: Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T14%3A47%3A24.042854&end=2022-10-04T14%3A47%3A24.042854&detailed=1 HTTP/1.1 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvX6AM6lhcJhh81nyRc9QyByi6AsNV3BynTFZlCgPY_R0FtsZu0p_jXMH6uPr5vma8hQLLhR3XgFr6eytrMMoo6OYA1s5vLSJfYuRxPe831Wkb8UsOgXyS2tCsl-xTeD0g-AzUasYBIkdX_NIm21mBPFxaG06U4oxVgCRvoFR_ZtXQ8 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 4cde395c53f247b1b7a00e688d9e959e Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1155990140 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4cde395c53f247b1b7a00e688d9e959e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4cde395c53f247b1b7a00e688d9e959e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4cde395c53f247b1b7a00e688d9e959e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4cde395c53f247b1b7a00e688d9e959e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1155990140 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 4cde395c53f247b1b7a00e688d9e959e Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1155990140 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TenantUsagesNegativeTestJSON-1155990140-project Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ecdff42b984f4559bc2b904bd1fa3d67 Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1155990140-project Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise self.value Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 03 14:47:25.283197 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-557fc5cf-8f2a-4c19-8fc7-38aa6ba44f93 tempest-TenantUsagesNegativeTestJSON-1155990140 tempest-TenantUsagesNegativeTestJSON-1155990140-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:25.288035 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-557fc5cf-8f2a-4c19-8fc7-38aa6ba44f93 tempest-TenantUsagesNegativeTestJSON-1155990140 tempest-TenantUsagesNegativeTestJSON-1155990140-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T14%3A47%3A24.042854&end=2022-10-04T14%3A47%3A24.042854&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.268169 Oct 03 14:47:25.292213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1760/3594] 10.222.0.20 () {58 vars in 1335 bytes} [Mon Oct 3 14:47:25 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-02T14%3A47%3A24.042854&end=2022-10-04T14%3A47%3A24.042854&detailed=1 => generated 123 bytes in 276 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:47:25.413082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:25.427592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:25.438360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:25.439769 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86aced16-1ed8-4246-aa72-da235ebb79bf tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2955 microversion: 2.42 time: 0.715811 Oct 03 14:47:25.457550 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1835/3595] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:24 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2955 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:25.501573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56c51771-e1c2-4764-bfdc-21cbc7dd6f12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Action: 'create', calling method: .version_select at 0x7fb2304a9a60>, body: {"keypair": {"name": "tempest-keypair-1294057936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+W/WAHv1uDgBNUzpcCmx9LCB4o7+MPW+ARbxtdQwYe5RxPDyYL5zbP66AG5fzBBRJtayYFVXenkBDzo0AFxKKYiycl7iDlBHXxkXkk8C8VqEXC3HAV/CSw48nN6aT4Og=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:25.555980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-56c51771-e1c2-4764-bfdc-21cbc7dd6f12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Getting quotas for project a870f5d2905749f1af61487e3bcffbd1. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:47:25.603664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-56c51771-e1c2-4764-bfdc-21cbc7dd6f12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Getting quotas for user bd57ce0236d346b3821d0df4f618ae8d and project a870f5d2905749f1af61487e3bcffbd1. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:47:25.691799 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56c51771-e1c2-4764-bfdc-21cbc7dd6f12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.398059 Oct 03 14:47:25.693136 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1761/3596] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:47:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:25.734946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:25.735855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:25.751613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:25.752399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:25.754125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:25.755717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:25.758345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:25.763168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:25.927725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:25.928458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:25.946799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:25.947523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:25.948112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:25.951455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:25.956035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:25.957814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:26.134513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:26.153088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:26.160438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:26.162184 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0aa3c68d-b7fc-498d-a229-2a6e38da216a tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1266 microversion: 2.26 time: 0.240279 Oct 03 14:47:26.170180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:26.185917 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1762/3597] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:25 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:26.200164 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2107cac9-6554-4ed3-9068-a7cc8d1db1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.468634 Oct 03 14:47:26.201347 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1836/3598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:25 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:26.476340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:26.477086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:26.501783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:26.502745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:26.505434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:26.508007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:26.511819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:26.513849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:27.212436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:27.214873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:27.238026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:27.239567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:27.241123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:27.243478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:27.244039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:27.245973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:27.344767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:27.357535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:27.365235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:27.367094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17a5d5e0-fe8e-406c-8d4a-cc1527235531 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2955 microversion: 2.42 time: 0.896627 Oct 03 14:47:27.371624 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1763/3599] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:26 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2955 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:27.378641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:27.380208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:27.387563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:27.388379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:27.389200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:27.390193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:27.390861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:27.391500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:27.435574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:27.450035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:27.454829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:27.459603 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e042e72f-e1ec-471e-a90e-1f833189f9e2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1314 microversion: 2.26 time: 0.259506 Oct 03 14:47:27.474208 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1837/3600] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:27 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:27.760037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:27.770910 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1213c7a2-5136-409a-9387-755411097609 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1655 microversion: 2.1 time: 0.395991 Oct 03 14:47:27.774402 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1764/3601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:27 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1655 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:27.799353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95702ec5-1f32-4da2-9997-cc341392f5f5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:27.811164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95702ec5-1f32-4da2-9997-cc341392f5f5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:27.811667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95702ec5-1f32-4da2-9997-cc341392f5f5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:27.812110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95702ec5-1f32-4da2-9997-cc341392f5f5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:27.853870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95702ec5-1f32-4da2-9997-cc341392f5f5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Going to try to start instance {{(pid=128869) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 14:47:27.984472 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95702ec5-1f32-4da2-9997-cc341392f5f5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.189185 Oct 03 14:47:27.985432 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1838/3602] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:27 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:28.025043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:28.028405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:28.054602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:28.056553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:28.057412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:28.062934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:28.063803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:28.065682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:28.411460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:28.412271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:28.422081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:28.422650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:28.423265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:28.424242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:28.424960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:28.425428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:28.653048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:28.662527 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80f93054-80bc-4275-866b-834aab8dc2cb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1664 microversion: 2.1 time: 0.671577 Oct 03 14:47:28.667234 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1765/3603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:27 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1664 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:28.680436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:28.681379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:28.687725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:28.688423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:28.688862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:28.689598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:28.690042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:28.690459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:28.855626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:28.868113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:28.882902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:28.885112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33e29c20-d32c-44f0-9679-66c28c2d79b7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2955 microversion: 2.42 time: 0.484601 Oct 03 14:47:28.885705 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1839/3604] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:28 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2955 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:28.894549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:28.919171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:28.924326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:28.927362 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5cfb4b74-e5b3-4f68-80d3-a1b6a0e773d0 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1320 microversion: 2.26 time: 0.258851 Oct 03 14:47:28.929726 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1766/3605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:28 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:29.689828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:29.690411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:29.711795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:29.712605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:29.713247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:29.714344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:29.714964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:29.715560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:29.914850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:29.916158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:29.942687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:29.949055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:29.949996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:29.951050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:29.951692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:29.952279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:29.999912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:30.490391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:30.503971 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-978a14f7-a266-41e1-a70f-32d5fae88c7d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1664 microversion: 2.1 time: 0.817988 Oct 03 14:47:30.511449 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1840/3606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:29 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1664 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:30.518250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:30.532327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:30.547985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:30.552490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:30.553467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:30.554376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:30.555015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:30.555789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:30.885110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:30.910339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:30.913240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:30.916232 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-69707297-b51d-47f0-9bb9-4003c4f7b66b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2934 microversion: 2.42 time: 1.005332 Oct 03 14:47:30.920491 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1767/3607] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:29 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2934 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:30.991212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:31.001305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:31.009217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:31.010894 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7c966a2-5114-4b2c-8db7-0bb6e0161301 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1320 microversion: 2.26 time: 0.496480 Oct 03 14:47:31.045340 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1841/3608] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:30 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:31.396339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b937c773-5d06-441d-95dc-8cbad6ea37fc req-68925c94-dcc5-4c06-8203-9f0b203872ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-unplugged", "status": "completed", "tag": "5390fedc-da97-4712-a8da-7629aee81daf"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:31.430562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b937c773-5d06-441d-95dc-8cbad6ea37fc req-68925c94-dcc5-4c06-8203-9f0b203872ed service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:31.432250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b937c773-5d06-441d-95dc-8cbad6ea37fc req-68925c94-dcc5-4c06-8203-9f0b203872ed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:31.436072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b937c773-5d06-441d-95dc-8cbad6ea37fc req-68925c94-dcc5-4c06-8203-9f0b203872ed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:31.472877 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b937c773-5d06-441d-95dc-8cbad6ea37fc req-68925c94-dcc5-4c06-8203-9f0b203872ed service nova] Creating event network-vif-unplugged:5390fedc-da97-4712-a8da-7629aee81daf for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:31.479820 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b937c773-5d06-441d-95dc-8cbad6ea37fc req-68925c94-dcc5-4c06-8203-9f0b203872ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088552 Oct 03 14:47:31.481014 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1768/3609] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:31.538086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:31.539009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:31.563245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:31.565578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:31.566225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:31.570903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:31.571818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:31.572440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:31.955041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:31.955848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:31.991191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:31.991823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:31.993430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:32.002222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:32.002222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:32.008665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:32.726633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:32.736251 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b1c9631-3c5d-43f9-96a6-deaa12d44a49 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1664 microversion: 2.1 time: 1.204678 Oct 03 14:47:32.740614 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1842/3610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:31 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1664 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:32.747587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:32.753312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:32.769816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:32.787332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:32.787332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:32.787332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:32.787332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:32.787332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:32.801038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:33.198596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:33.209927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:33.211648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:33.212989 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97033c86-1312-4217-86ae-a8eb801e8339 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.469436 Oct 03 14:47:33.233018 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1843/3611] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:32 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:33.242067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4a0f99f1-0cd8-4669-8e35-cc789d047279 req-f4f800d1-6fe2-4671-b984-f4574ab1d0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-deleted", "tag": "f24df28a-2ac7-4b48-9b16-7e4ad927f924"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:33.260209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:33.276951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:33.288396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4a0f99f1-0cd8-4669-8e35-cc789d047279 req-f4f800d1-6fe2-4671-b984-f4574ab1d0a7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:33.289728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:33.293462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5cfd8359-424d-458f-8596-3bfefcd790c7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2913 microversion: 2.42 time: 1.344307 Oct 03 14:47:33.297987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4a0f99f1-0cd8-4669-8e35-cc789d047279 req-f4f800d1-6fe2-4671-b984-f4574ab1d0a7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:33.298500 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1769/3612] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:31 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2913 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:33.299423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4a0f99f1-0cd8-4669-8e35-cc789d047279 req-f4f800d1-6fe2-4671-b984-f4574ab1d0a7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:33.330075 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4a0f99f1-0cd8-4669-8e35-cc789d047279 req-f4f800d1-6fe2-4671-b984-f4574ab1d0a7 service nova] Creating event network-vif-deleted:f24df28a-2ac7-4b48-9b16-7e4ad927f924 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:33.346097 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4a0f99f1-0cd8-4669-8e35-cc789d047279 req-f4f800d1-6fe2-4671-b984-f4574ab1d0a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111670 Oct 03 14:47:33.347162 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1844/3613] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:33.532502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-unplugged", "status": "completed", "tag": "67029309-c63a-423b-b036-5bd8407234e6"}, {"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-unplugged", "status": "completed", "tag": "6d38d07f-4e09-4390-929a-ce568815329f"}, {"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-unplugged", "status": "completed", "tag": "12ef2c91-4d07-4180-bd5b-de28f42de817"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:33.549797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:33.556092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:33.557426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:33.575692 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] Creating event network-vif-unplugged:67029309-c63a-423b-b036-5bd8407234e6 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:33.587451 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] Creating event network-vif-unplugged:6d38d07f-4e09-4390-929a-ce568815329f for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:33.588263 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] Creating event network-vif-unplugged:12ef2c91-4d07-4180-bd5b-de28f42de817 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:33.602223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f2e78444-445a-4f2c-98ec-4703e259c37b req-078ee6ae-74f1-4ce2-a77e-beb24c0fd365 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.073991 Oct 03 14:47:33.609779 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1770/3614] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:33.764203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:33.764918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:33.774702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:33.784354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:33.785463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:33.786459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:33.787115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:33.788197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:34.259642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:34.260365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:34.285217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:34.286020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:34.286631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:34.291389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:34.291389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:34.291389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:34.345199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:34.355911 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93e61ae8-cdbc-4910-ae41-965170d8d3f4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.595926 Oct 03 14:47:34.371265 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1845/3615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:33 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:34.393479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:34.394113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:34.413159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:34.420022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:34.420672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:34.421786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:34.422423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:34.423036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:34.448161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:34.512992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:34.886223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:34.889992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:34.900522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:34.906685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:34.908985 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5cf3f968-0ad4-4819-befa-aa1e574bd0ae tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2528 microversion: 2.42 time: 0.535470 Oct 03 14:47:34.909581 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1846/3616] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:34 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2528 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:34.919524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:34.921609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:34.922277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:34.925239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:34.939377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:34.939668 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a905484a-39e1-48b5-8008-70be457c744d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.684397 Oct 03 14:47:34.945917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:34.946780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:34.947825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:34.948524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:34.949240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:34.955415 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1771/3617] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:34 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:35.451146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6fa2f919-654f-46dd-bc67-b3b1c5fc4953 req-27b01c93-fb0d-42b7-88b3-2790061935d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-deleted", "tag": "5390fedc-da97-4712-a8da-7629aee81daf"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:35.483673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:35.494186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6fa2f919-654f-46dd-bc67-b3b1c5fc4953 req-27b01c93-fb0d-42b7-88b3-2790061935d8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:35.496633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6fa2f919-654f-46dd-bc67-b3b1c5fc4953 req-27b01c93-fb0d-42b7-88b3-2790061935d8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:35.500052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6fa2f919-654f-46dd-bc67-b3b1c5fc4953 req-27b01c93-fb0d-42b7-88b3-2790061935d8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:35.556152 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6fa2f919-654f-46dd-bc67-b3b1c5fc4953 req-27b01c93-fb0d-42b7-88b3-2790061935d8 service nova] Creating event network-vif-deleted:5390fedc-da97-4712-a8da-7629aee81daf for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:35.578008 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6fa2f919-654f-46dd-bc67-b3b1c5fc4953 req-27b01c93-fb0d-42b7-88b3-2790061935d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135229 Oct 03 14:47:35.580676 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1772/3618] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:35.605156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5ce9750c-8e22-44ed-9ace-75ba21157f2f req-67e9dcb0-8fc2-4b10-8e6c-d641b0cea1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fadfacb7-1ba7-4940-8d16-a4c8174afebd", "tag": "3d2739dc-a0ed-43b5-93f3-55eb157faefc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:35.629786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ce9750c-8e22-44ed-9ace-75ba21157f2f req-67e9dcb0-8fc2-4b10-8e6c-d641b0cea1c3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:35.630834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ce9750c-8e22-44ed-9ace-75ba21157f2f req-67e9dcb0-8fc2-4b10-8e6c-d641b0cea1c3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:35.631257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ce9750c-8e22-44ed-9ace-75ba21157f2f req-67e9dcb0-8fc2-4b10-8e6c-d641b0cea1c3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:35.643572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:35.675414 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5ce9750c-8e22-44ed-9ace-75ba21157f2f req-67e9dcb0-8fc2-4b10-8e6c-d641b0cea1c3 service nova] Creating event network-changed:3d2739dc-a0ed-43b5-93f3-55eb157faefc for instance fadfacb7-1ba7-4940-8d16-a4c8174afebd on n-h1-781139-2 Oct 03 14:47:35.696216 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5ce9750c-8e22-44ed-9ace-75ba21157f2f req-67e9dcb0-8fc2-4b10-8e6c-d641b0cea1c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095304 Oct 03 14:47:35.699790 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1773/3619] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:35.707145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:35.716319 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd15374c-ee5b-437b-b452-056f5d480a1a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.802444 Oct 03 14:47:35.727133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1847/3620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:34 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:35.758034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:35.758781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:35.772227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:35.784032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:35.784864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:35.785904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:35.786608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:35.787309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:35.858825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Unlocking {{(pid=128868) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 03 14:47:35.940093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:35.941039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:35.960102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:35.960552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:35.961242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:35.966996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:35.968718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:35.972222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:36.022692 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b32b3b08-4740-4862-bfed-9246ed560dd9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.269658 Oct 03 14:47:36.027893 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1774/3621] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:35 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:36.040213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:36.041938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:36.063176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:36.065573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:36.068812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:36.070649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:36.071653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:36.073679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:36.686671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:36.702950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:36.704740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:36.708120 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6b8f876-6aee-489e-af63-bf2ac19b6d60 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.675218 Oct 03 14:47:36.708957 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1775/3622] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:36 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:36.731098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:36.731923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:36.746354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:36.747045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:36.750000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:36.750944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:36.751577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:36.755083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:37.198925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:37.236631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:37.241838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:37.244867 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a74081ff-688d-4b9f-8e6a-83113e87ec11 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2369 microversion: 2.42 time: 1.308947 Oct 03 14:47:37.246386 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1848/3623] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:35 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2369 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:37.307718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:37.324460 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0d9cabcb-25ff-4efb-935d-c456867dcb58 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.614228 Oct 03 14:47:37.342822 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1776/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:36 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:37.356816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:37.357736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:37.369273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:37.370022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:37.370644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:37.372515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:37.386159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:37.389589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:37.696323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-fdd11ef7-a251-4dc0-9cd7-38e800a63fe7 req-311fb4a5-6750-430c-914e-926df7c7c13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-deleted", "tag": "6d38d07f-4e09-4390-929a-ce568815329f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:37.718989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fdd11ef7-a251-4dc0-9cd7-38e800a63fe7 req-311fb4a5-6750-430c-914e-926df7c7c13c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:37.719623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fdd11ef7-a251-4dc0-9cd7-38e800a63fe7 req-311fb4a5-6750-430c-914e-926df7c7c13c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:37.720325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fdd11ef7-a251-4dc0-9cd7-38e800a63fe7 req-311fb4a5-6750-430c-914e-926df7c7c13c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:37.766987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:37.780064 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-735d1931-cca0-4ec7-b5c4-30dd53c09a8f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.430371 Oct 03 14:47:37.782750 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-fdd11ef7-a251-4dc0-9cd7-38e800a63fe7 req-311fb4a5-6750-430c-914e-926df7c7c13c service nova] Creating event network-vif-deleted:6d38d07f-4e09-4390-929a-ce568815329f for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:37.783041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1849/3625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:37 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:37.789685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:37.791671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:37.795538 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-fdd11ef7-a251-4dc0-9cd7-38e800a63fe7 req-311fb4a5-6750-430c-914e-926df7c7c13c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103079 Oct 03 14:47:37.800500 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1777/3626] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:37.806941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:37.807696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:37.808791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:37.809985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:37.810831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:37.811572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:37.822496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:37.826938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:37.853595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:37.855854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:37.858146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:37.859830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:37.860540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:37.861313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:38.200605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:38.210893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:38.213178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:38.214607 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38076dda-e092-4407-9169-49a1c6e378ea tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.430312 Oct 03 14:47:38.215188 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1850/3627] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:37 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:38.275327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:38.276821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:38.283483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:38.284169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:38.284910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:38.285814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:38.286431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:38.287034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:38.514620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:38.531934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:38.533811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:38.535288 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3914671e-40f4-49f8-817c-70b4ea726fc4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2323 microversion: 2.42 time: 0.264539 Oct 03 14:47:38.536059 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1851/3628] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:38 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:38.572658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:38.598416 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f63ce57-c98d-4682-9827-fee783fffec8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.795301 Oct 03 14:47:38.599652 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1778/3629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:37 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:38.631491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:38.633545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:38.644379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:38.645443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:38.646704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:38.648034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:38.648728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:38.649738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:38.789553 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81fffad1-5dfb-40c5-aeda-50df546e4dab tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.165407 Oct 03 14:47:38.794326 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1852/3630] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:38 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:38.805996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:38.806785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:38.815672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:38.817081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:38.817641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:38.819153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:38.820511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:38.821812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:39.095601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:39.107114 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec7d99d7-ac6d-4317-9702-bdc04a57a9b5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1673 microversion: 2.1 time: 0.311203 Oct 03 14:47:39.121557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1779/3631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:38 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1673 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:39.241788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:39.243665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:39.279799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:39.280307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:39.280747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:39.281540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:39.282001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:39.282427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:39.563909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:39.564547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:39.589878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:39.591365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:39.592258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:39.593815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:39.594470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:39.595097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:39.768804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:39.785006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:39.788589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:39.793621 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcde647a-15ac-4542-9629-fa0848c5f429 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.557125 Oct 03 14:47:39.796670 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1853/3632] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:39 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:39.894598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8b4a776c-8221-47ba-877a-be6448aa4314 req-7977caa6-96e0-42ac-adb8-22427017bbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-deleted", "tag": "12ef2c91-4d07-4180-bd5b-de28f42de817"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:39.920283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b4a776c-8221-47ba-877a-be6448aa4314 req-7977caa6-96e0-42ac-adb8-22427017bbed service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:39.921567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b4a776c-8221-47ba-877a-be6448aa4314 req-7977caa6-96e0-42ac-adb8-22427017bbed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:39.922264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b4a776c-8221-47ba-877a-be6448aa4314 req-7977caa6-96e0-42ac-adb8-22427017bbed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:39.957149 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8b4a776c-8221-47ba-877a-be6448aa4314 req-7977caa6-96e0-42ac-adb8-22427017bbed service nova] Creating event network-vif-deleted:12ef2c91-4d07-4180-bd5b-de28f42de817 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:39.974706 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8b4a776c-8221-47ba-877a-be6448aa4314 req-7977caa6-96e0-42ac-adb8-22427017bbed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085980 Oct 03 14:47:39.977531 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1854/3633] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:40.133533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:40.135031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:40.149651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.150589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.151255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:40.153786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.154540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.155746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:40.582078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:40.592576 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e5feb36-ff0a-408e-b3d4-91c54013a9a4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1653 microversion: 2.1 time: 0.463669 Oct 03 14:47:40.598908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:40.603466 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1855/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:40 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1653 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:47:40.615060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:40.622270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:40.625920 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3717310-983a-4c47-904b-e843d48584df tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 2210 microversion: 2.42 time: 1.065781 Oct 03 14:47:40.628621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:40.629849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:40.634346 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1780/3635] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:39 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 2210 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:40.639889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.640383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.640825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:40.641562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.642011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.642436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:40.806146 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40c2ee62-d664-4857-89c7-a7aba1e684cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.180730 Oct 03 14:47:40.816983 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1856/3636] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:47:40 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:40.821631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:40.822258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:40.830561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:40.841316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:40.851692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.852756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.853492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:40.855400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.856156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.857963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.858522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:40.861890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.862600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:40.863549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:40.864202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:40.865475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:41.383373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:41.393070 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9c0d5d8-d5fb-4b18-bda3-d4a4ef619c14 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1660 microversion: 2.1 time: 0.566468 Oct 03 14:47:41.406734 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1857/3637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:40 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1660 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:41.479772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:41.495978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:41.497477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:41.498666 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-57411cc3-6eb9-4cbf-b92d-ccb915be0e40 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.681445 Oct 03 14:47:41.512215 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1781/3638] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:40 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:41.665757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:41.666383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:41.684499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:41.690712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:41.691601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:41.692556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:41.695021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:41.700867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:41.907218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:41.919795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:41.946207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:41.946750 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f5ace9a-3021-4e26-823b-3c5115143a2d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.288093 Oct 03 14:47:41.961728 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1858/3639] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:41 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:42.037632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-643c6657-60d7-473c-aebc-95bebe515d52 req-69491c0e-a6f7-4e5f-86f9-cb98075c19a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b74a99b-96bf-496d-87c7-254646d5f52a", "name": "network-vif-deleted", "tag": "67029309-c63a-423b-b036-5bd8407234e6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:42.065702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-643c6657-60d7-473c-aebc-95bebe515d52 req-69491c0e-a6f7-4e5f-86f9-cb98075c19a0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:42.071497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-643c6657-60d7-473c-aebc-95bebe515d52 req-69491c0e-a6f7-4e5f-86f9-cb98075c19a0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:42.072071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-643c6657-60d7-473c-aebc-95bebe515d52 req-69491c0e-a6f7-4e5f-86f9-cb98075c19a0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:42.140569 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-643c6657-60d7-473c-aebc-95bebe515d52 req-69491c0e-a6f7-4e5f-86f9-cb98075c19a0 service nova] Creating event network-vif-deleted:67029309-c63a-423b-b036-5bd8407234e6 for instance 8b74a99b-96bf-496d-87c7-254646d5f52a on n-h1-781139-2 Oct 03 14:47:42.167649 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-643c6657-60d7-473c-aebc-95bebe515d52 req-69491c0e-a6f7-4e5f-86f9-cb98075c19a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133434 Oct 03 14:47:42.173404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1782/3640] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:42.421757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:42.423160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:42.448328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:42.448910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:42.450899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:42.453900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:42.459104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:42.460102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:42.544160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:42.545245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:42.566123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:42.569764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:42.570262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:42.571327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:42.573334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:42.574787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:42.575572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:42.854353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:42.878916 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85294f56-c269-4937-85dc-07fc010a03f8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.457453 Oct 03 14:47:42.880166 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1859/3641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:42 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:42.907576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:42.908218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:42.931995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:42.932434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:42.952588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:42.955751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:42.956258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:42.962858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:43.112525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:43.123943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:43.130857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:43.135467 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58b59ac9-4cdd-40b2-a947-103f6360e1fe tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.596676 Oct 03 14:47:43.139247 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1783/3642] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:42 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:43.150995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:43.152889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:43.168661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:43.169585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:43.170301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:43.173547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:43.174301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:43.178125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:43.681802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:43.691528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:43.703598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:43.705396 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b3a2506-df95-4082-9570-73051b4dc5a9 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.564590 Oct 03 14:47:43.711103 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1784/3643] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:43 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:43.933076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6fb96275-4835-43a1-bea4-fcdaa2277917 req-9e130200-1e73-4a52-90fe-950351ae8f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadfacb7-1ba7-4940-8d16-a4c8174afebd", "name": "network-vif-plugged", "status": "completed", "tag": "3d2739dc-a0ed-43b5-93f3-55eb157faefc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:43.951492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6fb96275-4835-43a1-bea4-fcdaa2277917 req-9e130200-1e73-4a52-90fe-950351ae8f8a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:43.951492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6fb96275-4835-43a1-bea4-fcdaa2277917 req-9e130200-1e73-4a52-90fe-950351ae8f8a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:43.959593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6fb96275-4835-43a1-bea4-fcdaa2277917 req-9e130200-1e73-4a52-90fe-950351ae8f8a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:44.018954 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6fb96275-4835-43a1-bea4-fcdaa2277917 req-9e130200-1e73-4a52-90fe-950351ae8f8a service nova] Creating event network-vif-plugged:3d2739dc-a0ed-43b5-93f3-55eb157faefc for instance fadfacb7-1ba7-4940-8d16-a4c8174afebd on n-h1-781139-2 Oct 03 14:47:44.045890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6fb96275-4835-43a1-bea4-fcdaa2277917 req-9e130200-1e73-4a52-90fe-950351ae8f8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116773 Oct 03 14:47:44.059975 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1785/3644] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:44.172428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:44.173926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:44.193673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:44.204805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:44.206191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:44.207144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:44.207756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:44.208334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:44.292899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:44.736205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:44.746054 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecdd3ac8-f2e2-4bb2-aadf-232d8386c337 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 1.846514 Oct 03 14:47:44.769256 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1860/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:42 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:47:44.795872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce2ecada-fcb4-4790-adc9-5661018c41e5"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:44.803752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:44.838707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:44.847716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:44.847716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:44.847716 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5a4ce97-02d8-4c0c-8a92-7229649b28a9 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.683613 Oct 03 14:47:44.869037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:44.869535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:44.869980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:44.870681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:44.871135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:44.871561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:44.876578 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1786/3646] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:44 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:44.884970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:44.885558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:44.906438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:44.906924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:44.908427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:44.909336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:44.909655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:44.910073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:45.127821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:45.142240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:45.146741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:45.150415 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2dd2828a-728d-4198-aa3f-d26d0040cf5b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.269694 Oct 03 14:47:45.151243 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1787/3647] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:44 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:45.163398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:45.164090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:45.183836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:45.184413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:45.184853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:45.199811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:45.200400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:45.200884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:45.486441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:45.499790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-762e6d99-197b-4798-b66d-4de21e60128f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.344602 Oct 03 14:47:45.500702 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1788/3648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:45 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:45.528842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:45.529941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:45.568568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:45.577557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:45.586332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:45.587222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:45.587711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:45.588147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:45.872048 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a28b035-05c1-44eb-b6ef-4fa932b4c2db tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "POST /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.089764 Oct 03 14:47:45.873707 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1861/3649] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:47:44 2022] POST /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments => generated 194 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:45.887327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:45.891984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:45.918147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:45.919437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:45.920499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:45.925474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:45.926028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:45.926798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:46.188871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.203277 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29514d00-fca2-486e-a6ac-da24ecc62d92 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.682389 Oct 03 14:47:46.203874 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1789/3650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:45 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:47:46.215763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:46.216376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:46.258947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:46.261298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:46.266614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:46.272727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:46.274620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:46.275442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:46.458663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.495777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.499927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.507000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.513228 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1265111a-2439-4cca-9dc8-e7b296b32cf1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.307412 Oct 03 14:47:46.516994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.520315 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1790/3651] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:46 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:46.523147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.525640 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4823923a-e69f-42d2-ba0d-b544a95f40c1 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1362 microversion: 2.26 time: 0.649696 Oct 03 14:47:46.530591 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1862/3652] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:45 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1362 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:46.556599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:46.558139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:46.585462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:46.588535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:46.590235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:46.591753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:46.593620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:46.595617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:46.877569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:46.893274 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4e8c2bd8-c72f-4695-8290-99b74b72749b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.371572 Oct 03 14:47:46.894307 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1791/3653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:46 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:46.930774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:46.931866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:46.938453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:46.939281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:46.939948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:46.941014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:46.941694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:46.942323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:47.105271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-255bc16e-9e75-413d-80d5-13a6649cf89a tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Action: 'create', calling method: .version_select at 0x7fb22bf3e820>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:47.166526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:47.177506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd27dd57-6777-4bbc-bb78-22b0600243ca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.260293 Oct 03 14:47:47.178114 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1792/3654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:47:46 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:47.547773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:47.548426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:47.569779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:47.571308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:47.572138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:47.573107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:47.574237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:47.575846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:47.763478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:47.774158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:47.775681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:47.790439 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-330ef69f-6c78-43ba-b4de-bbbcc7fef89a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.246431 Oct 03 14:47:47.791057 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1793/3655] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:47 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:47.803228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:47.803228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:47.818922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:47.818922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:47.818922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:47.818922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:47.818922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:47.819312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.157470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:48.213759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:48.215623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:48.218446 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9b01f80-4933-4e60-a469-e5273648f2ae tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1547 microversion: 2.26 time: 0.426353 Oct 03 14:47:48.219872 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1794/3656] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:47 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1547 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:48.246433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb2304a9a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:48.265584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.266177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.267169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.267169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:48.286860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.287598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.289599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.291935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.292576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.294686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.369813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.370569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.371179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.409587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.412416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.413215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.459629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:48.499703 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a569c473-2fa3-43a3-bc96-55243392edef tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-909188935" status: 201 len: 0 microversion: 2.26 time: 0.258183 Oct 03 14:47:48.507116 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1795/3657] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Oct 3 14:47:48 2022] PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-909188935 => generated 0 bytes in 266 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 03 14:47:48.521731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a948487-3ec4-4760-b667-f19013b5f636 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb230197b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:48.535449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a948487-3ec4-4760-b667-f19013b5f636 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.537583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a948487-3ec4-4760-b667-f19013b5f636 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.539266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a948487-3ec4-4760-b667-f19013b5f636 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.572668 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a948487-3ec4-4760-b667-f19013b5f636 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-909188935" status: 204 len: 0 microversion: 2.26 time: 0.054821 Oct 03 14:47:48.574106 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1796/3658] 10.222.0.20 () {60 vars in 1358 bytes} [Mon Oct 3 14:47:48 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-909188935 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:48.582747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb230197790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:48.602669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.608700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.609512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.610168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:48.625046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.625835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.626445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.627349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.629331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.631996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.680504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.682227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.684485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.721116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:48.751158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1dec7e20-5018-416f-9820-a688a86dfdec tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 204 len: 0 microversion: 2.26 time: 0.172409 Oct 03 14:47:48.753088 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1797/3659] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 3 14:47:48 2022] DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:48.766967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-97458205-245f-42b3-8517-8dd38462e420 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb2304a9700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:48.780617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97458205-245f-42b3-8517-8dd38462e420 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.781424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97458205-245f-42b3-8517-8dd38462e420 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.782024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97458205-245f-42b3-8517-8dd38462e420 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.798978 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-97458205-245f-42b3-8517-8dd38462e420 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 200 len: 12 microversion: 2.26 time: 0.039563 Oct 03 14:47:48.800750 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1798/3660] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:47:48 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:48.818481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb230160ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:48.831346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.832316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.832991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.833792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:48.842993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.844465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.845108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.846047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.847043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.849294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.919724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.920997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.923044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:48.948761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:48.954370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:48.955089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.019151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:49.029895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:49.057263 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33ec5d9d-d3de-4572-bace-bc2079080240 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1349253529" status: 201 len: 0 microversion: 2.26 time: 0.250308 Oct 03 14:47:49.060089 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1799/3661] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 3 14:47:48 2022] PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1349253529 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 03 14:47:49.073257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:49.076764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:49.093929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.094764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.095459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.098508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.100007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.100648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.318268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:49.330343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:49.353589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:49.355142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2b1548a-904a-4170-8ddc-f213c1b9dec1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.293419 Oct 03 14:47:49.373768 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1800/3662] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:49 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:49.380741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d49f9803-606e-48a9-a95c-8ce1c18d2ebc tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb230160790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:49.405426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49f9803-606e-48a9-a95c-8ce1c18d2ebc tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.405426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49f9803-606e-48a9-a95c-8ce1c18d2ebc tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.405851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49f9803-606e-48a9-a95c-8ce1c18d2ebc tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.427574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d49f9803-606e-48a9-a95c-8ce1c18d2ebc tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 200 len: 36 microversion: 2.26 time: 0.050588 Oct 03 14:47:49.427574 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1801/3663] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:47:49 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 36 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:49.439897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb2304a9dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:49.448887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.449569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.450290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.450779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:49.457617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.457812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.458131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.459107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.459685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.462841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.514950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.517702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.519752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.570676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:49.619764 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04fc74c3-0cea-440f-a450-3864dabf0e10 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1349253529" status: 204 len: 0 microversion: 2.26 time: 0.185289 Oct 03 14:47:49.621514 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1802/3664] 10.222.0.20 () {60 vars in 1364 bytes} [Mon Oct 3 14:47:49 2022] DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1349253529 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 14:47:49.635924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb4eea36-2cb1-4863-9e0e-714667753742 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb23031bee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:49.656105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb4eea36-2cb1-4863-9e0e-714667753742 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.656904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb4eea36-2cb1-4863-9e0e-714667753742 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.659523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb4eea36-2cb1-4863-9e0e-714667753742 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.687024 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb4eea36-2cb1-4863-9e0e-714667753742 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 200 len: 12 microversion: 2.26 time: 0.055091 Oct 03 14:47:49.688886 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1803/3665] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:47:49 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:49.704013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb230131e50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:49.724217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.725081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.726517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.729763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:49.745129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.751831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.753713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.762576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.763084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.767353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.843232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:49.843737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:49.844183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:49.881474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:49.933103 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b79bed6a-2e56-47e2-904a-7668ef3c16af tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 204 len: 0 microversion: 2.26 time: 0.237895 Oct 03 14:47:49.946150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1804/3666] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 3 14:47:49 2022] DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:49.953460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb2302761f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:50.007282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.008359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.009665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.011659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:50.028174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.037679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.038283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.041468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.042556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.046267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.105701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.108840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.111422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.161919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.167847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.172511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.230284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:50.264341 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aee468cf-f32c-4512-8068-7cc6ac37453e tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1138867439" status: 201 len: 0 microversion: 2.26 time: 0.315525 Oct 03 14:47:50.265569 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1805/3667] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 3 14:47:49 2022] PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1138867439 => generated 0 bytes in 317 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 03 14:47:50.277107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb230160e50>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:50.295269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.295952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.296485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.297114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:50.303919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.305010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.305578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.306401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.307050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.307572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.341940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.342581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.343419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.354436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.355153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.356586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.396546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:50.415881 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b3547d1-2bee-4986-b6b0-ed1018d47232 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-2009758225" status: 201 len: 0 microversion: 2.26 time: 0.144724 Oct 03 14:47:50.418940 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1806/3668] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 3 14:47:50 2022] PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-2009758225 => generated 0 bytes in 148 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 03 14:47:50.425177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:50.426030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:50.433314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.437211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.437882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.439171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.439711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.440291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.552447 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-255bc16e-9e75-413d-80d5-13a6649cf89a tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.696458 Oct 03 14:47:50.561072 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1863/3669] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:47:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:50.561072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb22be67af0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:50.571501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.571992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.572432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.572919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:50.594822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.595253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.595704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.596447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.598222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.598685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.652214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.652694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.653469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.698960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:50.774061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:50.792069 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b7c1a12-f1b4-447b-9992-5746f567500c tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 204 len: 0 microversion: 2.26 time: 0.237602 Oct 03 14:47:50.793633 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1864/3670] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 3 14:47:50 2022] DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:50.799543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:50.806097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8814147d-a0b6-4cf7-a3da-76908c7a9a77 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Calling method '.version_select at 0x7fb22be1fdc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:50.812955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:50.816069 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bdb0f03e-51a4-48bd-884c-7a51c9679d69 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.395936 Oct 03 14:47:50.816867 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1807/3671] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:50 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:50.826345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-19c04da0-8a45-408b-920f-5466e6429025 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb230131550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:50.855031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c04da0-8a45-408b-920f-5466e6429025 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.872645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c04da0-8a45-408b-920f-5466e6429025 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.872645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-19c04da0-8a45-408b-920f-5466e6429025 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.920188 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-19c04da0-8a45-408b-920f-5466e6429025 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 200 len: 12 microversion: 2.26 time: 0.097721 Oct 03 14:47:50.921198 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1808/3672] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:47:50 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 12 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:50.938413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb2301ecaf0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:50.947552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.948039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.948476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.948981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:50.955887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.956372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.956824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:50.963475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:50.963734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:50.964182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.026223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.026714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.027153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.056173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:51.082937 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9f0e567a-c1da-4d32-aaad-e9e47d8ea752 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 204 len: 0 microversion: 2.26 time: 0.152375 Oct 03 14:47:51.086799 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1809/3673] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 3 14:47:50 2022] DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:51.096528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb2301ec550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:51.120647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.121176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.121615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.122101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:51.144871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.145276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.145701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.161569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.169271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.169725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.228505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.229207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.229654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.260859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.261697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.262293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.301924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:51.329949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:51.365452 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82635510-938c-4d61-9325-1f516c234ca2 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1767609695" status: 201 len: 0 microversion: 2.26 time: 0.273157 Oct 03 14:47:51.366133 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1810/3674] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 3 14:47:51 2022] PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-1767609695 => generated 0 bytes in 275 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 03 14:47:51.390132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb23031b4c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:51.401104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.401469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.402096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.402592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:51.410304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.410792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.411226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.412086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.412546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.412993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.485729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.486487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.487089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.497687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.498423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.499016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.543051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8814147d-a0b6-4cf7-a3da-76908c7a9a77 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/fbd6f871-14c9-4639-82d0-2de7eaa36c04" status: 200 len: 142 microversion: 2.1 time: 0.741525 Oct 03 14:47:51.551967 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1865/3675] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:47:50 2022] GET /compute/v2.1/os-floating-ips/fbd6f871-14c9-4639-82d0-2de7eaa36c04 => generated 142 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:51.557898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ef9d338-e39c-4d33-b52f-a61f2e686bfb tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Calling method '.version_select at 0x7fb22be3c3a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:51.580117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:51.616588 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df714a7d-7e89-4265-baeb-205ba94c0c15 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-203379819" status: 201 len: 0 microversion: 2.26 time: 0.233752 Oct 03 14:47:51.618593 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1811/3676] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Oct 3 14:47:51 2022] PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags/tempest-tag-203379819 => generated 0 bytes in 236 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 03 14:47:51.630050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Action: 'update_all', calling method: .version_select at 0x7fb234aacee0>, body: {"tags": ["tempest-tag-1216296830", "tempest-tag-1725971781"]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:51.649827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:51.658837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.660760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.664583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.665364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:51.681719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.683605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.686281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.687218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.688427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.691055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.762506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.773289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.774069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.846571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:51.899007 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-73a05202-1947-4fdc-8f71-298c406ee073 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 200 len: 62 microversion: 2.26 time: 0.274947 Oct 03 14:47:51.900287 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1812/3677] 10.222.0.20 () {62 vars in 1312 bytes} [Mon Oct 3 14:47:51 2022] PUT /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 62 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:51.909499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:51.910392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:51.917218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.918307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.919621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:51.920603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:51.921399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:51.922515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.088389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:52.104002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:52.113438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:52.114705 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-008256ac-26a2-42cc-9194-f9e5cb0054f7 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.212813 Oct 03 14:47:52.143269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1813/3678] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:51 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:52.162933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aaeb9ab9-9132-47cf-b07c-811d22b9cb79 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb2300e61f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:52.185341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aaeb9ab9-9132-47cf-b07c-811d22b9cb79 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.185839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aaeb9ab9-9132-47cf-b07c-811d22b9cb79 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.186274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aaeb9ab9-9132-47cf-b07c-811d22b9cb79 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.222813 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aaeb9ab9-9132-47cf-b07c-811d22b9cb79 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 200 len: 62 microversion: 2.26 time: 0.077883 Oct 03 14:47:52.233166 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1814/3679] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 3 14:47:52 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 62 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:47:52.247984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '.version_select at 0x7fb23031bee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:52.269890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.271899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.272451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.276909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:52.290715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.292090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.293426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.294877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.297177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.299721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.359985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.364231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.364910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.395024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'flavor' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:52.426472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80cc8e67-810f-4143-a110-8d037242855d tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags" status: 204 len: 0 microversion: 2.26 time: 0.191561 Oct 03 14:47:52.427416 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1815/3680] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 3 14:47:52 2022] DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd/tags => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:52.444143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:52.444655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:52.466834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.467379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.467829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.468567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.469053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.469483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.523059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:47:52.733346 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5be8cbbc-bbab-4137-9cd0-06db445f1ce6 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 204 len: 0 microversion: 2.26 time: 0.299093 Oct 03 14:47:52.734259 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1816/3681] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:47:52 2022] DELETE /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:47:52.742764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:52.743481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:52.751384 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ef9d338-e39c-4d33-b52f-a61f2e686bfb tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.197375 Oct 03 14:47:52.752271 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1866/3682] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:47:51 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:52.762904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.763514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.763963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.764695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:52.765178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:52.765609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:52.769681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3eae52b0-2b7f-4e15-a619-21c60968d401 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Calling method '.version_select at 0x7fb22be67e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:53.372353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:53.386568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:53.388245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:53.389731 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc65b31a-7720-4a46-bec5-50cc5908e086 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1553 microversion: 2.26 time: 0.651428 Oct 03 14:47:53.391075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1817/3683] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:52 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1553 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:53.396061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:53.396877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:53.403438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:53.404251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:53.404914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:53.405912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:53.406766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:53.407358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:53.534937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:53.555585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:53.559523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:53.565380 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a21ba4f5-b53a-4562-912c-72ed5d145775 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.168605 Oct 03 14:47:53.582488 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1818/3684] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:53 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:53.976597 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3eae52b0-2b7f-4e15-a619-21c60968d401 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/fbd6f871-14c9-4639-82d0-2de7eaa36c04" status: 202 len: 0 microversion: 2.1 time: 1.214487 Oct 03 14:47:53.978167 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1867/3685] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:47:52 2022] DELETE /compute/v2.1/os-floating-ips/fbd6f871-14c9-4639-82d0-2de7eaa36c04 => generated 0 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:47:53.989314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd8f956f-3fd8-4243-b5a6-640ad810706d tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Action: 'create', calling method: .version_select at 0x7fb2300fd310>, body: {"pool": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:54.421329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:54.422026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:54.432069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:54.437679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:54.438823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:54.439564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:54.440522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:54.441293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:54.442450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:54.727758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:54.745425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:54.747061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:54.749399 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22ca61a6-babc-46fd-bb87-d0f2230c1c84 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1553 microversion: 2.26 time: 0.333035 Oct 03 14:47:54.750941 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1868/3686] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:54 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:54.756374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:54.756999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:54.783137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:54.783625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:54.784058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:54.784763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:54.785357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:54.785705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:54.901801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:54.915949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:54.917811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:54.923597 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e189e9f-123b-4730-917e-f49c1395ca32 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.171304 Oct 03 14:47:54.924720 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1869/3687] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:54 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:55.452066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-afbaeac5-bfb6-412d-90b4-f42f047c1511 req-28f118e2-8961-4a25-936c-bf79f1dc2ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadfacb7-1ba7-4940-8d16-a4c8174afebd", "name": "network-vif-deleted", "tag": "3d2739dc-a0ed-43b5-93f3-55eb157faefc"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:47:55.487346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-afbaeac5-bfb6-412d-90b4-f42f047c1511 req-28f118e2-8961-4a25-936c-bf79f1dc2ad0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:55.489749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-afbaeac5-bfb6-412d-90b4-f42f047c1511 req-28f118e2-8961-4a25-936c-bf79f1dc2ad0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:55.495642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-afbaeac5-bfb6-412d-90b4-f42f047c1511 req-28f118e2-8961-4a25-936c-bf79f1dc2ad0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:55.525760 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-afbaeac5-bfb6-412d-90b4-f42f047c1511 req-28f118e2-8961-4a25-936c-bf79f1dc2ad0 service nova] Creating event network-vif-deleted:3d2739dc-a0ed-43b5-93f3-55eb157faefc for instance fadfacb7-1ba7-4940-8d16-a4c8174afebd on n-h1-781139-2 Oct 03 14:47:55.531281 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-afbaeac5-bfb6-412d-90b4-f42f047c1511 req-28f118e2-8961-4a25-936c-bf79f1dc2ad0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084505 Oct 03 14:47:55.532532 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1870/3688] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:47:55.777783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:55.779660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:55.787599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:55.788522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:55.789216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:55.790176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:55.790841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:55.791472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:55.841337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:55.842036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:55.842810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:55.844225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lazy-loading 'fault' on Instance uuid fadfacb7-1ba7-4940-8d16-a4c8174afebd {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:47:55.907278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:55.918389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:55.920501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e444169c7084eb8acb5e1f79af8566c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de61ad14d5544ded9d0694097d237219', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:55.922744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca705b30-48d1-4f22-a84d-c9e11c828d8f tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 200 len: 1352 microversion: 2.26 time: 0.148470 Oct 03 14:47:55.923919 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1871/3689] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:55 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 1352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:55.953278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:55.954229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:55.966228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:55.967062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:55.967736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:55.968828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:55.969507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:55.970097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:56.059007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:56.069446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:56.071566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:56.073730 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1093dbb7-2182-4b99-a53c-dafdbf0021fe tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.125502 Oct 03 14:47:56.076992 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1872/3690] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:55 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:47:56.427252 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd8f956f-3fd8-4243-b5a6-640ad810706d tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.443674 Oct 03 14:47:56.428065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1819/3691] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:47:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:47:56.440907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ce75627-9f58-47cd-ad64-ec7d1b1b8ab8 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Calling method '.version_select at 0x7fb22bda3a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:56.948840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:56.949618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] [instance: fadfacb7-1ba7-4940-8d16-a4c8174afebd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:56.958041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:56.958557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:56.959200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:56.960089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:56.960780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:56.961573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:56.988849 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] HTTP exception thrown: Instance fadfacb7-1ba7-4940-8d16-a4c8174afebd could not be found. Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Request method failure captured: Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd HTTP/1.1 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvX5HkT33jbJ6tD5poWkh56kCTkoSMYhWfXxE3qEKH7B1lbGBGZUmDeYnUgrC82uxHPWTqjUR1rC0TD0wlLG1jL75NgnLcz3cqqprIlHcglOz9WxMrmcc1ldJPkzbUzP37FmH16QeSx4-U4z1P3Kz7IJNXhm7waP_KfkEOWOXuRLaOU Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.26 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: de61ad14d5544ded9d0694097d237219 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerTagsTestJSON-1222254958 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de61ad14d5544ded9d0694097d237219"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de61ad14d5544ded9d0694097d237219", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de61ad14d5544ded9d0694097d237219"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de61ad14d5544ded9d0694097d237219"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerTagsTestJSON-1222254958 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: de61ad14d5544ded9d0694097d237219 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerTagsTestJSON-1222254958 Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerTagsTestJSON-1222254958-project Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 4e444169c7084eb8acb5e1f79af8566c Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerTagsTestJSON-1222254958-project Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance fadfacb7-1ba7-4940-8d16-a4c8174afebd could not be found. Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'fadfacb7-1ba7-4940-8d16-a4c8174afebd'} Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fadfacb7-1ba7-4940-8d16-a4c8174afebd could not be found. Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fadfacb7-1ba7-4940-8d16-a4c8174afebd could not be found. Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:56.993967 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.001553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:57.001553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:57.001553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:57.001553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:57.001553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:57.001553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fadfacb7-1ba7-4940-8d16-a4c8174afebd could not be found. Oct 03 14:47:57.001553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.006766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] Returning 404 to user: Instance fadfacb7-1ba7-4940-8d16-a4c8174afebd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:57.008058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14946f82-244a-4be5-820c-420dd45828a4 tempest-ServerTagsTestJSON-1222254958 tempest-ServerTagsTestJSON-1222254958-project] 10.222.0.20 "GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd" status: 404 len: 111 microversion: 2.26 time: 0.063289 Oct 03 14:47:57.008913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1820/3692] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:56 2022] GET /compute/v2.1/servers/fadfacb7-1ba7-4940-8d16-a4c8174afebd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:47:57.099623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:57.100737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:57.113357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:57.115053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:57.115800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:57.122175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:57.123009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:57.126040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:57.275575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:57.293688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:57.295558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:57.301703 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d0b90bed-b9d8-4e72-a43f-70fc0ba33a15 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.205263 Oct 03 14:47:57.302665 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1821/3693] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:57 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:57.474297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ce75627-9f58-47cd-ad64-ec7d1b1b8ab8 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82" status: 202 len: 0 microversion: 2.1 time: 1.037302 Oct 03 14:47:57.479358 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1873/3694] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:47:56 2022] DELETE /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:47:57.484643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70385c6b-2ded-4a39-897c-4598d3b21011 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Calling method '.version_select at 0x7fb230148ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:57.833811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG neutronclient.v2_0.client [None req-70385c6b-2ded-4a39-897c-4598d3b21011 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a72df2df-319c-4f48-89e1-dfd7ba506d82 could not be found", "detail": ""}} {{(pid=128868) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:47:57.834785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-70385c6b-2ded-4a39-897c-4598d3b21011 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] HTTP exception thrown: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70385c6b-2ded-4a39-897c-4598d3b21011 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Request method failure captured: Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82 HTTP/1.1 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvYSxtOJnrQNF-gvoljiOtlhYJSFisjqy3FWqYwTileV0PJRt8xykadSppH_kT4ejGGX6T41fCx-EmCL6s49NHdiwG0QRagVUnwVBAn6ndWCQ_g5MZpYqoJHxX4Bi6uHcgLswgWtUofmVSe1d3RI17mK_4uedhcWK2_LdD2Htqjajh8 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: d9b3a8405f774d5192a70d892adad7c0 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-FloatingIPsTestJSON-660543675 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9b3a8405f774d5192a70d892adad7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9b3a8405f774d5192a70d892adad7c0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9b3a8405f774d5192a70d892adad7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9b3a8405f774d5192a70d892adad7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-FloatingIPsTestJSON-660543675 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: d9b3a8405f774d5192a70d892adad7c0 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-FloatingIPsTestJSON-660543675 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-FloatingIPsTestJSON-660543675-project Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49262965fbd54d598e2be58e9bd9fbc1 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-FloatingIPsTestJSON-660543675-project Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: exception: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'a72df2df-319c-4f48-89e1-dfd7ba506d82'} Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a72df2df-319c-4f48-89e1-dfd7ba506d82 could not be found Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fefddc6c-b8db-4cfd-9249-c9bc4fa99ea6'] Oct 03 14:47:57.837067 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82. Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:57.843343 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:47:57.849042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70385c6b-2ded-4a39-897c-4598d3b21011 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Returning 404 to user: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:57.850680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70385c6b-2ded-4a39-897c-4598d3b21011 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82" status: 404 len: 111 microversion: 2.1 time: 0.369939 Oct 03 14:47:57.851523 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1822/3695] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:47:57 2022] GET /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82 => generated 111 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:47:57.861571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72efe05a-c80b-40e0-8d82-d913246e9503 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Calling method '.version_select at 0x7fb22bdd1550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:58.034935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-72efe05a-c80b-40e0-8d82-d913246e9503 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a72df2df-319c-4f48-89e1-dfd7ba506d82 could not be found", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:47:58.035887 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-72efe05a-c80b-40e0-8d82-d913246e9503 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] HTTP exception thrown: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72efe05a-c80b-40e0-8d82-d913246e9503 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Request method failure captured: Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82 HTTP/1.1 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvYSxtOJnrQNF-gvoljiOtlhYJSFisjqy3FWqYwTileV0PJRt8xykadSppH_kT4ejGGX6T41fCx-EmCL6s49NHdiwG0QRagVUnwVBAn6ndWCQ_g5MZpYqoJHxX4Bi6uHcgLswgWtUofmVSe1d3RI17mK_4uedhcWK2_LdD2Htqjajh8 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: d9b3a8405f774d5192a70d892adad7c0 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsTestJSON-660543675 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d9b3a8405f774d5192a70d892adad7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d9b3a8405f774d5192a70d892adad7c0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9b3a8405f774d5192a70d892adad7c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d9b3a8405f774d5192a70d892adad7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsTestJSON-660543675 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: d9b3a8405f774d5192a70d892adad7c0 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsTestJSON-660543675 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsTestJSON-660543675-project Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49262965fbd54d598e2be58e9bd9fbc1 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsTestJSON-660543675-project Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: exception: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a72df2df-319c-4f48-89e1-dfd7ba506d82'} Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a72df2df-319c-4f48-89e1-dfd7ba506d82 could not be found Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0592ea88-30f2-4ffb-b402-03088910d3bb'] Oct 03 14:47:58.039993 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82. Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 Oct 03 14:47:58.044279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:47:58.048638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72efe05a-c80b-40e0-8d82-d913246e9503 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] Returning 404 to user: Floating IP not found for ID a72df2df-319c-4f48-89e1-dfd7ba506d82 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:47:58.049971 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72efe05a-c80b-40e0-8d82-d913246e9503 tempest-FloatingIPsTestJSON-660543675 tempest-FloatingIPsTestJSON-660543675-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82" status: 404 len: 111 microversion: 2.1 time: 0.193452 Oct 03 14:47:58.051133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1874/3696] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:47:57 2022] DELETE /compute/v2.1/os-floating-ips/a72df2df-319c-4f48-89e1-dfd7ba506d82 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:47:58.328099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:58.329201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:58.336459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:58.341839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:58.342698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:58.343660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:58.347435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:58.348187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:58.409696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Calling method '.version_select at 0x7fb2300fdee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:58.414150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:58.414920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:58.415582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:58.452527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:58.453927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:58.458448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:58.478356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:58.489615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:58.494437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:58.495054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:58.495881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:58.503016 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f23d3438-4f11-4a3a-9827-8ad017fd509d tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242 tempest-PortsAdminExtendedAttrsIpV6TestJSON-465935242-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.307563 Oct 03 14:47:58.504349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:58.504908 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1823/3697] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:47:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:47:58.521636 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e44a17fd-9459-4e79-bb5e-3a78009aa26a tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.197416 Oct 03 14:47:58.524757 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1875/3698] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:58 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:47:59.549042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:47:59.549659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:47:59.560338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:59.560834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:59.564506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:59.565321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:47:59.565790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:47:59.566218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:47:59.719109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:59.732434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:59.733947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:47:59.744070 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2b974ac7-15b8-425b-8744-3c01949f0734 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.198866 Oct 03 14:47:59.757671 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1824/3699] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:47:59 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:00.773357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:00.775116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:00.784970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:00.785979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:00.786629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:00.787754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:00.788520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:00.789539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:00.960013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:00.980552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:00.985357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:00.990899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf4557b6-0512-4b94-a964-13538ecf46f3 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.222304 Oct 03 14:48:00.992741 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1876/3700] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:00 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:02.022564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:02.023191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:02.041653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:02.042298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:02.042739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:02.055159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:02.055665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:02.060980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:02.144532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:02.368701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:02.386003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:02.387449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:02.393327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-019e7f11-7a3f-4f35-b68f-e7d313def393 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.375645 Oct 03 14:48:02.394460 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1825/3701] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:02 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:03.424369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:03.425023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:03.442819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:03.443426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:03.443884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:03.444688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:03.450359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:03.450927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:03.576235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:03.587300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:03.600785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:03.602648 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce2c0faa-3632-43df-82fc-33b5b691a815 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.182229 Oct 03 14:48:03.608521 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1877/3702] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:03 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:04.638721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:04.639255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:04.658022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:04.660894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:04.664269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:04.665703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:04.668374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:04.670017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:04.778595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:04.815321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:04.817640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:04.824360 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-781adcb1-14ef-4bc1-9d70-7f767d4fe928 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.193083 Oct 03 14:48:04.830453 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1826/3703] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:04 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:05.081376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1196929472", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "86d791b1-de10-48ba-85b0-478d81f2c211"}], "security_groups": [{"name": "tempest-securitygroup--1629400234"}], "key_name": "tempest-keypair-1294057936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7fbd7412-e60a-4401-8051-609c27912203", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:05.333086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] validate_networks() for [('86d791b1-de10-48ba-85b0-478d81f2c211', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:48:05.862138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:05.863164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:05.879605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:05.883501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:05.884298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:05.885187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:05.887926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:05.888518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:06.053944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:06.068207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:06.074524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:06.078726 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c902114e-2fb2-4592-8417-bbe5fe1521c1 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.220815 Oct 03 14:48:06.093876 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1827/3704] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:05 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:06.686003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Getting quotas for project a870f5d2905749f1af61487e3bcffbd1. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:48:06.720736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Getting quotas for user bd57ce0236d346b3821d0df4f618ae8d and project a870f5d2905749f1af61487e3bcffbd1. Resources: dict_keys(['metadata_items']) {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:48:06.763328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:48:06.764964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:48:06.766424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:48:06.766841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:48:06.768224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:48:06.796882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:06.798553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:06.799024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:06.803702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:06.805156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:06.806498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:06.868630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Getting quotas for project a870f5d2905749f1af61487e3bcffbd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:48:06.881668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Getting quotas for user bd57ce0236d346b3821d0df4f618ae8d and project a870f5d2905749f1af61487e3bcffbd1. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:48:06.958738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:48:06.962025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fbd7412-e60a-4401-8051-609c27912203',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:48:07.109564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:07.112469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:07.122888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:07.123818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:07.124563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:07.125587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:07.146662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:07.150891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:07.318127 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4f3365f-e602-4dba-bbe6-bb32b3099ebe tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.244493 Oct 03 14:48:07.319403 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1878/3705] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:48:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:48:07.348164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7af7aac6-a89c-4a45-ada1-4e03ceb69b29 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:07.348825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7af7aac6-a89c-4a45-ada1-4e03ceb69b29 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:07.406301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:07.425283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:07.429152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:07.430426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7602fbde-cf91-4358-af81-528ce4ea110d tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.327863 Oct 03 14:48:07.437179 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1828/3706] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:07 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:07.548685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7af7aac6-a89c-4a45-ada1-4e03ceb69b29 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:07.561438 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7af7aac6-a89c-4a45-ada1-4e03ceb69b29 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1122 microversion: 2.1 time: 0.232603 Oct 03 14:48:07.566339 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1879/3707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:07 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1122 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:08.466290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:08.467096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:08.484621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:08.485878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:08.488715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:08.490197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:08.507546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:08.509665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:08.595137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77086039-bd90-44cb-bf67-c21654cb9966 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:08.595820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77086039-bd90-44cb-bf67-c21654cb9966 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:08.809177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77086039-bd90-44cb-bf67-c21654cb9966 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:08.816277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:08.831210 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77086039-bd90-44cb-bf67-c21654cb9966 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1122 microversion: 2.1 time: 0.233167 Oct 03 14:48:08.831787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:08.832020 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1880/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:08 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1122 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:48:08.849886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:08.851373 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-583c7541-1c02-4f60-ba0c-6a4b2cab296b tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.391353 Oct 03 14:48:08.851962 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1829/3709] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:08 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:09.862263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:09.862895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:09.882768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:09.883560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:09.884562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:09.885669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:09.887232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:09.887850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:09.892549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:09.893370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:09.915348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:09.918237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:09.921191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:09.922660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:09.929644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:09.935204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:10.255125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:10.273706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:10.275883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:10.279659 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3200a656-025d-4ca4-a471-cfe67c5fa635 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.391521 Oct 03 14:48:10.283661 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1830/3710] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:09 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:48:10.349474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:10.374612 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b81ea0c-22b2-4b24-a3e2-20db8288dc1f tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1220 microversion: 2.1 time: 0.515405 Oct 03 14:48:10.384458 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1881/3711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:09 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1220 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:11.312779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:11.313596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:11.326850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:11.333180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:11.334004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:11.339509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:11.343389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:11.343891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:11.411950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:11.423107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:11.440559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:11.441141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:11.441528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:11.442283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:11.442744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:11.450713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:11.638790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:11.663540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:11.665175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:11.666680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-efb965d7-b1ed-482f-bf8e-39ff0cfc9af4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.359383 Oct 03 14:48:11.667458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1831/3712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:11 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:11.868945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:11.873170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:11.882297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6cb6beb7-6fa5-4d00-b315-db9ce3b8b7f7 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1238 microversion: 2.1 time: 0.474177 Oct 03 14:48:11.887308 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1882/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:11 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1238 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:12.704048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:12.704846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:12.721352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:12.723854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:12.724566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:12.727399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:12.728138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:12.729700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:12.926407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:12.933750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:12.949510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:12.950449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:12.951058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:12.952124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:12.954916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:12.956074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:12.973730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:13.011587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:13.015050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '645649c7b4ad474c8aa0ffa7677e121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33c2d9960274f1dad48de24a88484dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:13.021207 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92d2e89e-5214-42ee-a77d-fd7fd494920f tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 200 len: 1604 microversion: 2.42 time: 0.325339 Oct 03 14:48:13.026521 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1832/3714] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:12 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 1604 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:13.152995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:13.155278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:13.171251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:13.171741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:13.172177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:13.172881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:13.173354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:13.178519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:13.278955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd6be1e0-861b-47b3-9cc8-c4b39f7485bd tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129782 Oct 03 14:48:13.283753 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1833/3715] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:48:13 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:13.295769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:13.296544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:13.301014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:13.310368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:13.314954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:13.315834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:13.317485 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d363b01-e32f-4eef-9017-33e2e1126da8 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1238 microversion: 2.1 time: 0.406204 Oct 03 14:48:13.317659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:13.319338 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1883/3716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:12 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1238 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:48:13.326748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:13.327627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:13.530670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lazy-loading 'services' on Instance uuid 63c94af6-b9e0-4f15-907a-60f0d062a325 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:48:13.737531 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e039e497-ea51-40e9-a2f3-7015898c6c2f tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments/ce2ecada-fcb4-4790-adc9-5661018c41e5" status: 202 len: 0 microversion: 2.1 time: 0.445566 Oct 03 14:48:13.738231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1834/3717] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 14:48:13 2022] DELETE /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments/ce2ecada-fcb4-4790-adc9-5661018c41e5 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:48:14.050074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:14.052366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:14.068760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:14.070360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:14.071640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:14.074218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:14.076678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:14.077395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:14.122056 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] HTTP exception thrown: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Request method failure captured: Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a HTTP/1.1 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSUOUMFWQybdtYzPRppYCwKQ6ZaymdKBjXObQvOx7dExfUx6bQRqKfA2PpEf-EY9-PrGF_fu21L1dzsHUWLl-lU_a1C7KRhwlNpwZf3nI2j3tVWdojnGSyF61CvkwjCktfkfUQQrLT6VHuQIVDKqNaOEwWnjhcbJeZLFlGW5oUc2NI Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.42 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c33c2d9960274f1dad48de24a88484dd Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c33c2d9960274f1dad48de24a88484dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c33c2d9960274f1dad48de24a88484dd Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TaggedBootDevicesTest_v242-689574170-project Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 645649c7b4ad474c8aa0ffa7677e121d Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TaggedBootDevicesTest_v242-689574170-project Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '8b74a99b-96bf-496d-87c7-254646d5f52a'} Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:14.127771 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:14.134116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:14.136731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Returning 404 to user: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:14.137871 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b26099de-c4ee-4c78-be1a-5e264404925e tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 404 len: 111 microversion: 2.42 time: 0.091952 Oct 03 14:48:14.139197 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1884/3718] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:14 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:48:14.149372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e574539b-f2d7-4292-81af-ff0ae04ea5eb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '.version_select at 0x7fb230118550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:14.194310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e574539b-f2d7-4292-81af-ff0ae04ea5eb tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496860179" status: 204 len: 0 microversion: 2.42 time: 0.050225 Oct 03 14:48:14.199074 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1835/3719] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 3 14:48:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496860179 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:48:14.344118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:14.344849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:14.355262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:14.355768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:14.356204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:14.358302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:14.361054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:14.361560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:14.540734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:14.554056 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04745b8a-13c7-464e-95af-76f162f45ee6 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1238 microversion: 2.1 time: 0.213074 Oct 03 14:48:14.556400 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1885/3720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:14 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1238 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:15.585077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:15.586081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:15.614760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:15.615893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:15.616627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:15.627805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:15.629473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:15.630091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:15.665218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb086035-fe67-4728-84b3-99261df63342 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Action: 'create', calling method: .version_select at 0x7fb22bdb1550>, body: {"keypair": {"name": "tempest-keypair-1417664208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEfQCznydAUZpq24nUTzCk0+IsT3CSt/05DobzF13hUX+kgNIjyVf6do/O5l772BjAstI5DvybJcEn/YnDg9yelMgJIJcVtvBSKOfD88iORxz5n5CoRNnrc/E9s/kJP8w=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:15.720036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-eb086035-fe67-4728-84b3-99261df63342 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Getting quotas for project 57e82f647a944e6db03d55e48bb87c49. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:48:15.741757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-eb086035-fe67-4728-84b3-99261df63342 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Getting quotas for user 5f6c97e624784092a1302a2ba80f23bf and project 57e82f647a944e6db03d55e48bb87c49. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:48:15.828669 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb086035-fe67-4728-84b3-99261df63342 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.165414 Oct 03 14:48:15.830176 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1886/3721] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:48:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 03 14:48:16.538197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:16.549726 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-afafbcf0-e4aa-4e13-a0be-363267b3597b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1306 microversion: 2.1 time: 0.970071 Oct 03 14:48:16.550337 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1836/3722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:15 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1306 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:17.574592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:17.575959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:17.587546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:17.589855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:17.590585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:17.591218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:17.592209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:17.593178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:17.593776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:18.210084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5ebaa123-7f14-48ee-b799-09ed63a34a71 req-5879bfce-e681-4d8c-be10-d3ae52597486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53555f13-170d-42a0-baf9-4f4c6546d616", "tag": "d27d2fc9-5913-4c43-92a5-b6445360d9f8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:18.231971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ebaa123-7f14-48ee-b799-09ed63a34a71 req-5879bfce-e681-4d8c-be10-d3ae52597486 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:18.233442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ebaa123-7f14-48ee-b799-09ed63a34a71 req-5879bfce-e681-4d8c-be10-d3ae52597486 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:18.236895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ebaa123-7f14-48ee-b799-09ed63a34a71 req-5879bfce-e681-4d8c-be10-d3ae52597486 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:18.273290 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5ebaa123-7f14-48ee-b799-09ed63a34a71 req-5879bfce-e681-4d8c-be10-d3ae52597486 service nova] Creating event network-changed:d27d2fc9-5913-4c43-92a5-b6445360d9f8 for instance 53555f13-170d-42a0-baf9-4f4c6546d616 on n-h2-781139-2 Oct 03 14:48:18.289288 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5ebaa123-7f14-48ee-b799-09ed63a34a71 req-5879bfce-e681-4d8c-be10-d3ae52597486 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411804 Oct 03 14:48:18.291484 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1837/3723] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:48:18.461829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:18.474885 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57110f44-15b2-4961-b3ae-b1fe70c2444b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1306 microversion: 2.1 time: 0.906549 Oct 03 14:48:18.475611 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1887/3724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:17 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1306 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:19.499948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:19.500649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:19.514379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:19.514901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:19.515342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:19.516051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:19.516506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:19.516965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:19.764494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:19.777684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-93b09596-1d2b-4230-b731-50c86561a0f9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1306 microversion: 2.1 time: 0.282715 Oct 03 14:48:19.778662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1838/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:19 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1306 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:20.804321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:20.806409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:20.830901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:20.832021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:20.833053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:20.834050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:20.834810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:20.835411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:21.674203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:21.683553 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6467c0c5-853f-427d-b0e7-89bbc83f3fe0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1306 microversion: 2.1 time: 0.886168 Oct 03 14:48:21.687322 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1888/3726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:20 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1306 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:22.402134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1413411817", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0b42cacf-4aba-4823-8dca-351fac8845fe"}, {"port": "6a23350a-a333-440d-a327-a676c7ec15bc", "tag": "port-1"}, {"port": "9b2f5bc3-8e81-4563-ba3f-7402fc93aae2", "tag": "port-2"}, {"uuid": "930ad0c2-8a91-4666-845a-3d7699455150", "tag": "net-1"}, {"uuid": "930ad0c2-8a91-4666-845a-3d7699455150"}, {"uuid": "bcf05e8d-773d-43f8-a23d-660cfee533f4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bcf05e8d-773d-43f8-a23d-660cfee533f4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "13d179b4-50fa-480f-82c3-581be6842795", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8480e67f-13c1-4d0d-a4bb-af9f5fb8fc0b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e95cfc35-5ee8-4fa9-af5d-267f3ebe50da", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1704627332"}], "key_name": "tempest-keypair-1417664208", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:22.450140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:22.714522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:22.715142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:22.752211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:22.752211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:22.752574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:22.758372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:22.758899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:22.759344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:22.948655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] validate_networks() for [('0b42cacf-4aba-4823-8dca-351fac8845fe', None, None, None, None, None), (None, None, '6a23350a-a333-440d-a327-a676c7ec15bc', None, None, None), (None, None, '9b2f5bc3-8e81-4563-ba3f-7402fc93aae2', None, None, None), ('930ad0c2-8a91-4666-845a-3d7699455150', None, None, None, None, None), ('930ad0c2-8a91-4666-845a-3d7699455150', None, None, None, None, None), ('bcf05e8d-773d-43f8-a23d-660cfee533f4', '10.2.2.100', None, None, None, None), ('bcf05e8d-773d-43f8-a23d-660cfee533f4', '10.2.2.200', None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:48:24.036720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:24.046051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ce5c037-7fef-4dc8-9aec-f33db246ca1d tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1306 microversion: 2.1 time: 1.335891 Oct 03 14:48:24.048403 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1889/3727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:22 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1306 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:25.078327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:25.080016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:25.125708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:25.127994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.129205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.137886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:25.140506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.142965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.144886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:25.373331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:25.383030 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6679369-2743-4e80-ad31-4690f682e661 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1306 microversion: 2.1 time: 0.310072 Oct 03 14:48:25.397420 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1890/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:25 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1306 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:25.409177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:25.417966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:25.436550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.437769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.439752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:25.443965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.444794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.445481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:25.526682 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80fa7d34-fa3d-41cf-a6fb-4b0145de481b tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126086 Oct 03 14:48:25.526682 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1891/3729] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:48:25 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:48:25.607474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a215133f-d6ef-4191-9bf3-d7248dd10eb9 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Calling method '.version_select at 0x7fb22be2a1f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:25.680358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a215133f-d6ef-4191-9bf3-d7248dd10eb9 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.152428 Oct 03 14:48:25.688522 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1892/3730] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:48:25 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:48:25.688522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:25.689889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:25.709137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.711645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.712494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:25.713519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.714263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.714919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:25.765889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d754604f-c6eb-46a9-b6d7-0b868cd8cc57 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082964 Oct 03 14:48:25.766993 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1893/3731] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:48:25 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:48:25.772859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6f3a566-01be-49a7-97ef-530ee019c7ca tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Action: 'create', calling method: .version_select at 0x7fb2302395e0>, body: {"pool": "non_exist_pool"} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:25.781864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=18 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:25.826778 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d6f3a566-01be-49a7-97ef-530ee019c7ca tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] HTTP exception thrown: Floating IP pool not found. Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6f3a566-01be-49a7-97ef-530ee019c7ca tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Request method failure captured: Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 26 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY5LeegqqMty2W6MTtXD3_Zlgo_qIPsDvTZIfSTOx8FzS0YawtbYNMfL02KEUHw9t3V6GAeZ0ihOjvHS8z0rH6842bFNEICi7LOdRgfwRJ6jPXiuId498jb-nUidVndW4nz31115e5lHmppO1OiOvunikkiIz_ov4aKOCL1yK8xSrI Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3edbb41c13334c2db190896b1e7da9a9 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1737901851 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3edbb41c13334c2db190896b1e7da9a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3edbb41c13334c2db190896b1e7da9a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3edbb41c13334c2db190896b1e7da9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3edbb41c13334c2db190896b1e7da9a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1737901851 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3edbb41c13334c2db190896b1e7da9a9 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1737901851 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsNegativeTestJSON-1737901851-project Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e77c9ef284f64cfa9eb0c8f2829da5c1 Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1737901851-project Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: {"pool": "non_exist_pool"} Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: exception: Floating IP pool not found. Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:25.828819 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:25.835554 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 03 14:48:25.835554 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.836638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6f3a566-01be-49a7-97ef-530ee019c7ca tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Returning 404 to user: Floating IP pool not found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:25.838116 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6f3a566-01be-49a7-97ef-530ee019c7ca tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.069809 Oct 03 14:48:25.838944 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1894/3732] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:48:25 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:48:25.850394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e0d68c9-c464-4113-a81f-e149ec363a56 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Calling method '.version_select at 0x7fb230282670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:25.930676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-8e0d68c9-c464-4113-a81f-e149ec363a56 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3d07c434-bcfa-431a-b284-a57a6e7b93ea could not be found", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:48:25.931677 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8e0d68c9-c464-4113-a81f-e149ec363a56 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] HTTP exception thrown: Floating IP not found for ID 3d07c434-bcfa-431a-b284-a57a6e7b93ea Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e0d68c9-c464-4113-a81f-e149ec363a56 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Request method failure captured: Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-floating-ips/3d07c434-bcfa-431a-b284-a57a6e7b93ea HTTP/1.1 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY5LeegqqMty2W6MTtXD3_Zlgo_qIPsDvTZIfSTOx8FzS0YawtbYNMfL02KEUHw9t3V6GAeZ0ihOjvHS8z0rH6842bFNEICi7LOdRgfwRJ6jPXiuId498jb-nUidVndW4nz31115e5lHmppO1OiOvunikkiIz_ov4aKOCL1yK8xSrI Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3edbb41c13334c2db190896b1e7da9a9 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1737901851 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3edbb41c13334c2db190896b1e7da9a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3edbb41c13334c2db190896b1e7da9a9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3edbb41c13334c2db190896b1e7da9a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3edbb41c13334c2db190896b1e7da9a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1737901851 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3edbb41c13334c2db190896b1e7da9a9 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1737901851 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-FloatingIPsNegativeTestJSON-1737901851-project Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e77c9ef284f64cfa9eb0c8f2829da5c1 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1737901851-project Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: exception: Floating IP not found for ID 3d07c434-bcfa-431a-b284-a57a6e7b93ea Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3d07c434-bcfa-431a-b284-a57a6e7b93ea'} Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3d07c434-bcfa-431a-b284-a57a6e7b93ea could not be found Oct 03 14:48:25.933622 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4a2c1102-1270-451e-8260-9fa7269b0cf7'] Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3d07c434-bcfa-431a-b284-a57a6e7b93ea. Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3d07c434-bcfa-431a-b284-a57a6e7b93ea Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3d07c434-bcfa-431a-b284-a57a6e7b93ea Oct 03 14:48:25.939231 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:25.945063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e0d68c9-c464-4113-a81f-e149ec363a56 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] Returning 404 to user: Floating IP not found for ID 3d07c434-bcfa-431a-b284-a57a6e7b93ea {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:25.946005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e0d68c9-c464-4113-a81f-e149ec363a56 tempest-FloatingIPsNegativeTestJSON-1737901851 tempest-FloatingIPsNegativeTestJSON-1737901851-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/3d07c434-bcfa-431a-b284-a57a6e7b93ea" status: 404 len: 111 microversion: 2.1 time: 0.099766 Oct 03 14:48:25.947711 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1895/3733] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:48:25 2022] DELETE /compute/v2.1/os-floating-ips/3d07c434-bcfa-431a-b284-a57a6e7b93ea => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:48:25.959718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:25.960520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:25.967769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.968648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.969341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:25.970431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:25.971092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:25.971727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:26.015501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:48:26.218014 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99713f42-1b46-4658-8e50-e550b35548af tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 204 len: 0 microversion: 2.1 time: 0.268074 Oct 03 14:48:26.219880 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1896/3734] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:48:25 2022] DELETE /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:48:26.233367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:26.234144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:26.251145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:26.251647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:26.252086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:26.252808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:26.253280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:26.254063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:26.805899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:26.823299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9730c52-13ef-40b7-9136-22cdf8f14535 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1680 microversion: 2.1 time: 0.598663 Oct 03 14:48:26.823908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1897/3735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:26 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1680 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:48:26.828471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:26.841320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:26.847984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:26.848468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:26.848914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:26.852530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:26.853054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:26.853493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:27.545215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:27.564634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30893b53-8670-4312-bfa9-6b4aeedae252 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1306 microversion: 2.1 time: 0.739578 Oct 03 14:48:27.568262 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1898/3736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:26 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1306 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:27.853193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:27.854525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:27.862203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:27.863117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:27.864152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:27.865835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:27.866619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:27.867329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:28.174069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:28.184678 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c56627bb-2e70-4948-99c1-99d1013d68b3 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1680 microversion: 2.1 time: 0.337160 Oct 03 14:48:28.210488 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1899/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:27 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1680 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:28.590562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:28.591120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:28.602142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:28.602668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:28.608550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:28.609472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:28.609969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:28.615807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:28.842114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:28.855762 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49c6e0fe-0e34-47b7-943a-f185cbfa8b25 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1294 microversion: 2.1 time: 0.269001 Oct 03 14:48:28.864160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1900/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:28 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1294 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:48:29.021984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-669194369", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:29.120577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] validate_networks() for [('2a62333a-9bbf-45d0-8291-9f475d60044b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:48:29.772183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:30.315378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:48:30.316417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:48:30.317189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:48:30.317792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:48:30.318545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:48:30.335681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:30.339695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:30.340207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:30.341217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:30.344856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:30.345582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:30.395953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Getting quotas for project 59c05dc202214244af424eddbccfb669. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:48:30.424703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Getting quotas for user 49662fc3f33c425baace58ea7f3e79aa and project 59c05dc202214244af424eddbccfb669. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:48:30.444111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:48:30.447698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:48:30.529924 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45319a96-ec4d-4f59-aeb4-dfeb5c795dcb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644292 Oct 03 14:48:30.531539 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1901/3739] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:48:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:48:30.537486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:30.538363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:30.548199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:30.549899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:30.550598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:30.555622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:30.556487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:30.557871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:30.960382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:30.972622 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c10d58e2-f13a-4b98-b6e5-48c269dba93a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1612 microversion: 2.1 time: 0.439692 Oct 03 14:48:30.973263 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1902/3740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:30 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1612 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:30.986008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:30.992032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:31.025973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.026762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.027372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:31.028280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.028959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.029558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:31.034397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:31.188889 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02bafc46-eb4c-4099-a73b-e84bbae3d638 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.212904 Oct 03 14:48:31.192459 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1903/3741] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:48:30 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:48:31.212416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:31.213849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:31.233127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.235524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.238145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:31.239276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.256172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.256635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:31.813355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:31.827524 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-081dbc81-4d8f-44c5-918e-92911ae9834c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1294 microversion: 2.1 time: 0.635448 Oct 03 14:48:31.829659 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1904/3742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:31 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1294 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:31.846036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:31.850400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:31.871646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.873622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.877157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:31.878675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.879965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.882015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:31.920568 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] HTTP exception thrown: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Request method failure captured: Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a HTTP/1.1 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSUOUMFWQybdtYzPRppYCwKQ6ZaymdKBjXObQvOx7dExfUx6bQRqKfA2PpEf-EY9-PrGF_fu21L1dzsHUWLl-lU_a1C7KRhwlNpwZf3nI2j3tVWdojnGSyF61CvkwjCktfkfUQQrLT6VHuQIVDKqNaOEwWnjhcbJeZLFlGW5oUc2NI Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.42 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c33c2d9960274f1dad48de24a88484dd Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c33c2d9960274f1dad48de24a88484dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c33c2d9960274f1dad48de24a88484dd Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TaggedBootDevicesTest_v242-689574170-project Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 645649c7b4ad474c8aa0ffa7677e121d Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TaggedBootDevicesTest_v242-689574170-project Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '8b74a99b-96bf-496d-87c7-254646d5f52a'} Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:48:31.924463 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Returning 404 to user: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf40dfb3-b614-4410-ae02-412074ac1fca tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 404 len: 111 microversion: 2.42 time: 0.091196 Oct 03 14:48:31.931572 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1905/3743] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:48:31 2022] DELETE /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:48:31.939970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:31.940615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:31.958678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.959257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.959696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:31.960559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:31.961044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:31.961474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:32.123068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:32.134989 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1070b0e-96ab-4e60-b86b-28df089c9df3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1268 microversion: 2.1 time: 0.202965 Oct 03 14:48:32.135589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1906/3744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:31 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:32.146706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:32.147671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:32.165694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:32.166678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:32.168453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:32.169641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:32.171865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:32.172575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:32.999976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:33.014758 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-758866f2-5438-4fcd-86a2-81ef15659d68 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1670 microversion: 2.1 time: 0.878073 Oct 03 14:48:33.015369 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1907/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:32 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1670 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:33.020571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0702d63e-61b2-4c31-b1c6-de31a0693fba req-eb7f7a08-3c31-45bc-8e5d-45a70869714b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c94af6-b9e0-4f15-907a-60f0d062a325", "name": "network-vif-deleted", "tag": "d9a86fed-bfe7-4009-bf6e-b08f71f97419"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:33.044292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0702d63e-61b2-4c31-b1c6-de31a0693fba req-eb7f7a08-3c31-45bc-8e5d-45a70869714b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.044780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0702d63e-61b2-4c31-b1c6-de31a0693fba req-eb7f7a08-3c31-45bc-8e5d-45a70869714b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.054840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0702d63e-61b2-4c31-b1c6-de31a0693fba req-eb7f7a08-3c31-45bc-8e5d-45a70869714b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.085232 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0702d63e-61b2-4c31-b1c6-de31a0693fba req-eb7f7a08-3c31-45bc-8e5d-45a70869714b service nova] Creating event network-vif-deleted:d9a86fed-bfe7-4009-bf6e-b08f71f97419 for instance 63c94af6-b9e0-4f15-907a-60f0d062a325 on n-h1-781139-2 Oct 03 14:48:33.098825 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0702d63e-61b2-4c31-b1c6-de31a0693fba req-eb7f7a08-3c31-45bc-8e5d-45a70869714b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081613 Oct 03 14:48:33.099810 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1908/3746] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:33.105257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:33.106002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] [instance: 8b74a99b-96bf-496d-87c7-254646d5f52a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:33.130101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.131129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.131780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.132735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.133473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.134460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.154767 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] HTTP exception thrown: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Request method failure captured: Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a HTTP/1.1 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSUOUMFWQybdtYzPRppYCwKQ6ZaymdKBjXObQvOx7dExfUx6bQRqKfA2PpEf-EY9-PrGF_fu21L1dzsHUWLl-lU_a1C7KRhwlNpwZf3nI2j3tVWdojnGSyF61CvkwjCktfkfUQQrLT6VHuQIVDKqNaOEwWnjhcbJeZLFlGW5oUc2NI Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.42 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c33c2d9960274f1dad48de24a88484dd Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c33c2d9960274f1dad48de24a88484dd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c33c2d9960274f1dad48de24a88484dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c33c2d9960274f1dad48de24a88484dd Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-689574170 Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TaggedBootDevicesTest_v242-689574170-project Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 645649c7b4ad474c8aa0ffa7677e121d Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TaggedBootDevicesTest_v242-689574170-project Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '8b74a99b-96bf-496d-87c7-254646d5f52a'} Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:33.156812 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. Oct 03 14:48:33.162320 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:33.164274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] Returning 404 to user: Instance 8b74a99b-96bf-496d-87c7-254646d5f52a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:33.165197 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae1bea33-a42f-44d8-806c-bd131e2c65a4 tempest-TaggedBootDevicesTest_v242-689574170 tempest-TaggedBootDevicesTest_v242-689574170-project] 10.222.0.20 "GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a" status: 404 len: 111 microversion: 2.42 time: 0.064246 Oct 03 14:48:33.168994 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1909/3747] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:33 2022] GET /compute/v2.1/servers/8b74a99b-96bf-496d-87c7-254646d5f52a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:48:33.173919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:33.174669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:33.186361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.186869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.187316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.191375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.192105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.192226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.262932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.263420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.265401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.269780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lazy-loading 'fault' on Instance uuid 63c94af6-b9e0-4f15-907a-60f0d062a325 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:48:33.610011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b310d519aab7472abec9c2e76d501f06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20da25d14b5454592756373984b0b59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:33.624507 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa7612b8-bb9d-4597-9505-f014bf5c9f72 tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 200 len: 1330 microversion: 2.1 time: 0.454351 Oct 03 14:48:33.636645 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1910/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:33 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 1330 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:33.648430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:33.652210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:33.666697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.667188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.667623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.668317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.668766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.673572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.931256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:48:33.935110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:48:33.936069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:48:33.936754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:48:33.938328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:48:33.963827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.968443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.968911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:33.969769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:33.970231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:33.970662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:34.000734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Getting quotas for project 57e82f647a944e6db03d55e48bb87c49. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:48:34.014094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Getting quotas for user 5f6c97e624784092a1302a2ba80f23bf and project 57e82f647a944e6db03d55e48bb87c49. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:48:34.158763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:34.171558 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6e4c186f-7364-4e92-a26c-fe7a0bae282b tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1294 microversion: 2.1 time: 0.533616 Oct 03 14:48:34.172851 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1911/3749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:33 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1294 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:34.180908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:34.186530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:34.203759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:34.204534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:34.205215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:34.206060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:34.206622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:34.213669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:34.324112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:48:34.326964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='13d179b4-50fa-480f-82c3-581be6842795',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8480e67f-13c1-4d0d-a4bb-af9f5fb8fc0b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e95cfc35-5ee8-4fa9-af5d-267f3ebe50da',volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:48:34.407893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:34.427221 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-906e1851-9d43-4708-bd90-7e3a3c0b3554 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1274 microversion: 2.1 time: 0.252916 Oct 03 14:48:34.449024 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1912/3750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:34 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:34.492820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:34.495141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:34.509263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:34.514631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:34.515289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:34.516153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:34.525404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:34.527438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:35.043350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e144530d-99cc-4736-96fe-6b28d6dcd0b7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 12.643987 Oct 03 14:48:35.047947 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1839/3751] 10.222.0.20 () {62 vars in 1189 bytes} [Mon Oct 3 14:48:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 12651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:48:35.060609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:35.061575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:35.074680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:35.076638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:35.077304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:35.080353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:35.081110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:35.083637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:35.114401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] HTTP exception thrown: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Request method failure captured: Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 HTTP/1.1 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvVYwHG3jEAWNjYWxQIzr-C10dCeZSkfGZvISKCAtVgQgJhi2vXYWcilDlgTxgqX2VK-3XgKuI1HC_lu4JlJCQfM7HlMncWc_Q_ga6oOWEXJ3nTPB3HtgJvPb0NUJn2_GH9Gz3GIA4UKQYD2GlyGCjWx8QpKMuIDSz1Rz4RMM-9b1ag Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c20da25d14b5454592756373984b0b59 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20da25d14b5454592756373984b0b59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20da25d14b5454592756373984b0b59", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20da25d14b5454592756373984b0b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20da25d14b5454592756373984b0b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c20da25d14b5454592756373984b0b59 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachSCSIVolumeTestJSON-2062796041-project Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b310d519aab7472abec9c2e76d501f06 Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2062796041-project Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '63c94af6-b9e0-4f15-907a-60f0d062a325'} Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:35.116232 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Returning 404 to user: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:35.121549 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4371a9ae-2dd0-4687-a40b-be26a3e2584a tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 404 len: 111 microversion: 2.1 time: 0.071682 Oct 03 14:48:35.122304 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1840/3752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:35 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:48:35.133141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ca971d8-e03e-49a4-8b1b-45d9cbec9249 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:35.133828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ca971d8-e03e-49a4-8b1b-45d9cbec9249 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:35.143303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:35.155056 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a8bd796-31da-4020-a48e-60b1d0bbed22 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1670 microversion: 2.1 time: 0.704486 Oct 03 14:48:35.173581 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1913/3753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:34 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1670 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:35.186287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d281786-9f89-4d94-9ec4-71680c273fdc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '.version_select at 0x7fb22bda3280>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:35.272852 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d281786-9f89-4d94-9ec4-71680c273fdc tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479336741" status: 202 len: 0 microversion: 2.1 time: 0.097223 Oct 03 14:48:35.273839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1914/3754] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1479336741 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:48:35.283728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:35.284393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:35.299637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:35.301392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:35.301853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:35.306308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:35.307026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:35.307559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:35.435679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ca971d8-e03e-49a4-8b1b-45d9cbec9249 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:35.446270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ca971d8-e03e-49a4-8b1b-45d9cbec9249 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:35.454950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ca971d8-e03e-49a4-8b1b-45d9cbec9249 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:35.457840 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ca971d8-e03e-49a4-8b1b-45d9cbec9249 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1286 microversion: 2.32 time: 0.333882 Oct 03 14:48:35.458807 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1841/3755] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:35 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1286 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:35.470157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:35.471168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:35.509357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:35.511504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:35.512489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:35.517252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:35.518137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:35.520394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:35.954041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:35.967105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a262138-0f57-4b99-8417-2686b547b9db tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 0.506345 Oct 03 14:48:35.970095 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1842/3756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:35 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:36.013615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:36.030582 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ea84685-57ec-47e1-9600-1a4b6af6944c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1294 microversion: 2.1 time: 0.755435 Oct 03 14:48:36.031249 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1915/3757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:35 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1294 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:36.180774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:36.181519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:36.192625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:36.201429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:36.202312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:36.203320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:36.204052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:36.204739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:36.492590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:36.494677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:36.522709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:36.528472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:36.531759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:36.533649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:36.537433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:36.543895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:36.553690 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f02224dc-2407-46d4-b12d-754c0f5c2be1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.377804 Oct 03 14:48:36.557339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:36.562315 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1843/3758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:36 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:36.758243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:36.772588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:36.774575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:36.776413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95345608-b006-4d40-b697-b6f35308ab22 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1528 microversion: 2.32 time: 0.288466 Oct 03 14:48:36.790795 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1916/3759] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:36 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1528 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:48:36.994658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:36.996345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:37.017821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.018844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.020384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:37.022530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.022998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.024129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:37.055799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:37.056714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:37.079349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.082419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.084309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:37.089045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.091982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.096555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:37.421315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:37.433336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5612d82e-7240-470f-92f2-1db8588d0324 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 0.443002 Oct 03 14:48:37.433994 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1844/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:36 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:37.461567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-566eeaea-4b7c-4a83-891b-b5022bbc6b8d req-4374fdfd-2609-402e-a91f-a8e2ad752201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5abef3-5a4d-48c8-89e6-63862eb6bf37", "tag": "7abe5823-b304-4057-b497-e2f4b020ff05"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:37.489554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-566eeaea-4b7c-4a83-891b-b5022bbc6b8d req-4374fdfd-2609-402e-a91f-a8e2ad752201 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.492347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-566eeaea-4b7c-4a83-891b-b5022bbc6b8d req-4374fdfd-2609-402e-a91f-a8e2ad752201 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.494055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-566eeaea-4b7c-4a83-891b-b5022bbc6b8d req-4374fdfd-2609-402e-a91f-a8e2ad752201 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:37.523863 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-566eeaea-4b7c-4a83-891b-b5022bbc6b8d req-4374fdfd-2609-402e-a91f-a8e2ad752201 service nova] Creating event network-changed:7abe5823-b304-4057-b497-e2f4b020ff05 for instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 on n-h1-781139-2 Oct 03 14:48:37.535753 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-566eeaea-4b7c-4a83-891b-b5022bbc6b8d req-4374fdfd-2609-402e-a91f-a8e2ad752201 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081044 Oct 03 14:48:37.538035 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1845/3761] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:37.719262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:37.728900 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7f9b62c-f0e8-4af3-a1ca-c945e0567f93 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1294 microversion: 2.1 time: 0.678741 Oct 03 14:48:37.749007 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1917/3762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:37 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1294 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:48:37.810269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:37.810892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:37.824789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.825319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.826159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:37.827193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.827820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.833591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:37.947103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-86ca6dc5-ce20-44a9-8299-b4475de31822 req-06746515-d727-4d8f-95af-75984f85f71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53555f13-170d-42a0-baf9-4f4c6546d616", "name": "network-vif-plugged", "status": "completed", "tag": "d27d2fc9-5913-4c43-92a5-b6445360d9f8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:37.970329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86ca6dc5-ce20-44a9-8299-b4475de31822 req-06746515-d727-4d8f-95af-75984f85f71a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:37.970816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86ca6dc5-ce20-44a9-8299-b4475de31822 req-06746515-d727-4d8f-95af-75984f85f71a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:37.971252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-86ca6dc5-ce20-44a9-8299-b4475de31822 req-06746515-d727-4d8f-95af-75984f85f71a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:38.010980 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-86ca6dc5-ce20-44a9-8299-b4475de31822 req-06746515-d727-4d8f-95af-75984f85f71a service nova] Creating event network-vif-plugged:d27d2fc9-5913-4c43-92a5-b6445360d9f8 for instance 53555f13-170d-42a0-baf9-4f4c6546d616 on n-h2-781139-2 Oct 03 14:48:38.023873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-86ca6dc5-ce20-44a9-8299-b4475de31822 req-06746515-d727-4d8f-95af-75984f85f71a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.484394 Oct 03 14:48:38.024502 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1846/3763] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:38.193828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:38.203585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:38.211810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:38.213399 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d3123ede-2283-4087-946e-a42f1f47446c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1584 microversion: 2.32 time: 0.408062 Oct 03 14:48:38.221324 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1918/3764] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:37 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1584 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:48:38.458398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:38.460294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:38.469504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:38.470196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:38.471413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:38.472308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:38.472980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:38.473575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:38.690892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:38.698872 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b9590266-f26e-44cd-8c71-4aa6ab6b08fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 0.246186 Oct 03 14:48:38.700056 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1847/3765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:38 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:38.759630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:38.764740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:38.776967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:38.778277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:38.779778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:38.780830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:38.781509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:38.782167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:39.183437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:39.191734 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-164ab65d-e086-426d-882c-44c9f55efd55 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1294 microversion: 2.1 time: 0.439129 Oct 03 14:48:39.192317 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1919/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:38 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1294 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:39.244049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:39.244663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:39.258812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:39.259321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:39.259763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:39.260479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:39.261031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:39.261377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:39.444286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:39.485754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:39.487306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:39.488683 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25a55aed-ccda-40f2-90ea-9e98a8294fab tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1594 microversion: 2.32 time: 0.248642 Oct 03 14:48:39.500749 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1848/3767] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:39 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1594 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:39.723028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:39.723800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:39.741704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:39.742233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:39.742740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:39.743614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:39.744112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:39.744550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:40.046893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:40.058671 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d5c995e-33ae-4a6b-9ccc-d219e87cd161 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 0.337115 Oct 03 14:48:40.074648 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1920/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:39 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:40.221932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:40.222846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:40.237345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:40.239024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:40.239747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:40.242295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:40.244134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:40.246529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:40.516662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:40.530132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1f97fc26-2c47-4d72-802b-586855c50c21 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1485 microversion: 2.1 time: 0.311682 Oct 03 14:48:40.533656 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1849/3769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:40 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1485 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:40.534306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:40.534977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:40.537125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:40.537830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:40.550593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:40.551132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:40.551650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:40.554981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:40.555504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:40.555939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:40.561370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:40.562109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:40.573631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:40.574593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:40.577411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:40.578654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:40.579273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:40.582220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:40.622516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:40.767061 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c664faee-d94e-47d8-abf6-e13d573aedbb tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209200 Oct 03 14:48:40.768436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1850/3770] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:48:40 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:40.812056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:40.823948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:40.826737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:40.828154 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62c0c0b2-5654-42da-b67b-0323dc96901f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1594 microversion: 2.32 time: 0.303056 Oct 03 14:48:40.847089 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1921/3771] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:40 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1594 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:41.090074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:41.090865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:41.104773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:41.106720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:41.107467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:41.109931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:41.112606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:41.113385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:41.857734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:41.858896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:41.871799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:41.878931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:41.883819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:41.887289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:41.888115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:41.888754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:42.077613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:42.095203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:42.100526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:42.104178 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfb69fb5-2730-4d4c-8374-b4b2e624d600 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1594 microversion: 2.32 time: 0.249853 Oct 03 14:48:42.107127 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1922/3772] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:41 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1594 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:42.565788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:42.582371 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-068aa278-568b-4c81-8026-b42b3ef94556 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 1.496434 Oct 03 14:48:42.586631 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1851/3773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:41 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:43.138065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:43.139282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:43.156628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:43.157470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:43.158094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:43.160743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:43.163869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:43.164566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:43.625945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:43.631516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:43.669585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:43.673544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:43.674016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:43.674839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:43.676485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:43.677716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:43.984262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:44.082942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:44.093617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b99125c8-b795-4f2b-b1b2-8fbbf6d2befd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 0.489342 Oct 03 14:48:44.103170 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1852/3774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:43 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:44.108845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:44.109686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:44.129037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:44.129800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:44.130532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:44.131415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:44.132035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:44.132627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:44.258047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:44.282590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:44.287246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:44.289661 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f463dbcb-80bb-4af6-a67d-10cff38d60ba tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1662 microversion: 2.32 time: 1.155778 Oct 03 14:48:44.290257 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1923/3775] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:43 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1662 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:44.502344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:44.515723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc81c648-03d0-4998-9dd1-17da0a7ee725 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1485 microversion: 2.1 time: 0.411173 Oct 03 14:48:44.538306 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1853/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:44 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1485 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:44.556447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-8f9ca859-5004-493e-81f2-d85093e50755 req-e58efb03-99b8-47f2-844b-a73b03a9cd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abef3-5a4d-48c8-89e6-63862eb6bf37", "name": "network-vif-plugged", "status": "completed", "tag": "7abe5823-b304-4057-b497-e2f4b020ff05"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:44.582343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f9ca859-5004-493e-81f2-d85093e50755 req-e58efb03-99b8-47f2-844b-a73b03a9cd63 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:44.582841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f9ca859-5004-493e-81f2-d85093e50755 req-e58efb03-99b8-47f2-844b-a73b03a9cd63 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:44.583274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f9ca859-5004-493e-81f2-d85093e50755 req-e58efb03-99b8-47f2-844b-a73b03a9cd63 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:44.608905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ce884877-fd31-447e-a9d9-58f4ae24c6d1 req-d1a6e231-ca2f-425a-a59d-7ff07e4e8246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53555f13-170d-42a0-baf9-4f4c6546d616", "tag": "d27d2fc9-5913-4c43-92a5-b6445360d9f8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:44.613823 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-8f9ca859-5004-493e-81f2-d85093e50755 req-e58efb03-99b8-47f2-844b-a73b03a9cd63 service nova] Creating event network-vif-plugged:7abe5823-b304-4057-b497-e2f4b020ff05 for instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 on n-h1-781139-2 Oct 03 14:48:44.626656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce884877-fd31-447e-a9d9-58f4ae24c6d1 req-d1a6e231-ca2f-425a-a59d-7ff07e4e8246 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:44.627333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce884877-fd31-447e-a9d9-58f4ae24c6d1 req-d1a6e231-ca2f-425a-a59d-7ff07e4e8246 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:44.627932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce884877-fd31-447e-a9d9-58f4ae24c6d1 req-d1a6e231-ca2f-425a-a59d-7ff07e4e8246 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:44.629121 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-8f9ca859-5004-493e-81f2-d85093e50755 req-e58efb03-99b8-47f2-844b-a73b03a9cd63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084896 Oct 03 14:48:44.632716 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1854/3777] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:44.667458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ce884877-fd31-447e-a9d9-58f4ae24c6d1 req-d1a6e231-ca2f-425a-a59d-7ff07e4e8246 service nova] Creating event network-changed:d27d2fc9-5913-4c43-92a5-b6445360d9f8 for instance 53555f13-170d-42a0-baf9-4f4c6546d616 on n-h2-781139-2 Oct 03 14:48:44.707496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ce884877-fd31-447e-a9d9-58f4ae24c6d1 req-d1a6e231-ca2f-425a-a59d-7ff07e4e8246 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409969 Oct 03 14:48:44.708170 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1924/3778] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:45.126450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:45.127490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:45.136665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:45.143035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:45.143728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:45.144649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:45.145289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:45.157839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:45.321334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:45.322032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:45.335437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:45.347881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:45.348558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:45.349643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:45.350307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:45.350931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:45.440027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:45.558696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:45.566702 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-60cfc8a7-b96f-4cd3-85b5-2d26dbf1fd7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 0.445369 Oct 03 14:48:45.577800 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1855/3779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:45 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:45.951392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:45.961446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:45.973303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:45.974630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7599584-bd6c-4aa3-aca1-186c51eb68d0 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1709 microversion: 2.32 time: 0.658229 Oct 03 14:48:45.975188 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1925/3780] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:45 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1709 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:48:46.591273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:46.592696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:46.610878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:46.611680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:46.612282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:46.613245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:46.613859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:46.614444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:47.009228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:47.011209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:47.029850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:47.032166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:47.033366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:47.036098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:47.038314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:47.039046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:47.161337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:47.170471 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ef84f3e7-7876-460f-85fb-fa5d8aef76ba tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1316 microversion: 2.1 time: 0.583654 Oct 03 14:48:47.179046 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1856/3781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:46 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:47.589865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:47.604872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:47.611852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:47.613111 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9808f7ae-96ad-45eb-b2c8-f8dfb8d7f1e9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1709 microversion: 2.32 time: 0.608710 Oct 03 14:48:47.613688 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1926/3782] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:47 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1709 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:48.199064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:48.199941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:48.217848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:48.218340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:48.218771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:48.224483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:48.225002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:48.232952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:48.640268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:48.641672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:48.663169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:48.663933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:48.664558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:48.665463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:48.666071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:48.666652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:49.461903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:49.472718 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1fb2b8d-5cf1-4ac5-9aec-99ec7cc89a4c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.282443 Oct 03 14:48:49.473345 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1857/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:48 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:48:49.735728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1898783616", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:49.804938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:49.820466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:49.826951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:49.828347 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-334e31c8-4af9-452e-90bc-1ef09b4ad345 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1756 microversion: 2.32 time: 1.192832 Oct 03 14:48:49.831724 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1927/3784] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:48 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1756 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:48:49.886675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] validate_networks() for [('2a62333a-9bbf-45d0-8291-9f475d60044b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:48:50.859739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:50.860470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:50.877445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:50.878296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:50.892717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:50.897030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:50.901171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:50.904547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:51.714102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:51.736626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:51.744208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:51.748052 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-441c6a67-4343-45f8-b31c-5d80d2625529 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1803 microversion: 2.32 time: 0.892856 Oct 03 14:48:51.749431 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1928/3785] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:50 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1803 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:51.773410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:51.774504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:51.799551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:51.800128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:51.805387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:51.806337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:51.806902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:51.807431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:51.860311 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] HTTP exception thrown: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Request method failure captured: Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 HTTP/1.1 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvVYwHG3jEAWNjYWxQIzr-C10dCeZSkfGZvISKCAtVgQgJhi2vXYWcilDlgTxgqX2VK-3XgKuI1HC_lu4JlJCQfM7HlMncWc_Q_ga6oOWEXJ3nTPB3HtgJvPb0NUJn2_GH9Gz3GIA4UKQYD2GlyGCjWx8QpKMuIDSz1Rz4RMM-9b1ag Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c20da25d14b5454592756373984b0b59 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20da25d14b5454592756373984b0b59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20da25d14b5454592756373984b0b59", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20da25d14b5454592756373984b0b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20da25d14b5454592756373984b0b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c20da25d14b5454592756373984b0b59 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachSCSIVolumeTestJSON-2062796041-project Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: b310d519aab7472abec9c2e76d501f06 Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2062796041-project Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '63c94af6-b9e0-4f15-907a-60f0d062a325'} Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:48:51.867733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:51.873406 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:51.901273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Returning 404 to user: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:51.902574 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c806fc7-7d09-43d5-bd73-d83fef0e714e tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 404 len: 111 microversion: 2.1 time: 0.151887 Oct 03 14:48:51.904026 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1929/3786] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:48:51 2022] DELETE /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:48:51.916507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:51.917790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] [instance: 63c94af6-b9e0-4f15-907a-60f0d062a325] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:51.971791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:51.979774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:51.980856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:51.981950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:51.982716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:51.983420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:52.049548 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] HTTP exception thrown: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Request method failure captured: Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 HTTP/1.1 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvVYwHG3jEAWNjYWxQIzr-C10dCeZSkfGZvISKCAtVgQgJhi2vXYWcilDlgTxgqX2VK-3XgKuI1HC_lu4JlJCQfM7HlMncWc_Q_ga6oOWEXJ3nTPB3HtgJvPb0NUJn2_GH9Gz3GIA4UKQYD2GlyGCjWx8QpKMuIDSz1Rz4RMM-9b1ag Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c20da25d14b5454592756373984b0b59 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20da25d14b5454592756373984b0b59"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20da25d14b5454592756373984b0b59", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20da25d14b5454592756373984b0b59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20da25d14b5454592756373984b0b59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c20da25d14b5454592756373984b0b59 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2062796041 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachSCSIVolumeTestJSON-2062796041-project Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: b310d519aab7472abec9c2e76d501f06 Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2062796041-project Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '63c94af6-b9e0-4f15-907a-60f0d062a325'} Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:48:52.055632 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:52.061940 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:48:52.061940 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:48:52.061940 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:48:52.061940 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:48:52.061940 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:48:52.061940 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. Oct 03 14:48:52.061940 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:48:52.065917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] Returning 404 to user: Instance 63c94af6-b9e0-4f15-907a-60f0d062a325 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:48:52.070328 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6bb305a8-ab71-4643-a5fd-7899ef9a224d tempest-AttachSCSIVolumeTestJSON-2062796041 tempest-AttachSCSIVolumeTestJSON-2062796041-project] 10.222.0.20 "GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325" status: 404 len: 111 microversion: 2.1 time: 0.161931 Oct 03 14:48:52.082714 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1930/3787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:51 2022] GET /compute/v2.1/servers/63c94af6-b9e0-4f15-907a-60f0d062a325 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:48:52.509951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:48:52.510441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:48:52.510827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:48:52.519722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:48:52.520427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:48:52.533973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:52.565169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:52.568037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:52.571088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:52.573999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:52.577819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:52.579435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:52.681776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Getting quotas for project 59c05dc202214244af424eddbccfb669. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:48:52.704792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Getting quotas for user 49662fc3f33c425baace58ea7f3e79aa and project 59c05dc202214244af424eddbccfb669. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:48:52.741586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:48:52.745334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:48:52.776839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:52.778493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:52.790723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:52.797694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:52.798648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:52.801441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:52.804057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:52.808059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:52.809939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:52.902137 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72ce5d29-69da-41f1-a218-d7f429fec4d7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.170295 Oct 03 14:48:52.917791 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1858/3788] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:48:52.942518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57517df9-0db9-4f90-8454-326cb22ee004 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:52.944721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-57517df9-0db9-4f90-8454-326cb22ee004 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:53.190801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57517df9-0db9-4f90-8454-326cb22ee004 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:53.212156 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-57517df9-0db9-4f90-8454-326cb22ee004 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1217 microversion: 2.1 time: 0.283701 Oct 03 14:48:53.216678 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1859/3789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:52 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1217 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:53.443067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34a084d0-323e-45f4-8e3d-01199c93a2f2 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Action: 'create', calling method: .version_select at 0x7fb2300e9670>, body: {"pool": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:53.446295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:53.456266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:53.457754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:53.458979 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-493481b5-57b5-4b77-a8b2-2b0495ef4692 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1803 microversion: 2.32 time: 0.686111 Oct 03 14:48:53.473574 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1931/3790] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:52 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1803 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:48:54.246872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:54.249892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:54.275604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:54.280070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:54.281887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:54.300281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:54.307166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:54.309907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:54.574600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:54.588283 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6147dcb8-6bb2-4fd3-97fe-4d6da12e25a9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1269 microversion: 2.1 time: 0.352585 Oct 03 14:48:54.588908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1932/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:54 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1269 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:48:54.627227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:54.627857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:54.654944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:54.655452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:54.655902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:54.656627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:54.661243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:54.663734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:55.751685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:55.773370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:55.778137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:55.779642 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-184bbe94-7202-4b8f-836a-5dd4784b2bf3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1850 microversion: 2.32 time: 1.168595 Oct 03 14:48:55.785397 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1933/3792] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:54 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1850 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:55.796127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:55.797138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:55.816965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:55.817667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:55.824218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:55.826357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:55.828391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:55.829134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:56.511647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:56.526386 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b962c273-dd57-4275-8c6d-fdb140919b19 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1275 microversion: 2.1 time: 0.738858 Oct 03 14:48:56.541585 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1934/3793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:55 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1275 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:56.814348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:56.815158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:56.848281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:56.856371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:56.861696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:56.865703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:56.866408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:56.873601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:57.853572 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34a084d0-323e-45f4-8e3d-01199c93a2f2 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.524932 Oct 03 14:48:57.855134 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1860/3794] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:48:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:57.860634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:57.861611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:57.895632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:57.903521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:57.904498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:57.910432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:57.912506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:57.913199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:58.363234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:58.382643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:58.384122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:58.385356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ed64abbb-8bdf-4df2-a234-e34e9cb68edf tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1850 microversion: 2.32 time: 1.576059 Oct 03 14:48:58.393321 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1935/3795] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:56 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1850 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:48:58.409001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bd9143c-e133-49c3-a8f4-a2d2ea25724f tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Action: 'create', calling method: .version_select at 0x7fb22bcd5670>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:58.722460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:48:58.740726 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b6a15a52-006f-417e-8056-b0a7dc2bb31c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1275 microversion: 2.1 time: 0.876723 Oct 03 14:48:58.746982 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1861/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:48:57 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1275 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:48:59.170834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-87ef4b3d-35de-4123-b604-6b6fbb258c68 req-23869ee5-6fa4-4231-bf9a-bba7008e326a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "e14485b9-4cd9-42c0-9cf6-f51ba0ee151c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:48:59.206360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-87ef4b3d-35de-4123-b604-6b6fbb258c68 req-23869ee5-6fa4-4231-bf9a-bba7008e326a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:59.209057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-87ef4b3d-35de-4123-b604-6b6fbb258c68 req-23869ee5-6fa4-4231-bf9a-bba7008e326a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:59.211039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-87ef4b3d-35de-4123-b604-6b6fbb258c68 req-23869ee5-6fa4-4231-bf9a-bba7008e326a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:59.271251 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-87ef4b3d-35de-4123-b604-6b6fbb258c68 req-23869ee5-6fa4-4231-bf9a-bba7008e326a service nova] Creating event network-changed:e14485b9-4cd9-42c0-9cf6-f51ba0ee151c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:48:59.287541 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-87ef4b3d-35de-4123-b604-6b6fbb258c68 req-23869ee5-6fa4-4231-bf9a-bba7008e326a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122381 Oct 03 14:48:59.288161 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1862/3797] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:48:59.427378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:48:59.428110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:48:59.445910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:59.446407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:59.446845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:59.447558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:48:59.448010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:48:59.448429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:48:59.493173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:00.337302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:00.346635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:00.358909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:00.360146 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e4612550-d560-4a58-896b-8d0df7950510 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1850 microversion: 2.32 time: 0.937657 Oct 03 14:49:00.373416 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1863/3798] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:48:59 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1850 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:00.391972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:00.392593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:00.413701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:00.419285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:00.419848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:00.420629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:00.421133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:00.421558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:00.571738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:00.580230 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-815d749b-acd2-4d9a-ac61-641f949d3514 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1275 microversion: 2.1 time: 0.205552 Oct 03 14:49:00.581504 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1864/3799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:00 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:01.398437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:01.399154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:01.419540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:01.421768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:01.422393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:01.426367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:01.428203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:01.429576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:01.910265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:01.929144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:01.931921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:01.933995 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4ff75c3-d7a7-4272-9544-af694209b230 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1871 microversion: 2.32 time: 0.539994 Oct 03 14:49:01.935431 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1865/3800] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:01 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1871 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:01.944853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:01.945861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:01.955407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:01.956302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:01.957195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:01.958924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:01.959913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:01.960872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:02.273250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:02.292093 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6e254e60-0d21-4301-8e20-83b11f9a1a0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.354881 Oct 03 14:49:02.293503 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1866/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:01 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:02.319636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3ed73bb5-0ccc-4192-b86d-80c0918941e4 req-0414388d-8412-4fef-bb35-e8dd0e45f748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "6a23350a-a333-440d-a327-a676c7ec15bc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:02.338720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3ed73bb5-0ccc-4192-b86d-80c0918941e4 req-0414388d-8412-4fef-bb35-e8dd0e45f748 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:02.340447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3ed73bb5-0ccc-4192-b86d-80c0918941e4 req-0414388d-8412-4fef-bb35-e8dd0e45f748 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:02.341094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3ed73bb5-0ccc-4192-b86d-80c0918941e4 req-0414388d-8412-4fef-bb35-e8dd0e45f748 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:02.358757 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3ed73bb5-0ccc-4192-b86d-80c0918941e4 req-0414388d-8412-4fef-bb35-e8dd0e45f748 service nova] Creating event network-changed:6a23350a-a333-440d-a327-a676c7ec15bc for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:49:02.364918 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3ed73bb5-0ccc-4192-b86d-80c0918941e4 req-0414388d-8412-4fef-bb35-e8dd0e45f748 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050198 Oct 03 14:49:02.367712 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1867/3802] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:02.964092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:02.968499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:02.969270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:02.990505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:02.991400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:02.992025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:02.992994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:02.993620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:02.994217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:03.196283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:03.542056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:03.558181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:03.563933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:03.566885 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2333dc6-1f83-44e8-9581-05107acc97ea tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1871 microversion: 2.32 time: 0.603533 Oct 03 14:49:03.581016 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1868/3803] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:02 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1871 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:03.581362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:03.583724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:03.598684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:03.600865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:03.607332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:03.609425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:03.610968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:03.613842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:04.050501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:04.072383 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4f61f5b-5be5-4d78-b581-7dbbc5315032 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.501001 Oct 03 14:49:04.086909 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1869/3804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:03 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:04.598488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:04.599688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:04.616644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:04.621265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:04.622542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:04.626218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:04.627113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:04.629346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:05.189396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:05.209621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:05.211434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:05.215626 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-10529efb-b09c-414d-bcd1-11dc1a319fc8 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1892 microversion: 2.32 time: 0.620824 Oct 03 14:49:05.218321 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1870/3805] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:04 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1892 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:05.232511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:05.235601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:05.250197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:05.250707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:05.252372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:05.255464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:05.256472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:05.257947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:05.312743 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bd9143c-e133-49c3-a8f4-a2d2ea25724f tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.914189 Oct 03 14:49:05.313244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1936/3806] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:48:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:05.327416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b37c0e9-0ef3-4703-aa5d-6a636b8c002c tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Action: 'create', calling method: .version_select at 0x7fb22bce9280>, body: {"pool": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:06.000115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:06.018063 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ee445396-a937-4f7c-a1a7-7d92244da270 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.793187 Oct 03 14:49:06.019297 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1871/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:05 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:06.041252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-aca524ce-8953-4e91-8ac7-bba1b031d43c req-4e8a236d-cea6-4c9b-80e7-db8bf5ae8739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c71dba2-a318-4f5e-a8aa-976b28f82201", "tag": "0b54336c-fddb-43e0-8a6c-2d4f3bf3c51a"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:06.060175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aca524ce-8953-4e91-8ac7-bba1b031d43c req-4e8a236d-cea6-4c9b-80e7-db8bf5ae8739 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:06.061400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aca524ce-8953-4e91-8ac7-bba1b031d43c req-4e8a236d-cea6-4c9b-80e7-db8bf5ae8739 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:06.062226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aca524ce-8953-4e91-8ac7-bba1b031d43c req-4e8a236d-cea6-4c9b-80e7-db8bf5ae8739 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:06.080183 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-aca524ce-8953-4e91-8ac7-bba1b031d43c req-4e8a236d-cea6-4c9b-80e7-db8bf5ae8739 service nova] Creating event network-changed:0b54336c-fddb-43e0-8a6c-2d4f3bf3c51a for instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 on n-h2-781139-2 Oct 03 14:49:06.093782 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-aca524ce-8953-4e91-8ac7-bba1b031d43c req-4e8a236d-cea6-4c9b-80e7-db8bf5ae8739 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072990 Oct 03 14:49:06.096046 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1872/3808] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:06.248309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:06.249324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:06.273673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:06.274309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:06.274936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:06.276842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:06.277992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:06.279459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:06.705130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:06.725045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:06.730798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:06.734046 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17aa996c-5490-4037-b37a-23d364b6d63f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1892 microversion: 2.32 time: 0.489905 Oct 03 14:49:06.735476 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1873/3809] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:06 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1892 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:06.848754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=9 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:07.055713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:07.059825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:07.078468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:07.079837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:07.082586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:07.085671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:07.086253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:07.087778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:07.723480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:07.735918 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5237613-76fb-45f1-84e7-f34d79fb5f16 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.689844 Oct 03 14:49:07.736444 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1874/3810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:07 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:07.769043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:07.770374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:07.784416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:07.785353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:07.786068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:07.787055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:07.787699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:07.788306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:08.217289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:08.228024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:08.231080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:08.234271 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5eb90394-b805-4b8d-944a-4b7be932b860 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1892 microversion: 2.32 time: 0.470061 Oct 03 14:49:08.265098 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1875/3811] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:07 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1892 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:08.280959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-69d83b00-4bc7-4036-89da-7f7078750ebd req-d76bd7b0-5e8a-4f32-ad15-bb862fb4e686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "9b2f5bc3-8e81-4563-ba3f-7402fc93aae2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:08.290962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-69d83b00-4bc7-4036-89da-7f7078750ebd req-d76bd7b0-5e8a-4f32-ad15-bb862fb4e686 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:08.291724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-69d83b00-4bc7-4036-89da-7f7078750ebd req-d76bd7b0-5e8a-4f32-ad15-bb862fb4e686 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:08.292326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-69d83b00-4bc7-4036-89da-7f7078750ebd req-d76bd7b0-5e8a-4f32-ad15-bb862fb4e686 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:08.313236 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-69d83b00-4bc7-4036-89da-7f7078750ebd req-d76bd7b0-5e8a-4f32-ad15-bb862fb4e686 service nova] Creating event network-changed:9b2f5bc3-8e81-4563-ba3f-7402fc93aae2 for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:49:08.327616 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-69d83b00-4bc7-4036-89da-7f7078750ebd req-d76bd7b0-5e8a-4f32-ad15-bb862fb4e686 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050983 Oct 03 14:49:08.328252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1876/3812] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:08.378513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=74 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:08.765440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:08.766576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:08.778674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:08.782997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:08.783577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:08.784458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:08.786135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:08.786768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:09.690446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:09.701713 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-054f322c-c000-466f-8ca5-8b66212f8979 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.941663 Oct 03 14:49:09.702322 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1877/3813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:08 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:09.730254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:09.735903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:09.755109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:09.755913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:09.756565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:09.758615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:09.759262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:09.759879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:10.084786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:10.111873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:10.121282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:10.123376 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83f0ee42-4944-463a-902b-ba457037d6ed tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1892 microversion: 2.32 time: 0.396768 Oct 03 14:49:10.127203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1878/3814] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:09 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1892 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:10.724828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:10.725840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:10.737364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:10.737858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:10.738292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:10.741215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:10.744289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:10.747031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:11.060428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:11.072597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90226f38-1d95-4188-9f26-4291d6f467fa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.351741 Oct 03 14:49:11.074170 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1879/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:10 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:11.156416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:11.157121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:11.189094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:11.191477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:11.193555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:11.196434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:11.197162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:11.200086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:11.474415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:11.487333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:11.489949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:11.491734 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d407fa1b-888a-49c5-9c91-92de453c576a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.341750 Oct 03 14:49:11.497743 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1880/3816] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:11 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:12.018308 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b37c0e9-0ef3-4703-aa5d-6a636b8c002c tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.695080 Oct 03 14:49:12.019505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1937/3817] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:49:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:12.037240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5094f60c-56a7-47ae-98e9-f10323245634 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Action: 'create', calling method: .version_select at 0x7fb2300a2c10>, body: {"pool": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:12.100685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:12.102221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:12.109242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:12.110018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:12.110902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:12.111836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:12.112488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:12.113164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:12.620905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:12.631301 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48fd1b02-f3cb-4b94-b797-9f443cd0b357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.534843 Oct 03 14:49:12.632522 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1938/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:12 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:12.638759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6f7b0403-43aa-43ea-b64f-fcd40f1cdefb req-02b4d430-881a-4266-80f4-57cee0a5baa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "cba80c5c-277c-4207-a6d7-6870affdac4f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:12.651813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6f7b0403-43aa-43ea-b64f-fcd40f1cdefb req-02b4d430-881a-4266-80f4-57cee0a5baa1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:12.653163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6f7b0403-43aa-43ea-b64f-fcd40f1cdefb req-02b4d430-881a-4266-80f4-57cee0a5baa1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:12.654140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6f7b0403-43aa-43ea-b64f-fcd40f1cdefb req-02b4d430-881a-4266-80f4-57cee0a5baa1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:12.667138 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6f7b0403-43aa-43ea-b64f-fcd40f1cdefb req-02b4d430-881a-4266-80f4-57cee0a5baa1 service nova] Creating event network-changed:cba80c5c-277c-4207-a6d7-6870affdac4f for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:49:12.673204 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6f7b0403-43aa-43ea-b64f-fcd40f1cdefb req-02b4d430-881a-4266-80f4-57cee0a5baa1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038760 Oct 03 14:49:12.673856 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1939/3819] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:12.679669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:12.680730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:12.688380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:12.688875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:12.689360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:12.690118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:12.690636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:12.691056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:13.122516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:13.135842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:13.137298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:13.138822 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31f3910f-c8a5-4dfe-8d97-462e53efcf6c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.463684 Oct 03 14:49:13.139575 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1940/3820] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:12 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:13.336738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-278d15eb-0beb-403f-903f-630c753edebe req-02da62cc-31ca-4bd4-a667-002b3e103c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c71dba2-a318-4f5e-a8aa-976b28f82201", "name": "network-vif-plugged", "status": "completed", "tag": "0b54336c-fddb-43e0-8a6c-2d4f3bf3c51a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:13.347638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-278d15eb-0beb-403f-903f-630c753edebe req-02da62cc-31ca-4bd4-a667-002b3e103c94 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:13.348449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-278d15eb-0beb-403f-903f-630c753edebe req-02da62cc-31ca-4bd4-a667-002b3e103c94 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:13.349202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-278d15eb-0beb-403f-903f-630c753edebe req-02da62cc-31ca-4bd4-a667-002b3e103c94 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:13.361968 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-278d15eb-0beb-403f-903f-630c753edebe req-02da62cc-31ca-4bd4-a667-002b3e103c94 service nova] Creating event network-vif-plugged:0b54336c-fddb-43e0-8a6c-2d4f3bf3c51a for instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 on n-h2-781139-2 Oct 03 14:49:13.367966 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-278d15eb-0beb-403f-903f-630c753edebe req-02da62cc-31ca-4bd4-a667-002b3e103c94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040309 Oct 03 14:49:13.369303 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1941/3821] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:13.668644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:13.670948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:13.689157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:13.692142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:13.692830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:13.694713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:13.695178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:13.696106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:14.425667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:14.461826 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a4abd73-cffc-4fa2-973a-aefb34c7cd30 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1317 microversion: 2.1 time: 0.802534 Oct 03 14:49:14.462768 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1942/3822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:13 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:14.497821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:14.498865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:14.509848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:14.511455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:14.512074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:14.512913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:14.513536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:14.514316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:14.944895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:14.979053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:14.983173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:14.985159 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b75ff40-5a16-405e-9702-55cd2347c95f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.521196 Oct 03 14:49:14.987669 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1943/3823] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:14 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:14.994444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-de94f3e3-7953-417c-84ec-50c3b0cac42d req-e07cadae-9b57-4adc-bbf9-8d9d2a8d038f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "3ba87e27-28db-4125-80ed-aaec86bd861c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:15.008955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-de94f3e3-7953-417c-84ec-50c3b0cac42d req-e07cadae-9b57-4adc-bbf9-8d9d2a8d038f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:15.009576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-de94f3e3-7953-417c-84ec-50c3b0cac42d req-e07cadae-9b57-4adc-bbf9-8d9d2a8d038f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:15.010129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-de94f3e3-7953-417c-84ec-50c3b0cac42d req-e07cadae-9b57-4adc-bbf9-8d9d2a8d038f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:15.023230 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-de94f3e3-7953-417c-84ec-50c3b0cac42d req-e07cadae-9b57-4adc-bbf9-8d9d2a8d038f service nova] Creating event network-changed:3ba87e27-28db-4125-80ed-aaec86bd861c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:49:15.028870 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-de94f3e3-7953-417c-84ec-50c3b0cac42d req-e07cadae-9b57-4adc-bbf9-8d9d2a8d038f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039773 Oct 03 14:49:15.029792 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1944/3824] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:15.487415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:15.488108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:15.497313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:15.498114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:15.498558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:15.499257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:15.500067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:15.500489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:15.839031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:15.848006 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b818b95-422b-4689-ad0b-d1bd6551aabc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1506 microversion: 2.1 time: 0.365588 Oct 03 14:49:15.865276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1945/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:15 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:15.871878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:15.872735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:15.879934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:15.880887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:15.881591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:15.882543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:15.883276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:15.883928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:15.911583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:49:15.940657 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5094f60c-56a7-47ae-98e9-f10323245634 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.910396 Oct 03 14:49:15.941212 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1881/3826] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:49:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:49:15.953958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c757de84-b951-4cc0-b4ca-2c1b7017e4b4 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Calling method '.version_select at 0x7fb2300d4820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:16.044835 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad1e70b1-5db6-4b73-96a4-c1809eea38cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 204 len: 0 microversion: 2.1 time: 0.172216 Oct 03 14:49:16.050217 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1946/3827] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:49:15 2022] DELETE /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:49:16.067541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:16.069860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:16.081268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:16.081767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:16.082774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:16.083795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:16.084772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:16.085231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:16.380384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c757de84-b951-4cc0-b4ca-2c1b7017e4b4 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/c4380fc6-2492-49c1-a797-479c2796b6e9" status: 200 len: 142 microversion: 2.1 time: 0.429338 Oct 03 14:49:16.382516 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1882/3828] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 3 14:49:15 2022] GET /compute/v2.1/os-floating-ips/c4380fc6-2492-49c1-a797-479c2796b6e9 => generated 142 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:16.394428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:16.395392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:16.402887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:16.403384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:16.403850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:16.404559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:16.405044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:16.405468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:16.459714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:16.487273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:16.488894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:16.490112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9888d0af-8764-4903-b259-f0a4a187f26c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.437947 Oct 03 14:49:16.512742 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1947/3829] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:16 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:16.512742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d149399f-81fc-4a23-91f7-25d5b3fad109 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Calling method '.version_select at 0x7fb234be9550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:16.758552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:16.768234 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5813a05b-1b6e-4b20-aafa-d5ea718ed939 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1512 microversion: 2.1 time: 0.381017 Oct 03 14:49:16.768973 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1883/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:16 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:17.059183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-8884f4ce-3b8a-4820-8846-42510029c9a4 req-8a393a5a-fd9c-42d5-88b0-e77dda69ed6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "a8a8304b-3890-4398-adc1-3a98e17e1e35"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:17.073451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8884f4ce-3b8a-4820-8846-42510029c9a4 req-8a393a5a-fd9c-42d5-88b0-e77dda69ed6c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:17.074645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8884f4ce-3b8a-4820-8846-42510029c9a4 req-8a393a5a-fd9c-42d5-88b0-e77dda69ed6c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:17.076083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8884f4ce-3b8a-4820-8846-42510029c9a4 req-8a393a5a-fd9c-42d5-88b0-e77dda69ed6c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:17.085411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:17.097429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-8884f4ce-3b8a-4820-8846-42510029c9a4 req-8a393a5a-fd9c-42d5-88b0-e77dda69ed6c service nova] Creating event network-changed:a8a8304b-3890-4398-adc1-3a98e17e1e35 for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:49:17.104209 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-8884f4ce-3b8a-4820-8846-42510029c9a4 req-8a393a5a-fd9c-42d5-88b0-e77dda69ed6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049437 Oct 03 14:49:17.105458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1884/3831] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:17.524395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:17.525168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:17.537925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:17.538592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:17.539091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:17.540136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:17.540762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:17.541546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:17.916865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:17.948745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:17.956601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:17.956601 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f3d5903-cc9f-4f3c-85b3-6cf41c769dc1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.439200 Oct 03 14:49:17.959041 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1885/3832] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:17 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:17.966727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:17.967592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:17.974677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:17.975163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:17.975594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:17.976426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:17.976995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:17.977321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:18.173495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:18.184478 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00b10efa-2bde-44d4-bb19-79036bf625f4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1512 microversion: 2.1 time: 0.223264 Oct 03 14:49:18.185092 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1886/3833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:17 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:18.998033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:19.000863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:19.025816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:19.030471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:19.031893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:19.033130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:19.034149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:19.034919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:19.371344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d149399f-81fc-4a23-91f7-25d5b3fad109 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/c4380fc6-2492-49c1-a797-479c2796b6e9" status: 202 len: 0 microversion: 2.1 time: 2.878824 Oct 03 14:49:19.378029 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1948/3834] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:49:16 2022] DELETE /compute/v2.1/os-floating-ips/c4380fc6-2492-49c1-a797-479c2796b6e9 => generated 0 bytes in 2886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:49:19.383828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:19.385139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:19.394434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:19.395295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:19.396482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:19.398169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:19.399543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:19.400286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:19.458221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:19.459134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:19.459860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:19.460547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lazy-loading 'fault' on Instance uuid 6c71dba2-a318-4f5e-a8aa-976b28f82201 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:49:19.599780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:19.612945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:19.614608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:19.617384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-921097f0-17b5-4ee9-83f9-478e4dce552e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.633157 Oct 03 14:49:19.620698 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1887/3835] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:18 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:19.631408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5fd83828-5663-4691-ab49-33973b192ee7 req-fce91d5a-c3c2-4a52-8325-4de4739ba8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c71dba2-a318-4f5e-a8aa-976b28f82201", "name": "network-vif-deleted", "tag": "0b54336c-fddb-43e0-8a6c-2d4f3bf3c51a"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:19.649718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:19.663596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5fd83828-5663-4691-ab49-33973b192ee7 req-fce91d5a-c3c2-4a52-8325-4de4739ba8c8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:19.664300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5fd83828-5663-4691-ab49-33973b192ee7 req-fce91d5a-c3c2-4a52-8325-4de4739ba8c8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:19.666187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5fd83828-5663-4691-ab49-33973b192ee7 req-fce91d5a-c3c2-4a52-8325-4de4739ba8c8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:19.669757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfce92b0-fa7c-463e-a7b2-0e267437c140 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 200 len: 1307 microversion: 2.1 time: 0.286219 Oct 03 14:49:19.674432 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1949/3836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:19 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:19.681920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d38c928d-632a-4f75-9706-9c2ae5f67511 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Calling method '.version_select at 0x7fb22bd6e1f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:19.711884 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5fd83828-5663-4691-ab49-33973b192ee7 req-fce91d5a-c3c2-4a52-8325-4de4739ba8c8 service nova] Creating event network-vif-deleted:0b54336c-fddb-43e0-8a6c-2d4f3bf3c51a for instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 on n-h2-781139-2 Oct 03 14:49:19.727380 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5fd83828-5663-4691-ab49-33973b192ee7 req-fce91d5a-c3c2-4a52-8325-4de4739ba8c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101382 Oct 03 14:49:19.741337 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1888/3837] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:19.941266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ba0b5ec-aae7-4c96-8ccc-4adc7d8ecfda tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1708993871", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:19.945452 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9ba0b5ec-aae7-4c96-8ccc-4adc7d8ecfda tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] HTTP exception thrown: min_count must be <= max_count Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ba0b5ec-aae7-4c96-8ccc-4adc7d8ecfda tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Request method failure captured: Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 184 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvZvf12l56XawmJdWn_ZcN-CgggyXVRs-4G9yUCcFQ00aHIO3r0vn43g_Vayfc7rTMqYkiEWLB3sN4ZTqCqJASJcsMROZhapbsLhXFC5XmGByZFHQvrV3k7e02avnxmK7mmLEIvJlc-C_XzK6hZMCRZzjTUKZM5AZBgGSb-nogbv_-o Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f88c1dcbafc4f84b7faba570355b11a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9246d2a8c2ac45179dd5e9309cf06171 Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1708993871", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: exception: min_count must be <= max_count Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1708993871', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 03 14:49:19.947037 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:19.954424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ba0b5ec-aae7-4c96-8ccc-4adc7d8ecfda tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Returning 400 to user: min_count must be <= max_count {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:19.954424 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ba0b5ec-aae7-4c96-8ccc-4adc7d8ecfda tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.204013 Oct 03 14:49:19.963165 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1889/3838] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:19 2022] POST /compute/v2.1/servers => generated 74 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:49:20.068878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9ea302c-da30-4d00-a20b-b0bddb01dcfa tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1113140909", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "max_count": 0}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9ea302c-da30-4d00-a20b-b0bddb01dcfa tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Request method failure captured: Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 168 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvZvf12l56XawmJdWn_ZcN-CgggyXVRs-4G9yUCcFQ00aHIO3r0vn43g_Vayfc7rTMqYkiEWLB3sN4ZTqCqJASJcsMROZhapbsLhXFC5XmGByZFHQvrV3k7e02avnxmK7mmLEIvJlc-C_XzK6hZMCRZzjTUKZM5AZBgGSb-nogbv_-o Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f88c1dcbafc4f84b7faba570355b11a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9246d2a8c2ac45179dd5e9309cf06171 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1113140909", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "max_count": 0}} Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1113140909', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'max_count': 0}}} Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 0 Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:20.074131 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 03 14:49:20.079264 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.083877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9ea302c-da30-4d00-a20b-b0bddb01dcfa tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:20.088289 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9ea302c-da30-4d00-a20b-b0bddb01dcfa tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024144 Oct 03 14:49:20.089408 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1890/3839] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:20 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:49:20.162783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a7823830-397f-4c63-b52e-0e3a5109102c tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-517146294", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "max_count": 2.5}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a7823830-397f-4c63-b52e-0e3a5109102c tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Request method failure captured: Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 169 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvZvf12l56XawmJdWn_ZcN-CgggyXVRs-4G9yUCcFQ00aHIO3r0vn43g_Vayfc7rTMqYkiEWLB3sN4ZTqCqJASJcsMROZhapbsLhXFC5XmGByZFHQvrV3k7e02avnxmK7mmLEIvJlc-C_XzK6hZMCRZzjTUKZM5AZBgGSb-nogbv_-o Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f88c1dcbafc4f84b7faba570355b11a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9246d2a8c2ac45179dd5e9309cf06171 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-517146294", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "max_count": 2.5}} Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-517146294', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'max_count': 2.5}}} Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 2.5 Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:20.169485 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.183229 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.188023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a7823830-397f-4c63-b52e-0e3a5109102c tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:20.189203 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a7823830-397f-4c63-b52e-0e3a5109102c tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.031761 Oct 03 14:49:20.200377 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1891/3840] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:20.265591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2e1e2c6-136c-425e-8101-599030b71d35 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1107810102", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 0}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2e1e2c6-136c-425e-8101-599030b71d35 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Request method failure captured: Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 168 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvZvf12l56XawmJdWn_ZcN-CgggyXVRs-4G9yUCcFQ00aHIO3r0vn43g_Vayfc7rTMqYkiEWLB3sN4ZTqCqJASJcsMROZhapbsLhXFC5XmGByZFHQvrV3k7e02avnxmK7mmLEIvJlc-C_XzK6hZMCRZzjTUKZM5AZBgGSb-nogbv_-o Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f88c1dcbafc4f84b7faba570355b11a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9246d2a8c2ac45179dd5e9309cf06171 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1107810102", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 0}} Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1107810102', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'min_count': 0}}} Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 0 Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:20.271055 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2e1e2c6-136c-425e-8101-599030b71d35 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2e1e2c6-136c-425e-8101-599030b71d35 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016166 Oct 03 14:49:20.286022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1892/3841] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:20 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:20.395006 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d38c928d-632a-4f75-9706-9c2ae5f67511 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.718705 Oct 03 14:49:20.395819 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1950/3842] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 3 14:49:19 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:49:20.420826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f222690-87fc-4aac-9ea4-6493290158bf tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Calling method '.version_select at 0x7fb2300d4820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:20.663102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:20.665275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:20.688235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:20.690590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:20.691612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:20.694084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:20.695761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:20.697418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:20.836989 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f222690-87fc-4aac-9ea4-6493290158bf tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.424340 Oct 03 14:49:20.837871 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1893/3843] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:49:20 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:20.843425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb625880-4de0-4989-8483-858f8d980df1 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1319828033", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 2.5}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb625880-4de0-4989-8483-858f8d980df1 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Request method failure captured: Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 170 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvZvf12l56XawmJdWn_ZcN-CgggyXVRs-4G9yUCcFQ00aHIO3r0vn43g_Vayfc7rTMqYkiEWLB3sN4ZTqCqJASJcsMROZhapbsLhXFC5XmGByZFHQvrV3k7e02avnxmK7mmLEIvJlc-C_XzK6hZMCRZzjTUKZM5AZBgGSb-nogbv_-o Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f88c1dcbafc4f84b7faba570355b11a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f88c1dcbafc4f84b7faba570355b11a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7f88c1dcbafc4f84b7faba570355b11a Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-943223430 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 9246d2a8c2ac45179dd5e9309cf06171 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-943223430-project Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1319828033", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 2.5}} Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1319828033', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'min_count': 2.5}}} Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 2.5 Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:20.848141 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 03 14:49:20.852840 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.854910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb625880-4de0-4989-8483-858f8d980df1 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:20.855924 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb625880-4de0-4989-8483-858f8d980df1 tempest-MultipleCreateNegativeTestJSON-943223430 tempest-MultipleCreateNegativeTestJSON-943223430-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016865 Oct 03 14:49:20.856677 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1894/3844] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:20.866049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:20.867254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:20.878545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:20.879378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:20.880117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:20.882427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:20.883112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:20.883604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:20.903712 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 HTTP/1.1 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6c71dba2-a318-4f5e-a8aa-976b28f82201'} Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:20.905305 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:20.911057 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4cde53e4-4889-44c9-bd9b-30f41e3dca32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 404 len: 111 microversion: 2.1 time: 0.044594 Oct 03 14:49:20.911957 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1895/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:20 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:49:20.917315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ba8d6c2-01d5-47d8-a345-3fdb92b154c0 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Calling method '.version_select at 0x7fb23009e8b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:21.166516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:21.207540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:21.209828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:21.211533 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be6476cf-4cc1-4d87-b5c7-1594c9fe050b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.559247 Oct 03 14:49:21.212790 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1951/3846] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:20 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:21.219654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:21.220839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:21.228426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:21.229011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:21.229665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:21.230363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:21.231069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:21.231866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:21.520442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:21.532352 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-557f5987-8945-42b2-be1b-63546f2a28cf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.317814 Oct 03 14:49:21.539741 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1952/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:21 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:21.664919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:21.677823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:21.680368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Searching by: {'deleted': False, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:49:21.697619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:21.698201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:21.698711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:21.699511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:21.700084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:21.700665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:21.731867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:49:21.791947 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cea5acfb-518f-48cf-ba6e-02798ffc0d12 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.133294 Oct 03 14:49:21.793951 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1953/3848] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:49:21 2022] GET /compute/v2.1/servers => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:49:21.809009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ac3fdce1-aba3-42ce-95c8-fdd44551d4d4 req-287f8877-1dcc-4abd-a718-206ff9285590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "79e408f7-cad2-401d-8e68-4887a9dd2e6b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:21.830650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ac3fdce1-aba3-42ce-95c8-fdd44551d4d4 req-287f8877-1dcc-4abd-a718-206ff9285590 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:21.831249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ac3fdce1-aba3-42ce-95c8-fdd44551d4d4 req-287f8877-1dcc-4abd-a718-206ff9285590 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:21.831765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ac3fdce1-aba3-42ce-95c8-fdd44551d4d4 req-287f8877-1dcc-4abd-a718-206ff9285590 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:21.849254 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ac3fdce1-aba3-42ce-95c8-fdd44551d4d4 req-287f8877-1dcc-4abd-a718-206ff9285590 service nova] Creating event network-changed:79e408f7-cad2-401d-8e68-4887a9dd2e6b for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:49:21.857559 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ac3fdce1-aba3-42ce-95c8-fdd44551d4d4 req-287f8877-1dcc-4abd-a718-206ff9285590 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061305 Oct 03 14:49:21.858848 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1954/3849] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:21.870212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-605c3863-3054-4663-b023-be690eb2c663 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-605c3863-3054-4663-b023-be690eb2c663 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 163 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": 12345, "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 12345 Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:21.874601 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-605c3863-3054-4663-b023-be690eb2c663 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-605c3863-3054-4663-b023-be690eb2c663 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015654 Oct 03 14:49:21.888271 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1955/3850] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:21 2022] POST /compute/v2.1/servers => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:21.900961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:21.900961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:21.902536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Searching by: {'deleted': False, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:49:21.920855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:21.927336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:21.928299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:21.929888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:21.931606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:21.933198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:22.004346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:49:22.075460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:22.091215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:22.091850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:22.093377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:22.254749 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ba8d6c2-01d5-47d8-a345-3fdb92b154c0 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/abdb708e-48b8-48c0-bacd-17c3d3464d51" status: 202 len: 0 microversion: 2.1 time: 1.341033 Oct 03 14:49:22.255611 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1896/3851] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:49:20 2022] DELETE /compute/v2.1/os-floating-ips/abdb708e-48b8-48c0-bacd-17c3d3464d51 => generated 0 bytes in 1343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:49:22.264299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:22.265319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:22.276316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:22.277017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:22.277845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:22.278777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:22.279229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:22.279844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:22.463260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:22.464961 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02d4abd9-ec00-4aa9-895d-d1755d7f1f34 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.580262 Oct 03 14:49:22.466314 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1956/3852] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:49:21 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:22.483502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:22.484688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:22.499630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:22.502934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:22.503435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:22.504254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:22.504725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:22.505524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:22.524888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:22.535557 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ddf736f-0fcf-40d7-b266-26048850be1c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.278267 Oct 03 14:49:22.536311 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1897/3853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:22 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:22.556182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b8e0166-b540-44e4-86d1-fc2e5b693c4b tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Calling method '.version_select at 0x7fb230148310>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:22.961756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:22.973694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:22.975420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:22.977384 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa7aead5-c9f4-4d67-ab00-6fcd51a1d131 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.509348 Oct 03 14:49:22.978217 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1957/3854] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:22 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:22.983514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be0ee378-5742-40f5-b2e7-5c9f8bbb9889 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:22.994495 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be0ee378-5742-40f5-b2e7-5c9f8bbb9889 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014882 Oct 03 14:49:22.995767 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1958/3855] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:49:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:49:23.001086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:23.001956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:23.022936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:23.024757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:23.025246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:23.026090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:23.026557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:23.032038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:23.388489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:23.399795 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9230b6a8-1eff-41a3-9658-f0d0a35d3314 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.402724 Oct 03 14:49:23.400403 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1959/3856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:22 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:23.407621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:23.416543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:23.426734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:23.429081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:23.429528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:23.430234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:23.430694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:23.431126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:23.500985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:49:23.608124 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b8e0166-b540-44e4-86d1-fc2e5b693c4b tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/bfc31bf6-b7d1-45d7-9294-529c1a8b2f76" status: 202 len: 0 microversion: 2.1 time: 1.070066 Oct 03 14:49:23.611875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1898/3857] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:49:22 2022] DELETE /compute/v2.1/os-floating-ips/bfc31bf6-b7d1-45d7-9294-529c1a8b2f76 => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:49:23.617384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63be9964-b138-49a2-9058-fa19ef5386d3 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] Calling method '.version_select at 0x7fb2301033a0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:23.693353 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77d12102-29ea-4106-86a1-4883cc1ddad0 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "DELETE /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 204 len: 0 microversion: 2.1 time: 0.291293 Oct 03 14:49:23.696773 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1960/3858] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:49:23 2022] DELETE /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:49:23.714022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:23.716232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:23.728179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:23.730216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:23.731773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:23.736276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:23.737638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:23.738723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:24.048009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:24.061197 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3ebd3b90-54d9-4673-976d-ff358b773048 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1610 microversion: 2.1 time: 0.358894 Oct 03 14:49:24.064334 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1961/3859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:23 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1610 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:24.075239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:24.077782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:24.092913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:24.093808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:24.094454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:24.095251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:24.096131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:24.096886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:24.609476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:24.619008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:24.620439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:24.621634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25e434d5-cd59-48d4-a714-616e98ac5634 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.556030 Oct 03 14:49:24.622213 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1962/3860] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:24 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:25.093844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:25.094487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:25.106101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:25.106875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:25.107941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:25.108647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:25.112211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:25.113025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:25.313137 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63be9964-b138-49a2-9058-fa19ef5386d3 tempest-FloatingIPDetailsTestJSON-335314338 tempest-FloatingIPDetailsTestJSON-335314338-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/2454db46-ba9e-4bd2-9662-3225d8a617ce" status: 202 len: 0 microversion: 2.1 time: 1.700072 Oct 03 14:49:25.314334 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1899/3861] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:49:23 2022] DELETE /compute/v2.1/os-floating-ips/2454db46-ba9e-4bd2-9662-3225d8a617ce => generated 0 bytes in 1702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:49:25.652454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:25.653097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:25.656436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:25.660985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:25.661952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:25.662426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:25.663143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:25.663614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:25.664023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:26.062767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:26.076248 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-097f84f4-5493-422f-8d3e-11b28d1f739c tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1610 microversion: 2.1 time: 0.989068 Oct 03 14:49:26.077206 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1963/3862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:25 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1610 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:26.258162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:26.275415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:26.279972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:26.289936 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b71c419-2b06-4dc8-abea-82dbf4eac34e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.641878 Oct 03 14:49:26.304949 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1900/3863] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:25 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:26.453986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dcb7ec8-2bc8-47b9-a9a2-57f84c5d767b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-87757201", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "d04be7f2-62b5-48bf-afba-8a7e823d652f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:26.522422 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3dcb7ec8-2bc8-47b9-a9a2-57f84c5d767b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Block Device d04be7f2-62b5-48bf-afba-8a7e823d652f is not bootable. Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dcb7ec8-2bc8-47b9-a9a2-57f84c5d767b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 356 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-87757201", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "d04be7f2-62b5-48bf-afba-8a7e823d652f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: exception: Block Device d04be7f2-62b5-48bf-afba-8a7e823d652f is not bootable. Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-87757201', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'd04be7f2-62b5-48bf-afba-8a7e823d652f'}], 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device d04be7f2-62b5-48bf-afba-8a7e823d652f is not bootable. Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:26.532954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device d04be7f2-62b5-48bf-afba-8a7e823d652f is not bootable. Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device d04be7f2-62b5-48bf-afba-8a7e823d652f is not bootable. Oct 03 14:49:26.538513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:26.541423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dcb7ec8-2bc8-47b9-a9a2-57f84c5d767b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Block Device d04be7f2-62b5-48bf-afba-8a7e823d652f is not bootable. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:26.542534 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3dcb7ec8-2bc8-47b9-a9a2-57f84c5d767b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.092590 Oct 03 14:49:26.543584 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1964/3864] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:26.554909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:26.555522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:26.563265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:26.563770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:26.564217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:26.564967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:26.565416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:26.565845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:26.936741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d751daf7-51c9-4243-80bf-7dc7262e07cf req-31e2f913-fc29-4fde-9199-eb77955ea5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53555f13-170d-42a0-baf9-4f4c6546d616", "name": "network-vif-deleted", "tag": "d27d2fc9-5913-4c43-92a5-b6445360d9f8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:26.950572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d751daf7-51c9-4243-80bf-7dc7262e07cf req-31e2f913-fc29-4fde-9199-eb77955ea5d0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:26.963085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d751daf7-51c9-4243-80bf-7dc7262e07cf req-31e2f913-fc29-4fde-9199-eb77955ea5d0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:26.964671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d751daf7-51c9-4243-80bf-7dc7262e07cf req-31e2f913-fc29-4fde-9199-eb77955ea5d0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:26.987680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d751daf7-51c9-4243-80bf-7dc7262e07cf req-31e2f913-fc29-4fde-9199-eb77955ea5d0 service nova] Creating event network-vif-deleted:d27d2fc9-5913-4c43-92a5-b6445360d9f8 for instance 53555f13-170d-42a0-baf9-4f4c6546d616 on n-h2-781139-2 Oct 03 14:49:27.017830 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d751daf7-51c9-4243-80bf-7dc7262e07cf req-31e2f913-fc29-4fde-9199-eb77955ea5d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085187 Oct 03 14:49:27.019648 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1965/3865] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:49:27.105362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:27.106237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:27.114508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:27.115578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:27.116233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:27.117315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:27.118003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:27.118677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:27.220683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:27.233593 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecbdbab2-897c-4564-a6ac-8c467b6acb79 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1253 microversion: 2.1 time: 0.136819 Oct 03 14:49:27.237619 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1966/3866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:27 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1253 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:27.318581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:27.319600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:27.328414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:27.329015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:27.330654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:27.342468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:27.343102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:27.344502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:27.511681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:27.520126 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f4a27d5-6960-4f32-b5d0-e5bd3301b6c6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.971299 Oct 03 14:49:27.524379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1901/3867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:26 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:27.561319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:27.563793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:27.592127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:27.601399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:27.603461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:27.604353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:27.605576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:27.606600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:27.935363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:27.952300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:27.958362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:27.963429 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d23a45d-9e87-4c3d-bde5-aa70c77e8c76 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.648929 Oct 03 14:49:27.985552 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1967/3868] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:27 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:28.250401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:28.259838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:28.260463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:28.276407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:28.277869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:28.278125 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d120442-2c16-4bd3-9c88-c9d359657021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.721011 Oct 03 14:49:28.279154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:28.279471 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1902/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:27 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:28.280391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:28.281144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:28.282067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:28.525881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:28.542096 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9726c57-4827-4d07-bcb5-ee3573ef99b9 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1253 microversion: 2.1 time: 0.285974 Oct 03 14:49:28.552966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1968/3870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:28 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1253 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:28.993266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:28.994198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:29.015674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:29.020869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:29.021618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:29.022723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:29.023398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:29.024050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:29.570363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:29.571351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:29.587298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:29.624696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:29.628858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:29.635697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:29.636266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:29.637426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:29.803014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:29.816942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:29.826952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:29.833664 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-713ec0f0-3737-44ff-9715-0f3bd311fc54 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.839664 Oct 03 14:49:29.841643 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1903/3871] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:28 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:30.116793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:30.131475 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a03f221-4338-428f-a61d-5c31523d8734 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1253 microversion: 2.1 time: 0.566491 Oct 03 14:49:30.132270 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1969/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:29 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1253 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:30.874520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:30.875237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:30.900569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:30.901233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:30.901814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:30.902689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:30.903291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:30.903974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:31.158614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:31.160160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:31.175601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:31.176980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:31.178952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:31.181488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:31.183429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:31.184127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:31.604074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:31.626220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:31.630139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:31.634189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-30374991-246f-4b3a-b62f-424478c6d367 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.763285 Oct 03 14:49:31.637380 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1904/3873] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:30 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:31.647549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24ea3dcb-f250-42b4-a8ae-7bf3a2bfc8f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-852942037", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "destination_type": "local"}, {"source_type": "volume", "uuid": "f9cbd164-1579-4c1f-b3c2-84b5b3622c2f", "destination_type": "invalid"}], "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24ea3dcb-f250-42b4-a8ae-7bf3a2bfc8f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 494 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-852942037", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "destination_type": "local"}, {"source_type": "volume", "uuid": "f9cbd164-1579-4c1f-b3c2-84b5b3622c2f", "destination_type": "invalid"}], "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-852942037', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f9cbd164-1579-4c1f-b3c2-84b5b3622c2f', 'destination_type': 'invalid'}], 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'invalid' Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:31.666433 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 03 14:49:31.671643 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:31.674736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24ea3dcb-f250-42b4-a8ae-7bf3a2bfc8f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:31.676135 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24ea3dcb-f250-42b4-a8ae-7bf3a2bfc8f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.037506 Oct 03 14:49:31.677175 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1905/3874] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:31 2022] POST /compute/v2.1/servers => generated 155 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:31.689631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:31.690570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:31.712074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:31.715809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:31.720534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:31.721557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:31.722420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:31.723056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:31.964245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:32.072023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:32.283272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:32.302037 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3527ef82-bbf4-4203-9d2d-a2613d94dacc tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1253 microversion: 2.1 time: 1.140345 Oct 03 14:49:32.302736 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1970/3875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:31 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1253 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:32.664138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:32.664754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:32.673487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:32.685911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:32.689155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:32.690158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:32.690623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:32.691120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:32.782215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:32.792240 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00e5619d-e865-4d61-bef3-3b01f10e6fea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.109241 Oct 03 14:49:32.795610 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1906/3876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:31 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:32.824854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:32.825555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:32.835344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:32.835868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:32.838334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:32.839054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:32.842400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:32.843937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:33.309374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:33.335405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:33.342722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:33.348964 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d36365ef-3268-4078-ae02-349e57b40c32 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.689300 Oct 03 14:49:33.373063 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1971/3877] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:32 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:33.389061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:33.389979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:33.404473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:33.405314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:33.405929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:33.406884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:33.407520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:33.408118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:33.538647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:33.548394 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecced820-961b-4bc6-99ba-0b42106c8e47 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1253 microversion: 2.1 time: 0.173764 Oct 03 14:49:33.560512 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1972/3878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:33 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1253 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:34.027542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:34.037685 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d562476f-ecf3-4d0d-9218-a63cc4da8dea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.216976 Oct 03 14:49:34.054178 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1907/3879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:32 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:34.123852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b41b4ea9-cb1f-4794-8406-4a1ff4884818 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-233497717", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b41b4ea9-cb1f-4794-8406-4a1ff4884818 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 491 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-233497717", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-233497717', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:34.128868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b41b4ea9-cb1f-4794-8406-4a1ff4884818 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b41b4ea9-cb1f-4794-8406-4a1ff4884818 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.010672 Oct 03 14:49:34.137538 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1973/3880] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:34 2022] POST /compute/v2.1/servers => generated 624 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:34.152575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:34.154089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:34.162546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:34.163401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:34.164544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:34.181267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:34.182201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:34.183414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:34.377212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:34.379462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:34.400445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:34.401258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:34.401929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:34.402920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:34.403614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:34.404272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:34.885349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:34.892767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:34.907889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:34.912458 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d8961e93-8563-496a-b45d-0f873585c53f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.766377 Oct 03 14:49:34.913448 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1908/3881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:34 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:34.914229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:34.915613 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-222ceb91-8fda-43d3-8f64-f92a975ed582 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.543668 Oct 03 14:49:34.924400 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1974/3882] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:34 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:34.927107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:34.930983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:34.939767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:34.977026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:34.993551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.001106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.001845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:35.003619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.005857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.006659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.008276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:35.017502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.031964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:35.033201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.033939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.035070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:35.171118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:35.193450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8582f298-fbfa-45d0-b1c9-4b14046f987e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1253 microversion: 2.1 time: 0.275715 Oct 03 14:49:35.194430 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1909/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:34 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1253 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:35.649710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:35.654979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:35.665893 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-074834eb-6c2f-4b52-90f9-cd40e47b33fe tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.728750 Oct 03 14:49:35.682336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1975/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:34 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:35.765767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b29edcde-8f44-41c1-8514-ff60aad7f715 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b29edcde-8f44-41c1-8514-ff60aad7f715 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 416 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:35.774220 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b29edcde-8f44-41c1-8514-ff60aad7f715 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:35.778309 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b29edcde-8f44-41c1-8514-ff60aad7f715 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.020278 Oct 03 14:49:35.786097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:35.786768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:35.787770 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1910/3885] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:35 2022] POST /compute/v2.1/servers => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:35.823802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.824328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.830192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:35.831020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.833776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.840722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:35.944433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:35.945413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:35.969313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.970550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.974137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:35.975931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:35.978055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:35.980263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:36.502053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:36.513932 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63a43b9f-5e3a-4454-b261-e8d2fc136168 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.733203 Oct 03 14:49:36.516721 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1976/3886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:35 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:36.526965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:36.527593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:36.546969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:36.547572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:36.548037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:36.550288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:36.551756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:36.552742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:36.669886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:36.671782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:36.673706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:36.675672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lazy-loading 'fault' on Instance uuid 53555f13-170d-42a0-baf9-4f4c6546d616 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:49:36.852371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:36.871390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:36.876448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:36.878180 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6e87237-15c7-402a-a6c6-a4a7d070109e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.940474 Oct 03 14:49:36.903541 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1911/3887] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:35 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:36.910760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:36.911387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:36.926527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:36.929436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:36.933568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:36.934738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:36.935389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:36.936028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:37.196066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:37.211225 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f039327c-ef1d-4142-be31-06ee89a54f22 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.311617 Oct 03 14:49:37.212967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1912/3888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:36 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:37.256167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd57ce0236d346b3821d0df4f618ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a870f5d2905749f1af61487e3bcffbd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:37.267770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db4af4bb-1b7f-4025-bc1f-0dc6d0d40c1e tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 200 len: 1212 microversion: 2.1 time: 0.749897 Oct 03 14:49:37.274592 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1977/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:36 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 1212 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:37.304614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24e3d45a-b667-4219-8634-64ce6ba336f8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1400672276", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": -1, "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:37.330961 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-24e3d45a-b667-4219-8634-64ce6ba336f8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Flavor -1 could not be found. Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24e3d45a-b667-4219-8634-64ce6ba336f8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 206 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1400672276", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": -1, "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: exception: Flavor -1 could not be found. Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1400672276', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': -1, 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:37.341440 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 03 14:49:37.347040 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:37.350426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24e3d45a-b667-4219-8634-64ce6ba336f8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:37.351615 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24e3d45a-b667-4219-8634-64ce6ba336f8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.051434 Oct 03 14:49:37.352723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1913/3890] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:37 2022] POST /compute/v2.1/servers => generated 73 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:49:37.363485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:37.364395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:37.384032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:37.392824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:37.395343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:37.397773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:37.399379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:37.403761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:37.404479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:37.914480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:37.915963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:37.942579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:37.943689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:37.945492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:37.949248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:37.950933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:37.956426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:38.303905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:38.316350 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aecde348-949a-439e-b1a5-c59db9ffcd49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.958032 Oct 03 14:49:38.338140 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1978/3891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:37 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:38.349170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:38.349810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] [instance: 53555f13-170d-42a0-baf9-4f4c6546d616] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:38.366822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:38.367333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:38.367773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:38.372948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:38.373861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:38.374503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:38.411304 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] HTTP exception thrown: Instance 53555f13-170d-42a0-baf9-4f4c6546d616 could not be found. Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Request method failure captured: Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 HTTP/1.1 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvX8sc_LRMya7rsPqKVExOXnyzP_kP_8o_vPAqrUqRiE2UG2XV_Smfga11Kf-6XG4KiXRs750RUQDwJPTM7fU9UESjQolCUNnd9bOka87rO10onq7bCLJuiCS2eA90Ou3NzNOG-brl8FG-4ATvamyfdIQ8ibjd7-3hDh9Wd_FRTdfxk Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: a870f5d2905749f1af61487e3bcffbd1 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersTestBootFromVolume-843873413 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a870f5d2905749f1af61487e3bcffbd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a870f5d2905749f1af61487e3bcffbd1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a870f5d2905749f1af61487e3bcffbd1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a870f5d2905749f1af61487e3bcffbd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersTestBootFromVolume-843873413 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: a870f5d2905749f1af61487e3bcffbd1 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersTestBootFromVolume-843873413 Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersTestBootFromVolume-843873413-project Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: bd57ce0236d346b3821d0df4f618ae8d Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersTestBootFromVolume-843873413-project Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 53555f13-170d-42a0-baf9-4f4c6546d616 could not be found. Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '53555f13-170d-42a0-baf9-4f4c6546d616'} Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53555f13-170d-42a0-baf9-4f4c6546d616 could not be found. Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53555f13-170d-42a0-baf9-4f4c6546d616 could not be found. Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:38.421858 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:38.428468 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:38.428468 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:38.428468 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:38.428468 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:38.428468 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:38.428468 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53555f13-170d-42a0-baf9-4f4c6546d616 could not be found. Oct 03 14:49:38.428468 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:38.430476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Returning 404 to user: Instance 53555f13-170d-42a0-baf9-4f4c6546d616 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:38.431585 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f9effbe-4881-4302-ad0a-bd8718fe4908 tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616" status: 404 len: 111 microversion: 2.1 time: 0.092304 Oct 03 14:49:38.432655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1979/3892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:38 2022] GET /compute/v2.1/servers/53555f13-170d-42a0-baf9-4f4c6546d616 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:49:38.447239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:38.448186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:38.464991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:38.467673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:38.468344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:38.469290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:38.470796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:38.472010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:39.022649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:39.027676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:39.044366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:39.053888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:39.059222 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1440226b-7315-4059-8dd0-c30beaac1f39 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 1.151675 Oct 03 14:49:39.059846 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1914/3893] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:37 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:39.102169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e17d5284-c69f-41f2-8041-2e539319abca tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] Calling method '.version_select at 0x7fb234b37280>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:39.151066 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e17d5284-c69f-41f2-8041-2e539319abca tempest-ServersTestBootFromVolume-843873413 tempest-ServersTestBootFromVolume-843873413-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294057936" status: 202 len: 0 microversion: 2.1 time: 0.069596 Oct 03 14:49:39.151883 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1915/3894] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294057936 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:49:39.212009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:39.222620 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4714d971-7cbb-46a5-aea3-2fb00146063c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.788671 Oct 03 14:49:39.229695 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1980/3895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:38 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:39.516167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c28b4dd8-a0e5-4302-aa1a-db8b6f5cebd8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1406249943", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c28b4dd8-a0e5-4302-aa1a-db8b6f5cebd8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 173 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1406249943", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1406249943', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi -1 Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:49:39.526346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:49:39.532041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c28b4dd8-a0e5-4302-aa1a-db8b6f5cebd8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:39.537416 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c28b4dd8-a0e5-4302-aa1a-db8b6f5cebd8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.026010 Oct 03 14:49:39.538500 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1916/3896] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:39 2022] POST /compute/v2.1/servers => generated 145 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:39.547035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:39.547750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:39.579576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:39.580081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:39.580520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:39.581601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:39.582067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:39.582496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:39.727094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:39.728195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:39.740229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:39.743827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:39.744564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:39.749241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:39.750076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:39.750765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:40.268396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:40.278667 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4099c1a-5c37-4c75-ab1f-1d1ef0f43317 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.735751 Oct 03 14:49:40.308081 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1981/3897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:39 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:40.318622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:40.319259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:40.325956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:40.326693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:40.327291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:40.328574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:40.329232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:40.329824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:40.549633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:40.561009 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80be092f-01b7-4569-a819-c49513802a7c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.836814 Oct 03 14:49:40.563172 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1917/3898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:39 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:40.579239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:40.580185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:40.592966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:40.593465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:40.593892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:40.599149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:40.599772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:40.600218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:41.229928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:41.267875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:41.274168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:41.278169 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69d1319b-e122-4215-9234-666d78b2f158 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.967196 Oct 03 14:49:41.282611 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1982/3899] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:40 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:41.294981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:41.295975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:41.303931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:41.304748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:41.305864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:41.307098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:41.307830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:41.308658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:41.515887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:41.531623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ea75244b-559b-4822-9d52-fe71d698ae87 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.965107 Oct 03 14:49:41.534020 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1918/3900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:40 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:41.820901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1343456733", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "814b26c2-0b39-4488-9617-90b19f00dd5e"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:41.973968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] validate_networks() for [('814b26c2-0b39-4488-9617-90b19f00dd5e', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:49:42.764121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:42.779124 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2bffff20-83b5-4def-b144-663928478e1e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 1.492942 Oct 03 14:49:42.782938 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1983/3901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:41 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:42.791860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52b25d4d-9373-40a6-aec8-3d5d51b07265 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1633737765", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:42.805081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-52b25d4d-9373-40a6-aec8-3d5d51b07265 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52b25d4d-9373-40a6-aec8-3d5d51b07265 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 216 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1633737765", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1633737765', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:42.811646 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:42.817429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:42.817429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:42.817429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:42.817429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:42.817429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:42.817429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 03 14:49:42.817429 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:42.821349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52b25d4d-9373-40a6-aec8-3d5d51b07265 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:42.822436 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52b25d4d-9373-40a6-aec8-3d5d51b07265 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.038314 Oct 03 14:49:42.841322 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1984/3902] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:42 2022] POST /compute/v2.1/servers => generated 123 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:42.857010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:42.858744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:42.895499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:42.895499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:42.895499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:42.896137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:42.896597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:42.897057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:43.420910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:49:43.421432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:49:43.421909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:49:43.422319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:49:43.422730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:49:43.441700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:43.442190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:43.442625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:43.451071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:43.451569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:43.452014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:43.498857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Getting quotas for project 7577babca68a4662a9a280bf3d862a9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:49:43.514469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Getting quotas for user 6557ff18d9be4fcb88ab283c9a9b61aa and project 7577babca68a4662a9a280bf3d862a9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:49:43.518609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:43.535528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:43.539946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:43.545239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:49:43.546370 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84a62141-e8f9-44f3-98a5-edb891d4266c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.703578 Oct 03 14:49:43.547063 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1985/3903] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:42 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:43.550001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:49:43.560429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:43.561067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:43.597113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:43.598842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:43.599314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:43.601670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:43.603088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:43.604726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:43.657135 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-937ed93c-36a7-4f18-b498-a3c100f236fc tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.119867 Oct 03 14:49:43.661868 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1919/3904] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:49:43.670474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:43.672914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:43.685964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:43.689624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:43.692366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:43.693363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:43.694025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:43.696501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:44.310697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:44.344008 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06841ee5-f143-4160-9cd0-ee8e1b97f7c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.781209 Oct 03 14:49:44.345654 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1986/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:43 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:44.357516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5f2e89f-68f7-4907-b49d-6c5bee9bd75f tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:44.360706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5f2e89f-68f7-4907-b49d-6c5bee9bd75f tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:44.516016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5f2e89f-68f7-4907-b49d-6c5bee9bd75f tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:44.526343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5f2e89f-68f7-4907-b49d-6c5bee9bd75f tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1225 microversion: 2.1 time: 0.178127 Oct 03 14:49:44.528819 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1987/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:44 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1225 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:44.718282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:44.736319 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2f82091a-178f-4343-80b6-4dcfa12e29c0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.072463 Oct 03 14:49:44.749380 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1920/3907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:43 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:44.757203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1609550454", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:44.774983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:44.787259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:44.801096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:44.805370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:44.806941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:44.810001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:44.810676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:44.811294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:44.828747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] validate_networks() for [('28327e4f-adf0-4363-ba93-d85cf5c8956d', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:49:45.392410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:45.410947 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e7dd923-7238-4c5e-90d8-207f2c7436a8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.660315 Oct 03 14:49:45.414035 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1921/3908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:44 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:45.435091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:45.441240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:45.496526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:45.500144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:45.502799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:45.507089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:45.509865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:45.510734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:46.015459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:46.029118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:46.036183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:46.037773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2527bc0b-c960-46f8-910c-c71e556a0a5c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.621943 Oct 03 14:49:46.053816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1922/3909] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:45 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:46.063040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:46.064430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:46.081246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:46.082187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:46.082872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:46.084411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:46.085157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:46.085831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:46.630267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:49:46.631233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:49:46.631875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:49:46.632449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:49:46.633057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:49:46.642371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:46.643055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:46.643957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:46.644919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:46.645580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:46.646191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:46.700561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for project 3617808e389f442db9240aab3538e9a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:49:46.717287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for user ba57cee91b1a42b6b3c8c42a5a40eba4 and project 3617808e389f442db9240aab3538e9a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:49:46.735611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:49:46.739953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:49:46.817096 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b74f8bc-fdd5-4880-a7a2-b04674d87236 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.271078 Oct 03 14:49:46.824948 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1988/3910] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:49:46.833830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:46.852181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:46.863116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:46.864300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:46.865117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:46.866030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:46.867728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:46.868353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:47.620436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:47.635139 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70b1ce00-656d-4cf6-8c6e-4c646e94c3d9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.577509 Oct 03 14:49:47.636197 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1923/3911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:46 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:47.653633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1245772654", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "85fcbfd3-3026-41ec-a964-76a31555f33f"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:47.740878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] validate_networks() for [('85fcbfd3-3026-41ec-a964-76a31555f33f', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:49:47.800028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:47.819756 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be12f22b-32d3-431c-b3a2-b2a5ec9e395d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1283 microversion: 2.1 time: 0.981891 Oct 03 14:49:47.820415 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1989/3912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:46 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1283 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:47.835544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:47.836444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:47.857169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:47.858996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:47.860106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:47.869801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:47.870560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:47.871280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:48.030127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:48.044993 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b903075c-bd92-45e5-a6bc-6e6fcf9f9aad tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1226 microversion: 2.1 time: 0.218774 Oct 03 14:49:48.045615 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1990/3913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:47 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1226 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:48.061201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:48.061201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:48.065215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:48.065987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:48.066605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:48.069458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:48.070263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:48.070875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:48.633227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:48.648980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:48.650304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:48.651480 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eee0a9ab-9377-4847-9c29-86fd4ac2f980 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.604946 Oct 03 14:49:48.663824 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1991/3914] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:48 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:48.668852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-720abbca-0228-4258-a17a-1a6d66f01b69 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1960428768", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-key-1686155118", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:48.768597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-720abbca-0228-4258-a17a-1a6d66f01b69 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] validate_networks() for [('2a62333a-9bbf-45d0-8291-9f475d60044b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:49:49.710610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:49:49.711085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:49:49.711509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:49:49.711920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:49:49.712335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:49:49.722394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:49.723163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:49.723774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:49.724903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:49.725574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:49.729643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:49.777273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:49:49.779424 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-720abbca-0228-4258-a17a-1a6d66f01b69 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Invalid key_name provided. Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-720abbca-0228-4258-a17a-1a6d66f01b69 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 247 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1960428768", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-key-1686155118", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid key_name provided. Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1960428768', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'key_name': 'tempest-key-1686155118', 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1686155118 not found for user 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:49.782360 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:49.787956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-720abbca-0228-4258-a17a-1a6d66f01b69 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid key_name provided. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:49.796495 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-720abbca-0228-4258-a17a-1a6d66f01b69 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.126546 Oct 03 14:49:49.796495 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1992/3915] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 1128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 03 14:49:49.796892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for user 2cd32680b6b342ea962e104cfaf4c311 and project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:49:49.815639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1628917610", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:49.835225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:49:49.848552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:49:49.929122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] validate_networks() for [('28327e4f-adf0-4363-ba93-d85cf5c8956d', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:49:49.948857 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cf497e02-2a0f-4e05-b2fa-77a05029f08f tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.305086 Oct 03 14:49:49.964379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1924/3916] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:49:49.982805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:49.985784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:50.014226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:50.016300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:50.019075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:50.024230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:50.024959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:50.035446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:51.268822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:51.284173 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5eaf647-fe18-4028-bba6-8f26b6e664d2 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1325 microversion: 2.1 time: 1.318256 Oct 03 14:49:51.296576 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1925/3917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:49 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1325 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:51.306675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:51.307584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:51.336456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:51.342651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:51.343356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:51.344483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:51.345031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:51.345460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:52.418511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:49:52.419049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:49:52.419412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:49:52.419812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:49:52.420232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:49:52.436552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.438586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.439255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:52.440254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.441484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.443891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:52.477761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for project 3617808e389f442db9240aab3538e9a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:49:52.484449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for user ba57cee91b1a42b6b3c8c42a5a40eba4 and project 3617808e389f442db9240aab3538e9a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:49:52.512718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:49:52.515327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:49:52.583868 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-914cd7a5-ad78-42d3-8608-4b023a424c2e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.790614 Oct 03 14:49:52.584982 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1993/3918] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:49:52.591806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:52.592678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:52.600123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.600676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.601145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:52.601900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.602526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.603110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:52.730459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:52.752703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:52.778478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:52.788811 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fbc9715-d22f-4d74-8063-a55bd3f68191 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 1.490546 Oct 03 14:49:52.790513 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1926/3919] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:51 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:52.798147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:52.799281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:52.807967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.808823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.824372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:52.825514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:52.826112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:52.826902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.027799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:53.037970 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0cf19580-548f-4ccd-bd5f-0654a93e1bca tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1273 microversion: 2.1 time: 0.246154 Oct 03 14:49:53.042971 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1927/3920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:52 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1273 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:53.057548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:53.057548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:53.068344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:53.068970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:53.069624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.074787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:53.075547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:53.076187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.422010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:53.435526 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1be8aba7-ad6c-4972-b420-f78df48eaf08 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1325 microversion: 2.1 time: 0.391113 Oct 03 14:49:53.454324 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1928/3921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:53 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1325 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:53.466797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:53.471078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:53.489933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:53.490534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:53.494125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.495951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:53.497719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:53.498532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.637034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:53.646530 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb8cffef-436c-4a25-92ee-9c4d4cb8c7e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1226 microversion: 2.1 time: 0.190870 Oct 03 14:49:53.648728 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1929/3922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:53 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1226 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:53.820571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:53.822101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:53.829434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:53.830686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:53.831350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.832353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:53.834176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:53.834820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:53.949160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:53.960842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5f9d3df-eefb-4d22-9bf2-acf4d14387e5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.374347 Oct 03 14:49:53.964810 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1994/3923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:52 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:54.001872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:54.003202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:54.029379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.030621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.031418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:54.032808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.033481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.034204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:54.642981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:54.654501 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5c622b3-89de-4eed-b758-bfa12e63ecfd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.661827 Oct 03 14:49:54.655223 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1995/3924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:53 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:54.664762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:54.666857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:54.692468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.692951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.698884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:54.699711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.701232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.702507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:54.728956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:54.752962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:54.761188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:54.766969 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-699682fa-498c-4d92-a397-a1330e6c9c89 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.948934 Oct 03 14:49:54.771212 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1930/3925] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:53 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:49:54.786395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:54.794304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:54.812220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.812888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.813711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:54.815748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:54.819533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:54.820970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.386856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:55.396841 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9717bbf-93b8-48ff-bf6e-9340f243dd43 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1325 microversion: 2.1 time: 0.623436 Oct 03 14:49:55.399691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1931/3926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:54 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1325 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:55.412565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:55.416416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:55.431054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:55.434131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:55.434715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.435579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:55.438462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:55.439019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.441469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:55.450552 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5baa768-136e-4437-b6b2-46b0bbfc6bcd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1273 microversion: 2.1 time: 0.793799 Oct 03 14:49:55.455757 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1996/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:54 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1273 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:55.467636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f57443c-8a2c-4350-8dd6-a8a26d81cef0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-336909881", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:55.622559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:55.632874 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9a1317be-4dc7-44e8-b58b-23e6ee5e41e4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1280 microversion: 2.1 time: 0.231131 Oct 03 14:49:55.637551 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1932/3928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:55 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:55.761785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-28487f4a-3229-47bf-9803-29d98aba6863 req-2207f4ab-687f-4fe6-aaab-e2793f669b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32fdbfb7-9bc1-4957-9677-c2a78f73698d", "tag": "fd3a7fdb-0a44-4d37-b8d4-4d7a6d6eb3be"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:49:55.768644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:55.784645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28487f4a-3229-47bf-9803-29d98aba6863 req-2207f4ab-687f-4fe6-aaab-e2793f669b75 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:55.786546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28487f4a-3229-47bf-9803-29d98aba6863 req-2207f4ab-687f-4fe6-aaab-e2793f669b75 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:55.790480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28487f4a-3229-47bf-9803-29d98aba6863 req-2207f4ab-687f-4fe6-aaab-e2793f669b75 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.823213 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-28487f4a-3229-47bf-9803-29d98aba6863 req-2207f4ab-687f-4fe6-aaab-e2793f669b75 service nova] Creating event network-changed:fd3a7fdb-0a44-4d37-b8d4-4d7a6d6eb3be for instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d on n-h2-781139-2 Oct 03 14:49:55.835672 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-28487f4a-3229-47bf-9803-29d98aba6863 req-2207f4ab-687f-4fe6-aaab-e2793f669b75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078547 Oct 03 14:49:55.836716 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1933/3929] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:49:55.852919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:55.855916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:55.862723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:55.863566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:55.864668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.865672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:55.866387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:55.867054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.880672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-3f57443c-8a2c-4350-8dd6-a8a26d81cef0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Neutron security group does_not_exist not found {{(pid=128869) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 03 14:49:55.881343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3f57443c-8a2c-4350-8dd6-a8a26d81cef0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f57443c-8a2c-4350-8dd6-a8a26d81cef0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 257 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-336909881", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-336909881', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 03 14:49:55.894274 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:55.898867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f57443c-8a2c-4350-8dd6-a8a26d81cef0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:55.912091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f57443c-8a2c-4350-8dd6-a8a26d81cef0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.438909 Oct 03 14:49:55.912091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1997/3930] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:49:55 2022] POST /compute/v2.1/servers => generated 106 bytes in 443 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:49:55.912091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:55.912091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:55.917829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:55.918337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:55.918769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.919477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:55.923631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:55.924466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:55.936569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:56.426597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:56.439359 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1997f8f4-9191-4e87-846a-4c3ee13d8491 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.535779 Oct 03 14:49:56.453416 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1998/3931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:55 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:56.468133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:56.469215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:56.481423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:56.482237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:56.482859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:56.484250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:56.490459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:56.491662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:56.684596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:56.707541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:56.710779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:56.717070 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa0c28c8-89f6-46f9-9f24-c8ad6c6c0ee7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.874804 Oct 03 14:49:56.718239 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1934/3932] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:55 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:56.724676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:56.733199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:56.744648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:56.749850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:56.750586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:56.751661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:56.756270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:56.757291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:56.811153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:57.181137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:57.194543 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fab02c83-06fd-47f8-8e4a-0384d2f4fe2d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1325 microversion: 2.1 time: 0.739515 Oct 03 14:49:57.195139 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 1999/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:56 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1325 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:57.215902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:57.216800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:57.227569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:57.228093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:57.231782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:57.233648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:57.235922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:57.237353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:57.780032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:57.793995 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb80947d-4a75-4b5b-a710-49cfc572fec4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.074478 Oct 03 14:49:57.795234 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1935/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:56 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:57.805018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:57.820489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:57.831317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:57.832185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:57.834210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:57.835552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:57.836133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:57.836665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:58.140592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:58.144638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:58.156279 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce86b4be-6dd6-409a-8b95-e26bc6bc5d70 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.359213 Oct 03 14:49:58.157291 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf4f4fb2-8cd8-4ac2-913b-4610cc2807a5 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.959007 Oct 03 14:49:58.157716 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1936/3935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:57 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:58.159416 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2000/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:57 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:58.163221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:58.164518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:58.170898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c396e6dd-44c0-4af4-99fe-a1839a9f3507 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:58.171654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c396e6dd-44c0-4af4-99fe-a1839a9f3507 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: d76f5348-e908-4509-9cc4-b07de498fde1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:58.178580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:58.182721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:58.184539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:58.189128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:58.191399 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c396e6dd-44c0-4af4-99fe-a1839a9f3507 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance d76f5348-e908-4509-9cc4-b07de498fde1 could not be found. Oct 03 14:49:58.192590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:58.193333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c396e6dd-44c0-4af4-99fe-a1839a9f3507 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/d76f5348-e908-4509-9cc4-b07de498fde1 HTTP/1.1 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d76f5348-e908-4509-9cc4-b07de498fde1 could not be found. Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd76f5348-e908-4509-9cc4-b07de498fde1'} Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d76f5348-e908-4509-9cc4-b07de498fde1 could not be found. Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d76f5348-e908-4509-9cc4-b07de498fde1 could not be found. Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:58.198869 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d76f5348-e908-4509-9cc4-b07de498fde1 could not be found. Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c396e6dd-44c0-4af4-99fe-a1839a9f3507 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance d76f5348-e908-4509-9cc4-b07de498fde1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:49:58.204013 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c396e6dd-44c0-4af4-99fe-a1839a9f3507 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d76f5348-e908-4509-9cc4-b07de498fde1" status: 404 len: 111 microversion: 2.1 time: 0.042267 Oct 03 14:49:58.204804 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2001/3937] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:49:58 2022] DELETE /compute/v2.1/servers/d76f5348-e908-4509-9cc4-b07de498fde1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:49:58.222614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:58.223290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:58.250164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:58.251733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:58.252963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:58.254095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:58.254757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:58.256528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:58.555335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:58.573975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:58.575671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:58.577414 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59bcb8fc-b22f-4514-9635-80f80e63c23e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.418604 Oct 03 14:49:58.592420 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1937/3938] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:49:58 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:49:58.595317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:58.602074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:58.609857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:58.610641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:58.612591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:58.613730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:58.615075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:58.617576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:59.028394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:59.048970 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e8d68855-a5d6-4456-a684-c2dfefa4d609 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1325 microversion: 2.1 time: 0.451553 Oct 03 14:49:59.049848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1938/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:58 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1325 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:59.185303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:59.193390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:59.195901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:59.203848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:59.205159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:59.206076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:59.207468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:59.208307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:59.209103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:59.218363 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0a8b072-f30b-4a8c-b3b1-a511bdccc7cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.006762 Oct 03 14:49:59.219858 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2002/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:58 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:49:59.225684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:59.226535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:59.233775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:59.234586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:59.235731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:59.236729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:59.238024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:59.240071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:59.683962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:49:59.692539 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82c15a4f-27fc-4ecf-b54a-f0aca37cedf2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.516487 Oct 03 14:49:59.694127 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1939/3941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:59 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:49:59.699081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:49:59.700041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:49:59.706521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:59.707549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:59.708165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:59.709151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:49:59.709847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:49:59.711406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:49:59.762961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:49:59.814936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=12 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:00.029843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:00.051068 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdccc8d5-2565-4d91-b3a4-8aaf4d565553 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.829799 Oct 03 14:50:00.053997 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2003/3942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:59 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:00.067455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:00.068880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:00.090477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:00.092047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:00.092852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:00.096026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:00.096596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:00.097339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:00.161920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:00.172256 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74939628-1d2d-484f-9557-ca66214a5325 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.476771 Oct 03 14:50:00.172858 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1940/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:49:59 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:00.195162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-2e9b8b6b-b795-48e5-9c8c-b685cac3e176 req-f02bc4bf-a0d0-4042-858c-3511a334e830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335b701a-b1ae-4492-a11b-cf7f6a9f03cb", "tag": "d1b940fb-7b30-4aa7-bbae-5d63b072a331"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:00.208569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2e9b8b6b-b795-48e5-9c8c-b685cac3e176 req-f02bc4bf-a0d0-4042-858c-3511a334e830 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:00.209087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2e9b8b6b-b795-48e5-9c8c-b685cac3e176 req-f02bc4bf-a0d0-4042-858c-3511a334e830 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:00.209518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2e9b8b6b-b795-48e5-9c8c-b685cac3e176 req-f02bc4bf-a0d0-4042-858c-3511a334e830 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:00.259408 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-2e9b8b6b-b795-48e5-9c8c-b685cac3e176 req-f02bc4bf-a0d0-4042-858c-3511a334e830 service nova] Creating event network-changed:d1b940fb-7b30-4aa7-bbae-5d63b072a331 for instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb on n-h2-781139-2 Oct 03 14:50:00.265950 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-2e9b8b6b-b795-48e5-9c8c-b685cac3e176 req-f02bc4bf-a0d0-4042-858c-3511a334e830 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091830 Oct 03 14:50:00.267634 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1941/3944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:00.276075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:00.277435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:00.285537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:00.286377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:00.287380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:00.288274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:00.288892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:00.289647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:00.927853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:00.938016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:00.939508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:00.940832 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcfd5aa8-1c5a-445d-b24b-15aaf637ba84 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.885084 Oct 03 14:50:00.941429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2004/3945] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:00 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:00.960635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5271d990-beea-40a0-9f74-781d9cb894f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:00.961522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5271d990-beea-40a0-9f74-781d9cb894f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 14:50:00.963057 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5271d990-beea-40a0-9f74-781d9cb894f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5271d990-beea-40a0-9f74-781d9cb894f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 9223372036854775808 could not be found. Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '9223372036854775808'} Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:00.964919 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:00.970611 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:00.970611 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:00.970611 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:00.970611 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 03 14:50:00.970611 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:00.972732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5271d990-beea-40a0-9f74-781d9cb894f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:00.974065 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5271d990-beea-40a0-9f74-781d9cb894f7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.031206 Oct 03 14:50:00.975761 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2005/3946] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Oct 3 14:50:00 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:50:00.981384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:00.982339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:00.990907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:00.991542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:00.992195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:00.992961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:00.993428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:00.994050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:01.258176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:01.281978 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c30142b-6a35-4800-8875-1c3ac436396d tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1325 microversion: 2.1 time: 1.012778 Oct 03 14:50:01.283315 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1942/3947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:00 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1325 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:01.291904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:01.292530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:01.304848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:01.311035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:01.311500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:01.312420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:01.318077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:01.318604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:01.773764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:01.782244 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57a1d82b-0237-4798-9252-c7108e30186d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.805382 Oct 03 14:50:01.799066 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2006/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:00 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:01.804401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:01.805243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:01.812320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:01.812957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:01.813700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:01.814485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:01.815263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:01.815865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:01.820727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:01.832319 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7d36e66-ab5f-49f4-a434-0bb301a8e77e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.546717 Oct 03 14:50:01.834404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1943/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:01 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:01.842714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-eb188b9c-59e3-424c-b128-90dcf46a0042 req-82ccc6ae-66d3-47ef-b5e4-caf1411b3431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fdbfb7-9bc1-4957-9677-c2a78f73698d", "name": "network-vif-plugged", "status": "completed", "tag": "fd3a7fdb-0a44-4d37-b8d4-4d7a6d6eb3be"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:01.871499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eb188b9c-59e3-424c-b128-90dcf46a0042 req-82ccc6ae-66d3-47ef-b5e4-caf1411b3431 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:01.873090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eb188b9c-59e3-424c-b128-90dcf46a0042 req-82ccc6ae-66d3-47ef-b5e4-caf1411b3431 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:01.875024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eb188b9c-59e3-424c-b128-90dcf46a0042 req-82ccc6ae-66d3-47ef-b5e4-caf1411b3431 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:01.896912 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-eb188b9c-59e3-424c-b128-90dcf46a0042 req-82ccc6ae-66d3-47ef-b5e4-caf1411b3431 service nova] Creating event network-vif-plugged:fd3a7fdb-0a44-4d37-b8d4-4d7a6d6eb3be for instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d on n-h2-781139-2 Oct 03 14:50:01.903886 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-eb188b9c-59e3-424c-b128-90dcf46a0042 req-82ccc6ae-66d3-47ef-b5e4-caf1411b3431 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067744 Oct 03 14:50:01.904633 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1944/3950] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:01.912679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:01.913817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:01.922970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:01.923635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:01.924564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:01.925468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:01.926525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:01.927054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:02.233108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:02.265509 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2e2cb1a-a7b9-4525-847c-3857b2934213 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.357909 Oct 03 14:50:02.267514 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1945/3951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:01 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:02.273771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5a96691d-7b67-43d1-960b-bef789d399ba req-b53a24be-52f6-47d9-9863-ff89780029ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04994ce-f544-4364-9887-e60b13b07143", "tag": "a2b25e07-562c-40ab-9636-a9ba529efa7d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:02.290028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5a96691d-7b67-43d1-960b-bef789d399ba req-b53a24be-52f6-47d9-9863-ff89780029ea service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:02.292061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5a96691d-7b67-43d1-960b-bef789d399ba req-b53a24be-52f6-47d9-9863-ff89780029ea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:02.292670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5a96691d-7b67-43d1-960b-bef789d399ba req-b53a24be-52f6-47d9-9863-ff89780029ea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:02.308169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5a96691d-7b67-43d1-960b-bef789d399ba req-b53a24be-52f6-47d9-9863-ff89780029ea service nova] Creating event network-changed:a2b25e07-562c-40ab-9636-a9ba529efa7d for instance b04994ce-f544-4364-9887-e60b13b07143 on n-h2-781139-2 Oct 03 14:50:02.315495 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5a96691d-7b67-43d1-960b-bef789d399ba req-b53a24be-52f6-47d9-9863-ff89780029ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045419 Oct 03 14:50:02.316441 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1946/3952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:02.324024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:02.325531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:02.334055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:02.334623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:02.335074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:02.335786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:02.336506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:02.337135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:02.338152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:02.347953 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8533fb1-41a0-4d8d-b542-fbc526427cd2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.547648 Oct 03 14:50:02.351214 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2007/3953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:01 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:02.363798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-347ef5d5-c81e-49d0-8763-92ab512bfd5f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:02.364467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-347ef5d5-c81e-49d0-8763-92ab512bfd5f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Failed to fetch instance by id -1 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 14:50:02.368600 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-347ef5d5-c81e-49d0-8763-92ab512bfd5f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance -1 could not be found. Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-347ef5d5-c81e-49d0-8763-92ab512bfd5f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance -1 could not be found. Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '-1'} Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:02.371618 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:02.379935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:02.379935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:02.379935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 03 14:50:02.379935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:02.379935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-347ef5d5-c81e-49d0-8763-92ab512bfd5f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:02.379935 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-347ef5d5-c81e-49d0-8763-92ab512bfd5f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.020644 Oct 03 14:50:02.379935 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2008/3954] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:50:02 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:50:02.387845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:02.388470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:02.410961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:02.411463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:02.411916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:02.412696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:02.413095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:02.413515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:02.463845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:02.504456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=14 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:02.960075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:02.983444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:02.987202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:02.990512 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6a068140-5964-47c8-b958-ab2d1452892d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.672602 Oct 03 14:50:03.019114 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1947/3955] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:02 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:03.028739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-467bbfb4-89f5-498f-8188-99272b7be0dc req-7222f636-91fa-450a-a625-d7867df93944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a", "tag": "4a60185d-a514-45ec-b3b9-cf023e0ef954"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:03.051173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-467bbfb4-89f5-498f-8188-99272b7be0dc req-7222f636-91fa-450a-a625-d7867df93944 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:03.052793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-467bbfb4-89f5-498f-8188-99272b7be0dc req-7222f636-91fa-450a-a625-d7867df93944 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:03.053996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-467bbfb4-89f5-498f-8188-99272b7be0dc req-7222f636-91fa-450a-a625-d7867df93944 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:03.089366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:03.089958 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-467bbfb4-89f5-498f-8188-99272b7be0dc req-7222f636-91fa-450a-a625-d7867df93944 service nova] Creating event network-changed:4a60185d-a514-45ec-b3b9-cf023e0ef954 for instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a on n-h1-781139-2 Oct 03 14:50:03.100894 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-467bbfb4-89f5-498f-8188-99272b7be0dc req-7222f636-91fa-450a-a625-d7867df93944 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081127 Oct 03 14:50:03.101836 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1948/3956] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:03.104437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-817b0ca6-9732-486b-a935-c955ae5a75d6 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1325 microversion: 2.1 time: 0.725545 Oct 03 14:50:03.105460 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2009/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:02 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1325 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:03.111777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:03.112874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:03.116805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:03.117458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:03.124192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:03.124192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:03.124782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:03.126092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:03.127635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:03.128411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:03.130173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:03.137863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:03.138427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:03.139291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:03.139859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:03.140386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:03.434890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:03.446748 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb6f1d4c-9836-4df2-ab10-ca34039c3d5e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.341466 Oct 03 14:50:03.449594 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1949/3958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:03 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:03.466207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:03.467164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:03.476545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:03.477441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:03.478238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:03.479475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:03.480752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:03.481980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:03.922559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:03.938032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:03.953817 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c33398c4-8e4b-48a0-ae61-50c86498b104 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.502780 Oct 03 14:50:03.959459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c712481f-0e09-41f1-b83b-78c77068b1b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.852234 Oct 03 14:50:03.962705 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1950/3959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:03 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:03.991428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:03.991891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:03.992916 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2010/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:03 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:04.000723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5d0a979e-4254-4246-89e5-1bbf81888743 req-a87a6314-b4c5-4b64-917f-db37d1de89d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-plugged", "status": "completed", "tag": "79e408f7-cad2-401d-8e68-4887a9dd2e6b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:04.019285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d0a979e-4254-4246-89e5-1bbf81888743 req-a87a6314-b4c5-4b64-917f-db37d1de89d9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.020280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d0a979e-4254-4246-89e5-1bbf81888743 req-a87a6314-b4c5-4b64-917f-db37d1de89d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.020932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5d0a979e-4254-4246-89e5-1bbf81888743 req-a87a6314-b4c5-4b64-917f-db37d1de89d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.023889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.025360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.029018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.031475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.033514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.036431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.044960 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5d0a979e-4254-4246-89e5-1bbf81888743 req-a87a6314-b4c5-4b64-917f-db37d1de89d9 service nova] Creating event network-vif-plugged:79e408f7-cad2-401d-8e68-4887a9dd2e6b for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:04.088042 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5d0a979e-4254-4246-89e5-1bbf81888743 req-a87a6314-b4c5-4b64-917f-db37d1de89d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075928 Oct 03 14:50:04.090951 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2011/3961] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:04.099244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:04.101836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:04.117843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.118629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.119788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.121290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.122062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.123861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.528107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:04.543790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14d1d74b-65a1-4df7-91d2-f185c05b91ff tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.578870 Oct 03 14:50:04.545097 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1951/3962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:03 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:04.559418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:04.561632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:04.576523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.580271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:04.581267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.581846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.582845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.583324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.583753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.598541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:04.600001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:04.601349 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7961cea-5e06-41e1-8393-6d35c6bec227 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.508573 Oct 03 14:50:04.602241 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2012/3963] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:04 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:04.785587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-947446951", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "d23000a4-0058-4b54-8d39-748e55a5a002"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:04.853324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:04.857246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] validate_networks() for [('d23000a4-0058-4b54-8d39-748e55a5a002', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:50:04.863442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-62a3909c-0e20-4e61-a1e7-1c44adc5d135 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1522 microversion: 2.1 time: 0.316432 Oct 03 14:50:04.864062 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1952/3964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:04 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:04.883914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f2092be-8bb6-40d9-bc8a-6044f44b91c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:04.884788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f2092be-8bb6-40d9-bc8a-6044f44b91c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:04.893728 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0f2092be-8bb6-40d9-bc8a-6044f44b91c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9 could not be found. Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f2092be-8bb6-40d9-bc8a-6044f44b91c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9/action HTTP/1.1 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 19 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: {"forceDelete": {}} Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9 could not be found. Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9', 'body': {'forceDelete': {}}} Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9 could not be found. Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9 could not be found. Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:04.907598 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:04.914060 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:04.914060 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:04.914060 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9 could not be found. Oct 03 14:50:04.914060 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:04.914060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f2092be-8bb6-40d9-bc8a-6044f44b91c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:04.915449 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f2092be-8bb6-40d9-bc8a-6044f44b91c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9/action" status: 404 len: 111 microversion: 2.1 time: 0.036078 Oct 03 14:50:04.916498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1953/3965] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:04 2022] POST /compute/v2.1/servers/e04ef5ca-a356-48ac-a6a1-bcafe87ba1b9/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:04.929768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:04.930508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:04.953409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.955747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.956857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:04.957980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:04.958632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:04.960482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:05.024384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] HTTP exception thrown: Action 999 not found Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Request method failure captured: Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d/os-instance-actions/999 HTTP/1.1 Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaEM6gsPOTb9T0njjLFyqh7zm7TFDN9NuCqJwfyw05pv4DOtvum_867U4REywufq3rmjfzWY-eK3rOCHFh6oPAw-Fc8W_k8FTioST8RPjnwLF041XY07aDhoD8hpwxEnLeYecWYxR_Mv65uQ6cQBoixurvGoEtWXUty18d7kXaiiSY Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7577babca68a4662a9a280bf3d862a9a Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7577babca68a4662a9a280bf3d862a9a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7577babca68a4662a9a280bf3d862a9a Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-InstanceActionsNegativeTestJSON-1526035002-project Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6557ff18d9be4fcb88ab283c9a9b61aa Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1526035002-project Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: exception: Action 999 not found Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': '32fdbfb7-9bc1-4957-9677-c2a78f73698d', 'id': '999'} Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 03 14:50:05.031648 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:05.038122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Returning 404 to user: Action 999 not found {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:05.039409 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6fac761c-a44e-44b8-99b2-ac93aa17b474 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.121500 Oct 03 14:50:05.040591 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1954/3966] 10.222.0.20 () {58 vars in 1308 bytes} [Mon Oct 3 14:50:04 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d/os-instance-actions/999 => generated 66 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:50:05.048677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:05.050190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:05.058202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:05.059203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:05.060022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:05.061161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:05.061955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:05.062703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:05.362839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:05.373581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:05.382022 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb89cfa8-ea44-49f3-9d27-de17cd5d332b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.339479 Oct 03 14:50:05.383220 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1955/3967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:05 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:05.390677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:05.391894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:05.402418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:05.403358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:05.404232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:05.405444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:05.406192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:05.408659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:05.641417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:05.657043 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5bbb6750-ea72-4500-a8be-95824b2d2365 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.271661 Oct 03 14:50:05.669364 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1956/3968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:05 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:05.678209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:05.679240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:05.685753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:05.686611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:05.687326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:05.688541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:05.689265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:05.690030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.034251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:06.051298 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f25a0ed-3720-40e2-9f37-0b171add636c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.379784 Oct 03 14:50:06.052809 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1957/3969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:05 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:06.073472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46d026d5-b30b-4105-af93-1483326e71e4 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '.version_select at 0x7fb234addee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:06.074365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46d026d5-b30b-4105-af93-1483326e71e4 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 90ce7910-ab4a-4781-bc24-821c9dd9deaa] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.083497 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-46d026d5-b30b-4105-af93-1483326e71e4 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] HTTP exception thrown: Instance 90ce7910-ab4a-4781-bc24-821c9dd9deaa could not be found. Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46d026d5-b30b-4105-af93-1483326e71e4 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Request method failure captured: Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/90ce7910-ab4a-4781-bc24-821c9dd9deaa/os-instance-actions HTTP/1.1 Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaEM6gsPOTb9T0njjLFyqh7zm7TFDN9NuCqJwfyw05pv4DOtvum_867U4REywufq3rmjfzWY-eK3rOCHFh6oPAw-Fc8W_k8FTioST8RPjnwLF041XY07aDhoD8hpwxEnLeYecWYxR_Mv65uQ6cQBoixurvGoEtWXUty18d7kXaiiSY Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7577babca68a4662a9a280bf3d862a9a Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7577babca68a4662a9a280bf3d862a9a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7577babca68a4662a9a280bf3d862a9a Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-InstanceActionsNegativeTestJSON-1526035002-project Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6557ff18d9be4fcb88ab283c9a9b61aa Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1526035002-project Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 90ce7910-ab4a-4781-bc24-821c9dd9deaa could not be found. Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': '90ce7910-ab4a-4781-bc24-821c9dd9deaa'} Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ce7910-ab4a-4781-bc24-821c9dd9deaa could not be found. Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:06.087291 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ce7910-ab4a-4781-bc24-821c9dd9deaa could not be found. Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ce7910-ab4a-4781-bc24-821c9dd9deaa could not be found. Oct 03 14:50:06.091837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.097313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46d026d5-b30b-4105-af93-1483326e71e4 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Returning 404 to user: Instance 90ce7910-ab4a-4781-bc24-821c9dd9deaa could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:06.098517 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46d026d5-b30b-4105-af93-1483326e71e4 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/90ce7910-ab4a-4781-bc24-821c9dd9deaa/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.044415 Oct 03 14:50:06.099332 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1958/3970] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 3 14:50:06 2022] GET /compute/v2.1/servers/90ce7910-ab4a-4781-bc24-821c9dd9deaa/os-instance-actions => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:06.106499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:06.107485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.116355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.118136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.118805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.119780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.120536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.121212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.275629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:06.286262 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-006828c0-78ee-4d70-b7e8-7b195a85e29d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.185480 Oct 03 14:50:06.286841 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1959/3971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:06 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:06.293276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:06.294097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.300628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.301625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.302240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.303647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.304619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.305236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.362696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:50:06.363217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:50:06.363610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:50:06.365250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:50:06.365250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:50:06.374710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.375785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.376458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.377991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.378671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.379329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.396539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:06.418207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Getting quotas for project 955ecb0850844adf8230075b9fbf2dab. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:50:06.426652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Getting quotas for user c4747ce77385466ba7242aef2b746d32 and project 955ecb0850844adf8230075b9fbf2dab. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:50:06.446335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:50:06.451312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:50:06.522294 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c70330c-8654-47be-b1ae-09278715fde9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918824 Oct 03 14:50:06.524475 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2013/3972] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:50:06.548631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:06.552604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.572766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.573879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.574510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.575412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.576039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.576636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.632576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:50:06.710872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:06.726522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:06.728604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:06.730120 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9a5572c1-644e-4f4b-873b-d415f9fa42d3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.442150 Oct 03 14:50:06.730927 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1960/3973] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:06 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:06.747237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-33885e73-57e3-4609-a500-0a992ade8efd req-5f5a1bae-b0eb-4b9d-80eb-d0a5c77ad341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-plugged", "status": "completed", "tag": "3ba87e27-28db-4125-80ed-aaec86bd861c"}, {"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-plugged", "status": "completed", "tag": "cba80c5c-277c-4207-a6d7-6870affdac4f"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:06.793080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-33885e73-57e3-4609-a500-0a992ade8efd req-5f5a1bae-b0eb-4b9d-80eb-d0a5c77ad341 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.793576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-33885e73-57e3-4609-a500-0a992ade8efd req-5f5a1bae-b0eb-4b9d-80eb-d0a5c77ad341 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.794084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-33885e73-57e3-4609-a500-0a992ade8efd req-5f5a1bae-b0eb-4b9d-80eb-d0a5c77ad341 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.802089 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddf7b218-07ca-4b74-ad31-ca28ca4ec3ee tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "DELETE /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 204 len: 0 microversion: 2.1 time: 0.275907 Oct 03 14:50:06.802735 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2014/3974] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:50:06 2022] DELETE /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:50:06.816223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e7e1527-a07d-45eb-8a21-e49445ed95cb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:06.818911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e7e1527-a07d-45eb-8a21-e49445ed95cb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 364e729c-3db7-4dc4-b88f-7c1261b76ec9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.819086 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-33885e73-57e3-4609-a500-0a992ade8efd req-5f5a1bae-b0eb-4b9d-80eb-d0a5c77ad341 service nova] Creating event network-vif-plugged:3ba87e27-28db-4125-80ed-aaec86bd861c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:06.820158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-33885e73-57e3-4609-a500-0a992ade8efd req-5f5a1bae-b0eb-4b9d-80eb-d0a5c77ad341 service nova] Creating event network-vif-plugged:cba80c5c-277c-4207-a6d7-6870affdac4f for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:06.827975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-33885e73-57e3-4609-a500-0a992ade8efd req-5f5a1bae-b0eb-4b9d-80eb-d0a5c77ad341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095611 Oct 03 14:50:06.830641 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1961/3975] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:06.838492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c227dfba-924b-4992-9d7a-e122600e5c9f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:06.839644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c227dfba-924b-4992-9d7a-e122600e5c9f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.840459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2e7e1527-a07d-45eb-8a21-e49445ed95cb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 364e729c-3db7-4dc4-b88f-7c1261b76ec9 could not be found. Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e7e1527-a07d-45eb-8a21-e49445ed95cb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/364e729c-3db7-4dc4-b88f-7c1261b76ec9/action HTTP/1.1 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 39 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: {"os-getConsoleOutput": {"length": 10}} Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 364e729c-3db7-4dc4-b88f-7c1261b76ec9 could not be found. Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '364e729c-3db7-4dc4-b88f-7c1261b76ec9', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364e729c-3db7-4dc4-b88f-7c1261b76ec9 could not be found. Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364e729c-3db7-4dc4-b88f-7c1261b76ec9 could not be found. Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.849829 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:06.855443 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:06.855443 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:06.855443 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:06.855443 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:06.855443 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364e729c-3db7-4dc4-b88f-7c1261b76ec9 could not be found. Oct 03 14:50:06.855443 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:06.855443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e7e1527-a07d-45eb-8a21-e49445ed95cb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 364e729c-3db7-4dc4-b88f-7c1261b76ec9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:06.856849 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e7e1527-a07d-45eb-8a21-e49445ed95cb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/364e729c-3db7-4dc4-b88f-7c1261b76ec9/action" status: 404 len: 111 microversion: 2.1 time: 0.050819 Oct 03 14:50:06.858423 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2015/3976] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:06 2022] POST /compute/v2.1/servers/364e729c-3db7-4dc4-b88f-7c1261b76ec9/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:06.862936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:06.864205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.888249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.889279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.890559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.893272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.894759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.895796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.932628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c227dfba-924b-4992-9d7a-e122600e5c9f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:06.943140 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c227dfba-924b-4992-9d7a-e122600e5c9f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1215 microversion: 2.1 time: 0.110996 Oct 03 14:50:06.946756 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1962/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:06 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:06.954681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:06.956011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:06.966236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.967019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.967953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:06.969050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:06.969762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:06.971174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.191148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:07.202076 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ef371c03-7bb4-4e0b-84af-22ecc38dee7a tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1528 microversion: 2.1 time: 0.253982 Oct 03 14:50:07.202989 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1963/3978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:06 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1528 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:07.208450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.209423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:07.216392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.217105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.217749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.218618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.219252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.219826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.388872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:07.404145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a01ba915-fcc9-4305-9437-babaf0ff2525 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.543773 Oct 03 14:50:07.407562 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2016/3979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:06 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:07.414337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:07.422084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.423093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:07.423822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-383c2cc8-1534-468c-8c2c-f103a2deab12 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.219565 Oct 03 14:50:07.424571 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1964/3980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:07.432000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.432898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.433646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.434630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.435304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.436214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.452755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.453416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:07.463522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.464216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.464832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.465772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.466389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.467074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.642069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:07.655419 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce82d27d-9dc9-40a6-96b3-8d988fa7c357 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.207186 Oct 03 14:50:07.657179 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1965/3981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:07.681089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e291347-3985-4e4a-9f89-4ff5ccc326f6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.681749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0e291347-3985-4e4a-9f89-4ff5ccc326f6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6e6bcadb-0c51-43fc-97ce-f40686452d1d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:07.689407 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0e291347-3985-4e4a-9f89-4ff5ccc326f6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 6e6bcadb-0c51-43fc-97ce-f40686452d1d could not be found. Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e291347-3985-4e4a-9f89-4ff5ccc326f6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6e6bcadb-0c51-43fc-97ce-f40686452d1d HTTP/1.1 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6e6bcadb-0c51-43fc-97ce-f40686452d1d could not be found. Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6e6bcadb-0c51-43fc-97ce-f40686452d1d'} Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6bcadb-0c51-43fc-97ce-f40686452d1d could not be found. Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6bcadb-0c51-43fc-97ce-f40686452d1d could not be found. Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:07.691693 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:07.697282 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:07.697282 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:07.697282 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:07.697282 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6bcadb-0c51-43fc-97ce-f40686452d1d could not be found. Oct 03 14:50:07.697282 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:07.699053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e291347-3985-4e4a-9f89-4ff5ccc326f6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 6e6bcadb-0c51-43fc-97ce-f40686452d1d could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:07.700182 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e291347-3985-4e4a-9f89-4ff5ccc326f6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6e6bcadb-0c51-43fc-97ce-f40686452d1d" status: 404 len: 111 microversion: 2.1 time: 0.024065 Oct 03 14:50:07.704666 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1966/3982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1/servers/6e6bcadb-0c51-43fc-97ce-f40686452d1d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:07.710352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.711425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:07.719811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.720752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.721627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.722657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.723303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.724534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.918205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:07.939125 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1dc9583b-c4f0-4582-bcb8-420b731ecf58 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.232746 Oct 03 14:50:07.962597 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1967/3983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:07.969220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:07.969844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:07.981444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.982989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.983714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:07.984880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:07.985816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:07.986574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:08.345545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:08.361346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:08.373909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:08.403508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:08.411421 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31ee0640-553f-4110-913b-405107043a76 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.996040 Oct 03 14:50:08.413670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cf50d587-2c53-4752-8a12-ae1bb076214f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.448673 Oct 03 14:50:08.414125 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2017/3984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:08.432059 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1968/3985] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:07 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:08.460755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:08.461406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:08.463075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:08.464291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:08.488029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:08.498522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:08.499550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:08.503009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:08.503729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:08.504434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:08.506350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:08.507127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:08.509554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:08.510310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:08.511011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:08.511785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:08.600230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:08.784886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:08.803687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61d22139-586a-4612-87b3-81d1a1df2e24 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1267 microversion: 2.1 time: 0.367941 Oct 03 14:50:08.806224 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1969/3986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:08 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1267 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:08.833796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:08.835048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:08.862345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:08.863602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:08.867332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:08.868445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:08.869342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:08.870018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.030211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:09.041431 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89a8853a-d9af-4d50-ab86-5f98e702c23e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.609669 Oct 03 14:50:09.042641 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2018/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:08 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:09.050258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:09.051231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:09.060138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.061019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.061758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.062646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.063252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.064180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.278929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:09.289303 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3f6f52f-2395-4095-bc08-09d8536e5450 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.245253 Oct 03 14:50:09.290276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2019/3988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:09 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:09.312494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-879d74e5-c501-41e6-9891-fd9747b08445 req-98b85d04-5f59-4eec-b8bc-6bfe5788bfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-plugged", "status": "completed", "tag": "9b2f5bc3-8e81-4563-ba3f-7402fc93aae2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:09.335194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-879d74e5-c501-41e6-9891-fd9747b08445 req-98b85d04-5f59-4eec-b8bc-6bfe5788bfe8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.335879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-879d74e5-c501-41e6-9891-fd9747b08445 req-98b85d04-5f59-4eec-b8bc-6bfe5788bfe8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.336687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-879d74e5-c501-41e6-9891-fd9747b08445 req-98b85d04-5f59-4eec-b8bc-6bfe5788bfe8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.352133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-879d74e5-c501-41e6-9891-fd9747b08445 req-98b85d04-5f59-4eec-b8bc-6bfe5788bfe8 service nova] Creating event network-vif-plugged:9b2f5bc3-8e81-4563-ba3f-7402fc93aae2 for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:09.358457 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-879d74e5-c501-41e6-9891-fd9747b08445 req-98b85d04-5f59-4eec-b8bc-6bfe5788bfe8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055292 Oct 03 14:50:09.359552 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2020/3989] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:09.377825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bca3f15d-bfae-4c0f-9eda-dde1d00579a3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203969776", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bca3f15d-bfae-4c0f-9eda-dde1d00579a3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 238 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203969776", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1203969776', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.395462 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:09.401256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bca3f15d-bfae-4c0f-9eda-dde1d00579a3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:09.405596 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bca3f15d-bfae-4c0f-9eda-dde1d00579a3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043014 Oct 03 14:50:09.411225 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2021/3990] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:50:09 2022] POST /compute/v2.1/servers => generated 139 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:50:09.417673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:09.418619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:09.428681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.430577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.430577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.431524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.432102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.432877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.600461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:09.610505 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f45eb3c0-eb5d-4b9b-b4f4-57d4696ed962 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.197994 Oct 03 14:50:09.629437 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2022/3991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:09 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:09.638722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:09.639612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:09.647442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.648207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.648816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.649979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.650603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.651195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.821193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:09.833376 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b589f6e-7314-4fe4-a646-a100ae56e1c7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.202424 Oct 03 14:50:09.845190 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2023/3992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:09 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:09.850997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:09.853234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:09.868703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.869226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.869666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.870439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:09.870905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:09.873564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:09.973212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6557ff18d9be4fcb88ab283c9a9b61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7577babca68a4662a9a280bf3d862a9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:09.987189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-68eaab01-d564-47af-99a1-59842854d800 tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 200 len: 1528 microversion: 2.1 time: 1.169753 Oct 03 14:50:10.005643 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1970/3993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:08 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 1528 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:10.020379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:10.021612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:10.049013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.051450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.052953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.054134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.055488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.067173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.287763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:10.298697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:10.301065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:10.302698 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ef202b3-3d99-4ab6-8f90-70f12ad91044 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.463410 Oct 03 14:50:10.303761 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2024/3994] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:09 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:10.310455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:10.311204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:10.325664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.327139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.329631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.331951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.332845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.336457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.422309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a61cde25-5756-4c9f-bf6e-495e1e5372ae tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1273 microversion: 2.1 time: 0.128992 Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2025/3995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:10 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d53c8c6b-28c8-48ab-826c-b683c701d793 req-49530f31-e77a-4188-b706-f3f2c199737c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fdbfb7-9bc1-4957-9677-c2a78f73698d", "name": "network-vif-deleted", "tag": "fd3a7fdb-0a44-4d37-b8d4-4d7a6d6eb3be"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d53c8c6b-28c8-48ab-826c-b683c701d793 req-49530f31-e77a-4188-b706-f3f2c199737c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d53c8c6b-28c8-48ab-826c-b683c701d793 req-49530f31-e77a-4188-b706-f3f2c199737c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d53c8c6b-28c8-48ab-826c-b683c701d793 req-49530f31-e77a-4188-b706-f3f2c199737c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d53c8c6b-28c8-48ab-826c-b683c701d793 req-49530f31-e77a-4188-b706-f3f2c199737c service nova] Creating event network-vif-deleted:fd3a7fdb-0a44-4d37-b8d4-4d7a6d6eb3be for instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d on n-h2-781139-2 Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d53c8c6b-28c8-48ab-826c-b683c701d793 req-49530f31-e77a-4188-b706-f3f2c199737c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061206 Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2026/3996] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:10.505180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:10.511811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.512225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.512667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.513414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.514030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.514474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.681505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:10.690777 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3f9a3bf-e445-421f-a64c-1e171a9be2e0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.191322 Oct 03 14:50:10.691755 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2027/3997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:10 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:10.868900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:10.869751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:10.893045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.894480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.895485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:10.897644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:10.899852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:10.900502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:11.062186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:11.093019 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-95470a50-bf4b-436c-95e8-5d72d4343529 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.080013 Oct 03 14:50:11.094356 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1971/3998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:10 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:11.112662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:11.114173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:11.114936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] [instance: 32fdbfb7-9bc1-4957-9677-c2a78f73698d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:11.130122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:11.135794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:11.136607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:11.137558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:11.138159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:11.139337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:11.161608 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ba50100-2b8d-43e2-8a63-a7cf017f2fb8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.303554 Oct 03 14:50:11.164019 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2028/3999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:10 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:11.198874 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] HTTP exception thrown: Instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d could not be found. Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Request method failure captured: Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d HTTP/1.1 Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaEM6gsPOTb9T0njjLFyqh7zm7TFDN9NuCqJwfyw05pv4DOtvum_867U4REywufq3rmjfzWY-eK3rOCHFh6oPAw-Fc8W_k8FTioST8RPjnwLF041XY07aDhoD8hpwxEnLeYecWYxR_Mv65uQ6cQBoixurvGoEtWXUty18d7kXaiiSY Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7577babca68a4662a9a280bf3d862a9a Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7577babca68a4662a9a280bf3d862a9a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7577babca68a4662a9a280bf3d862a9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7577babca68a4662a9a280bf3d862a9a Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1526035002 Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-InstanceActionsNegativeTestJSON-1526035002-project Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6557ff18d9be4fcb88ab283c9a9b61aa Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1526035002-project Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d could not be found. Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '32fdbfb7-9bc1-4957-9677-c2a78f73698d'} Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d could not be found. Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d could not be found. Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.211076 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d could not be found. Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] Returning 404 to user: Instance 32fdbfb7-9bc1-4957-9677-c2a78f73698d could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:11.214214 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0aed86c6-9f9c-4487-aa82-9bafdfd7e8ae tempest-InstanceActionsNegativeTestJSON-1526035002 tempest-InstanceActionsNegativeTestJSON-1526035002-project] 10.222.0.20 "GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d" status: 404 len: 111 microversion: 2.1 time: 0.117000 Oct 03 14:50:11.222462 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1972/4000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:11 2022] GET /compute/v2.1/servers/32fdbfb7-9bc1-4957-9677-c2a78f73698d => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:11.226163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-574371a1-ff0d-404c-9764-ac9cf9f6fbd7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1697341086", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-574371a1-ff0d-404c-9764-ac9cf9f6fbd7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 235 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1697341086", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1697341086', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.231086 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-574371a1-ff0d-404c-9764-ac9cf9f6fbd7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:11.235457 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-574371a1-ff0d-404c-9764-ac9cf9f6fbd7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026063 Oct 03 14:50:11.236825 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2029/4001] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:50:11 2022] POST /compute/v2.1/servers => generated 133 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:50:11.256838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:11.277951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:11.287696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:11.291294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:11.294328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:11.295096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:11.295571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:11.296009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:11.329007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:11.329628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:11.357600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:11.358113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:11.358571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:11.359320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:11.359783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:11.360213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:11.925949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:11.939070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:11.945923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:11.950630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d26e1b39-c2e2-4ed6-8d09-16e289cd84bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.625241 Oct 03 14:50:11.953546 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2030/4002] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:11 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:11.969120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-733377fe-1a69-4ae3-aaa7-99773acaeb80 req-28a9a686-3f98-4b13-b812-9ab24813aa26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335b701a-b1ae-4492-a11b-cf7f6a9f03cb", "name": "network-vif-plugged", "status": "completed", "tag": "d1b940fb-7b30-4aa7-bbae-5d63b072a331"}, {"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-plugged", "status": "completed", "tag": "6a23350a-a333-440d-a327-a676c7ec15bc"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:12.000897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-733377fe-1a69-4ae3-aaa7-99773acaeb80 req-28a9a686-3f98-4b13-b812-9ab24813aa26 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.001414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-733377fe-1a69-4ae3-aaa7-99773acaeb80 req-28a9a686-3f98-4b13-b812-9ab24813aa26 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.002291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-733377fe-1a69-4ae3-aaa7-99773acaeb80 req-28a9a686-3f98-4b13-b812-9ab24813aa26 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.030889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:12.042125 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-733377fe-1a69-4ae3-aaa7-99773acaeb80 req-28a9a686-3f98-4b13-b812-9ab24813aa26 service nova] Creating event network-vif-plugged:d1b940fb-7b30-4aa7-bbae-5d63b072a331 for instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb on n-h2-781139-2 Oct 03 14:50:12.042641 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-733377fe-1a69-4ae3-aaa7-99773acaeb80 req-28a9a686-3f98-4b13-b812-9ab24813aa26 service nova] Creating event network-vif-plugged:6a23350a-a333-440d-a327-a676c7ec15bc for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:12.047817 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2255a3d3-c8aa-4930-afb7-a8c651363d2c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.806269 Oct 03 14:50:12.048768 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1973/4003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:11 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:12.053949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:12.054565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:12.089689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.091745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.093462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.095714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.096183 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-733377fe-1a69-4ae3-aaa7-99773acaeb80 req-28a9a686-3f98-4b13-b812-9ab24813aa26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.136799 Oct 03 14:50:12.098368 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2031/4004] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:12.099090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.101105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.109688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:12.112742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:12.139901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.140658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.141280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.142148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.142845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.144914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.246769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:12.258353 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ac12330-3a58-4c50-8665-6fd99f77f60f tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1273 microversion: 2.1 time: 0.208372 Oct 03 14:50:12.276935 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1974/4005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:12 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:12.288679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:12.290134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:12.303541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.304281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.304946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.306712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.308643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.309250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.441766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:12.449855 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-888e3c79-45cf-470e-9bd8-064f7155dd02 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.345007 Oct 03 14:50:12.456126 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2032/4006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:12 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:12.476339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:12.478466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:12.500492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.500766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.501245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.502416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.502865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.503333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:12.847702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:12.877782 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8267bca-64ad-4028-b332-fbfbc3310802 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.418757 Oct 03 14:50:12.882023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2033/4007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:12 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:12.982174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:12.982801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:12.994309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:12.994827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:12.995257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:13.003945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:13.004485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:13.004958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:13.533413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:13.548260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:13.550028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:13.551394 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b42c650b-6d67-40a3-aa13-ef7480debca6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.573301 Oct 03 14:50:13.552020 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2034/4008] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:12 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:50:13.563786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:13.578097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:13.584652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:13.585337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:13.585899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:13.586770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:13.587361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:13.587923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:13.652168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:13.661797 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f17e327-fd39-491c-bbf1-e66c9c74df2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.383611 Oct 03 14:50:13.666297 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1975/4009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:12 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:13.681742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:13.682816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:13.690751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:13.697712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:13.698475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:13.699443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:13.700105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:13.701015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:13.910659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:13.934806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4d80461-7f46-4976-bd2b-90158e139ad1 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.379018 Oct 03 14:50:13.935809 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2035/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:13 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:13.955096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d2a6664-14c4-4db9-a6bd-2ea2a94d676f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:13.956551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d2a6664-14c4-4db9-a6bd-2ea2a94d676f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 88b69743-5d6d-4c75-b775-690d50434d7e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:13.972225 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1d2a6664-14c4-4db9-a6bd-2ea2a94d676f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 88b69743-5d6d-4c75-b775-690d50434d7e could not be found. Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d2a6664-14c4-4db9-a6bd-2ea2a94d676f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/88b69743-5d6d-4c75-b775-690d50434d7e/action HTTP/1.1 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 13 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: {"pause": {}} Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 88b69743-5d6d-4c75-b775-690d50434d7e could not be found. Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '88b69743-5d6d-4c75-b775-690d50434d7e', 'body': {'pause': {}}} Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b69743-5d6d-4c75-b775-690d50434d7e could not be found. Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b69743-5d6d-4c75-b775-690d50434d7e could not be found. Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:13.985599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:13.989215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:13.989215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:13.989215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b69743-5d6d-4c75-b775-690d50434d7e could not be found. Oct 03 14:50:13.989215 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:13.989215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d2a6664-14c4-4db9-a6bd-2ea2a94d676f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 88b69743-5d6d-4c75-b775-690d50434d7e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:13.991315 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d2a6664-14c4-4db9-a6bd-2ea2a94d676f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/88b69743-5d6d-4c75-b775-690d50434d7e/action" status: 404 len: 111 microversion: 2.1 time: 0.048952 Oct 03 14:50:13.991975 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2036/4011] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:13 2022] POST /compute/v2.1/servers/88b69743-5d6d-4c75-b775-690d50434d7e/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:14.004207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:14.004844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:14.015654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:14.016152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:14.016649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:14.017348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:14.025214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:14.026896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:14.451539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:14.452490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:14.455864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:14.464739 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8caea799-fea7-48cc-9019-5959fe0c504a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.797079 Oct 03 14:50:14.466472 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abccdb01-c673-49ca-8ed5-5d50dc318f54 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.467309 Oct 03 14:50:14.467101 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2037/4012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:13 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:14.470083 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1976/4013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:13 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:14.479848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:14.481560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:14.485570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-plugged", "status": "completed", "tag": "e14485b9-4cd9-42c0-9cf6-f51ba0ee151c"}, {"server_uuid": "b04994ce-f544-4364-9887-e60b13b07143", "name": "network-vif-plugged", "status": "completed", "tag": "a2b25e07-562c-40ab-9636-a9ba529efa7d"}, {"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-plugged", "status": "completed", "tag": "a8a8304b-3890-4398-adc1-3a98e17e1e35"}, {"server_uuid": "6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a", "name": "network-vif-plugged", "status": "completed", "tag": "4a60185d-a514-45ec-b3b9-cf023e0ef954"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:14.497137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:14.498359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:14.501147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:14.503568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:14.504848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:14.508415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:14.514208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:14.514970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:14.515608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:14.541528 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Creating event network-vif-plugged:e14485b9-4cd9-42c0-9cf6-f51ba0ee151c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:14.548333 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Creating event network-vif-plugged:a2b25e07-562c-40ab-9636-a9ba529efa7d for instance b04994ce-f544-4364-9887-e60b13b07143 on n-h2-781139-2 Oct 03 14:50:14.550857 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Creating event network-vif-plugged:a8a8304b-3890-4398-adc1-3a98e17e1e35 for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:14.551439 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] Creating event network-vif-plugged:4a60185d-a514-45ec-b3b9-cf023e0ef954 for instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a on n-h1-781139-2 Oct 03 14:50:14.587792 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-4f1306f0-04db-4043-a35b-7cd3ed1aaf07 req-25c2d908-e372-4042-a9db-bdaebb739429 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.115332 Oct 03 14:50:14.594086 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1977/4014] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:14.601534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:14.602466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:14.625509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:14.626478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:14.627458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:14.628281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:14.628875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:14.629703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:14.983950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:14.994430 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23fb9f6f-e519-4ad4-b148-c7f09993f3dc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.525082 Oct 03 14:50:15.018781 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2038/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:14 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:15.030606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:15.031531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:15.039573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.040271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.040845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.042388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.042962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.043598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.308448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:15.318833 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-709e8d5b-3670-4c3f-ab55-1c26a26c3aa9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.298861 Oct 03 14:50:15.324171 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2039/4016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:15 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:15.340802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:15.341677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:15.349280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.350029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.350605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.351459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.352049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.352608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.379567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:15.594391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:15.622676 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fb58d09-e181-498f-a3c6-9cc5c233c453 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.296585 Oct 03 14:50:15.624704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2040/4017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:15 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:15.634310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:15.635693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:15.646159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.646987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.647802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.649545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.650226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.651065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.750053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:15.761031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:15.762851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:15.764228 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a5b68873-a1a1-4a41-9175-acceb44caaa1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 1.168827 Oct 03 14:50:15.765846 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1978/4018] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:14 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:15.770628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:15.771439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:15.778347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.778974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.779683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.780540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.781164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.781727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.908805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:15.925538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1467352b-4c08-4692-9359-6040808249f1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.299320 Oct 03 14:50:15.941175 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2041/4019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:15 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:15.946585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:15.947303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:15.953993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.954666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.955635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:15.956495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:15.957308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:15.958190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:16.091514 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19371d9c-e794-4822-bf4d-9fe49554a1cd tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 202 len: 0 microversion: 2.1 time: 0.148629 Oct 03 14:50:16.092527 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2042/4020] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:15 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:16.105538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:16.113377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:16.131049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:16.131663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:16.132320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:16.133549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:16.135089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:16.138551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:16.336192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:16.347136 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc5968e6-c1b2-412a-97a4-910048ac9b30 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1322 microversion: 2.1 time: 0.580052 Oct 03 14:50:16.348328 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1979/4021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:15 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1322 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:16.354462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:16.355625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:16.372461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:16.373335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:16.374003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:16.374983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:16.376233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:16.377486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:16.393377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:16.440426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:16.531380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:16.542557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a738a27c-118c-42b9-917f-9f12685a566b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1509 microversion: 2.1 time: 0.445632 Oct 03 14:50:16.543891 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2043/4022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:16 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1509 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:16.796629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:16.797701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:16.805037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:16.805778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:16.806432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:16.807167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:16.807598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:16.808208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:16.937826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:16.958695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:16.973438 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-336ced2c-b4de-4332-8683-7c4ba1d82309 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.623755 Oct 03 14:50:16.982418 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1980/4023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:16 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:16.992124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:16.994673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:17.045234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:17.045801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:17.050512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:17.052163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:17.067613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:17.068077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:17.651993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:17.652565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:17.667847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:17.669246 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3d906d9-fd7b-4e21-8e43-17f43acb0907 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1315 microversion: 2.1 time: 0.685381 Oct 03 14:50:17.669935 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1981/4024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:16 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:17.670396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:17.708854 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3901079-f24e-496b-b49c-93c99c4e3589 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1880 microversion: 2.32 time: 0.916224 Oct 03 14:50:17.709530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2044/4025] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:16 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1880 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:50:17.732523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:17.733465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:17.742880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:17.743603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:17.744190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:17.745089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:17.746228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:17.746802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:17.789080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-89ab8dfb-187d-427d-aaca-c8ec5d4b598a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Action: 'create', calling method: .version_select at 0x7fb234addb80>, body: {"keypair": {"name": "tempest-keypair-1732639320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7oDaa4fKbRUnDbiAn4fEDEW2XL1fhn6fkem/ilAvqOCWZcu6RsFvnSNJVRtrnt97lgtdLdWDj9NrEYYAstYLQ8WJlH7Yh99sFgTqMdcbrdZzIejEMAZPi8yqY2s9rN9Q=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:17.795561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:17.836805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-89ab8dfb-187d-427d-aaca-c8ec5d4b598a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Getting quotas for project 274c609aea3e492aa92942d359fd4d8a. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:50:17.878533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-89ab8dfb-187d-427d-aaca-c8ec5d4b598a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Getting quotas for user 2e346fcbb9e040448644511b529ad4dc and project 274c609aea3e492aa92942d359fd4d8a. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:50:17.934618 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-89ab8dfb-187d-427d-aaca-c8ec5d4b598a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.262910 Oct 03 14:50:17.935516 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1982/4026] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:50:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:17.941210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:17.950687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:17.967863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:17.971784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:17.972799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:17.974375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:17.974956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:17.976086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.206277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:18.220154 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6d61592-d7a0-40ee-b5d5-b43bd6ad2188 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1516 microversion: 2.1 time: 0.493613 Oct 03 14:50:18.237138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2045/4027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:17 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:18.237138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d1ccb386-0f7b-4041-ab1b-6b75f98d6399 req-637a7545-5ca8-4e4d-b1c1-826a5aaa2aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b667d8-6149-4397-b436-84c02d21ed14", "tag": "abb4881b-9d98-4297-957f-705362311606"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:18.250270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d1ccb386-0f7b-4041-ab1b-6b75f98d6399 req-637a7545-5ca8-4e4d-b1c1-826a5aaa2aa2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.250906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d1ccb386-0f7b-4041-ab1b-6b75f98d6399 req-637a7545-5ca8-4e4d-b1c1-826a5aaa2aa2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.251366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d1ccb386-0f7b-4041-ab1b-6b75f98d6399 req-637a7545-5ca8-4e4d-b1c1-826a5aaa2aa2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.264736 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d1ccb386-0f7b-4041-ab1b-6b75f98d6399 req-637a7545-5ca8-4e4d-b1c1-826a5aaa2aa2 service nova] Creating event network-changed:abb4881b-9d98-4297-957f-705362311606 for instance f7b667d8-6149-4397-b436-84c02d21ed14 on n-h1-781139-2 Oct 03 14:50:18.272349 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d1ccb386-0f7b-4041-ab1b-6b75f98d6399 req-637a7545-5ca8-4e4d-b1c1-826a5aaa2aa2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049425 Oct 03 14:50:18.274196 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2046/4028] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:18.286777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:18.293742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:18.300455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.309159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.309532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.310385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.310955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.311447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.543001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:18.566538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dabb93cc-ed96-4bf1-bade-28017e8ad211 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.289840 Oct 03 14:50:18.578845 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2047/4029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:18 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:18.596952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:18.599930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:18.609082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.609525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.609968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.610708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.611230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.612346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.664198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lazy-loading 'flavor' on Instance uuid b04994ce-f544-4364-9887-e60b13b07143 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:50:18.709767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:18.729160 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd587082-9086-4919-970f-9a3eaca7eb21 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1489 microversion: 2.1 time: 0.790189 Oct 03 14:50:18.731706 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1983/4030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:17 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1489 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:18.754055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:18.762811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:18.781331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.782163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.782279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.783062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.783520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.784145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.832512 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58f672fe-d710-480b-b931-f5d2f8e9838c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action" status: 200 len: 32 microversion: 2.1 time: 0.252100 Oct 03 14:50:18.841453 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2048/4031] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:18 2022] POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action => generated 32 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:50:18.847198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:18.853878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:18.868766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.869316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.869761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:18.870517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:18.870928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:18.871346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.236625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:19.254032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:19.255825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:19.257344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70273a71-f788-4c4b-bb77-b980532ce8d9 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2835 microversion: 2.32 time: 0.414490 Oct 03 14:50:19.274559 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2049/4032] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:50:18 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2835 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:19.288172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:19.288963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:19.296176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.297041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.297687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.298700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.299312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.299882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.329215 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Cannot 'pause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state paused Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action HTTP/1.1 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 13 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: {"pause": {}} Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'pause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state paused Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'pause': {}}} Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 in vm_state paused. Cannot pause while the instance is in this state. Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state paused Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:19.333391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:19.337098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:19.337098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:19.337098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:19.337098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state paused Oct 03 14:50:19.337098 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:19.338420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 409 to user: Cannot 'pause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state paused {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:19.339308 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb13b59a-85bd-4676-8aef-bec7c352dad4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 409 len: 143 microversion: 2.1 time: 0.063510 Oct 03 14:50:19.340406 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2050/4033] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:19 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 143 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:50:19.356951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:19.356951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:19.389419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.390034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.390667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.391454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.392019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.392504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.676087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:19.689686 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c7973bd-d3e4-4347-9c56-a30d6ea79624 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.347634 Oct 03 14:50:19.705493 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2051/4034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:19 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:19.716570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:19.719594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:19.736787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.739566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.739903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.740654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.741247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.741577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.855332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:19.864322 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb004359-a9fd-4daf-86cc-efce905c1c84 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1502 microversion: 2.1 time: 1.131283 Oct 03 14:50:19.864950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1984/4035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:18 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1502 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:19.880228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:19.880982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:19.897297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.898017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.898611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:19.899469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:19.900090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:19.900644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:20.032847 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7cef3e16-f27b-4767-99b6-0379628e370d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 202 len: 0 microversion: 2.1 time: 0.161901 Oct 03 14:50:20.034369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1985/4036] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:19 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:20.041776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:20.042686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:20.055861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1a84513-9877-4e0e-a738-4719ca5b4449 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.353628 Oct 03 14:50:20.056811 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2052/4037] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:50:19 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b/os-interface => generated 1832 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:50:20.057591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:20.058088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:20.058569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:20.059274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:20.059727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:20.060147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:20.062291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:20.062839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:20.090537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:20.091183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:20.096896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:20.097789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:20.098295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:20.100993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:20.583168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:20.596356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bf78a946-8681-4888-8c55-5014b7f94460 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.559663 Oct 03 14:50:20.599300 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1986/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:20 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:20.613602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:20.615379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:20.615745 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Removing security group 8f895bd4-8daa-4003-b8bb-c42786a5ed78 from port 4a60185d-a514-45ec-b3b9-cf023e0ef954 Oct 03 14:50:20.644512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:20.647351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:20.648009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:20.648912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:20.650566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:20.660002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.052767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:21.065974 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3681f629-fc92-4c45-9ba4-9945af63b212 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1496 microversion: 2.1 time: 0.462554 Oct 03 14:50:21.066557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1987/4039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:20 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1496 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:21.091250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:21.093228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:21.102394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:21.103078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:21.103590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.104561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:21.105125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:21.105753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.474226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:21.483610 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4bce8590-0fdb-4180-8afc-4daaf3121b14 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.414814 Oct 03 14:50:21.484318 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1988/4040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:21 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:21.624417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:21.625121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:21.634927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:21.636225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:21.636857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.637884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:21.638579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:21.640862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.657030 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5641e91-1bf4-4bf9-bada-3019e38d0bfb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a/action" status: 202 len: 0 microversion: 2.1 time: 1.599021 Oct 03 14:50:21.659769 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2053/4041] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:20 2022] POST /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a/action => generated 0 bytes in 1602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:21.669033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:21.671219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:21.688466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:21.689368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:21.690305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.691606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:21.693261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:21.693902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.897549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:21.906075 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ec0aef4-4e25-49e6-b583-4715982cfc85 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1460 microversion: 2.1 time: 0.243307 Oct 03 14:50:21.906975 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2054/4042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:21 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1460 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:21.930020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-45c79b10-1174-40cd-ad44-67f14bdedb84 req-51bad458-9e7a-4ea9-9f5d-e5b9cd3cb2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a", "tag": "4a60185d-a514-45ec-b3b9-cf023e0ef954"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:21.948692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45c79b10-1174-40cd-ad44-67f14bdedb84 req-51bad458-9e7a-4ea9-9f5d-e5b9cd3cb2c6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:21.949706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45c79b10-1174-40cd-ad44-67f14bdedb84 req-51bad458-9e7a-4ea9-9f5d-e5b9cd3cb2c6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:21.951600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45c79b10-1174-40cd-ad44-67f14bdedb84 req-51bad458-9e7a-4ea9-9f5d-e5b9cd3cb2c6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:21.988824 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-45c79b10-1174-40cd-ad44-67f14bdedb84 req-51bad458-9e7a-4ea9-9f5d-e5b9cd3cb2c6 service nova] Creating event network-changed:4a60185d-a514-45ec-b3b9-cf023e0ef954 for instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a on n-h1-781139-2 Oct 03 14:50:22.004830 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-45c79b10-1174-40cd-ad44-67f14bdedb84 req-51bad458-9e7a-4ea9-9f5d-e5b9cd3cb2c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080942 Oct 03 14:50:22.005869 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2055/4043] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:22.013200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:22.014228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:22.022133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:22.022929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:22.023818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:22.024808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:22.025515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:22.030023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:22.038429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:22.105229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:22.129271 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29247a84-04eb-4dc0-8365-b75c4c66ad87 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.510085 Oct 03 14:50:22.143389 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1989/4044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:21 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:22.156896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:22.157619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:22.168446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:22.169897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:22.170945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:22.175095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:22.176128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:22.177784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:22.691782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:22.709675 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6800406d-eb4a-4aa5-8812-6ee22a69e18d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.701855 Oct 03 14:50:22.711556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2056/4045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:22 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:22.717683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:22.718775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:22.725525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:22.729667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:22.730806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:22.732690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:22.734171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:22.734887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:22.735557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:23.079290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:23.087631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:23.099566 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6348d1c5-17d4-498e-94e0-df5114570dc4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.386356 Oct 03 14:50:23.104014 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53de4890-788a-4440-bf41-592d70047d08 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1496 microversion: 2.1 time: 0.959317 Oct 03 14:50:23.107018 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1990/4046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:22 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1496 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:23.122824 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2057/4047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:22 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:23.142646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:23.144511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:23.156463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:23.157128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:23.159191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:23.160140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:23.163951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:23.164942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:23.166335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:23.166982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:23.167152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:23.167606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:23.167933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:23.168833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:23.170018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:23.171083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:23.352051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:23.362502 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79f801c1-c894-4c3a-863c-202a92af74de tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.210434 Oct 03 14:50:23.369790 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2058/4048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:23 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:23.369790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8e93b997-904d-41d5-b285-4f9b3f545374"}], "security_groups": [{"name": "tempest-securitygroup--458966857"}], "key_name": "tempest-keypair-1732639320", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:23.487902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] validate_networks() for [('8e93b997-904d-41d5-b285-4f9b3f545374', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:50:23.776583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:23.791582 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-358a3415-4172-4f17-84e7-174d2b101291 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.667295 Oct 03 14:50:23.798447 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1991/4049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:23 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:23.821348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:23.821348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:23.834194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:23.835815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:23.836381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:23.837514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:23.837836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:23.838458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.050279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:50:24.050893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:50:24.051179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:50:24.051593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:50:24.052164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:50:24.066427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.067005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.067448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.068247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.068710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.069181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.103294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Getting quotas for project 274c609aea3e492aa92942d359fd4d8a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:50:24.109533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Getting quotas for user 2e346fcbb9e040448644511b529ad4dc and project 274c609aea3e492aa92942d359fd4d8a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:50:24.128479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:50:24.131358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:50:24.198063 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbea3cec-0cce-4f37-8941-7c600fe65d87 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.833106 Oct 03 14:50:24.206203 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2059/4050] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:50:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:50:24.217088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-69e62f65-9865-40ee-9759-2afc889b056f req-fd987c2e-87b4-43f1-aa72-298097696c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "tag": "e14485b9-4cd9-42c0-9cf6-f51ba0ee151c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:24.230694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-69e62f65-9865-40ee-9759-2afc889b056f req-fd987c2e-87b4-43f1-aa72-298097696c6b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.231285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-69e62f65-9865-40ee-9759-2afc889b056f req-fd987c2e-87b4-43f1-aa72-298097696c6b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.231629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-69e62f65-9865-40ee-9759-2afc889b056f req-fd987c2e-87b4-43f1-aa72-298097696c6b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.248806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-69e62f65-9865-40ee-9759-2afc889b056f req-fd987c2e-87b4-43f1-aa72-298097696c6b service nova] Creating event network-changed:e14485b9-4cd9-42c0-9cf6-f51ba0ee151c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:50:24.255207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-69e62f65-9865-40ee-9759-2afc889b056f req-fd987c2e-87b4-43f1-aa72-298097696c6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047113 Oct 03 14:50:24.256072 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2060/4051] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:24.262327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:24.262897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:24.273773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.274248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.274680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.275417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.275864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.276281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.634640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:24.644548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e61a386c-ff4e-4074-9027-dfd502eeb4c6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.827801 Oct 03 14:50:24.648521 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1992/4052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:23 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:24.659683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:24.661514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:24.668716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:24.676158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.676731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.681865 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6c443bc-6d16-4fa0-b9d9-e2b3450ec9fc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.424545 Oct 03 14:50:24.697321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.697321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.697321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.697321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.698813 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2061/4053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:24 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:24.711946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bca713c3-7ff1-49e1-9267-9826264405b3 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:24.712634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bca713c3-7ff1-49e1-9267-9826264405b3 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:24.831224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bca713c3-7ff1-49e1-9267-9826264405b3 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:24.842253 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bca713c3-7ff1-49e1-9267-9826264405b3 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1226 microversion: 2.1 time: 0.139544 Oct 03 14:50:24.843826 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2062/4054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:24 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:24.854083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:24.854702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:24.871923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.878643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.879311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:24.880355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:24.881026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:24.881591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.089864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:25.101706 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2d28819-c35d-47af-8aa5-1e27e4dbad29 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.447467 Oct 03 14:50:25.118310 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1993/4055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:24 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:25.125297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:25.126164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:25.135293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.136113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.136737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.137672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.139699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.140357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.145820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:25.295877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:25.312242 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7c786047-41cb-4eaf-84ee-01d42a9cb11a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.466105 Oct 03 14:50:25.313238 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2063/4056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:24 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:25.318831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:25.319443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:25.334262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.337530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.338135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.339016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.341430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.342053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.752303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:25.763397 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25d730de-28b2-4fbe-8307-d4cb3d3e2924 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.643541 Oct 03 14:50:25.775444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:25.778497 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1994/4057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:25 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:25.786405 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c2dadf6-844b-4b6f-95e8-aebcd1f086d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.472023 Oct 03 14:50:25.795913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6bfa0ff8-2bf0-4323-b45a-d1ab5c7f8fd9 req-623c7137-5f57-4cdb-8037-dc5c57318d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b667d8-6149-4397-b436-84c02d21ed14", "name": "network-vif-plugged", "status": "completed", "tag": "abb4881b-9d98-4297-957f-705362311606"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:25.807270 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2064/4058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:25 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:25.827601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bfa0ff8-2bf0-4323-b45a-d1ab5c7f8fd9 req-623c7137-5f57-4cdb-8037-dc5c57318d67 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.828305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bfa0ff8-2bf0-4323-b45a-d1ab5c7f8fd9 req-623c7137-5f57-4cdb-8037-dc5c57318d67 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.828978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bfa0ff8-2bf0-4323-b45a-d1ab5c7f8fd9 req-623c7137-5f57-4cdb-8037-dc5c57318d67 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.831303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:25.833889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:25.847639 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6bfa0ff8-2bf0-4323-b45a-d1ab5c7f8fd9 req-623c7137-5f57-4cdb-8037-dc5c57318d67 service nova] Creating event network-vif-plugged:abb4881b-9d98-4297-957f-705362311606 for instance f7b667d8-6149-4397-b436-84c02d21ed14 on n-h1-781139-2 Oct 03 14:50:25.849664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.854059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.854826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.856111 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6bfa0ff8-2bf0-4323-b45a-d1ab5c7f8fd9 req-623c7137-5f57-4cdb-8037-dc5c57318d67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075405 Oct 03 14:50:25.857264 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1995/4059] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:25.858037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.858518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.858962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.867760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:25.868736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:25.877011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.877664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.878911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.880056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.880682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.881866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.929496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201/action HTTP/1.1 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 28 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: {"reboot": {"type": "SOFT"}} Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '6c71dba2-a318-4f5e-a8aa-976b28f82201', 'body': {'reboot': {'type': 'SOFT'}}} Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:25.934544 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:25.938599 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:25.940763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:25.944157 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42c28b01-b9a0-43b2-ae5c-abc70142e734 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201/action" status: 404 len: 111 microversion: 2.1 time: 0.117317 Oct 03 14:50:25.945479 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2065/4060] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:25 2022] POST /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201/action => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:50:25.967799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:25.972326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:25.989821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:25.992012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.992680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.993980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:25.997156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:25.997984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:25.999049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:26.006371 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4be071a5-a6b1-4e9f-9f7b-c899748a257c tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1278 microversion: 2.1 time: 0.138684 Oct 03 14:50:26.009822 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1996/4061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:25 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:26.025563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-489885090", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "85fcbfd3-3026-41ec-a964-76a31555f33f"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:26.135172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] validate_networks() for [('85fcbfd3-3026-41ec-a964-76a31555f33f', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:50:26.366458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:26.377731 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b3d02d9-4357-41a0-bf39-619599dd654a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.422487 Oct 03 14:50:26.404495 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2066/4062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:25 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:26.424738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:26.425421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:26.432723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:26.433362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:26.433882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:26.441399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:26.442464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:26.443175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.029110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:27.042432 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92f404a0-239e-4d7b-a7d1-b61c47cefb8d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.634801 Oct 03 14:50:27.044093 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2067/4063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:26 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:27.049460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:27.050524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:27.057131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.057959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.058636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.061546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.062209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.062934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.403131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:27.416274 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48fafdf9-1dfa-4cc6-9450-33ed172826b0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.370548 Oct 03 14:50:27.417736 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2068/4064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:27 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:27.423559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:27.424625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:27.432889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.433662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.434306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.435203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.436116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.436727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.609896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:50:27.609896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:50:27.610883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:50:27.611526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:50:27.611948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:50:27.634061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.634736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.637011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.641027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.642292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.643608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.670540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:50:27.678450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Getting quotas for user 2cd32680b6b342ea962e104cfaf4c311 and project b183c9eff5e549478b3d8de2fe72ada3. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:50:27.709772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:50:27.715117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:50:27.737743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:27.754853 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7f68d9f-ab98-45f1-8a7f-2b908a4b905a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.335724 Oct 03 14:50:27.769359 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2069/4065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:27 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:27.784659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:27.785316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:27.802598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.803102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.805681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.806667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.808822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.809472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.815801 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8fb1edd1-9e56-4fc1-84c6-3d305ab6b492 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.792678 Oct 03 14:50:27.829592 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1997/4066] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:50:27.840147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b38640e-eb75-449b-9141-253f975efec6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:27.842883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b38640e-eb75-449b-9141-253f975efec6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1c3c2298-d646-4543-a5a8-5cc26ed6f17b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:27.862737 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-3b38640e-eb75-449b-9141-253f975efec6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 1c3c2298-d646-4543-a5a8-5cc26ed6f17b could not be found. Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b38640e-eb75-449b-9141-253f975efec6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/1c3c2298-d646-4543-a5a8-5cc26ed6f17b/action HTTP/1.1 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 28 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: {"reboot": {"type": "SOFT"}} Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1c3c2298-d646-4543-a5a8-5cc26ed6f17b could not be found. Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1c3c2298-d646-4543-a5a8-5cc26ed6f17b', 'body': {'reboot': {'type': 'SOFT'}}} Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3c2298-d646-4543-a5a8-5cc26ed6f17b could not be found. Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3c2298-d646-4543-a5a8-5cc26ed6f17b could not be found. Oct 03 14:50:27.865281 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3c2298-d646-4543-a5a8-5cc26ed6f17b could not be found. Oct 03 14:50:27.869256 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:27.871800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b38640e-eb75-449b-9141-253f975efec6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 1c3c2298-d646-4543-a5a8-5cc26ed6f17b could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:27.874836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b38640e-eb75-449b-9141-253f975efec6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1c3c2298-d646-4543-a5a8-5cc26ed6f17b/action" status: 404 len: 111 microversion: 2.1 time: 0.043796 Oct 03 14:50:27.878264 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1998/4067] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:27 2022] POST /compute/v2.1/servers/1c3c2298-d646-4543-a5a8-5cc26ed6f17b/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:27.884128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ea46da8e-ab5a-4ccc-98ff-7fea60fe950b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:27.887092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ea46da8e-ab5a-4ccc-98ff-7fea60fe950b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:27.922473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:27.935331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37f58a62-2636-4d0a-aed4-8307961044eb tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1284 microversion: 2.1 time: 0.164724 Oct 03 14:50:27.938104 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2070/4068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:27 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:27.947996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:27.948937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:27.967511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.974852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.975621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:27.977384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:27.977990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:27.978585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.005683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ea46da8e-ab5a-4ccc-98ff-7fea60fe950b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:28.024914 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ea46da8e-ab5a-4ccc-98ff-7fea60fe950b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1214 microversion: 2.1 time: 0.145195 Oct 03 14:50:28.040948 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 1999/4069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:27 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:28.068913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:28.069995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:28.097891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.098609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.099435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.100436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.101238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.101849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.304563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:28.313408 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7160e6f2-0a99-4b8d-bc12-e442cf2f4380 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.373110 Oct 03 14:50:28.318084 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2071/4070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:27 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:28.365077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:28.366427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:28.379161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.380467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.381519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.383587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.384909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.386084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.514881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:28.523275 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-075d9ec4-9f00-4f4a-a881-83414c928a27 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.459117 Oct 03 14:50:28.533683 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2000/4071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:28 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:28.539032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:28.539922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:28.554718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.555499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.556006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.556782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.557884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.558284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.932363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:28.947479 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92d20336-eee3-4a09-9096-96cd3d9dbe0b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.589646 Oct 03 14:50:28.962207 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2072/4072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:28 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:28.974599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:28.975324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:28.983278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.983952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.984597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:28.985823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:28.986508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:28.987441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.138215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:29.149548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d38bf6b6-b2f4-40b2-80ef-ab8781a3de55 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1315 microversion: 2.1 time: 0.614529 Oct 03 14:50:29.160525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2001/4073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:28 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:29.164349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:29.167349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:29.186510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.187021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.187605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.188323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.188954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.189496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.231253 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201/action HTTP/1.1 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 65 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6c71dba2-a318-4f5e-a8aa-976b28f82201', 'body': {'rebuild': {'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca'}}} Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 03 14:50:29.233587 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:29.238742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:29.241379 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7637cd3-3746-4caa-9dc9-ba5598bfe186 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201/action" status: 404 len: 111 microversion: 2.1 time: 0.079000 Oct 03 14:50:29.242940 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2002/4074] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:29 2022] POST /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:29.248024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:29.256765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:29.265252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.265923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.267324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.268175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.268744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.269315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.426543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:29.441147 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d187e7c0-cb76-4690-b405-047a8f9ff3ce tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1351 microversion: 2.1 time: 0.471134 Oct 03 14:50:29.444709 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2073/4075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:28 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1351 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:29.454251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:29.455397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:29.465716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.466496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.467097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.468059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.468892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.469507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.501885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:29.515731 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6355fa99-1d28-4c6b-b2d2-c417d1ea8b27 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1210 microversion: 2.1 time: 0.271384 Oct 03 14:50:29.530269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2003/4076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:29 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1210 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:29.572901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:29.573683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:29.580685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.581220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.581649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.582620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.583230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.583915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.824265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:29.842572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca58e9db-0527-4f78-9574-b3c122fea8d2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.396225 Oct 03 14:50:29.864490 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2074/4077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:29 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:29.874019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:29.875577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:29.886234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.887397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.888480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.889526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:29.890178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:29.890798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:29.922432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:29.934510 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b1576631-0196-494e-b8b7-6c2c7d77a75f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.370450 Oct 03 14:50:29.935801 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2004/4078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:29 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:30.173733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:30.175368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:30.184447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.188118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.190870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:30.191803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.194053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.194614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:30.334349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:30.337971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:30.343907 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb5a5ad7-7238-4797-8c61-1dad479aa668 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.477790 Oct 03 14:50:30.344663 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2075/4079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:29 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:30.366593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-133f9736-b4ef-49f3-b5c4-f596e0332a65 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:30.371375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-133f9736-b4ef-49f3-b5c4-f596e0332a65 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1ed8054f-85ea-4e6a-991c-126995dd67e6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:30.379283 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-133f9736-b4ef-49f3-b5c4-f596e0332a65 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 1ed8054f-85ea-4e6a-991c-126995dd67e6 could not be found. Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-133f9736-b4ef-49f3-b5c4-f596e0332a65 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1ed8054f-85ea-4e6a-991c-126995dd67e6/action HTTP/1.1 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 65 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1ed8054f-85ea-4e6a-991c-126995dd67e6 could not be found. Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1ed8054f-85ea-4e6a-991c-126995dd67e6', 'body': {'rebuild': {'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca'}}} Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed8054f-85ea-4e6a-991c-126995dd67e6 could not be found. Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:30.381341 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed8054f-85ea-4e6a-991c-126995dd67e6 could not be found. Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed8054f-85ea-4e6a-991c-126995dd67e6 could not be found. Oct 03 14:50:30.384582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:30.386213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-133f9736-b4ef-49f3-b5c4-f596e0332a65 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 1ed8054f-85ea-4e6a-991c-126995dd67e6 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:30.387215 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-133f9736-b4ef-49f3-b5c4-f596e0332a65 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1ed8054f-85ea-4e6a-991c-126995dd67e6/action" status: 404 len: 111 microversion: 2.1 time: 0.024663 Oct 03 14:50:30.392978 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2076/4080] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:30 2022] POST /compute/v2.1/servers/1ed8054f-85ea-4e6a-991c-126995dd67e6/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:30.398410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:30.399272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:30.407525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.408190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.408901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:30.409939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.410655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.411275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:30.556363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:30.573184 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e0f6ea9-c6a6-4305-92b8-c597f728328a tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1503 microversion: 2.1 time: 0.403319 Oct 03 14:50:30.596698 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2005/4081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:30 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:30.605097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:30.608982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:30.625841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.628852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.629833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:30.632915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.634685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.635306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:30.727169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:30.747219 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a6812bc-99f9-4519-9d87-ea60a0a938b2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.352122 Oct 03 14:50:30.750500 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2077/4082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:30 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:30.758653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:30.760314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:30.780197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.781849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.783305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:30.784809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:30.788876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:30.789694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.047410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:31.063263 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f5c86a4-3bcd-428b-ad65-0a10c78302a2 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1351 microversion: 2.1 time: 0.464416 Oct 03 14:50:31.064814 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2006/4083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:30 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1351 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:31.073015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:31.073749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:31.086179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.088096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.088996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.090503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.091109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.091699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.148022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:50:31.263338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:31.271719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0e5ba39-1ea8-478b-8826-9055ef0a8f09 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1272 microversion: 2.1 time: 0.518584 Oct 03 14:50:31.272317 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2078/4084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:30 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1272 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:31.283583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:31.284188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:31.306016 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b351aadd-ad65-4cf5-bb31-1d31f3c18e94 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 204 len: 0 microversion: 2.1 time: 0.238202 Oct 03 14:50:31.308939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.309811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.310464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.311623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.311994 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2007/4085] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:50:31 2022] DELETE /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:50:31.312577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.313308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.332529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b8c1747c-3179-4a04-ae38-e505c1b198c1 req-82f91f3a-ab56-43d4-b91c-c3a155ce4f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269c05c3-7f77-492e-a1b5-e2e9df32d7c7", "tag": "7f22fb92-81a0-452d-bbd8-f2c6f89862c5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:31.360109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b8c1747c-3179-4a04-ae38-e505c1b198c1 req-82f91f3a-ab56-43d4-b91c-c3a155ce4f46 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.361028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b8c1747c-3179-4a04-ae38-e505c1b198c1 req-82f91f3a-ab56-43d4-b91c-c3a155ce4f46 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.361643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b8c1747c-3179-4a04-ae38-e505c1b198c1 req-82f91f3a-ab56-43d4-b91c-c3a155ce4f46 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.387799 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b8c1747c-3179-4a04-ae38-e505c1b198c1 req-82f91f3a-ab56-43d4-b91c-c3a155ce4f46 service nova] Creating event network-changed:7f22fb92-81a0-452d-bbd8-f2c6f89862c5 for instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 on n-h2-781139-2 Oct 03 14:50:31.398223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b8c1747c-3179-4a04-ae38-e505c1b198c1 req-82f91f3a-ab56-43d4-b91c-c3a155ce4f46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079203 Oct 03 14:50:31.399242 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2008/4086] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:31.407190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:31.408186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:31.418216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.418932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.419593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.426432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.427217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.427863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.655529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:31.678986 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f500d40a-ef2b-4ad6-a990-e3e1cd8439f9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.402179 Oct 03 14:50:31.697396 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2079/4087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:31 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:31.721047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:31.724958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:31.733407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.733903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.734342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.735164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.735846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.736768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.766694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:31.776997 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42ed5c86-bc5b-47eb-8ce6-90c4791a979b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.375391 Oct 03 14:50:31.777602 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2009/4088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:31 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:31.806394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8620942-62ff-4e94-b393-180207c873e7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:31.806962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a8620942-62ff-4e94-b393-180207c873e7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 18f9601a-eb48-4da5-adb8-7e5a669d00af] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:31.817215 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-a8620942-62ff-4e94-b393-180207c873e7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 18f9601a-eb48-4da5-adb8-7e5a669d00af could not be found. Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8620942-62ff-4e94-b393-180207c873e7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/18f9601a-eb48-4da5-adb8-7e5a669d00af/action HTTP/1.1 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: {"restore": {}} Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 18f9601a-eb48-4da5-adb8-7e5a669d00af could not be found. Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '18f9601a-eb48-4da5-adb8-7e5a669d00af', 'body': {'restore': {}}} Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18f9601a-eb48-4da5-adb8-7e5a669d00af could not be found. Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18f9601a-eb48-4da5-adb8-7e5a669d00af could not be found. Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:31.818907 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:31.822956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:31.822956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:31.822956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18f9601a-eb48-4da5-adb8-7e5a669d00af could not be found. Oct 03 14:50:31.822956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:31.822956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8620942-62ff-4e94-b393-180207c873e7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 18f9601a-eb48-4da5-adb8-7e5a669d00af could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:31.822956 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8620942-62ff-4e94-b393-180207c873e7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/18f9601a-eb48-4da5-adb8-7e5a669d00af/action" status: 404 len: 111 microversion: 2.1 time: 0.018249 Oct 03 14:50:31.837367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2010/4089] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:31 2022] POST /compute/v2.1/servers/18f9601a-eb48-4da5-adb8-7e5a669d00af/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:31.842462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:31.843100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:31.862965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.863506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.863897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:31.864600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:31.865075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:31.865690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:32.150723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:32.165076 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36fb2ced-51e1-4adf-a06c-3b936a7ac6cf tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1509 microversion: 2.1 time: 0.452807 Oct 03 14:50:32.176646 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2080/4090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:31 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1509 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:32.183602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:32.184485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:32.194305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:32.195046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:32.195664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:32.196721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:32.198235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:32.198883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:32.959747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:32.970298 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8a497c8-de53-44f8-b774-a7b743144c4f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1351 microversion: 2.1 time: 0.791874 Oct 03 14:50:32.990718 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2081/4091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:32 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1351 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:32.997154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:32.998327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:33.006132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.006994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.008186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.009773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.010446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.011097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.084420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:33.101958 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb295810-2ec4-4cd7-a97e-c7cbd5d228c9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 1.263301 Oct 03 14:50:33.103932 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2011/4092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:31 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:33.118961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:33.124371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:33.140606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.141302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.142285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.143745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.144685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.145292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.530382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:33.539400 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dee92557-3658-45cf-8620-bd06efa9488d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.546892 Oct 03 14:50:33.540772 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2082/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:32 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:33.546099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:33.546914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:33.554151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.554972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.555558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.556423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.557162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.557808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.614419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:33.624754 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ccf16a29-a08b-47f2-a04b-49d06cba3338 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.519040 Oct 03 14:50:33.638411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2012/4094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:33 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:33.649408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:33.650198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:33.656891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.657839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.658258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.658968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.659418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.659840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.931536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:33.941601 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57c5cb39-2c74-4300-a432-0e74f4e53fe8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.399477 Oct 03 14:50:33.942568 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2083/4095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:33 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:33.969884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:33.971924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:33.990292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.990811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.991256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:33.991986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:33.992437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:33.992852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.024797 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Cannot 'restore' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action HTTP/1.1 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 15 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: {"restore": {}} Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'restore' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'restore': {}}} Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 in vm_state active. Cannot restore while the instance is in this state. Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:34.026732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 409 to user: Cannot 'restore' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbd2775c-2270-4748-a4ee-c16e9c83cb59 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 409 len: 145 microversion: 2.1 time: 0.064419 Oct 03 14:50:34.032610 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2084/4096] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:33 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 145 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:50:34.043083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:34.044090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:34.060347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.060841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.064586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.065785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.066410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.066986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.084885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:34.148533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:34.162838 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb9b8a9e-b4ca-4c54-a23f-8a0480fdddf9 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1509 microversion: 2.1 time: 0.522612 Oct 03 14:50:34.163437 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2013/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:33 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1509 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:34.177203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:34.177993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:34.184382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.184877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.185353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.186070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.186526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.186955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.384108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:34.400445 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec495f86-eed6-4297-8cd8-9f542c6f5f93 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1351 microversion: 2.1 time: 0.361662 Oct 03 14:50:34.401737 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2085/4098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:34 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1351 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:34.575667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:34.576963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:34.588473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.597446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:34.611502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:34.630035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.631516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.633569 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87274591-fa8a-4282-92a1-6372fe824ed7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.467277 Oct 03 14:50:34.634447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.634941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.635064 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2014/4099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:34 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:34.649125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.668223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ebf4ddd0-0ab6-49df-a48b-601c6e037fe6 req-f2333741-a993-4a43-80da-8095ce5d59b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b6a44a-0eef-4fef-a7c1-b2b493d86c61", "tag": "5641f14c-b607-4db5-a316-ac609bb2a1df"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:34.712532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebf4ddd0-0ab6-49df-a48b-601c6e037fe6 req-f2333741-a993-4a43-80da-8095ce5d59b9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.713042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebf4ddd0-0ab6-49df-a48b-601c6e037fe6 req-f2333741-a993-4a43-80da-8095ce5d59b9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.713475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebf4ddd0-0ab6-49df-a48b-601c6e037fe6 req-f2333741-a993-4a43-80da-8095ce5d59b9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.760979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ebf4ddd0-0ab6-49df-a48b-601c6e037fe6 req-f2333741-a993-4a43-80da-8095ce5d59b9 service nova] Creating event network-changed:5641f14c-b607-4db5-a316-ac609bb2a1df for instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 on n-h2-781139-2 Oct 03 14:50:34.774885 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ebf4ddd0-0ab6-49df-a48b-601c6e037fe6 req-f2333741-a993-4a43-80da-8095ce5d59b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136461 Oct 03 14:50:34.779308 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2015/4100] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:34.791361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:34.792303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:34.827395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:34.833505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.834914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.835533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.836454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:34.838592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:34.839228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:34.839770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:35.191675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:35.203730 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6bedba0-16f1-4a06-a798-a2ddf185735a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.642215 Oct 03 14:50:35.215224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2086/4101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:34 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:35.231143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:35.233176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:35.249111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:35.250029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:35.250628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:35.253882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:35.255173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:35.256998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:35.574533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:35.584622 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3fffffcd-c181-4c70-8842-0bea3af9e9a8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.803919 Oct 03 14:50:35.589621 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2016/4102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:34 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:35.755386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:35.766378 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-757a2e6a-86a7-4180-ac82-44508206b2b3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.548581 Oct 03 14:50:35.768679 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2087/4103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:35 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:35.780393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:35.791855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:35.813645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:35.814660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:35.815348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:35.816291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:35.817167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:35.817815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:35.857203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:35.857882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:35.858483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:35.859101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lazy-loading 'fault' on Instance uuid f7b667d8-6149-4397-b436-84c02d21ed14 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:50:35.863101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2035684514", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "0cecf6fd-db00-46b3-877a-52ca8ae36197"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:35.948008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4747ce77385466ba7242aef2b746d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '955ecb0850844adf8230075b9fbf2dab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:35.956988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb9a47b6-b81c-4fb9-b135-aaf6a2635920 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 200 len: 1305 microversion: 2.1 time: 0.183933 Oct 03 14:50:35.970370 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2088/4104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:35 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 1305 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:35.981521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-29a16244-53ef-48b4-bc1d-c8627c124f93 req-5dfaafac-dec3-44fb-8d0a-68b954cc0431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b667d8-6149-4397-b436-84c02d21ed14", "name": "network-vif-deleted", "tag": "abb4881b-9d98-4297-957f-705362311606"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:36.002477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-29a16244-53ef-48b4-bc1d-c8627c124f93 req-5dfaafac-dec3-44fb-8d0a-68b954cc0431 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:36.002927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-29a16244-53ef-48b4-bc1d-c8627c124f93 req-5dfaafac-dec3-44fb-8d0a-68b954cc0431 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:36.011246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-29a16244-53ef-48b4-bc1d-c8627c124f93 req-5dfaafac-dec3-44fb-8d0a-68b954cc0431 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:36.028853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] validate_networks() for [('0cecf6fd-db00-46b3-877a-52ca8ae36197', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:50:36.033539 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-29a16244-53ef-48b4-bc1d-c8627c124f93 req-5dfaafac-dec3-44fb-8d0a-68b954cc0431 service nova] Creating event network-vif-deleted:abb4881b-9d98-4297-957f-705362311606 for instance f7b667d8-6149-4397-b436-84c02d21ed14 on n-h1-781139-2 Oct 03 14:50:36.048183 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-29a16244-53ef-48b4-bc1d-c8627c124f93 req-5dfaafac-dec3-44fb-8d0a-68b954cc0431 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075915 Oct 03 14:50:36.051520 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2089/4105] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:36.057323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:36.057988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:36.078978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:36.079586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:36.080294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:36.080857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:36.081468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:36.081874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:36.341101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:36.351504 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c46156d5-c33a-4a7f-ac31-e0ae66bd7603 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1351 microversion: 2.1 time: 0.298426 Oct 03 14:50:36.358145 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2090/4106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:36 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1351 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:36.369165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9194c6b3-f336-49e8-92bf-2095181b5fe7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:36.370083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9194c6b3-f336-49e8-92bf-2095181b5fe7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 8fd32885-f8fd-4a6d-9910-6bcc03361a1a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:36.377545 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9194c6b3-f336-49e8-92bf-2095181b5fe7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 8fd32885-f8fd-4a6d-9910-6bcc03361a1a could not be found. Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9194c6b3-f336-49e8-92bf-2095181b5fe7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/8fd32885-f8fd-4a6d-9910-6bcc03361a1a/action HTTP/1.1 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 14 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: {"resume": {}} Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 8fd32885-f8fd-4a6d-9910-6bcc03361a1a could not be found. Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '8fd32885-f8fd-4a6d-9910-6bcc03361a1a', 'body': {'resume': {}}} Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd32885-f8fd-4a6d-9910-6bcc03361a1a could not be found. Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd32885-f8fd-4a6d-9910-6bcc03361a1a could not be found. Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:36.385853 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:36.390868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:36.390868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:36.390868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd32885-f8fd-4a6d-9910-6bcc03361a1a could not be found. Oct 03 14:50:36.390868 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:36.390868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9194c6b3-f336-49e8-92bf-2095181b5fe7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 8fd32885-f8fd-4a6d-9910-6bcc03361a1a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:36.390868 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9194c6b3-f336-49e8-92bf-2095181b5fe7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/8fd32885-f8fd-4a6d-9910-6bcc03361a1a/action" status: 404 len: 111 microversion: 2.1 time: 0.026313 Oct 03 14:50:36.390868 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2091/4107] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:36 2022] POST /compute/v2.1/servers/8fd32885-f8fd-4a6d-9910-6bcc03361a1a/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:36.397386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:36.398126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:36.406768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:36.407593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:36.408127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:36.409337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:36.409592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:36.410102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:36.598660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:36.608604 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a114c9e-9241-4bce-b0ef-4e399287473b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.219584 Oct 03 14:50:36.617358 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2092/4108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:36 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:36.623147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:36.624075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:36.631893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:36.632452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:36.632944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:36.633633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:36.634409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:36.634672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.159091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:37.172678 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4b9fe3e-6e62-487f-92c8-287b7f58453c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.550424 Oct 03 14:50:37.173525 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2093/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:36 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:37.180383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:37.180981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:37.187879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.188843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.189504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.190514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.191113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.191679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.258876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:50:37.262099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:50:37.262969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:50:37.264446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:50:37.264917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:50:37.286536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.287576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.288165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.289308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.289911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.290632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.327815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Getting quotas for project fc810f57a07f43fc8e4345b67bb45887. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:50:37.335830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Getting quotas for user ca273453c3b54aec91ba17e2341a5b99 and project fc810f57a07f43fc8e4345b67bb45887. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:50:37.356638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:50:37.362477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:50:37.459066 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fbef032-40f4-4a9d-934a-ee65fe30a207 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.864443 Oct 03 14:50:37.461872 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2017/4110] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:50:37.480762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:37.481688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:37.489899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.490883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.491634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.492670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.493343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.494021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.518208 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] HTTP exception thrown: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Request method failure captured: Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 HTTP/1.1 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvacJBdWWeuusTxeVuF4lLfIi8EI3i7skb_oU9397xIwTYKS8hXRpeP9IlEy2zBsFoS4naIaMWwH_N8S5-JfQMGNt9Bv1wVxptg17_--avYHHuGEJfIEJ6FuQo_bxb0tk6hb-bTxWc_DZhwZeHPHOxYvuw67pntggu0I6lnDK-6CzCU Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_955ecb0850844adf8230075b9fbf2dab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c4747ce77385466ba7242aef2b746d32 Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f7b667d8-6149-4397-b436-84c02d21ed14'} Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:37.520671 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:37.525302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:37.525302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:37.525302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:37.525302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:37.525302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:37.525302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:37.525302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:37.527151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Returning 404 to user: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:37.528684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-375ca3d0-bfe3-4cd6-bd83-4f626d830b65 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 404 len: 111 microversion: 2.1 time: 0.065534 Oct 03 14:50:37.530534 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2018/4111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:37 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:37.538012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:37.539096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:37.571618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.572655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.575041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:37.576185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:37.577901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:37.578823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.095837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:38.098432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:38.107565 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ffcb19c-61b1-4071-a7f3-f4b5e9161977 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.929816 Oct 03 14:50:38.108208 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2094/4112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:37 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:38.114776 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04bef94f-d6a3-4c1b-b004-ccc5ce4dc09a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.581500 Oct 03 14:50:38.116725 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2019/4113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:37 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:38.132544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e01f15fe-2168-471d-a9bb-7909d12e0609 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:38.133465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e01f15fe-2168-471d-a9bb-7909d12e0609 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:38.151538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:38.152163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:38.170440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.171592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.173506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.175508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.178862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.179514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.208185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:38.339663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e01f15fe-2168-471d-a9bb-7909d12e0609 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:38.351675 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e01f15fe-2168-471d-a9bb-7909d12e0609 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1217 microversion: 2.1 time: 0.232620 Oct 03 14:50:38.366934 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2020/4114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:38 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:38.376287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1313106219", "metadata": {"image_type": "test"}}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:38.385359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:38.421849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.424495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.425260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.427435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.440284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.441521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.460428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] HTTP exception thrown: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Request method failure captured: Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14/action HTTP/1.1 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 112 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvacJBdWWeuusTxeVuF4lLfIi8EI3i7skb_oU9397xIwTYKS8hXRpeP9IlEy2zBsFoS4naIaMWwH_N8S5-JfQMGNt9Bv1wVxptg17_--avYHHuGEJfIEJ6FuQo_bxb0tk6hb-bTxWc_DZhwZeHPHOxYvuw67pntggu0I6lnDK-6CzCU Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_955ecb0850844adf8230075b9fbf2dab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c4747ce77385466ba7242aef2b746d32 Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1313106219", "metadata": {"image_type": "test"}}} Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f7b667d8-6149-4397-b436-84c02d21ed14', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1313106219', 'metadata': {'image_type': 'test'}}}} Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:38.463436 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:38.467082 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.469156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Returning 404 to user: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:38.470391 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6910cee2-9053-46cb-85c2-c2a72e18b6f8 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "POST /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14/action" status: 404 len: 111 microversion: 2.1 time: 0.101519 Oct 03 14:50:38.471195 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2021/4115] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 3 14:50:38 2022] POST /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:38.483810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:38.485311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:38.493037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.494395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.495086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.496004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.496679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.497336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.548015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:38.564453 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26828349-eea6-4818-a51f-8bd71b990167 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1351 microversion: 2.1 time: 0.439304 Oct 03 14:50:38.573908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2095/4116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:38 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1351 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:38.587614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:38.588398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:38.599604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.600097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.600556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.601888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.602387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.602813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.654862 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Cannot 'resume' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action HTTP/1.1 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 14 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: {"resume": {}} Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'resume' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'resume': {}}} Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 in vm_state active. Cannot resume while the instance is in this state. Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.656831 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.661163 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.661163 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.661163 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.661163 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:38.661163 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:38.661163 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:50:38.661163 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.662906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 409 to user: Cannot 'resume' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:38.667033 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f103491-a31d-4340-8d87-c6ade90da96c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 409 len: 144 microversion: 2.1 time: 0.088802 Oct 03 14:50:38.668000 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2096/4117] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:38 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 144 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:50:38.674253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2ecd0220-f173-40cb-aca6-7a46f1ebc44c req-8b1155e0-a8e9-4f31-a8ab-5af0e9da016e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269c05c3-7f77-492e-a1b5-e2e9df32d7c7", "name": "network-vif-plugged", "status": "completed", "tag": "7f22fb92-81a0-452d-bbd8-f2c6f89862c5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:38.684411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:38.688020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2ecd0220-f173-40cb-aca6-7a46f1ebc44c req-8b1155e0-a8e9-4f31-a8ab-5af0e9da016e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.700835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2ecd0220-f173-40cb-aca6-7a46f1ebc44c req-8b1155e0-a8e9-4f31-a8ab-5af0e9da016e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.701315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2ecd0220-f173-40cb-aca6-7a46f1ebc44c req-8b1155e0-a8e9-4f31-a8ab-5af0e9da016e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.717757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2ecd0220-f173-40cb-aca6-7a46f1ebc44c req-8b1155e0-a8e9-4f31-a8ab-5af0e9da016e service nova] Creating event network-vif-plugged:7f22fb92-81a0-452d-bbd8-f2c6f89862c5 for instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 on n-h2-781139-2 Oct 03 14:50:38.724465 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2ecd0220-f173-40cb-aca6-7a46f1ebc44c req-8b1155e0-a8e9-4f31-a8ab-5af0e9da016e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054737 Oct 03 14:50:38.734340 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2097/4118] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:38.741436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9018a460-2955-43c3-8243-e2abd498c42c tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1967166421", "metadata": {"image_type": "test"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:38.744250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9018a460-2955-43c3-8243-e2abd498c42c tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Failed to fetch instance by id tempest-invalid-828814152 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 14:50:38.744774 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9018a460-2955-43c3-8243-e2abd498c42c tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] HTTP exception thrown: Instance tempest-invalid-828814152 could not be found. Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9018a460-2955-43c3-8243-e2abd498c42c tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Request method failure captured: Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/tempest-invalid-828814152/action HTTP/1.1 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 112 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvacJBdWWeuusTxeVuF4lLfIi8EI3i7skb_oU9397xIwTYKS8hXRpeP9IlEy2zBsFoS4naIaMWwH_N8S5-JfQMGNt9Bv1wVxptg17_--avYHHuGEJfIEJ6FuQo_bxb0tk6hb-bTxWc_DZhwZeHPHOxYvuw67pntggu0I6lnDK-6CzCU Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_955ecb0850844adf8230075b9fbf2dab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: c4747ce77385466ba7242aef2b746d32 Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1967166421", "metadata": {"image_type": "test"}}} Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance tempest-invalid-828814152 could not be found. Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'tempest-invalid-828814152', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1967166421', 'metadata': {'image_type': 'test'}}}} Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-828814152 could not be found. Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:38.746574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-828814152 could not be found. Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-828814152 could not be found. Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9018a460-2955-43c3-8243-e2abd498c42c tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Returning 404 to user: Instance tempest-invalid-828814152 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:38.750299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9018a460-2955-43c3-8243-e2abd498c42c tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-828814152/action" status: 404 len: 100 microversion: 2.1 time: 0.012077 Oct 03 14:50:38.754038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2098/4119] 10.222.0.20 () {60 vars in 1246 bytes} [Mon Oct 3 14:50:38 2022] POST /compute/v2.1/servers/tempest-invalid-828814152/action => generated 100 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:38.773191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:38.777750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:38.788530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.794827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.795514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.800838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:38.801556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:38.802144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:38.841875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:38.856092 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b76ae3f-af26-4931-84a4-033958a8a1c0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.383177 Oct 03 14:50:38.864423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2022/4120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:38 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:38.874541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ce503ab-dcd9-46ae-b98a-a3b5ba487df5 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1338364923"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:38.883361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ce503ab-dcd9-46ae-b98a-a3b5ba487df5 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 14:50:38.883815 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-4ce503ab-dcd9-46ae-b98a-a3b5ba487df5 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ce503ab-dcd9-46ae-b98a-a3b5ba487df5 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Request method failure captured: Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 57 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvacJBdWWeuusTxeVuF4lLfIi8EI3i7skb_oU9397xIwTYKS8hXRpeP9IlEy2zBsFoS4naIaMWwH_N8S5-JfQMGNt9Bv1wVxptg17_--avYHHuGEJfIEJ6FuQo_bxb0tk6hb-bTxWc_DZhwZeHPHOxYvuw67pntggu0I6lnDK-6CzCU Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_955ecb0850844adf8230075b9fbf2dab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c4747ce77385466ba7242aef2b746d32 Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: {"createImage": {"name": "tempest-test-snap-1338364923"}} Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1338364923'}}} Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.886966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.890837 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.896241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ce503ab-dcd9-46ae-b98a-a3b5ba487df5 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:38.897213 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ce503ab-dcd9-46ae-b98a-a3b5ba487df5 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.031496 Oct 03 14:50:38.902054 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2023/4121] 10.222.0.20 () {60 vars in 1275 bytes} [Mon Oct 3 14:50:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:38.916638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85598730-092d-49a8-aed9-daa538a17bf0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-765195677"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:38.924561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-85598730-092d-49a8-aed9-daa538a17bf0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 14:50:38.925385 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-85598730-092d-49a8-aed9-daa538a17bf0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85598730-092d-49a8-aed9-daa538a17bf0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Request method failure captured: Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 56 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvacJBdWWeuusTxeVuF4lLfIi8EI3i7skb_oU9397xIwTYKS8hXRpeP9IlEy2zBsFoS4naIaMWwH_N8S5-JfQMGNt9Bv1wVxptg17_--avYHHuGEJfIEJ6FuQo_bxb0tk6hb-bTxWc_DZhwZeHPHOxYvuw67pntggu0I6lnDK-6CzCU Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_955ecb0850844adf8230075b9fbf2dab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c4747ce77385466ba7242aef2b746d32 Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: {"createImage": {"name": "tempest-test-snap-765195677"}} Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-765195677'}}} Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.954745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 03 14:50:38.958627 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:38.959181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85598730-092d-49a8-aed9-daa538a17bf0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:38.960905 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-85598730-092d-49a8-aed9-daa538a17bf0 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.055163 Oct 03 14:50:38.964265 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2024/4122] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Oct 3 14:50:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:38.990229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:38.991629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.007138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.009668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.010198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.010953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.011417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.011852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.043557 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] HTTP exception thrown: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Request method failure captured: Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 HTTP/1.1 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvacJBdWWeuusTxeVuF4lLfIi8EI3i7skb_oU9397xIwTYKS8hXRpeP9IlEy2zBsFoS4naIaMWwH_N8S5-JfQMGNt9Bv1wVxptg17_--avYHHuGEJfIEJ6FuQo_bxb0tk6hb-bTxWc_DZhwZeHPHOxYvuw67pntggu0I6lnDK-6CzCU Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_955ecb0850844adf8230075b9fbf2dab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c4747ce77385466ba7242aef2b746d32 Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f7b667d8-6149-4397-b436-84c02d21ed14'} Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:39.045302 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Returning 404 to user: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99049beb-59c5-4726-be7f-1ff47be18404 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 404 len: 111 microversion: 2.1 time: 0.075271 Oct 03 14:50:39.048912 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2025/4123] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:50:38 2022] DELETE /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:39.076279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:39.077039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] [instance: f7b667d8-6149-4397-b436-84c02d21ed14] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.085180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.085682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.086121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.086831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.087291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.087722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.104854 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] HTTP exception thrown: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Request method failure captured: Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 HTTP/1.1 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvacJBdWWeuusTxeVuF4lLfIi8EI3i7skb_oU9397xIwTYKS8hXRpeP9IlEy2zBsFoS4naIaMWwH_N8S5-JfQMGNt9Bv1wVxptg17_--avYHHuGEJfIEJ6FuQo_bxb0tk6hb-bTxWc_DZhwZeHPHOxYvuw67pntggu0I6lnDK-6CzCU Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_955ecb0850844adf8230075b9fbf2dab", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/955ecb0850844adf8230075b9fbf2dab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 955ecb0850844adf8230075b9fbf2dab Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-996050849 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: c4747ce77385466ba7242aef2b746d32 Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ImagesNegativeTestJSON-996050849-project Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f7b667d8-6149-4397-b436-84c02d21ed14'} Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:39.106489 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.110503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.110503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:39.110503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:39.110503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:39.110503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:39.110503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. Oct 03 14:50:39.110503 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.111977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] Returning 404 to user: Instance f7b667d8-6149-4397-b436-84c02d21ed14 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:39.113229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9bea3eb9-808e-476a-81a4-f3b99eef98d6 tempest-ImagesNegativeTestJSON-996050849 tempest-ImagesNegativeTestJSON-996050849-project] 10.222.0.20 "GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14" status: 404 len: 111 microversion: 2.1 time: 0.047995 Oct 03 14:50:39.114925 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2026/4124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:39 2022] GET /compute/v2.1/servers/f7b667d8-6149-4397-b436-84c02d21ed14 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:39.127423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:39.137948 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be13d1af-70a2-424e-81c1-eceeda55f24d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.382714 Oct 03 14:50:39.141769 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2099/4125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:38 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:39.146071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:39.146857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.155010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.155494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.155949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.156632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.157929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.158352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.169728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:39.170619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.182941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.183656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.185148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.186495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.187173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.187832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.347992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:39.360072 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97080bed-e9d5-431b-a6a4-f496a2751d05 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.194503 Oct 03 14:50:39.361302 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2100/4126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:39 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:39.379833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:39.380785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.390454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.409546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.410379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.411484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.411958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.412436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.489289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:39.491426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:39.500431 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba4a8f8c-f423-4556-83c6-d64f4fb1a9c6 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1269 microversion: 2.1 time: 0.125470 Oct 03 14:50:39.501939 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2101/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:39 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1269 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:39.502577 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c7ad558-536c-47fc-be98-d078e730fd48 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.361379 Oct 03 14:50:39.503171 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2027/4128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:39 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:39.557982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d4ca846-ad5b-47f8-8196-74c85c799860 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d4ca846-ad5b-47f8-8196-74c85c799860 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 160 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a62333a-9bbf-45d0-8291-9f475d60044b"}]}} Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'networks': [{'uuid': '2a62333a-9bbf-45d0-8291-9f475d60044b'}]}}} Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '' Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:50:39.562199 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d4ca846-ad5b-47f8-8196-74c85c799860 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d4ca846-ad5b-47f8-8196-74c85c799860 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010545 Oct 03 14:50:39.570902 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2102/4129] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:50:39 2022] POST /compute/v2.1/servers => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:50:39.575738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:39.576436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.583367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.583857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.584470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.585208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.585809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.586212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.598497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:39.599185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.608965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.609527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.609973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.611250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.611720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.612424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.779419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:39.789893 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d55afa9-da20-40fb-93f7-a5a87ae8c113 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1351 microversion: 2.1 time: 0.195448 Oct 03 14:50:39.795460 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2103/4130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:39 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:39.890113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:39.890946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:39.898187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.898676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.899153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:39.899864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:39.900325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:39.900709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.054739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:40.064453 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb3c06d7-7f7f-4fa5-8258-47447ae2f453 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.178332 Oct 03 14:50:40.075149 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2104/4131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:39 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:40.128386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:40.137756 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06c87b66-b0bd-4912-923d-24a0ba392c1b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.567356 Oct 03 14:50:40.138524 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2028/4132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:39 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:40.161440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:40.162114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:40.168116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.168608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.169072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.169772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.170229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.170650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.330363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:40.342726 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72486061-7c99-425f-924d-9694a7ac2c32 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.184995 Oct 03 14:50:40.356958 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2105/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:40 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:40.376775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2e96b48-8178-480a-91cb-68b158bbc863 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:40.377572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f2e96b48-8178-480a-91cb-68b158bbc863 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 762a1ee9-b2c4-4ebc-be35-96b1d325a214] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:40.385507 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-f2e96b48-8178-480a-91cb-68b158bbc863 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 762a1ee9-b2c4-4ebc-be35-96b1d325a214 could not be found. Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2e96b48-8178-480a-91cb-68b158bbc863 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/762a1ee9-b2c4-4ebc-be35-96b1d325a214/action HTTP/1.1 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 14 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: {"shelve": {}} Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 762a1ee9-b2c4-4ebc-be35-96b1d325a214 could not be found. Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '762a1ee9-b2c4-4ebc-be35-96b1d325a214', 'body': {'shelve': {}}} Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762a1ee9-b2c4-4ebc-be35-96b1d325a214 could not be found. Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762a1ee9-b2c4-4ebc-be35-96b1d325a214 could not be found. Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:40.389245 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:40.393941 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:40.393941 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:40.393941 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762a1ee9-b2c4-4ebc-be35-96b1d325a214 could not be found. Oct 03 14:50:40.393941 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:40.395829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2e96b48-8178-480a-91cb-68b158bbc863 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 762a1ee9-b2c4-4ebc-be35-96b1d325a214 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:40.396964 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2e96b48-8178-480a-91cb-68b158bbc863 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/762a1ee9-b2c4-4ebc-be35-96b1d325a214/action" status: 404 len: 111 microversion: 2.1 time: 0.029011 Oct 03 14:50:40.398084 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2029/4134] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:40 2022] POST /compute/v2.1/servers/762a1ee9-b2c4-4ebc-be35-96b1d325a214/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:50:40.407118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:40.407955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:40.415575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.416168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.416904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.417773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.418596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.419028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.526888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:40.528496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:40.539050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.540094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.541125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.542080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.542908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.543566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.566616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:40.575655 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e642aff2-d72d-4bec-af93-f484e3d173d0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.173010 Oct 03 14:50:40.576247 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2106/4135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:40 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:40.595653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:40.596453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:40.603225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.603863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.604303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.605032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.605484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.605900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.735710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:40.745205 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d02e28a4-b0b8-4f67-a00a-c68eaae6eaa0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1275 microversion: 2.1 time: 0.224862 Oct 03 14:50:40.746903 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2030/4136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:40 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:40.752726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:40.753654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:40.760380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.761198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.761843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.762912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.763579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.764205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.775386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:40.790280 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-645544a2-71e6-4f3d-8dc6-d3c8509edc07 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.207109 Oct 03 14:50:40.805838 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2107/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:40 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:40.812658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:40.820239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:40.826869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.827659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.828058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.828759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:40.829287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:40.829855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:40.975187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:40.986543 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47b034de-2e69-4211-8a93-31ec7cbb923f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1542 microversion: 2.1 time: 0.176991 Oct 03 14:50:40.986892 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2108/4138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:40 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1542 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:41.021949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:41.027642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:41.040670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.041184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.041618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.042316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.042759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.043208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.185979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:41.207812 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-86d7b86a-e39f-4c86-b487-8eff76107cb3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.459496 Oct 03 14:50:41.208825 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2031/4139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:40 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:41.213360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:41.214210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:41.220785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.221621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.222253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.223174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.223818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.224430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.266820 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9c390a9-8f62-47c0-948f-cb5a121103bc tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.256702 Oct 03 14:50:41.267654 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2109/4140] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:50:41 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:50:41.272783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:41.273334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:41.280450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.281419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.282600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.283673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.284787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.285495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.316519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lazy-loading 'flavor' on Instance uuid 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:50:41.570687 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f99ddbd-f9de-480d-bf20-961969024179 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 202 len: 0 microversion: 2.1 time: 0.301391 Oct 03 14:50:41.575777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:41.587182 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2110/4141] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:41 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:41.590625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1db166dc-fc02-40ba-8f5d-46676d0c8438 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.380825 Oct 03 14:50:41.591419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2032/4142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:41 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:41.605460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:41.609353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:41.616528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.617046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.617584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.619037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.619037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.619225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.774167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:41.775358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:41.789381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.790104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.791621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.792580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.793355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.793998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.886237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:41.901537 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6ffc36e-bbd9-4749-a6db-a529a9d4f376 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.312802 Oct 03 14:50:41.902142 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2111/4143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:41 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:41.906669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:41.907332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:41.924514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.925039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.925483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:41.926191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:41.926646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:41.927070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:42.321558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:42.333504 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f4785ee-b884-48e0-94d6-73bae8500c85 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.563466 Oct 03 14:50:42.347963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:42.349130 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2033/4144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:41 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:42.356448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0e10f997-0c1d-4f93-8078-8669abda0e24 req-2d360842-3cae-41d8-9cc8-255a310db514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6a44a-0eef-4fef-a7c1-b2b493d86c61", "name": "network-vif-plugged", "status": "completed", "tag": "5641f14c-b607-4db5-a316-ac609bb2a1df"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:42.358205 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bab4a3c6-e5a7-4826-83f1-470c34d10539 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.454532 Oct 03 14:50:42.359542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2112/4145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:41 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:42.369298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0e10f997-0c1d-4f93-8078-8669abda0e24 req-2d360842-3cae-41d8-9cc8-255a310db514 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:42.369997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0e10f997-0c1d-4f93-8078-8669abda0e24 req-2d360842-3cae-41d8-9cc8-255a310db514 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:42.370616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0e10f997-0c1d-4f93-8078-8669abda0e24 req-2d360842-3cae-41d8-9cc8-255a310db514 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:42.383397 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0e10f997-0c1d-4f93-8078-8669abda0e24 req-2d360842-3cae-41d8-9cc8-255a310db514 service nova] Creating event network-vif-plugged:5641f14c-b607-4db5-a316-ac609bb2a1df for instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 on n-h2-781139-2 Oct 03 14:50:42.389046 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0e10f997-0c1d-4f93-8078-8669abda0e24 req-2d360842-3cae-41d8-9cc8-255a310db514 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038492 Oct 03 14:50:42.389850 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2034/4146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:42.618860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:42.623877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:42.644378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:42.645505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:42.646783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:42.648710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:42.649477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:42.650070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:42.658216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:42.929894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:42.930613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:42.945117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:42.946524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:42.947780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:42.949209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:42.949953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:42.950756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:42.957457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:42.968043 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33b65ea1-9394-46d4-8f77-a03c4774df4e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.353610 Oct 03 14:50:42.970031 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2113/4147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:42 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:43.364441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:43.366051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:43.377025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:43.377529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:43.380608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:43.381469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:43.381972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:43.382453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:43.432230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:43.441312 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ad7a1f6-4b6d-4a7b-9dc4-ed1846fefd57 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.517918 Oct 03 14:50:43.441904 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2035/4148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:42 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:43.447768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:43.448908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:43.461302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:43.461820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:43.462280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:43.463533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:43.464016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:43.464548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:43.787435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:43.800028 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8400fd6-27ad-4e5f-a7c6-b99a6d92a835 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.439575 Oct 03 14:50:43.801199 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2114/4149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:43 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:43.808568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-63b4a634-2eef-4fb0-b84f-76e019328858 req-56739fc3-a69c-49b5-90ba-5c1be795d7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269c05c3-7f77-492e-a1b5-e2e9df32d7c7", "tag": "7f22fb92-81a0-452d-bbd8-f2c6f89862c5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:43.823069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-63b4a634-2eef-4fb0-b84f-76e019328858 req-56739fc3-a69c-49b5-90ba-5c1be795d7c1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:43.824062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-63b4a634-2eef-4fb0-b84f-76e019328858 req-56739fc3-a69c-49b5-90ba-5c1be795d7c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:43.824711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-63b4a634-2eef-4fb0-b84f-76e019328858 req-56739fc3-a69c-49b5-90ba-5c1be795d7c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:43.838617 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-63b4a634-2eef-4fb0-b84f-76e019328858 req-56739fc3-a69c-49b5-90ba-5c1be795d7c1 service nova] Creating event network-changed:7f22fb92-81a0-452d-bbd8-f2c6f89862c5 for instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 on n-h2-781139-2 Oct 03 14:50:43.848634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-63b4a634-2eef-4fb0-b84f-76e019328858 req-56739fc3-a69c-49b5-90ba-5c1be795d7c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044109 Oct 03 14:50:43.857198 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2115/4150] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:44.012981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:44.013954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:44.029082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:44.029969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:44.031551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:44.032584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:44.035014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:44.035757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:44.308891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:44.323133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c39edb7-0c95-4be5-ab4d-2479b500fdc2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1314 microversion: 2.1 time: 0.330747 Oct 03 14:50:44.324382 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2116/4151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:43 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:44.478982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:44.482210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:44.493510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:44.494287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:44.496109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:44.497316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:44.498372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:44.499215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:44.520483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:44.535424 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7c55929a-e8fa-4fdc-8a71-73d234e60d9b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 1.092099 Oct 03 14:50:44.551177 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2036/4152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:43 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:44.826191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:44.826889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:44.842994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:44.843942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:44.844759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:44.848231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:44.848717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:44.850904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:44.919022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:44.928719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f919db9-113e-4358-93fc-e7fa5bf5af6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.455041 Oct 03 14:50:44.932370 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2117/4153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:44 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:45.076145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-102b5517-df85-42c2-a044-cb2a5f537e79 req-cebcb07f-1b45-4fd6-ac92-42c22ea61e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd75d70-3269-4e1e-94ca-ad1901a551cb", "tag": "aa96e258-3c54-4608-a47f-21232b39ccc2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:45.088028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-102b5517-df85-42c2-a044-cb2a5f537e79 req-cebcb07f-1b45-4fd6-ac92-42c22ea61e6c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.088967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-102b5517-df85-42c2-a044-cb2a5f537e79 req-cebcb07f-1b45-4fd6-ac92-42c22ea61e6c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.089544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-102b5517-df85-42c2-a044-cb2a5f537e79 req-cebcb07f-1b45-4fd6-ac92-42c22ea61e6c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.107036 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-102b5517-df85-42c2-a044-cb2a5f537e79 req-cebcb07f-1b45-4fd6-ac92-42c22ea61e6c service nova] Creating event network-changed:aa96e258-3c54-4608-a47f-21232b39ccc2 for instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb on n-h1-781139-2 Oct 03 14:50:45.112801 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-102b5517-df85-42c2-a044-cb2a5f537e79 req-cebcb07f-1b45-4fd6-ac92-42c22ea61e6c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042753 Oct 03 14:50:45.114078 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2118/4154] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:50:45.349349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:45.350336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:45.357428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.357909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.358404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.359439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.359930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.360506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.436585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:45.447686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2d07eb96-7c4c-4089-9bcf-30cab0ebf052 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.625353 Oct 03 14:50:45.448703 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2037/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:44 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:45.531318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:45.540496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34be6bde-1223-41d9-be7b-aebe29ad9903 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1500 microversion: 2.1 time: 0.196489 Oct 03 14:50:45.541407 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2119/4156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:45 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:45.559035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:45.559648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:45.567839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.568855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:45.569412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.569555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:45.570107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.570849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.571524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.572701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.576659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.577237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.578038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.579143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.579968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.580532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.659304 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5de85e60-e8c9-43e6-b981-d78f2991bc80 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61/action" status: 202 len: 0 microversion: 2.1 time: 0.094700 Oct 03 14:50:45.660049 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2120/4157] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:45 2022] POST /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:45.668914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:45.669665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:45.676752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.677277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.677709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.678737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.679218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.679619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.835035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:45.847480 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75d362dc-01ab-49ea-9f5a-4777c8648387 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1505 microversion: 2.1 time: 0.182548 Oct 03 14:50:45.849248 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2121/4158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:45 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:45.956576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:45.957682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:45.964257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.964900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.965368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:45.966150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:45.966676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:45.967038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:46.063868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:46.079557 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac1a651c-200d-4d45-97ed-e968c1e132ed tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.524142 Oct 03 14:50:46.080536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2038/4159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:45 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:46.150718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:46.162219 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86b089ca-868c-4363-b759-74cf2ef10824 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.209830 Oct 03 14:50:46.162811 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2122/4160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:45 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:46.472862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:46.473679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:46.481144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:46.481684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:46.482205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:46.482965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:46.483615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:46.484188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:46.683716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:46.697450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9e0378a-7684-41ff-b065-887f86cd5147 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.228697 Oct 03 14:50:46.698098 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2039/4161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:46 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:46.874516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:46.877084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:46.886323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:46.886840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:46.887279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:46.888007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:46.888468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:46.888906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.106352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:47.107208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:47.115620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.117118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.117735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.118616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.119207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.119789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.127430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:47.161005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:47.175514 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3097d7a4-24bf-4910-aee4-da70125ec03d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1485 microversion: 2.1 time: 0.305807 Oct 03 14:50:47.186568 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2123/4162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:46 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1485 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:47.203430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:47.206713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:47.213914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.215775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.217582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.218551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.219241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.220825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.304097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:47.333516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:47.351398 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5d1fa35-70a2-46e2-b91a-f00929bd4053 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.248887 Oct 03 14:50:47.357949 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2040/4163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:47 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:47.387132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:47.390443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:47.406938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.407935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.408046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.408747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.409268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.409764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.451315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lazy-loading 'flavor' on Instance uuid 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:50:47.620037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:47.632792 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-964c38d9-fe08-42d9-95cc-7481cf8772b6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.435878 Oct 03 14:50:47.640669 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2124/4164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:47 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:47.709812 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c44a9207-c6e5-41ad-b11a-0306ad6558b6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61/action" status: 202 len: 0 microversion: 2.1 time: 0.350266 Oct 03 14:50:47.710568 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2041/4165] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:47 2022] POST /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:47.720232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:47.720753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:47.725747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:47.726866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:47.727223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.727717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.728144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.729402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.729971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.730699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.737993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.738841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.739606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.740552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:47.741500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:47.742354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:47.957284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:47.967388 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9762da35-0a95-4868-a3a1-d4e31d6770cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1491 microversion: 2.1 time: 0.251948 Oct 03 14:50:47.982673 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2125/4166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:47 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1491 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:47.991156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:47.999571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac22cdaf-0719-4258-b5a9-586bf2f6f29d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.281503 Oct 03 14:50:48.002638 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2042/4167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:47 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:48.384772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:48.385465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:48.392188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:48.392809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:48.393509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:48.394737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:48.395273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:48.395781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:48.549632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:48.561702 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36c64eed-fe29-48ea-9504-9311216f48d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1522 microversion: 2.1 time: 0.181783 Oct 03 14:50:48.565704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2126/4168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:48 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:48.659903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:48.660551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:48.665163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=20 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:48.669959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:48.670460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:48.670892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:48.671598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:48.672050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:48.672609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:48.991651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:48.992270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:49.009052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.010057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.010784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.011949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.014894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.017309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.034332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:49.046719 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c3b16ca-5427-4f77-855d-570570443312 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.391419 Oct 03 14:50:49.047834 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2043/4169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:48 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:49.056232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:49.056853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:49.075554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.076362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.076964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.078106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.078807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.079424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.241579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:49.250098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4637b627-c530-4b83-a716-4800bc0b1e1c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1512 microversion: 2.1 time: 0.262842 Oct 03 14:50:49.262127 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2127/4170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:48 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:49.390838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] Calling method '.version_select at 0x7fb22bce3a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:49.403643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.404183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.404651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.405423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.405925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.406425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.412692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:49.420667 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d58009e-bc00-4c10-b2d2-6890d79cec0d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.370752 Oct 03 14:50:49.421363 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2044/4171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:49 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:49.428297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a5c8374-d4ba-4c76-a479-7f698c873470 tempest-AbsoluteLimitsTestJSON-247304346 tempest-AbsoluteLimitsTestJSON-247304346-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.159622 Oct 03 14:50:49.428889 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2128/4172] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 3 14:50:49 2022] GET /compute/v2.1/limits => generated 511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:49.585924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:49.586887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:49.606705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.607627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.608699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.609691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.610490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.611265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.886418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:49.894786 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-237ecd40-ee8d-4088-910c-e8ddeac3b418 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1502 microversion: 2.1 time: 0.312738 Oct 03 14:50:49.909592 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2045/4173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:49 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1502 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:49.919368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:49.920290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:49.928656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.929411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.930024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:49.930890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:49.931486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:49.932227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.073935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:50.075252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:50.081749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.082546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.083189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.084115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.084800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.085460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.216450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:50.225387 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d60d4cd9-a78f-4618-9483-ef393e1f6c33 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1516 microversion: 2.1 time: 0.310769 Oct 03 14:50:50.225981 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2129/4174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:49 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:50.255791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2d6734b-2aba-4088-9730-b3893553ec98 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:50.258582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2d6734b-2aba-4088-9730-b3893553ec98 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: d26d5fb4-169a-415a-8552-9b57482f835a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:50.262363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:50.273839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d8c988fc-13d7-4c64-b659-b986175e7812 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.203614 Oct 03 14:50:50.283020 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a2d6734b-2aba-4088-9730-b3893553ec98 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Instance d26d5fb4-169a-415a-8552-9b57482f835a could not be found. Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2d6734b-2aba-4088-9730-b3893553ec98 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/d26d5fb4-169a-415a-8552-9b57482f835a/action HTTP/1.1 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 14 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: {"rescue": {}} Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d26d5fb4-169a-415a-8552-9b57482f835a could not be found. Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd26d5fb4-169a-415a-8552-9b57482f835a', 'body': {'rescue': {}}} Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d26d5fb4-169a-415a-8552-9b57482f835a could not be found. Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d26d5fb4-169a-415a-8552-9b57482f835a could not be found. Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:50.287968 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:50.292391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:50.292391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:50.292391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:50.292391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:50.292391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d26d5fb4-169a-415a-8552-9b57482f835a could not be found. Oct 03 14:50:50.292391 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:50:50.292784 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2046/4175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:50 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:50.294953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2d6734b-2aba-4088-9730-b3893553ec98 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 404 to user: Instance d26d5fb4-169a-415a-8552-9b57482f835a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:50.295816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:50.296143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:50.296654 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2d6734b-2aba-4088-9730-b3893553ec98 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/d26d5fb4-169a-415a-8552-9b57482f835a/action" status: 404 len: 111 microversion: 2.1 time: 0.045379 Oct 03 14:50:50.297531 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2130/4176] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:50 2022] POST /compute/v2.1/servers/d26d5fb4-169a-415a-8552-9b57482f835a/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:50:50.304094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.304664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.305116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.305821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.306273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.306750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.309555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:50.310505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:50.318491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.319228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.320224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.321253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.321888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.322838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.359316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:50.452137 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46c1d825-edf0-4700-97c9-28725df1d79a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action" status: 202 len: 0 microversion: 2.1 time: 0.148216 Oct 03 14:50:50.457256 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2131/4177] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:50 2022] POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:50.468505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:50.470359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:50.483204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.484088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.484725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.485917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.487177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.488098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.536619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:50.557671 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-963b113a-df67-41fb-a9de-535e1cb85162 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1512 microversion: 2.1 time: 0.266536 Oct 03 14:50:50.564055 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2047/4178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:50 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:50.570531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:50.571395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:50.579759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.580536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.581193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.581963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:50.582380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:50.582807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:50.756657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:50.766683 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-42132545-c14a-47c0-ad2f-746e4c4994cf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1521 microversion: 2.1 time: 0.200954 Oct 03 14:50:50.767751 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2048/4179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:50 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:50.802609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:50.814203 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbec717f-e213-4a98-9d4d-203cae305d9f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.354855 Oct 03 14:50:50.817687 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2132/4180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:50 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:51.302980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:51.303632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:51.320963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:51.322963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:51.323618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:51.325453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:51.326327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:51.328647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:51.578900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-da1f7afe-a68f-4004-b4e2-ffa5ac161655 req-84c6b897-b5fc-4fd4-b7c0-f7d1ce9f0383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd75d70-3269-4e1e-94ca-ad1901a551cb", "name": "network-vif-plugged", "status": "completed", "tag": "aa96e258-3c54-4608-a47f-21232b39ccc2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:51.598477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da1f7afe-a68f-4004-b4e2-ffa5ac161655 req-84c6b897-b5fc-4fd4-b7c0-f7d1ce9f0383 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:51.601560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da1f7afe-a68f-4004-b4e2-ffa5ac161655 req-84c6b897-b5fc-4fd4-b7c0-f7d1ce9f0383 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:51.603284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-da1f7afe-a68f-4004-b4e2-ffa5ac161655 req-84c6b897-b5fc-4fd4-b7c0-f7d1ce9f0383 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:51.630801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:51.631942 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-da1f7afe-a68f-4004-b4e2-ffa5ac161655 req-84c6b897-b5fc-4fd4-b7c0-f7d1ce9f0383 service nova] Creating event network-vif-plugged:aa96e258-3c54-4608-a47f-21232b39ccc2 for instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb on n-h1-781139-2 Oct 03 14:50:51.643755 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-da1f7afe-a68f-4004-b4e2-ffa5ac161655 req-84c6b897-b5fc-4fd4-b7c0-f7d1ce9f0383 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068216 Oct 03 14:50:51.644987 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2133/4181] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:51.657132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:51.658244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:51.659882 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2e2d575-abef-42e3-8e5f-1178fc8eed7b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.360304 Oct 03 14:50:51.666070 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2049/4182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:51 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:51.670039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:51.670516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:51.676402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:51.677507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:51.678143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:51.680522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:51.795208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:51.798038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:51.825781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:51.826485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:51.827232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:51.828094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:51.828831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:51.829436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.034332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:52.046437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7570a6d6-8a04-4fea-95bf-8655c429cf02 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.399618 Oct 03 14:50:52.065536 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2134/4183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:51 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:52.073738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:52.075139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:52.082389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.083119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.083955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.085741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.086470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.087093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.283546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:52.293270 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be9bc420-0d9b-4183-b315-2f5fe4788fbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1501 microversion: 2.1 time: 0.506083 Oct 03 14:50:52.299319 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2050/4184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:51 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1501 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:52.312103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:52.323573 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-646ae345-86d2-4c0a-83e8-ddf20d7e491a tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.254501 Oct 03 14:50:52.324424 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2135/4185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:52 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:52.330080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:52.333464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:52.350121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.350852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.351452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.352373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.353642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.354224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.417673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lazy-loading 'flavor' on Instance uuid 335b701a-b1ae-4492-a11b-cf7f6a9f03cb {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:50:52.453162 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Cannot 'rescue' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state paused Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action HTTP/1.1 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 14 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: {"rescue": {}} Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: exception: Cannot 'rescue' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state paused Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '335b701a-b1ae-4492-a11b-cf7f6a9f03cb', 'body': {'rescue': {}}} Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb in vm_state paused. Cannot rescue while the instance is in this state. Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state paused Oct 03 14:50:52.456974 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state paused Oct 03 14:50:52.461807 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:50:52.467042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 409 to user: Cannot 'rescue' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state paused {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:50:52.468628 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a86639ce-504e-4da8-824b-918b90e9fa91 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action" status: 409 len: 144 microversion: 2.1 time: 0.143938 Oct 03 14:50:52.471035 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2051/4186] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:52 2022] POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action => generated 144 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:50:52.480640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:52.481252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:52.509015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.509735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.511763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.512511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.514262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.515009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.691647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:52.692274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:52.704166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.704998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.705765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.706703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.707315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.707905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.737576 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c78d0a0-e552-4da8-8c1e-26b8203d9966 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action" status: 202 len: 0 microversion: 2.1 time: 0.262549 Oct 03 14:50:52.741580 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2136/4187] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:52 2022] POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:50:52.755591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:52.757563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:52.770630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.773169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.773646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.776587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:52.777116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:52.777556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:52.980372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:53.004784 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-802f7dff-5db6-4560-adb5-8863c5be087c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.317392 Oct 03 14:50:53.006484 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2052/4188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:52 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:53.079721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:53.081813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:53.092889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:53.093840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:53.094677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:53.096055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:53.096662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:53.097585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:53.188902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:53.207313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1feee3a6-cd4c-43d1-8a79-f24a0281555c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1508 microversion: 2.1 time: 0.457230 Oct 03 14:50:53.210612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2137/4189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:52 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1508 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:53.352534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:53.353615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:53.363994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:53.364976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:53.365626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:53.366751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:53.367441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:53.368063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:53.861607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:53.871688 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92c7bb97-c14b-449b-aa44-8f439668046d tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1317 microversion: 2.1 time: 0.523758 Oct 03 14:50:53.877897 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2138/4190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:53 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:53.889507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6a48b13d-b33f-43d5-bac0-cc6cbd28af74 req-55ac5c6a-5adb-41ef-986e-1030201c3fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6a44a-0eef-4fef-a7c1-b2b493d86c61", "name": "network-vif-plugged", "status": "completed", "tag": "5641f14c-b607-4db5-a316-ac609bb2a1df"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:53.909694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a48b13d-b33f-43d5-bac0-cc6cbd28af74 req-55ac5c6a-5adb-41ef-986e-1030201c3fe4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:53.910206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a48b13d-b33f-43d5-bac0-cc6cbd28af74 req-55ac5c6a-5adb-41ef-986e-1030201c3fe4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:53.924174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a48b13d-b33f-43d5-bac0-cc6cbd28af74 req-55ac5c6a-5adb-41ef-986e-1030201c3fe4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:53.946088 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6a48b13d-b33f-43d5-bac0-cc6cbd28af74 req-55ac5c6a-5adb-41ef-986e-1030201c3fe4 service nova] Creating event network-vif-plugged:5641f14c-b607-4db5-a316-ac609bb2a1df for instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 on n-h2-781139-2 Oct 03 14:50:53.956841 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6a48b13d-b33f-43d5-bac0-cc6cbd28af74 req-55ac5c6a-5adb-41ef-986e-1030201c3fe4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070908 Oct 03 14:50:53.963824 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2139/4191] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:54.032021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:54.033405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:54.044211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:54.047306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:54.047982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:54.049817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:54.051198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:54.052318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:54.052437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:54.096560 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bbc7bc42-2081-49c6-a414-90549b1252d8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 1.022117 Oct 03 14:50:54.100516 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2053/4192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:53 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:54.246032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:54.247089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:54.262264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:54.265650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:54.268297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:54.271190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:54.272566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:54.273994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:54.294872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:54.308109 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3a5ba39-46bb-41c0-bec7-78ab25e02448 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.282177 Oct 03 14:50:54.309568 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2140/4193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:54 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:54.797025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:54.801622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:54.815712 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3a2af13b-996c-430f-8af8-0a9775f86b97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1516 microversion: 2.1 time: 0.583627 Oct 03 14:50:54.816589 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2054/4194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:54 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1516 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:54.908216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:54.910440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:54.923198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:54.926147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:54.926822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:54.928075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:54.931029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:54.931645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.123394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:55.124606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:55.135615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.145025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.145856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.146842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.147566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.148203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.288345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:55.308872 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-287bd0d6-236e-4484-9266-d12dc9e57777 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1505 microversion: 2.1 time: 0.405861 Oct 03 14:50:55.310201 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2141/4195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:54 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:55.343177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:55.343177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:55.365419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.367517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.369622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.373169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.373650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.374294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.662677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:55.675336 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51a66082-e3a6-4889-be0d-c2ae6b74bac7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.344822 Oct 03 14:50:55.676638 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2142/4196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:55 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:50:55.682554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:55.683223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:55.690745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.692215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.693065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.694870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.695652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.696256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.744432 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cbbd627-e3e6-44f9-b2f6-4a841e2e64c7 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb/ips" status: 200 len: 108 microversion: 2.1 time: 0.065155 Oct 03 14:50:55.745774 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2143/4197] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:50:55 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb/ips => generated 108 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:55.782727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:55.783292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:55.790675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.791863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.792544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.793663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.794166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.794638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.855929 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47e8dc5c-96f4-4a44-9c5c-3770bf620ab3 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb/ips" status: 200 len: 108 microversion: 2.1 time: 0.079380 Oct 03 14:50:55.856974 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2144/4198] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:50:55 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb/ips => generated 108 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:50:55.891915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:55.891915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:55.921250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.924472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.927676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.931326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:55.934411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:55.935035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:55.970324 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a39cebf5-1883-4f6e-af5e-402e8b53708f tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb/ips/tempest-ServerAddressesTestJSON-399619582-network" status: 200 len: 93 microversion: 2.1 time: 0.103713 Oct 03 14:50:55.972528 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2145/4199] 10.222.0.20 () {58 vars in 1398 bytes} [Mon Oct 3 14:50:55 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb/ips/tempest-ServerAddressesTestJSON-399619582-network => generated 93 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:50:56.014845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:56.015699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:56.023992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:56.024735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:56.025564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:56.026427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:56.027025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:56.028239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:56.064039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:50:56.161640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:56.221877 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4df02fda-b5a7-4acd-8a55-49b1232b912b tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 204 len: 0 microversion: 2.1 time: 0.238101 Oct 03 14:50:56.225392 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2146/4200] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:50:55 2022] DELETE /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:50:56.233430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:56.234392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:56.242700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:56.243608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:56.244199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:56.245124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:56.245708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:56.246222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:56.256899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:56.284149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:56.293175 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd305645-237d-410b-8216-346071c9d663 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 1.173824 Oct 03 14:50:56.314349 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2055/4201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:55 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:56.600543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:56.615098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4bc23e6-69d6-479d-b173-3b40407d0d73 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1511 microversion: 2.1 time: 0.387242 Oct 03 14:50:56.616050 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2147/4202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:56 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1511 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:56.706466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:56.707463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:56.725826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:56.726327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:56.726774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:56.740791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:56.741740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:56.742195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:57.316159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:57.316703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:57.325970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:57.327456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:57.328452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:57.329531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:57.330217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:57.330863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:57.711985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:57.721896 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bffa788-03a8-40bd-9a0b-8085cd74f94d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.409942 Oct 03 14:50:57.741911 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2148/4203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:57 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:57.747978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:50:57.760669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:57.774508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:57.775722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:57.777175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:57.779496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:57.780865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:57.782752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:57.842974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lazy-loading 'flavor' on Instance uuid 335b701a-b1ae-4492-a11b-cf7f6a9f03cb {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:50:57.907471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:57.922218 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2976f6e1-bedb-4165-bfef-eeb1610b6de4 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 1.222167 Oct 03 14:50:57.923261 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2056/4204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:56 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:57.932680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:57.934674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:57.950022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:57.954600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:57.955286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:57.956227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:57.956833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:57.957418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:58.037379 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-055f4388-1231-4e9e-9ee5-f4c769be7cc7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action" status: 200 len: 32 microversion: 2.1 time: 0.293472 Oct 03 14:50:58.051905 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2149/4205] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:50:57 2022] POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action => generated 32 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:50:58.064058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:58.066004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:58.091326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:58.092090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:58.095748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:58.096625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:58.098254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:58.098254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:58.778787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:58.794525 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e7d1df5-414d-443f-aecc-9ce9ea2db96f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.736659 Oct 03 14:50:58.803904 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2150/4206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:58 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:58.812116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:58.829273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:58.837987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:58.838495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:58.838940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:58.839866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:58.840400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:58.840892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:58.952164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:58.966347 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1331cd7-2acb-4db2-a594-1b92cadcf6f0 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1511 microversion: 2.1 time: 1.037377 Oct 03 14:50:58.968249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2057/4207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:57 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1511 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:58.976672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:58.979912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:59.000492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:59.001926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:59.004834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:59.006176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:59.008095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:59.011418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:59.403096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:59.420588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:50:59.595756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:50:59.607946 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa14b164-f542-4151-b4a9-66475ed95e21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.801701 Oct 03 14:50:59.619012 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2151/4208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:58 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:50:59.831505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:50:59.833030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:50:59.846950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:59.849533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:59.850340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:50:59.853922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:50:59.857394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:50:59.858003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:00.019628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:00.044912 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-09be958d-d7e9-4ae2-91b9-b3a99f8110bf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 1.074095 Oct 03 14:51:00.045865 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2058/4209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:58 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:00.056078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:00.065208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:00.081715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:00.083588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:00.084352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:00.086296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:00.086934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:00.093561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:00.196489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:00.209774 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94b63211-f9e1-4a03-9f3f-fc833027b501 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.383645 Oct 03 14:51:00.210474 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2152/4210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:50:59 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:00.625163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:00.637448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:00.638220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:00.648502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:00.654845 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b19da0fe-7a0a-472a-b580-64347dac900c tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1511 microversion: 2.1 time: 0.606829 Oct 03 14:51:00.655628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:00.658326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:00.661096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:00.663519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:00.664133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:00.676042 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2059/4211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:00 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1511 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:00.778378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3c3d76bb-bd86-4561-a2e8-84a297248f67 req-5afeb407-dd6c-440b-aa24-09238882a3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd75d70-3269-4e1e-94ca-ad1901a551cb", "name": "network-vif-deleted", "tag": "aa96e258-3c54-4608-a47f-21232b39ccc2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:00.797218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:00.804542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3c3d76bb-bd86-4561-a2e8-84a297248f67 req-5afeb407-dd6c-440b-aa24-09238882a3a8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:00.806139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3c3d76bb-bd86-4561-a2e8-84a297248f67 req-5afeb407-dd6c-440b-aa24-09238882a3a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:00.807008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3c3d76bb-bd86-4561-a2e8-84a297248f67 req-5afeb407-dd6c-440b-aa24-09238882a3a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:00.841407 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3c3d76bb-bd86-4561-a2e8-84a297248f67 req-5afeb407-dd6c-440b-aa24-09238882a3a8 service nova] Creating event network-vif-deleted:aa96e258-3c54-4608-a47f-21232b39ccc2 for instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb on n-h1-781139-2 Oct 03 14:51:00.856072 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3c3d76bb-bd86-4561-a2e8-84a297248f67 req-5afeb407-dd6c-440b-aa24-09238882a3a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082665 Oct 03 14:51:00.861282 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2060/4212] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:01.041158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:01.052347 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b477fe6a-cac9-413a-965b-9dee19fb6f21 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.418830 Oct 03 14:51:01.053967 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2153/4213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:00 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:01.082993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:01.086848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:01.103403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:01.104645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:01.105321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:01.106247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:01.106959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:01.107610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:01.234227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:01.235499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:01.258919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:01.259589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:01.260037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:01.260759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:01.264176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:01.264645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:01.485645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:01.495926 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14b9f4c2-2168-4c13-acc1-e9cc20df15a7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.428872 Oct 03 14:51:01.496540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2061/4214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:01 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:01.683463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:01.684751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:01.695889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:01.696823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:01.701108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:01.702887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:01.704881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:01.705632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:01.777031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:01.784435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:01.786072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:01.789330 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a67358a-6993-4cf8-9a00-47c4d97b0a9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.559853 Oct 03 14:51:01.790413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:01.791078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lazy-loading 'fault' on Instance uuid 6bd75d70-3269-4e1e-94ca-ad1901a551cb {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:51:01.805010 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2154/4215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:01 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:01.962846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca273453c3b54aec91ba17e2341a5b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc810f57a07f43fc8e4345b67bb45887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:01.976544 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f77c3164-72f4-4fd8-b53a-6b74af9ad56e tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 200 len: 1307 microversion: 2.1 time: 0.294421 Oct 03 14:51:02.000404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2062/4216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:01 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 1307 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:02.076833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:02.077710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:02.095201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:02.095703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:02.096145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:02.096862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:02.097348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:02.097786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:02.375426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:02.384598 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5162f6d-ff0a-402d-9972-006cc5f13461 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.311829 Oct 03 14:51:02.390451 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2155/4217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:02 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:02.521871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:02.522665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:02.543866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:02.548709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:02.550770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:02.551710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:02.553696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:02.557137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:02.812608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:02.813376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:02.826700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:02.827202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:02.830791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:02.833352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:02.834033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:02.835579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:03.182178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:03.192604 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-69165ca2-525c-4ffd-83d4-050448f4b03d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.674710 Oct 03 14:51:03.193245 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2063/4218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:02 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:03.205192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:03.205192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] [instance: 6bd75d70-3269-4e1e-94ca-ad1901a551cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:03.219047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:03.219552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:03.220000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:03.220720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:03.221205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:03.221632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:03.243050 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] HTTP exception thrown: Instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb could not be found. Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Request method failure captured: Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb HTTP/1.1 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOva6kA4ayN-FDw5LVfHjBxp-PW3tJYsd4qjApIdNS3KCjBAW7xsvDL7tlK4NVDnLce1kpBzRf5Pieyej3sTrkYViCSE5BO9z-x7-YV4VLXj-HnemSvO1-boDwjNDD_uAjaFBzpkT6xCId9PJ3lc2hVWKwa4YLGIQY_ce5sEDO2mSQO0 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: fc810f57a07f43fc8e4345b67bb45887 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerAddressesTestJSON-1313467935 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fc810f57a07f43fc8e4345b67bb45887"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fc810f57a07f43fc8e4345b67bb45887", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc810f57a07f43fc8e4345b67bb45887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fc810f57a07f43fc8e4345b67bb45887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerAddressesTestJSON-1313467935 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: fc810f57a07f43fc8e4345b67bb45887 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1313467935 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerAddressesTestJSON-1313467935-project Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ca273453c3b54aec91ba17e2341a5b99 Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerAddressesTestJSON-1313467935-project Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb could not be found. Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6bd75d70-3269-4e1e-94ca-ad1901a551cb'} Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb could not be found. Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb could not be found. Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:03.245543 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb could not be found. Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] Returning 404 to user: Instance 6bd75d70-3269-4e1e-94ca-ad1901a551cb could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:03.249422 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-79491596-5735-4518-aa32-049697528887 tempest-ServerAddressesTestJSON-1313467935 tempest-ServerAddressesTestJSON-1313467935-project] 10.222.0.20 "GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb" status: 404 len: 111 microversion: 2.1 time: 0.052935 Oct 03 14:51:03.253076 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2064/4219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:03 2022] GET /compute/v2.1/servers/6bd75d70-3269-4e1e-94ca-ad1901a551cb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:51:03.412547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:03.426419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:03.427392 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-841c21f2-64bf-4bab-9d83-d04d16cf9747 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.617238 Oct 03 14:51:03.427939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:03.428075 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2156/4220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:02 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:03.443441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:03.444184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:03.445556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:03.447135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:03.447798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:03.448879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:04.218910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:04.219809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:04.232705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:04.233226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:04.233675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:04.234427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:04.234882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:04.235304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:04.515224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:04.524302 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9f2ce668-8da3-4b9d-bdd9-36933d43f4a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 1.113677 Oct 03 14:51:04.549405 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2065/4221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:03 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:04.555915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:04.556784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:04.585297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:04.586081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:04.586699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:04.587566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:04.588173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:04.588752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:04.675070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:04.691309 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45d2f3e7-1664-4586-8873-9be16f2734aa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1531 microversion: 2.1 time: 0.476687 Oct 03 14:51:04.710302 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2157/4222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:04 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1531 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:04.987530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:05.010223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-08731080-7b71-49e5-b1c0-a43bdb8d9045 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.459487 Oct 03 14:51:05.011480 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2066/4223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:04 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:05.565642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:05.566489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:05.584524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:05.587916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:05.588467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:05.589269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:05.589738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:05.592735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:05.723872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:05.725496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:05.736586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:05.747144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:05.750346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:05.752883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:05.757112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:05.757566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:06.034447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:06.106945 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b957c0fc-f6e1-4345-8850-eb6a30f745a9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.545234 Oct 03 14:51:06.110798 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2158/4224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:05 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:06.119241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:06.131187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:06.172013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:06.175522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:06.178870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:06.181134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:06.184144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:06.185127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:06.246463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:06.269490 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e1b48223-3a8e-4435-bb30-bcb509369a85 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1531 microversion: 2.1 time: 0.549414 Oct 03 14:51:06.282474 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2067/4225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:05 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1531 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:06.520046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:06.534362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a88683ed-2cf7-41ae-8b27-a5a68b10aac3 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb234ac4310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-805767073", "description": "tempest-description-765090225"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:06.544140 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ce24d31-6949-4036-b15c-e328620d84f8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.429497 Oct 03 14:51:06.544756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2159/4226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:06 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:07.130332 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 14:51:07.131315 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 14:51:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 (ip 10.222.0.20) !!! Oct 03 14:51:07.135943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:07.136577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:07.156043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.156796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.162519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:07.163590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.164080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.164703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:07.235461 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a88683ed-2cf7-41ae-8b27-a5a68b10aac3 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.939933 Oct 03 14:51:07.236179 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2068/4227] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:51:06 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:07.241486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:07.242336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:07.260132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.263825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.266284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:07.267301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.269474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.271756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:07.450847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:07.463860 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f0be397-e660-4441-95a4-0c6620003da6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.334520 Oct 03 14:51:07.489125 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2160/4228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:07 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:07.502615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c33e54a-756d-4147-8ea8-0a00fbfd7e47 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb230961e50>, body: {"security_group_rule": {"parent_group_id": "87c0aef0-f045-4ef4-bb4f-6a372763214c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:07.758771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:07.777469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:07.784426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:07.790632 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-426af0f3-1d20-43b9-a8e2-13c18dbd0fd6 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2954 microversion: 2.32 time: 0.551582 Oct 03 14:51:07.792729 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2069/4229] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:51:07 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2954 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:51:07.807153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:07.808171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:07.838568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.840123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.841082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:07.841730 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c33e54a-756d-4147-8ea8-0a00fbfd7e47 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.344202 Oct 03 14:51:07.842301 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2161/4230] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:51:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:07.844516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.845679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.846721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:07.856477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:07.857399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:07.873239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.874037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.875349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:07.876919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:07.883625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:07.884087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:08.188158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:08.197575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:08.201151 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-07d75e15-d8ce-4c46-9744-e32436366f97 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.347836 Oct 03 14:51:08.203105 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2162/4231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:07 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:08.209025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:08.209967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:08.219561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:08.221654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:08.222680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:08.223565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:08.224305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:08.224884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:08.444303 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-40fc1991-1919-4fbd-91f1-d4f2b2e8baf7 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.239608 Oct 03 14:51:08.444971 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2163/4232] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:51:08 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b/os-interface => generated 1832 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:51:08.453400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c405e4ba-9dc0-4121-95f8-20ffadb0cb93 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb22be1c940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1949807351", "description": "tempest-description-2109678030"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:08.642505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:08.692538 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2f35431e-9637-4ade-9e8f-871c95d50189 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1531 microversion: 2.1 time: 0.893523 Oct 03 14:51:08.698839 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2070/4233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:07 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1531 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:08.719803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0bda9325-f604-41d5-b774-288f58e1042d req-b82b2f62-d76f-4cb0-9f37-35911856e3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abef3-5a4d-48c8-89e6-63862eb6bf37", "name": "network-vif-plugged", "status": "completed", "tag": "7abe5823-b304-4057-b497-e2f4b020ff05"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:08.754300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0bda9325-f604-41d5-b774-288f58e1042d req-b82b2f62-d76f-4cb0-9f37-35911856e3ea service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:08.755083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0bda9325-f604-41d5-b774-288f58e1042d req-b82b2f62-d76f-4cb0-9f37-35911856e3ea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:08.755711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0bda9325-f604-41d5-b774-288f58e1042d req-b82b2f62-d76f-4cb0-9f37-35911856e3ea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:08.803768 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0bda9325-f604-41d5-b774-288f58e1042d req-b82b2f62-d76f-4cb0-9f37-35911856e3ea service nova] Creating event network-vif-plugged:7abe5823-b304-4057-b497-e2f4b020ff05 for instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 on n-h1-781139-2 Oct 03 14:51:08.815187 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0bda9325-f604-41d5-b774-288f58e1042d req-b82b2f62-d76f-4cb0-9f37-35911856e3ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111604 Oct 03 14:51:08.818213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2071/4234] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:08.829309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:08.830594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:08.835395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c405e4ba-9dc0-4121-95f8-20ffadb0cb93 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.389333 Oct 03 14:51:08.841124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:08.842145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:08.842982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:08.845352 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2164/4235] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:51:08 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:08.850768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:08.851359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c5a3411-3186-4ed9-9071-ffb39091418e tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb22be1f8b0>, body: {"security_group_rule": {"parent_group_id": "c03bb242-ca64-4e0d-a94b-78fda2e63e1a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:08.851769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:08.852356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:09.222339 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c5a3411-3186-4ed9-9071-ffb39091418e tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.374652 Oct 03 14:51:09.222968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2165/4236] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:51:08 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:09.238976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:09.239796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:09.250207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:09.251551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:09.253480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:09.254735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:09.255405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:09.255983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:09.529265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:09.544974 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48f7b2fc-9359-42fc-8c2e-06e94965b764 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.310459 Oct 03 14:51:09.554562 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2166/4237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:09 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:09.561594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23089bbc-3f64-44e3-8b15-43220589c134 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb22be1fa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-63403216", "description": "tempest-description-368988701"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:09.948204 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23089bbc-3f64-44e3-8b15-43220589c134 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.388858 Oct 03 14:51:09.949613 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2167/4238] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:51:09 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:09.956718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:09.958396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:09.970408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:09.971264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:09.971891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:09.972792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:09.973366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:09.974314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:10.177528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:10.189596 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77e51f80-2d44-4067-939f-188d0819b594 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.238126 Oct 03 14:51:10.190771 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2168/4239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:09 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:10.196445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b4b2ff5-2cb1-4524-b401-59600edbd92a tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb22bd968b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1827690382", "description": "tempest-description-1314515464"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:10.309526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:10.320485 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-626977b2-d375-4814-b889-7ce5a437b9a1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 1.499758 Oct 03 14:51:10.326016 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2072/4240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:08 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:10.580345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:10.581014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:10.592222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:10.592723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:10.598784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:10.599914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:10.601830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:10.602589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:10.607681 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b4b2ff5-2cb1-4524-b401-59600edbd92a tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.414872 Oct 03 14:51:10.616839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2169/4241] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:51:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:10.624013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e5464f3-3f66-400f-a245-90d975a3ce2c tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb22be1f3a0>, body: {"security_group_rule": {"parent_group_id": "8fdd2c71-5c29-4988-a586-58d59595aebb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a1468033-8f14-447b-a31e-d29247b8a89d"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:11.228078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:11.239508 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1bf636a9-76e5-4b34-9a0e-d1b57af9ba51 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.663535 Oct 03 14:51:11.257298 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2073/4242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:10 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:11.281985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:11.305369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:11.313415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:11.319224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:11.320035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:11.321142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:11.321866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:11.324581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:11.368950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:11.950182 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e5464f3-3f66-400f-a245-90d975a3ce2c tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.323249 Oct 03 14:51:11.951619 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2170/4243] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:51:10 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:51:12.236997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:12.256521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be443413-e852-4613-9425-04a94ebd81cc tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 1.006756 Oct 03 14:51:12.278062 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2074/4244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:11 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:12.302238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61d4893d-0072-4d18-b60c-fc39a3b9171c tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb23062b670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-21390046", "description": "tempest-description-982246552"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:12.370818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:12.372092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:12.394917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:12.397673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:12.398567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:12.400184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:12.401401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:12.402716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:12.752804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:12.767895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8d90605-9e7f-439a-9316-ecaf0dc3f948 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.813711 Oct 03 14:51:12.786334 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2171/4245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:11 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:12.799169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:12.801143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:12.820949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:12.821895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:12.821895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:12.822591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:12.827947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:12.829057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:13.209317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:13.223174 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb8dd37c-8e27-49c5-ab6b-72797194874d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.435501 Oct 03 14:51:13.223905 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2172/4246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:12 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:13.281406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:13.282150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:13.290652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:13.292387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:13.294501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:13.295398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:13.301909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:13.302725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:13.620902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:13.641466 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4c11164-3299-48a4-a6dd-34e847180ec8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.365510 Oct 03 14:51:13.643123 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2173/4247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:13 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:13.670500 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61d4893d-0072-4d18-b60c-fc39a3b9171c tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.389286 Oct 03 14:51:13.677442 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2075/4248] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:51:12 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:13.692485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35cf2470-f6a1-47a0-b3f3-21ede411d691 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb22be67f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1023536641", "description": "tempest-description-1190912042"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:13.791896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:13.792659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:13.804403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:13.815895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:13.816703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:13.818393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:13.820719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:13.821286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:14.057158 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35cf2470-f6a1-47a0-b3f3-21ede411d691 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.369461 Oct 03 14:51:14.058238 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2174/4249] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:51:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:14.073594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70e95c6b-9bc3-4a0c-9408-e24237c70146 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb230961820>, body: {"security_group_rule": {"parent_group_id": "ff9c26aa-9d0c-4fea-93f1-cdbaef9a8215", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "820ce6f3-21ad-497d-9b75-3a965a948241"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:14.568492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:14.569689 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70e95c6b-9bc3-4a0c-9408-e24237c70146 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.501048 Oct 03 14:51:14.570856 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2175/4250] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:51:14 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:14.585217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:14.588575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:14.595310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d53a5c1d-37a0-42b7-a850-bfbcac9c8c9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1507 microversion: 2.1 time: 0.806905 Oct 03 14:51:14.595929 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2076/4251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:13 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1507 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:14.608199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:14.608980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:14.609589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:14.610874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-41e8bcc5-5616-49af-808f-ee0000d29644 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb230f55280>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:14.611794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:14.612916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:14.615934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:15.009040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:15.024944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e48fe70-6359-4a76-b258-3ca2d85d45eb tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.447207 Oct 03 14:51:15.026168 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2176/4252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:14 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:15.036421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:15.037666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:15.056531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:15.057405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:15.058007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:15.058880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:15.068122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:15.068732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:15.149744 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-41e8bcc5-5616-49af-808f-ee0000d29644 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/820ce6f3-21ad-497d-9b75-3a965a948241" status: 202 len: 0 microversion: 2.1 time: 0.548816 Oct 03 14:51:15.151110 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2077/4253] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:14 2022] DELETE /compute/v2.1/os-security-groups/820ce6f3-21ad-497d-9b75-3a965a948241 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:15.162547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98c490a2-2a2b-4ee1-867d-1642e0f00db2 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb230df2940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:15.272472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98c490a2-2a2b-4ee1-867d-1642e0f00db2 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/ff9c26aa-9d0c-4fea-93f1-cdbaef9a8215" status: 200 len: 245 microversion: 2.1 time: 0.114285 Oct 03 14:51:15.283192 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2078/4254] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:51:15 2022] GET /compute/v2.1/os-security-groups/ff9c26aa-9d0c-4fea-93f1-cdbaef9a8215 => generated 245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:15.289793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-749fa00b-3851-4e6c-86d1-69ab1bbe307b tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb234b60b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-90585718", "description": "tempest-description-1203532618"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:15.461418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:15.474539 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad8864ac-3359-44fe-baea-c07cb331dcc6 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.442878 Oct 03 14:51:15.477617 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2177/4255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:15 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:15.627717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-749fa00b-3851-4e6c-86d1-69ab1bbe307b tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.343094 Oct 03 14:51:15.628681 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2079/4256] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:51:15 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:15.630894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:15.633642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:15.642522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fbbf9cd0-3891-4eed-a461-066d7c6a80c5 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb2300618b0>, body: {"security_group_rule": {"parent_group_id": "7f55985e-62dc-436f-9dbb-840649c0e86e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:15.652107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:15.652778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:15.654167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:15.655212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:15.655913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:15.657868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:16.018103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:16.026567 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86909c1d-1dcb-462e-a86c-d8acebecfbaf tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1504 microversion: 2.1 time: 0.410233 Oct 03 14:51:16.027160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2178/4257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:15 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:16.057386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:16.057992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:16.082640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:16.083557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:16.084171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:16.085135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:16.085732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:16.086302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:16.138052 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fbbf9cd0-3891-4eed-a461-066d7c6a80c5 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.500258 Oct 03 14:51:16.146188 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2080/4258] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:51:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:16.153347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ccc9305-6aba-48d6-ad31-c9602a9abdf2 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Action: 'create', calling method: .version_select at 0x7fb230a8dca0>, body: {"security_group_rule": {"parent_group_id": "7f55985e-62dc-436f-9dbb-840649c0e86e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:16.684236 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ccc9305-6aba-48d6-ad31-c9602a9abdf2 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.536448 Oct 03 14:51:16.692292 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2081/4259] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 3 14:51:16 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:16.699818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:16.701970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:16.736205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:16.737857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:16.738970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:16.741255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:16.741922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:16.742804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:16.871777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:16.882998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fcc089b7-9b86-4815-ab5a-7cf28bbd61e5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 0.829413 Oct 03 14:51:16.891740 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2179/4260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:16 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:16.905893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d10f20e6-f669-4bef-9868-8f7605b403f3 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb22bf133a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:17.064204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:17.075804 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2b084d35-c7a5-4e71-99f2-99adcf9c0082 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.381004 Oct 03 14:51:17.076398 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2082/4261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:16 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:17.086898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:17.087528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:17.094066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:17.094783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:17.095384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:17.096405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:17.097037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:17.097613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:17.189248 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d10f20e6-f669-4bef-9868-8f7605b403f3 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/7f55985e-62dc-436f-9dbb-840649c0e86e" status: 200 len: 663 microversion: 2.1 time: 0.292647 Oct 03 14:51:17.189248 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2180/4262] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:51:16 2022] GET /compute/v2.1/os-security-groups/7f55985e-62dc-436f-9dbb-840649c0e86e => generated 663 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:17.200737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44be3ce2-8163-472f-8eb7-635a309fb23d tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb22bf2c940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:17.336902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:17.351623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8757ce0d-d342-456b-8171-96fd9a46eef2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1504 microversion: 2.1 time: 0.270380 Oct 03 14:51:17.352226 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2083/4263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:17 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:17.910680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:17.911372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:17.926037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:17.928563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:17.929216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:17.930872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:17.934797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:17.935465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:18.035404 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44be3ce2-8163-472f-8eb7-635a309fb23d tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/b5b60237-165d-4756-9a82-441693b0ec7d" status: 202 len: 0 microversion: 2.1 time: 0.838815 Oct 03 14:51:18.041862 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2181/4264] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Oct 3 14:51:17 2022] DELETE /compute/v2.1/os-security-group-rules/b5b60237-165d-4756-9a82-441693b0ec7d => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:18.049482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aee9f402-045a-4ce3-a8c0-924ad869d3b8 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb22be67ee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:18.207555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:18.244292 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56b4918a-69aa-4f2f-a3ec-c0bda31c6534 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1502 microversion: 2.1 time: 0.337692 Oct 03 14:51:18.249392 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2084/4265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:17 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:18.264178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:18.265654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:18.276823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:18.277773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:18.278515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:18.279562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:18.280246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:18.280894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:18.522707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:18.541611 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f6d9756-9d61-410d-87cf-5c9debe39473 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.289781 Oct 03 14:51:18.552960 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2085/4266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:18 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:18.848245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-856195d9-986a-43de-868a-66fd3e77be06 tempest-ExtensionsTest-585789317 tempest-ExtensionsTest-585789317-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:18.850157 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-856195d9-986a-43de-868a-66fd3e77be06 tempest-ExtensionsTest-585789317 tempest-ExtensionsTest-585789317-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.306088 Oct 03 14:51:18.855067 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2086/4267] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 3 14:51:18 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:18.865233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40cf4fdf-ec8c-495f-80cb-d6f8b596f880"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:18.869564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:18.877307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:18.877878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:18.878421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:18.879203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:18.879721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:18.880216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:18.909503 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Cannot 'attach_volume' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state rescued Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/os-volume_attachments HTTP/1.1 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 74 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: {"volumeAttachment": {"volumeId": "40cf4fdf-ec8c-495f-80cb-d6f8b596f880"}} Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: exception: Cannot 'attach_volume' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state rescued Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': '335b701a-b1ae-4492-a11b-cf7f6a9f03cb', 'body': {'volumeAttachment': {'volumeId': '40cf4fdf-ec8c-495f-80cb-d6f8b596f880'}}} Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 03 14:51:18.912114 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state rescued Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state rescued Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 409 to user: Cannot 'attach_volume' instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb while it is in vm_state rescued {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b8bb879-9843-40b6-83d4-902dc8556bf4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057419 Oct 03 14:51:18.916260 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2087/4268] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:51:18 2022] POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:51:18.920189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:18.920878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:18.937852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:18.938326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:18.941361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:18.942779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:18.943451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:18.944037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:19.140663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:19.149070 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ebe98531-f60d-48f6-8d54-83576e3fd9e1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1504 microversion: 2.1 time: 0.233818 Oct 03 14:51:19.150825 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2088/4269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:18 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:19.155697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e37c928-6e9e-4f83-bafa-1fadebb30f6a tempest-ExtensionsTest-585789317 tempest-ExtensionsTest-585789317-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:19.158010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e37c928-6e9e-4f83-bafa-1fadebb30f6a tempest-ExtensionsTest-585789317 tempest-ExtensionsTest-585789317-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006267 Oct 03 14:51:19.158724 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2089/4270] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 3 14:51:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:51:19.198781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:19.199245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:19.206308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:19.206799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:19.207235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:19.207949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:19.208401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:19.208824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:19.303133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aee9f402-045a-4ce3-a8c0-924ad869d3b8 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7f55985e-62dc-436f-9dbb-840649c0e86e" status: 202 len: 0 microversion: 2.1 time: 1.260051 Oct 03 14:51:19.303748 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2182/4271] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:18 2022] DELETE /compute/v2.1/os-security-groups/7f55985e-62dc-436f-9dbb-840649c0e86e => generated 0 bytes in 1261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:19.315259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c346fd19-661d-4dc8-a1d5-6e4cdbd5a779 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb22bf133a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:19.444436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG neutronclient.v2_0.client [None req-c346fd19-661d-4dc8-a1d5-6e4cdbd5a779 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist", "detail": ""}} {{(pid=128869) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 03 14:51:19.445091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.security_group_api [None req-c346fd19-661d-4dc8-a1d5-6e4cdbd5a779 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Neutron security group 820ce6f3-21ad-497d-9b75-3a965a948241 not found {{(pid=128869) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 03 14:51:19.445907 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c346fd19-661d-4dc8-a1d5-6e4cdbd5a779 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] HTTP exception thrown: Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist Oct 03 14:51:19.445907 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-c7aa99b6-a175-4c04-a07e-a1c3df36b1ac'] Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c346fd19-661d-4dc8-a1d5-6e4cdbd5a779 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Request method failure captured: Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-security-groups/820ce6f3-21ad-497d-9b75-3a965a948241 HTTP/1.1 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvbaBs9DERfjhB98NKvF_Dzq___-fNsRjuc_Oesegv2rnSZ7zr0taxQy-zVIClV7HdBiVg1uO-u32zdxkQvYvpLFzgqo_3npM3NIfw2X3PaGVO5dQWLFHKbHsSxGh_vbTuIL2kL67av9ByedXSwDHsOHIjQUOdWlEAU__y9VZSk3GCE Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 64c0f156c6f14766ae1dac5f721ab7e9 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-913559376 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64c0f156c6f14766ae1dac5f721ab7e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64c0f156c6f14766ae1dac5f721ab7e9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64c0f156c6f14766ae1dac5f721ab7e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64c0f156c6f14766ae1dac5f721ab7e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-SecurityGroupRulesTestJSON-913559376 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 64c0f156c6f14766ae1dac5f721ab7e9 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-913559376 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-SecurityGroupRulesTestJSON-913559376-project Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 0f3440f7173043c39668278df178df0c Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-SecurityGroupRulesTestJSON-913559376-project Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: exception: Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-c7aa99b6-a175-4c04-a07e-a1c3df36b1ac'] Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '820ce6f3-21ad-497d-9b75-3a965a948241'} Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 03 14:51:19.449262 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7aa99b6-a175-4c04-a07e-a1c3df36b1ac'] Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7aa99b6-a175-4c04-a07e-a1c3df36b1ac'] Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7aa99b6-a175-4c04-a07e-a1c3df36b1ac'] Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7aa99b6-a175-4c04-a07e-a1c3df36b1ac'] Oct 03 14:51:19.452744 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:51:19.459221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c346fd19-661d-4dc8-a1d5-6e4cdbd5a779 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Returning 404 to user: Security group 820ce6f3-21ad-497d-9b75-3a965a948241 does not exist Oct 03 14:51:19.459221 n-d-781139-2 devstack@n-api.service[128869]: Neutron server returns request_ids: ['req-c7aa99b6-a175-4c04-a07e-a1c3df36b1ac'] {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:19.460552 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c346fd19-661d-4dc8-a1d5-6e4cdbd5a779 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/820ce6f3-21ad-497d-9b75-3a965a948241" status: 404 len: 194 microversion: 2.1 time: 0.152223 Oct 03 14:51:19.464702 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2183/4272] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:19 2022] DELETE /compute/v2.1/os-security-groups/820ce6f3-21ad-497d-9b75-3a965a948241 => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:51:19.475748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f45067fe-a734-406e-aa14-1cd4fd41a0f7 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb22be7f3a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:19.501564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36793735-ee6d-44c2-b0fa-8d9b4b0fb459 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action" status: 202 len: 0 microversion: 2.1 time: 0.320246 Oct 03 14:51:19.511117 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2090/4273] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:51:19 2022] POST /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:19.528314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:19.529854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:19.537558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:19.538057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:19.538502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:19.542470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:19.543911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:19.544397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:19.756986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:19.768788 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13271963-5b12-474e-8056-70b70383acec tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1510 microversion: 2.1 time: 0.256090 Oct 03 14:51:19.768788 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2091/4274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:19 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:19.778445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:19.779081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:19.800455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:19.801022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:19.801427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:19.805491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:19.807999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:19.809013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:19.936238 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f45067fe-a734-406e-aa14-1cd4fd41a0f7 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ff9c26aa-9d0c-4fea-93f1-cdbaef9a8215" status: 202 len: 0 microversion: 2.1 time: 0.469688 Oct 03 14:51:19.937819 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2184/4275] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:19 2022] DELETE /compute/v2.1/os-security-groups/ff9c26aa-9d0c-4fea-93f1-cdbaef9a8215 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:19.946903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-416c0b65-be0a-484c-ae71-08d4f4c2289d tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb22be7f940>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:20.251286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:20.266891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d994053-e4f9-4d27-a3e3-9ad31db0f4ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.498581 Oct 03 14:51:20.268227 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2092/4276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:19 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:20.286195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:20.288245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:20.298221 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-416c0b65-be0a-484c-ae71-08d4f4c2289d tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a1468033-8f14-447b-a31e-d29247b8a89d" status: 202 len: 0 microversion: 2.1 time: 0.356192 Oct 03 14:51:20.298818 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2185/4277] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:19 2022] DELETE /compute/v2.1/os-security-groups/a1468033-8f14-447b-a31e-d29247b8a89d => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:20.300860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:20.304008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:20.304635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:20.305526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:20.309545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a6178c3-6050-4d87-bbe5-c5732abb1f4f tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb230a0fee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:20.310023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:20.310594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:20.587450 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a6178c3-6050-4d87-bbe5-c5732abb1f4f tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/8fdd2c71-5c29-4988-a586-58d59595aebb" status: 202 len: 0 microversion: 2.1 time: 0.283998 Oct 03 14:51:20.592769 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2186/4278] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:20 2022] DELETE /compute/v2.1/os-security-groups/8fdd2c71-5c29-4988-a586-58d59595aebb => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:20.599106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05169dcf-a3ea-46f4-aafa-6bd4804eedd9 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb22bbf1160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:20.809040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:20.824825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f6b8f1f-4fdc-422b-9e3c-ce53723d9d9e tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1504 microversion: 2.1 time: 0.555189 Oct 03 14:51:20.825804 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2093/4279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:20 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1504 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:20.852159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:20.855114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:20.870211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:20.873280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:20.876665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:20.877795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:20.878745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:20.879537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:21.366954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:21.377277 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d373a03-479b-41b2-96ef-d824bf91412c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1510 microversion: 2.1 time: 0.534830 Oct 03 14:51:21.397973 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2094/4280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:20 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:21.410672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d5c3a8f3-d388-4e3a-8118-76b0c84bb36a req-0ffeb228-69b9-4871-9e04-00a5d4398cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6a44a-0eef-4fef-a7c1-b2b493d86c61", "name": "network-vif-unplugged", "status": "completed", "tag": "5641f14c-b607-4db5-a316-ac609bb2a1df"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:21.430696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d5c3a8f3-d388-4e3a-8118-76b0c84bb36a req-0ffeb228-69b9-4871-9e04-00a5d4398cd9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:21.431181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d5c3a8f3-d388-4e3a-8118-76b0c84bb36a req-0ffeb228-69b9-4871-9e04-00a5d4398cd9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:21.431606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d5c3a8f3-d388-4e3a-8118-76b0c84bb36a req-0ffeb228-69b9-4871-9e04-00a5d4398cd9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:21.444677 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d5c3a8f3-d388-4e3a-8118-76b0c84bb36a req-0ffeb228-69b9-4871-9e04-00a5d4398cd9 service nova] Creating event network-vif-unplugged:5641f14c-b607-4db5-a316-ac609bb2a1df for instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 on n-h2-781139-2 Oct 03 14:51:21.450874 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d5c3a8f3-d388-4e3a-8118-76b0c84bb36a req-0ffeb228-69b9-4871-9e04-00a5d4398cd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051310 Oct 03 14:51:21.452086 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2095/4281] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:21.457779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:21.458954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:21.466855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:21.467667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:21.468366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:21.469438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:21.470079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:21.470689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:21.633795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:21.642907 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-040343ac-9ed6-49a3-aedf-7ef89d84f6e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.189348 Oct 03 14:51:21.645544 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2096/4282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:21 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:21.777977 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05169dcf-a3ea-46f4-aafa-6bd4804eedd9 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c03bb242-ca64-4e0d-a94b-78fda2e63e1a" status: 202 len: 0 microversion: 2.1 time: 1.182971 Oct 03 14:51:21.779085 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2187/4283] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:20 2022] DELETE /compute/v2.1/os-security-groups/c03bb242-ca64-4e0d-a94b-78fda2e63e1a => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:21.787966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1722b66-1e14-4d98-8c72-f4d2d00baa73 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] Calling method '.version_select at 0x7fb234b60b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:21.850060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:21.851143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:21.865624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:21.866206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:21.866664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:21.867465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:21.867885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:21.868306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:22.187372 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1722b66-1e14-4d98-8c72-f4d2d00baa73 tempest-SecurityGroupRulesTestJSON-913559376 tempest-SecurityGroupRulesTestJSON-913559376-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/87c0aef0-f045-4ef4-bb4f-6a372763214c" status: 202 len: 0 microversion: 2.1 time: 0.403375 Oct 03 14:51:22.188007 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2097/4284] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:51:21 2022] DELETE /compute/v2.1/os-security-groups/87c0aef0-f045-4ef4-bb4f-6a372763214c => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:51:22.196554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:22.197422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:22.209445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:22.209938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:22.217684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:22.219097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:22.219738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:22.220323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:22.318874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:51:22.344626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:22.371123 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9055153c-533e-4b6b-8ba3-979587345816 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 200 len: 1447 microversion: 2.1 time: 0.520770 Oct 03 14:51:22.375078 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2188/4285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:21 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 1447 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:22.404148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:22.404779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:22.434578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:22.438359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:22.440002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:22.446249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:22.447086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:22.447906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:22.459621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:22.633410 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34e794ad-8300-40ea-8d03-212423cfa645 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "DELETE /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 204 len: 0 microversion: 2.1 time: 0.440442 Oct 03 14:51:22.634961 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2098/4286] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:51:22 2022] DELETE /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:51:22.645834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:22.647046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:22.672108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:22.677017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:22.679072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:22.680276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:22.681449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:22.682790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:22.944515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:22.955189 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93e3fff3-44e5-4831-9200-0348ed2e61c4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.557797 Oct 03 14:51:22.960677 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2189/4287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:22 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:22.992223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:22.992774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:23.024282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:23.024776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:23.027184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:23.027974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:23.028444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:23.030546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:23.155069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:23.167122 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2add93e-cf95-44fe-a607-8401453d6a79 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1510 microversion: 2.1 time: 0.530415 Oct 03 14:51:23.170545 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2099/4288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:22 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1510 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:23.191322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:23.192842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:23.200589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:23.201427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:23.202031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:23.203014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:23.204449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:23.205118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:23.434392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:23.443186 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6435902e-5073-472a-b55c-5958eba46557 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1667 microversion: 2.1 time: 0.468500 Oct 03 14:51:23.447547 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2190/4289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:22 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1667 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:23.456998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:23.462173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:23.502674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:23.505171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:23.505774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:23.506763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:23.507233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:23.508357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:23.854504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:23.884575 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-41d112cc-cca1-4d9d-bdc9-a91f182b93f0 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.709150 Oct 03 14:51:23.885490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2100/4290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:23 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:24.176517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:24.219235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-595ed8a2-4bf5-4646-b038-4e130b7218d2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.767410 Oct 03 14:51:24.232242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2191/4291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:23 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:24.237092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:24.238081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:24.250256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:24.252564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:24.253630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:24.256054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:24.262267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:24.264423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:24.277185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d6f0d91d-0e6b-4836-96e9-10b48bb4a42a tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] Calling method '.version_select at 0x7fb234b60280>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:24.381788 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d6f0d91d-0e6b-4836-96e9-10b48bb4a42a tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.491669 Oct 03 14:51:24.382535 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2101/4292] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:51:23 2022] GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2/defaults => generated 371 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:24.399245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:24.399898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:24.461734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:24.465663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:24.466436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:24.468410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:24.470919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:24.472658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:24.817236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:24.845665 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d141783e-ec0d-4046-878b-4c69d463910f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1510 microversion: 2.1 time: 0.622738 Oct 03 14:51:24.848969 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2192/4293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:24 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1510 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:24.861422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5ec0728-7727-487f-8c18-f8ddbd196050 tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] Calling method '.version_select at 0x7fb230136ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:25.037374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:25.061879 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b07e4dca-da9f-485f-b08f-782072abbc5b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.676161 Oct 03 14:51:25.078415 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2102/4294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:24 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:25.096482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:25.097481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:25.117636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:25.118656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:25.119278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:25.121147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:25.121858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:25.122487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:25.244746 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5ec0728-7727-487f-8c18-f8ddbd196050 tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2" status: 200 len: 371 microversion: 2.1 time: 0.391418 Oct 03 14:51:25.247272 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2193/4295] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:51:24 2022] GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2 => generated 371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:25.269218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:25.270919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:25.281525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:25.290065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:25.290775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:25.292429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:25.293074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:25.293662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:25.566432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:25.581844 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bac9f900-b9e1-4090-b9a3-469bac64627e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1667 microversion: 2.1 time: 0.501550 Oct 03 14:51:25.584778 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2103/4296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:25 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1667 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:25.600581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:25.601788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:25.615594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:25.616098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:25.616556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:25.622350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:25.622895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:25.623354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:26.320187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:26.345830 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6cb3a6d-b283-42f0-abd4-c68439288739 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.759377 Oct 03 14:51:26.368736 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2104/4297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:25 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:26.380144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d4dd0b8-63b9-41e9-a072-f43df014f82d tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] Calling method '.version_select at 0x7fb2301485e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:26.470518 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d4dd0b8-63b9-41e9-a072-f43df014f82d tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2/defaults" status: 200 len: 371 microversion: 2.1 time: 0.099497 Oct 03 14:51:26.471483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2105/4298] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 14:51:26 2022] GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2/defaults => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:26.485652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:26.489898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:26.490917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:26.499451 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31b57a5b-0992-436b-9952-4c14e4e119d1 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 1.250547 Oct 03 14:51:26.515822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:26.515822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:26.515822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:26.515822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:26.515822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:26.515822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:26.520847 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2194/4299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:25 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:26.533774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90418e71-315b-4bd3-86e5-a61ac57efddd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:26.543543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:26.547072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90418e71-315b-4bd3-86e5-a61ac57efddd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:26.547692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90418e71-315b-4bd3-86e5-a61ac57efddd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:26.549336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90418e71-315b-4bd3-86e5-a61ac57efddd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:26.601288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90418e71-315b-4bd3-86e5-a61ac57efddd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:51:26.606588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:26.687243 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90418e71-315b-4bd3-86e5-a61ac57efddd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.162744 Oct 03 14:51:26.687862 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2195/4300] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:51:26 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:26.699682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88911cb0-b967-479c-b63f-e168790f9dd6 tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] Calling method '.version_select at 0x7fb22bf13160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:26.917327 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88911cb0-b967-479c-b63f-e168790f9dd6 tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2" status: 200 len: 371 microversion: 2.1 time: 0.228007 Oct 03 14:51:26.919186 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2196/4301] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:51:26 2022] GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2 => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:26.939696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:26.940539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:26.975019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:26.975779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:26.976289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:26.977110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:26.977768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:26.978376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:27.359544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:27.368087 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1cbf72ee-bb1f-4225-8390-6d69500edc5b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1516 microversion: 2.1 time: 0.884728 Oct 03 14:51:27.368704 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2106/4302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:26 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1516 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:27.377039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:27.377662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:27.423008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:27.423804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:27.425894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:27.426807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:27.427814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:27.436254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:27.770462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:27.789049 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0a23f3c-8f84-4537-a4f3-da6d5670b99e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1667 microversion: 2.1 time: 0.859377 Oct 03 14:51:27.795773 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2197/4303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:26 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1667 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:27.808971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcdaee79-8baf-4e48-9ddd-953d5fbb6e17 tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] Calling method '.version_select at 0x7fb22bc02ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:27.909056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:27.930121 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1037107d-7170-4cf8-83f6-89231cc28bc6 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.560312 Oct 03 14:51:27.940181 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2107/4304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:27 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:27.962525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:27.965781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:27.981936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:27.986904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:27.987616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:27.988636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:27.989375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:27.990035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:28.017393 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcdaee79-8baf-4e48-9ddd-953d5fbb6e17 tempest-QuotasTestJSON-339269195 tempest-QuotasTestJSON-339269195-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2?user_id=fa5355bbb9ef4deeb953d0666f816bcd" status: 200 len: 371 microversion: 2.1 time: 0.217221 Oct 03 14:51:28.019263 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2198/4305] 10.222.0.20 () {58 vars in 1323 bytes} [Mon Oct 3 14:51:27 2022] GET /compute/v2.1/os-quota-sets/eaa5522dd65342adadf5abc11a994bd2?user_id=fa5355bbb9ef4deeb953d0666f816bcd => generated 371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:28.582576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:28.591597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1de34dfa-cf41-4e88-9304-b2dbf6328b15 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.640800 Oct 03 14:51:28.595819 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2108/4306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:27 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:28.817323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:28.817975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:28.831933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:28.832441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:28.832765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:28.833697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:28.847461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:28.854927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:28.967595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:28.968665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:28.991106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:28.993386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:28.995553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:28.996800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:28.998620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:28.999403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:29.214079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:29.223190 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-852867cd-f5c0-43e0-8e66-7d81f594493d tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1600 microversion: 2.1 time: 0.410626 Oct 03 14:51:29.237779 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2199/4307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:28 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1600 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:29.621845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:29.622434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:29.637111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:29.638101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:29.640079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:29.642177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:29.646860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:29.649617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:29.705915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:29.719773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b61b872-1e03-44af-861c-feabd3c3a4fc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.756759 Oct 03 14:51:29.720916 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2109/4308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:28 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:30.269408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:30.271173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:30.303335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:30.306058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:30.306604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:30.309081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:30.311855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:30.312400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:30.315666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:30.325913 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-51081eb4-f1be-4313-a051-fc66284af642 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.709811 Oct 03 14:51:30.348041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2200/4309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:29 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:30.406033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4e0227d-5d30-45a8-aba3-fc8378bc28ef tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'create', calling method: .version_select at 0x7fb22be1f8b0>, body: {"keypair": {"name": "tempest-keypair-1507661167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx+K82Czscu1DbBXTsish/Bysi5z2GkFhJHegT7cHmc6kuXx5Bl1tYoXm6BlUtIWx2jWVKbGhyaWteMWmTBrlJzZQ4UKkpTLMlZu5e/XVgDAhDNVWhfeyGnpsPXhu69ew=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:30.443222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e4e0227d-5d30-45a8-aba3-fc8378bc28ef tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for project 3617808e389f442db9240aab3538e9a3. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:51:30.451475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e4e0227d-5d30-45a8-aba3-fc8378bc28ef tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for user ba57cee91b1a42b6b3c8c42a5a40eba4 and project 3617808e389f442db9240aab3538e9a3. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:51:30.544465 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4e0227d-5d30-45a8-aba3-fc8378bc28ef tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143291 Oct 03 14:51:30.547192 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2201/4310] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:51:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:30.552761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dc1ffab1-2d77-4375-9445-7878f22d3eaf req-7df9a98f-a5fa-448b-a4aa-dc82d97d29e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269c05c3-7f77-492e-a1b5-e2e9df32d7c7", "name": "network-vif-deleted", "tag": "7f22fb92-81a0-452d-bbd8-f2c6f89862c5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:30.569362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc1ffab1-2d77-4375-9445-7878f22d3eaf req-7df9a98f-a5fa-448b-a4aa-dc82d97d29e1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:30.569965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc1ffab1-2d77-4375-9445-7878f22d3eaf req-7df9a98f-a5fa-448b-a4aa-dc82d97d29e1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:30.570621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc1ffab1-2d77-4375-9445-7878f22d3eaf req-7df9a98f-a5fa-448b-a4aa-dc82d97d29e1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:30.603711 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dc1ffab1-2d77-4375-9445-7878f22d3eaf req-7df9a98f-a5fa-448b-a4aa-dc82d97d29e1 service nova] Creating event network-vif-deleted:7f22fb92-81a0-452d-bbd8-f2c6f89862c5 for instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 on n-h2-781139-2 Oct 03 14:51:30.618882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:30.622709 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dc1ffab1-2d77-4375-9445-7878f22d3eaf req-7df9a98f-a5fa-448b-a4aa-dc82d97d29e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072816 Oct 03 14:51:30.625224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2202/4311] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:30.639180 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-839f6200-47b1-4884-b034-5f0fd5e5ee4a tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1600 microversion: 2.1 time: 0.376716 Oct 03 14:51:30.647491 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2110/4312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:30 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1600 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:30.745753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:30.746655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:30.768893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:30.769590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:30.770178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:30.772822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:30.773630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:30.775481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:31.358918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:31.359675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:31.364363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:31.383293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:31.383841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:31.384290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:31.385046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:31.385555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:31.385985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:31.545868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:31.559235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1bf7c64c-31df-44d4-8246-a2031be551e4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.815356 Oct 03 14:51:31.565294 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2203/4313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:30 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:31.665074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:31.665701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:31.672575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:31.687186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:31.691467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:31.694759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:31.696254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:31.697038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:31.832308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:31.838098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:31.838679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:31.840732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lazy-loading 'fault' on Instance uuid 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:51:32.039295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:32.053600 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.696799 Oct 03 14:51:32.072413 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2111/4314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:31 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:32.098309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:32.099798 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002181 Oct 03 14:51:32.100457 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2112/4315] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 3 14:51:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 03 14:51:32.109749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:32.112320 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002674 Oct 03 14:51:32.113004 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2113/4316] 10.222.0.20 () {54 vars in 1035 bytes} [Mon Oct 3 14:51:32 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 03 14:51:32.122712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e346fcbb9e040448644511b529ad4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274c609aea3e492aa92942d359fd4d8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:32.123531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:32.127555 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.005804 Oct 03 14:51:32.130365 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2114/4317] 10.222.0.20 () {54 vars in 1041 bytes} [Mon Oct 3 14:51:32 2022] GET /compute/v2.1/ => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:32.137871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:32.139142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d2a8568-c67c-4c98-b8e8-42b9a8f0eb36 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001621 Oct 03 14:51:32.139817 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2115/4318] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 3 14:51:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 03 14:51:32.146064 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ad65c37-1769-4454-86a2-b6ec4160bef5 tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 200 len: 1316 microversion: 2.1 time: 0.484778 Oct 03 14:51:32.179163 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2204/4319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:31 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:32.584784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:32.587054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:32.603045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:32.603857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:32.604549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:32.606214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:32.606876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:32.608424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:33.037637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:33.055153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5bed4006-6a12-404e-90df-444c3638d86b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.476238 Oct 03 14:51:33.057506 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2116/4320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:32 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:33.081177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:33.081845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:33.098971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:33.101719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:33.102504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:33.104218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:33.106075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:33.106703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:33.186635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:33.187627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] [instance: 269c05c3-7f77-492e-a1b5-e2e9df32d7c7] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:33.196817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:33.200057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:33.200682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:33.203927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:33.204892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:33.205505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:33.251962 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] HTTP exception thrown: Instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 could not be found. Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Request method failure captured: Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 HTTP/1.1 Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvap9jK2ZP2kZaYgYAq7rEo3d5a87dDXcBK9RcEol_H17rRhcMZmsS51xhYnMKt3liNoCaRs8YrcCteFty6iwUKP6VHsJKn7BZocK-4dN-rLnTRruFG75D3Y2a5Yv-kSnK7Ab1Ilp8P7xiBCGZx1Na9vSs9T3ci7cMFoskASznbvW2U Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 274c609aea3e492aa92942d359fd4d8a Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersTestFqdnHostnames-2033664004 Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/274c609aea3e492aa92942d359fd4d8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_274c609aea3e492aa92942d359fd4d8a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/274c609aea3e492aa92942d359fd4d8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/274c609aea3e492aa92942d359fd4d8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersTestFqdnHostnames-2033664004 Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 274c609aea3e492aa92942d359fd4d8a Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-2033664004 Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersTestFqdnHostnames-2033664004-project Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2e346fcbb9e040448644511b529ad4dc Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersTestFqdnHostnames-2033664004-project Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 could not be found. Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '269c05c3-7f77-492e-a1b5-e2e9df32d7c7'} Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 could not be found. Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 could not be found. Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:33.260990 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 could not be found. Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Returning 404 to user: Instance 269c05c3-7f77-492e-a1b5-e2e9df32d7c7 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e11c0c4b-3a8c-4b11-bb0c-cd25abf3ec3e tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7" status: 404 len: 111 microversion: 2.1 time: 0.080224 Oct 03 14:51:33.265027 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2117/4321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:33 2022] GET /compute/v2.1/servers/269c05c3-7f77-492e-a1b5-e2e9df32d7c7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:51:33.293405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1a591c58-db39-463b-9086-2c980d20dd7f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] Calling method '.version_select at 0x7fb230d4b940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:33.363621 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1a591c58-db39-463b-9086-2c980d20dd7f tempest-ServersTestFqdnHostnames-2033664004 tempest-ServersTestFqdnHostnames-2033664004-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732639320" status: 202 len: 0 microversion: 2.1 time: 0.091182 Oct 03 14:51:33.364234 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2118/4322] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:51:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732639320 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:33.788362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:33.801200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e88b9677-cd10-4fd9-83c7-1486c836c00a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.725566 Oct 03 14:51:33.821584 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2205/4323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:33 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:34.080620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:34.083233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:34.116085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:34.120553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:34.121176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:34.131959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:34.137138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:34.138166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:34.835271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:34.836546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:34.862419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:34.866035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:34.867140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:34.867917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:34.868392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:34.877474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:35.530030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:35.545654 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2da9d3a7-bd04-4cf6-b004-330c808909ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 1.467496 Oct 03 14:51:35.548132 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2119/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:34 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:35.828534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:35.830644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:35.831349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:35.832078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:35.833305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:35.834019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:35.834652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:35.893045 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e9aeaf0-429e-464d-86a7-e4c884286684 tempest-AZV2TestJSON-572621638 tempest-AZV2TestJSON-572621638-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.343169 Oct 03 14:51:35.893846 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2120/4325] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 3 14:51:35 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:51:36.019604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:36.043667 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4970d2b-59ac-42ff-b099-256bd1e29333 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 1.213562 Oct 03 14:51:36.045607 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2206/4326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:34 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:36.572890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:36.573625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:36.596635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:36.598724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:36.600320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:36.606683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:36.607510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:36.608389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:36.720272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-31250928", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28327e4f-adf0-4363-ba93-d85cf5c8956d"}], "security_groups": [{"name": "tempest-securitygroup--18346500"}], "key_name": "tempest-keypair-1507661167", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:36.923986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] validate_networks() for [('28327e4f-adf0-4363-ba93-d85cf5c8956d', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:51:37.231003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:37.243090 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-31960c49-ed07-4127-9e61-7023b4ae69cd tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1678 microversion: 2.1 time: 0.674042 Oct 03 14:51:37.246895 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2121/4327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:36 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1678 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:37.263177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:37.267205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:37.286291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:37.288405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:37.290915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:37.292665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:37.293520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:37.294683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:37.923006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:37.933605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-15b01579-e4f3-4096-9170-a15f2bfde26f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1526 microversion: 2.1 time: 0.684483 Oct 03 14:51:37.934867 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2122/4328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:37 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1526 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:38.275776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:38.277012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:38.287173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:38.287739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:38.288461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:38.289518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:38.290259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:38.291131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:38.298565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:38.434112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:51:38.435161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:51:38.437269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:51:38.437946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:51:38.438837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:51:38.459875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:38.470877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:38.472348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:38.473827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:38.474874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:38.475963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:38.515499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for project 3617808e389f442db9240aab3538e9a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:51:38.540196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Getting quotas for user ba57cee91b1a42b6b3c8c42a5a40eba4 and project 3617808e389f442db9240aab3538e9a3. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:51:38.596464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:51:38.599631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:51:38.672530 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4cc166f9-f1f0-4a1a-946b-3e89e0b70796 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.957268 Oct 03 14:51:38.673900 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2207/4329] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:51:36 2022] POST /compute/v2.1/servers => generated 407 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:51:38.706808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27ae5c54-c944-4e8e-a011-02cfecd9ce83 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:38.707481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27ae5c54-c944-4e8e-a011-02cfecd9ce83 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:38.845068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27ae5c54-c944-4e8e-a011-02cfecd9ce83 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:38.853748 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27ae5c54-c944-4e8e-a011-02cfecd9ce83 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1244 microversion: 2.1 time: 0.162074 Oct 03 14:51:38.858154 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2208/4330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:38 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1244 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:38.860787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:38.873997 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f38f9083-4588-4575-8739-8c4bcba95ee4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1655 microversion: 2.1 time: 0.603493 Oct 03 14:51:38.878940 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2123/4331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:38 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1655 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:38.913091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05d2d2b4-ca33-4c1e-aa15-a2d99073b6c1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:38.923266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05d2d2b4-ca33-4c1e-aa15-a2d99073b6c1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:38.924335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05d2d2b4-ca33-4c1e-aa15-a2d99073b6c1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:38.925602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05d2d2b4-ca33-4c1e-aa15-a2d99073b6c1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:38.959169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:38.959798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:38.970451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:38.973558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:38.979845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:38.982624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:38.985951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:38.988269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:38.994703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05d2d2b4-ca33-4c1e-aa15-a2d99073b6c1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Going to try to start instance {{(pid=128869) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 14:51:39.118187 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05d2d2b4-ca33-4c1e-aa15-a2d99073b6c1 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.214025 Oct 03 14:51:39.122687 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2209/4332] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:51:38 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:39.131025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:39.132007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:39.141576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:39.143184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:39.144113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:39.145381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:39.146154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:39.146857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:39.494183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:39.550777 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-277394f0-b8e5-4c2c-ba8f-f6581c51c98a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1664 microversion: 2.1 time: 0.426176 Oct 03 14:51:39.552018 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2210/4333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:39 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1664 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:39.628272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2947f832-ae70-4a5e-be9f-bc46abc0d913 req-cb067e88-efc4-4e7e-8c3c-effc40342dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abef3-5a4d-48c8-89e6-63862eb6bf37", "name": "network-vif-unplugged", "status": "completed", "tag": "7abe5823-b304-4057-b497-e2f4b020ff05"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:39.650492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2947f832-ae70-4a5e-be9f-bc46abc0d913 req-cb067e88-efc4-4e7e-8c3c-effc40342dc4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:39.651237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2947f832-ae70-4a5e-be9f-bc46abc0d913 req-cb067e88-efc4-4e7e-8c3c-effc40342dc4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:39.651893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2947f832-ae70-4a5e-be9f-bc46abc0d913 req-cb067e88-efc4-4e7e-8c3c-effc40342dc4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:39.705972 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2947f832-ae70-4a5e-be9f-bc46abc0d913 req-cb067e88-efc4-4e7e-8c3c-effc40342dc4 service nova] Creating event network-vif-unplugged:7abe5823-b304-4057-b497-e2f4b020ff05 for instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 on n-h1-781139-2 Oct 03 14:51:39.724685 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2947f832-ae70-4a5e-be9f-bc46abc0d913 req-cb067e88-efc4-4e7e-8c3c-effc40342dc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100518 Oct 03 14:51:39.725636 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2211/4334] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:51:39.882037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:39.887407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:39.888292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:39.902200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:39.903497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:39.904809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:39.909357 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dae5b4a6-4624-476e-bb84-a001214e9073 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1508 microversion: 2.1 time: 0.949199 Oct 03 14:51:39.909844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:39.910933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:39.911390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:39.912517 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2124/4335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:38 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1508 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:40.084531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:40.094673 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d57e860-a49e-4116-9b7d-8c054f2877d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1248 microversion: 2.1 time: 0.213712 Oct 03 14:51:40.095264 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2212/4336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:39 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1248 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:40.579468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:40.581726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:40.591116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:40.592246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:40.593136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:40.594273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:40.595049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:40.595829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:40.937799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:40.939089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:40.946752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:40.947417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:40.948021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:40.948868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:40.949499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:40.950063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:41.628805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:41.641209 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79fa1dd6-f70b-440e-b731-6815ea8b98e8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1508 microversion: 2.1 time: 0.708256 Oct 03 14:51:41.643945 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2213/4337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:40 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1508 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:41.655149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:41.658099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:41.672060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:41.672674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:41.673257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:41.675131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:41.678695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:41.679065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:41.859474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:41.868875 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a68ef0aa-1097-436c-84c3-540e6edfd4a3 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1664 microversion: 2.1 time: 1.293695 Oct 03 14:51:41.885449 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2125/4338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:40 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1664 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:42.282186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:42.294811 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c61dc6f7-0f3c-411f-94dc-870c01832192 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1296 microversion: 2.1 time: 0.643190 Oct 03 14:51:42.296803 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2214/4339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:41 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1296 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:42.679680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:42.680564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:42.695339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:42.698824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:42.700847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:42.703193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:42.704560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:42.712874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:42.898687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:42.899314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:42.908407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:42.912261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:42.912955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:42.913859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:42.914478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:42.915073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:43.337429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:43.347024 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-209a21b4-73f4-4427-81c7-1ec4ab2a6b7a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1664 microversion: 2.1 time: 0.452190 Oct 03 14:51:43.351950 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2215/4340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:42 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1664 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:43.363281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:43.372386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:43.385389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:43.385892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:43.386321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:43.389986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:43.393756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:43.394416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:43.428046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:43.473123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:43.492136 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4cf8fead-2ffb-46e1-9e65-e5578f278fa8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1451 microversion: 2.1 time: 0.825031 Oct 03 14:51:43.505538 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2126/4341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:42 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1451 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:43.519290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:43.519909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:43.530554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:43.531044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:43.531489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:43.532195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:43.532647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:43.533103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:43.624281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:43.634099 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18ae7801-49cf-4fd5-9a1a-ec3243037b8e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1302 microversion: 2.1 time: 0.280751 Oct 03 14:51:43.657079 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2216/4342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:43 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1302 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:44.371842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:44.373195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:44.393671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:44.394597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:44.395324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:44.396240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:44.396847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:44.397486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:44.484266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:44.500040 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3ab5013-8f03-4f71-a71b-2194f8137fdb tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1451 microversion: 2.1 time: 0.984895 Oct 03 14:51:44.504703 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2127/4343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:43 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1451 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:44.629417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:44.630014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:44.645106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:44.645953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:44.646931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:44.648358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:44.649984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:44.650726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:44.711677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lazy-loading 'flavor' on Instance uuid 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:51:44.749284 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Cannot 'shelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state shelved_offloaded Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action HTTP/1.1 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 14 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: {"shelve": {}} Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: exception: Cannot 'shelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state shelved_offloaded Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'shelve': {}}} Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:51:44.751826 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state shelved_offloaded Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state shelved_offloaded Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 409 to user: Cannot 'shelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state shelved_offloaded {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:51:44.756325 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1be22c06-e5e3-41f2-86c0-89055b562198 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 409 len: 155 microversion: 2.1 time: 0.132769 Oct 03 14:51:44.763036 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2128/4344] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:51:44 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 155 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 14:51:44.777410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:44.779031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:44.816380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:44.816888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:44.828033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:44.837347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:44.838652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:44.841226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:45.003951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:45.031321 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20ed9480-cd3b-41fd-aebf-d4e947bd86ea tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.664543 Oct 03 14:51:45.031920 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2217/4345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:44 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:45.052861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:45.053478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:45.071384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:45.074913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:45.075592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:45.076905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:45.077671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:45.078356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:45.144902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:45.159808 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-adec0af9-1ddb-49c3-87b5-88c7baeae23d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1302 microversion: 2.1 time: 0.400670 Oct 03 14:51:45.162090 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2129/4346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:44 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1302 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:45.173802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:45.174887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:45.184857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128869) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 14:51:45.200622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:45.202142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:45.203733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:45.204509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:45.205010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:45.205448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:45.411823 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a44726c-73a1-43a6-88c7-d530d50a31e2 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 202 len: 0 microversion: 2.1 time: 0.359090 Oct 03 14:51:45.416760 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2218/4347] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:51:45 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:45.438889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:45.439521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:45.490816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:45.498213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:45.498947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:45.499712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:45.500199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:45.507934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:45.857325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:46.151647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:46.164226 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7ba8e71-ccf2-4377-9625-29ba671ad289 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1459 microversion: 2.1 time: 0.742860 Oct 03 14:51:46.165585 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2219/4348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:45 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1459 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:46.191749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:46.193644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:46.207269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:46.208219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:46.208883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:46.209890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:46.210565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:46.211219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:46.373602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:46.390416 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a6ec2dd-babf-4887-9386-e1d415a60080 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1302 microversion: 2.1 time: 0.202504 Oct 03 14:51:46.394592 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2220/4349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:46 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:46.781468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:46.797887 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1881111-ec57-4ca2-a500-91f9d8fcd528 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 1.633470 Oct 03 14:51:46.816306 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2130/4350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:45 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:46.832983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:46.834262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:46.841699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:46.842566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:46.843386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:46.844333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:46.845026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:46.845682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:47.193396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:47.194762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:47.221374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:47.225500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:47.226114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:47.228079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:47.231802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:47.232339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:47.294164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:47.346774 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab0951af-d081-4d4a-bd0b-dc312e1e62fb tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.521628 Oct 03 14:51:47.353309 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2221/4351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:46 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:47.391723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:47.394119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:47.419573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:47.425611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:47.426300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:47.438943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:47.444239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:47.444684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:48.256292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:48.265358 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a39cb9be-ae44-4295-87eb-68893e501b9e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1459 microversion: 2.1 time: 1.076152 Oct 03 14:51:48.266506 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2131/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:47 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1459 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:48.293088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:48.293485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:48.296277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:48.309784 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-645547fe-1f00-433b-addd-24a8a9a31759 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.931951 Oct 03 14:51:48.311613 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2222/4353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:47 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:48.328785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:48.334851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:48.335735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:48.336833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:48.340883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:48.341586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:48.344609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:48.345372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:48.352741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:48.353902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:48.354510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:48.355540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:48.356152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:48.356733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:48.495468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:48.852704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:49.028335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:49.037185 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f8301485-4ccc-4f84-a8fa-ad6d6eadcb85 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 0.748206 Oct 03 14:51:49.038055 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2132/4354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:48 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:49.292953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:49.293788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:49.307564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:49.308167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:49.308720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:49.309558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:49.310108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:49.312058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:49.685938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:49.704025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de83e0eb-919a-4c21-b3dc-84f5bab671ee tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 1.365911 Oct 03 14:51:49.704691 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2223/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:48 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:49.729102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:49.737494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:49.751508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:49.755734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:49.756319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:49.757381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:49.759057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:49.761562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:49.764582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:49.846773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lazy-loading 'flavor' on Instance uuid 931c2fbe-6c74-4e2a-9d69-996fcb544f90 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:51:49.993171 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7dd8726-8480-4c0d-8af3-e1546b80e83c tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.269428 Oct 03 14:51:49.994224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2224/4356] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:51:49 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:50.109501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7b62c86-8656-431c-870b-d4fc0946336c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'create', calling method: .version_select at 0x7fb230a69670>, body: {"keypair": {"name": "tempest-keypair-1153873761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoB7hy+adiRnGM6/u6a0KtCIsWmepYyTmxxhfek0OWO+gpaItVVsgidzIs0lJBoqyZF7+Lch1JlPxrLjYk40+V74XfBRiPuJDwifCHGvwxWrWTGfT20tSo2TXPmmtAu5g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:50.140823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e7b62c86-8656-431c-870b-d4fc0946336c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:51:50.152875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e7b62c86-8656-431c-870b-d4fc0946336c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for user cb80c02a281e4132aa50bb4de496525c and project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:51:50.216779 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7b62c86-8656-431c-870b-d4fc0946336c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.220933 Oct 03 14:51:50.217477 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2225/4357] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:51:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 223 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:51:50.228544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:50.229493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:50.238632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:50.241558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:50.242204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:50.250183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:50.251301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:50.251893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:50.861929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:50.870909 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c946a4b7-3f80-48a9-b886-c8dce9ee31ef tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1676 microversion: 2.1 time: 0.652259 Oct 03 14:51:50.886855 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2226/4358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:50 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1676 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:50.892206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:50.892679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:50.893203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:50.908889 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-81b47924-6a79-4e84-b94d-e22e4bc77378 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 1.619642 Oct 03 14:51:50.925037 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2133/4359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:49 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:50.925218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:50.925218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:50.925218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:50.925218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:50.925218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:50.925577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:51.368744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f56221d8-98ac-4848-8dcb-af48464ac3f1 req-724fc173-96b6-4794-b48b-795300243b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5abef3-5a4d-48c8-89e6-63862eb6bf37", "tag": "7abe5823-b304-4057-b497-e2f4b020ff05"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:51.392345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f56221d8-98ac-4848-8dcb-af48464ac3f1 req-724fc173-96b6-4794-b48b-795300243b1b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:51.392835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f56221d8-98ac-4848-8dcb-af48464ac3f1 req-724fc173-96b6-4794-b48b-795300243b1b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:51.396586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f56221d8-98ac-4848-8dcb-af48464ac3f1 req-724fc173-96b6-4794-b48b-795300243b1b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:51.429326 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f56221d8-98ac-4848-8dcb-af48464ac3f1 req-724fc173-96b6-4794-b48b-795300243b1b service nova] Creating event network-changed:7abe5823-b304-4057-b497-e2f4b020ff05 for instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 on n-h2-781139-2 Oct 03 14:51:51.440352 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f56221d8-98ac-4848-8dcb-af48464ac3f1 req-724fc173-96b6-4794-b48b-795300243b1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075291 Oct 03 14:51:51.441953 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2134/4360] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:51.523098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:51.531605 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c67fc50f-f473-421f-a956-cf35fe595c9e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 0.643488 Oct 03 14:51:51.532205 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2227/4361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:50 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:51.897476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:51.898201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:51.912543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:51.913080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:51.913531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:51.914270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:51.914724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:51.920570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:51.936201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:51.937476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:51.950079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:51.952735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:51.954735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:51.959367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:51.960105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:51.960706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:52.352771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:52.366837 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1217e408-2653-4ab2-adb2-bbb37114e835 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.434625 Oct 03 14:51:52.367594 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2228/4362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:51 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:52.386747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-13d1dee2-2929-4f5e-a4a9-e4ed1bf6376a req-9fd8ef92-073a-4224-8310-7cb48099172c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34f6896-67b3-4663-a15e-350a205c2a59", "tag": "61f60a49-c60f-4431-b990-cacae19b267d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:52.402442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-13d1dee2-2929-4f5e-a4a9-e4ed1bf6376a req-9fd8ef92-073a-4224-8310-7cb48099172c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:52.406578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-13d1dee2-2929-4f5e-a4a9-e4ed1bf6376a req-9fd8ef92-073a-4224-8310-7cb48099172c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:52.409612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-13d1dee2-2929-4f5e-a4a9-e4ed1bf6376a req-9fd8ef92-073a-4224-8310-7cb48099172c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:52.434090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-13d1dee2-2929-4f5e-a4a9-e4ed1bf6376a req-9fd8ef92-073a-4224-8310-7cb48099172c service nova] Creating event network-changed:61f60a49-c60f-4431-b990-cacae19b267d for instance c34f6896-67b3-4663-a15e-350a205c2a59 on n-h1-781139-2 Oct 03 14:51:52.450049 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-13d1dee2-2929-4f5e-a4a9-e4ed1bf6376a req-9fd8ef92-073a-4224-8310-7cb48099172c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071360 Oct 03 14:51:52.454636 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2229/4363] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:51:52.556034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:52.556905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:52.578143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:52.578771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:52.579084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:52.585783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:52.586335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:52.586821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:52.758097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:52.772717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-77d207b0-26b8-4daa-9b5b-24a8be16b882 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1659 microversion: 2.1 time: 0.880779 Oct 03 14:51:52.786102 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2135/4364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:51 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1659 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:52.810786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:52.812846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:52.831666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:52.832417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:52.833037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:52.834797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:52.837168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:52.838600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:52.979501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4d767dfc-ad22-477d-89d0-a07c7e551808 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action" status: 202 len: 0 microversion: 2.1 time: 0.181413 Oct 03 14:51:52.981026 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2136/4365] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:51:52 2022] POST /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:51:52.996373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:52.998163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:53.019430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:53.020170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:53.022626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:53.024386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:53.024861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:53.036817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:54.767005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:54.792203 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e3b99bd-0510-4734-a08e-9ddaa0a46c69 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 2.240795 Oct 03 14:51:54.793386 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2230/4366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:52 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:54.800690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:54.811351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:54.844977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:54.846202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:54.847114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:54.851862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:54.856905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:54.857797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:54.907106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:54.922389 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52a26487-ded2-4039-af8d-2a9b127f54f2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1665 microversion: 2.1 time: 1.935497 Oct 03 14:51:54.943163 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2137/4367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:52 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1665 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:55.698547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:55.704385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:55.725316 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-860f66fa-81f1-408f-9586-8a35c8c9f399 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.930568 Oct 03 14:51:55.734115 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2231/4368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:54 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:55.828076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:55.829716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:55.856095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:55.856612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:55.857130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:55.858355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:55.858965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:55.859581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:55.948848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:55.949656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:55.976824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:55.979326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:55.979989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:55.993537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:55.995913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:55.996597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:56.692079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:56.700661 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b6bcb9f-df58-4202-b8bb-cdeae1f8beb4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 0.883188 Oct 03 14:51:56.701985 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2138/4369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:55 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:56.766178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:56.767763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:56.775692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:56.776373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:56.777013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:56.778130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:56.778787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:56.779602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:56.852295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:51:57.465341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:57.480172 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-797cb075-23e8-4083-967e-b0dece862fc0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1665 microversion: 2.1 time: 1.538012 Oct 03 14:51:57.484691 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2232/4370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:55 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1665 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:51:57.725680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:57.727667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:57.746857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:57.747361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:57.747801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:57.748944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:57.749393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:57.749830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:58.233836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:58.256798 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7903ef7d-3874-47bf-b2ca-76df1cca32c3 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 1.495711 Oct 03 14:51:58.259980 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2139/4371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:56 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:58.279267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1700569449", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b94ff4e8-3464-467f-854f-9f26bf9c658a"}], "security_groups": [{"name": "tempest-securitygroup--678787487"}], "key_name": "tempest-keypair-1153873761", "user_data": "}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:51:58.300759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:58.309649 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b3078e7-8240-45a2-a794-082505e77723 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 0.589229 Oct 03 14:51:58.310261 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2233/4372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:57 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:58.513151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:58.514805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:58.528839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:58.530571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:58.532887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:58.535112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:58.537222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:58.538446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:58.946874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:58.967361 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf925715-ea04-4aa5-b085-ea24e89581ed tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1665 microversion: 2.1 time: 0.457715 Oct 03 14:51:58.980953 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2234/4373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:58 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1665 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:59.297690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:59.300762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:59.330465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:59.331218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:59.332891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:59.336254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:59.336986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:59.339147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:59.895151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:51:59.903495 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee0688f8-4bd4-43e5-a43a-c6256eb552df tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.620380 Oct 03 14:51:59.904324 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2235/4374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:59 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:51:59.913125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:51:59.913749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:51:59.936321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:59.939397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:59.939665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:51:59.940470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:51:59.940961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:51:59.941520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:00.062335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] validate_networks() for [('b94ff4e8-3464-467f-854f-9f26bf9c658a', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:00.182572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:00.186256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:00.200169 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58020fe4-c393-40fb-b038-53be9dd2f010 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 0.292354 Oct 03 14:52:00.203014 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2236/4375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:51:59 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:00.241248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:00.243023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:00.260002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:00.268519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:00.269228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:00.270156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:00.271503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:00.272112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:00.703343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:00.713086 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36223757-3f5f-4bbf-9a73-199128dbd9cc tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.508255 Oct 03 14:52:00.717733 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2237/4376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:00 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:00.745632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:00.750694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:00.776869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:00.783959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:00.784447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:00.791581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:00.792131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:00.792588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:01.531172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:01.546394 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92d125b4-65e1-46e2-8ae9-d03732c169f7 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1668 microversion: 2.1 time: 0.807253 Oct 03 14:52:01.575336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2238/4377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:00 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1668 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:01.614936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:01.614936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:01.628281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:01.629186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:01.629991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:01.631042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:01.631556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:01.631996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:02.010748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:02.025595 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71376958-2eb8-443f-9c8c-80fcb8b41037 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.441312 Oct 03 14:52:02.026245 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2239/4378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:01 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:02.304129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:02.309773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1720043906", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c63b6dcd-ca3a-4858-9a9a-aa9b536a4aae"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:02.450535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] validate_networks() for [('c63b6dcd-ca3a-4858-9a9a-aa9b536a4aae', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:03.101661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:03.102086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:03.102607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:03.103385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:03.103959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:03.142834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.143570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.144029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.150774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.151752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.152375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.199559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:03.217870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for user cb80c02a281e4132aa50bb4de496525c and project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:03.258209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:03.267701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:03.273476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:03.274012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:03.274586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:03.275102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:03.275619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:03.292537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.304998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.305571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.311899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.312899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.313935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.336500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Getting quotas for project d4f161773c114bf2a7472b6136be58f0. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:03.346039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Getting quotas for user 97d4ddc0886040d98942495773b81f57 and project d4f161773c114bf2a7472b6136be58f0. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:03.372418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:03.377999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:03.418050 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58f4f6e3-047d-4f4a-833c-0a0bfb61743c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.153325 Oct 03 14:52:03.422066 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2140/4379] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:51:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 5162 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:52:03.451310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:03.455057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:03.485938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.486729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.487339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.489037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.490200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.490792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.519430 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d73aa3ee-6762-4788-921b-038cd860597a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469235 Oct 03 14:52:03.520210 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2240/4380] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:03.542324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:03.547212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:03.569641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.573469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.573920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.574674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:03.575139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:03.575572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:03.669730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:52:03.695899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Working on deleting snapshot 0e78316b-bf11-4147-956a-185e6a0dea5f from shelved instance... Oct 03 14:52:04.597251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:04.616972 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ab124aa3-e232-4100-b35e-886684489138 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 1.183449 Oct 03 14:52:04.617870 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2141/4381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:03 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:04.765248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1798580706", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fd28a296-d4d0-487d-b766-c66e0eb4645b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:05.267692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] validate_networks() for [('fd28a296-d4d0-487d-b766-c66e0eb4645b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:05.279893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Doing local delete in cell 54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=128869) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 03 14:52:05.280807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:05.285693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:05.287508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:05.295335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 03 14:52:05.301268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] deallocate_for_instance() {{(pid=128869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 03 14:52:06.319537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:06.321532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:06.322542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:06.323356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:06.323988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:06.342008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:06.342860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:06.345659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:06.355224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:06.371283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:06.371744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:06.423585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:06.433818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for user 3569fcf74b3b4e3d99b0dbcd5465d97d and project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:06.463728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:06.465984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:06.593878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33e10ad6-afb8-42ca-9dc7-59432a8919a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.972311 Oct 03 14:52:06.597202 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2142/4382] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:06.609893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:06.610791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:06.624105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:06.625354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:06.625984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:06.627042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:06.627712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:06.629018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:07.281209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Updating instance_info_cache with network_info: [] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:52:07.522370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:07.533315 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e99ece69-ca10-4130-b407-027f45c17d7a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.934780 Oct 03 14:52:07.537017 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2143/4383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:06 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:07.549142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3f9a189e-a673-46b7-9322-555546258d19 req-9172bd56-6094-4803-8f46-49333a77bb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34f6896-67b3-4663-a15e-350a205c2a59", "name": "network-vif-plugged", "status": "completed", "tag": "61f60a49-c60f-4431-b990-cacae19b267d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:07.580869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3f9a189e-a673-46b7-9322-555546258d19 req-9172bd56-6094-4803-8f46-49333a77bb0c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:07.591343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3f9a189e-a673-46b7-9322-555546258d19 req-9172bd56-6094-4803-8f46-49333a77bb0c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:07.591943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3f9a189e-a673-46b7-9322-555546258d19 req-9172bd56-6094-4803-8f46-49333a77bb0c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:07.605946 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3f9a189e-a673-46b7-9322-555546258d19 req-9172bd56-6094-4803-8f46-49333a77bb0c service nova] Creating event network-vif-plugged:61f60a49-c60f-4431-b990-cacae19b267d for instance c34f6896-67b3-4663-a15e-350a205c2a59 on n-h1-781139-2 Oct 03 14:52:07.625747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3f9a189e-a673-46b7-9322-555546258d19 req-9172bd56-6094-4803-8f46-49333a77bb0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086616 Oct 03 14:52:07.626656 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2144/4384] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:07.632204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:07.633072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:07.652974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:07.653311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:07.656863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:07.657788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:07.658253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:07.658681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:07.856961 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9456a65c-6ccf-4df3-8342-22870e1bde59 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 204 len: 0 microversion: 2.1 time: 4.335356 Oct 03 14:52:07.858742 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2241/4385] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:03 2022] DELETE /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 0 bytes in 4337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:52:07.867206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-153601188", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c63b6dcd-ca3a-4858-9a9a-aa9b536a4aae"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:07.985691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] validate_networks() for [('c63b6dcd-ca3a-4858-9a9a-aa9b536a4aae', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:08.194529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:08.204777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:08.207044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:08.208547 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a5ee1403-6dc1-44b0-bfa5-687e532191a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1342 microversion: 2.20 time: 0.580556 Oct 03 14:52:08.227150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2145/4386] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:07 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1342 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:08.244316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:08.245454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:08.254007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.254707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.255310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.256187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.256819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.257452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.563813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:08.564373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:08.565392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:08.565810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:08.566232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:08.579678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.580438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.581087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.581967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.582717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.583305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.604609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Getting quotas for project d4f161773c114bf2a7472b6136be58f0. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:08.611155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Getting quotas for user 97d4ddc0886040d98942495773b81f57 and project d4f161773c114bf2a7472b6136be58f0. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:08.628744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:08.632199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:08.726053 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6dd8961f-a9ca-44c7-bceb-abf754ce5fac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864796 Oct 03 14:52:08.727317 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2242/4387] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:08.732672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:08.733565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:08.741987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.743568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.744154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.745974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.746769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.747547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.774937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:08.864884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:08.881726 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a266373d-e5f3-4d2e-af3e-c9d8f8b14a67 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1368 microversion: 2.1 time: 0.653114 Oct 03 14:52:08.888691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2146/4388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:08 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1368 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:08.910948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:08.911106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-42692290-4d54-4b10-bb58-f901e27f5a84 req-d3d0c6f7-b1fa-441f-ad5e-09947f652001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b6a44a-0eef-4fef-a7c1-b2b493d86c61", "name": "network-vif-deleted", "tag": "5641f14c-b607-4db5-a316-ac609bb2a1df"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:08.922572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42692290-4d54-4b10-bb58-f901e27f5a84 req-d3d0c6f7-b1fa-441f-ad5e-09947f652001 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.923146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42692290-4d54-4b10-bb58-f901e27f5a84 req-d3d0c6f7-b1fa-441f-ad5e-09947f652001 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.923734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42692290-4d54-4b10-bb58-f901e27f5a84 req-d3d0c6f7-b1fa-441f-ad5e-09947f652001 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.927309 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6135f2b0-016d-4318-ab6e-edcce0d25458 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1267 microversion: 2.1 time: 0.198723 Oct 03 14:52:08.927920 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2243/4389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:08 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:08.945068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.server_external_events [req-42692290-4d54-4b10-bb58-f901e27f5a84 req-d3d0c6f7-b1fa-441f-ad5e-09947f652001 service nova] Unable to find a host for instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61. Dropping event network-vif-deleted {{(pid=128868) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 14:52:08.946243 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-42692290-4d54-4b10-bb58-f901e27f5a84 req-d3d0c6f7-b1fa-441f-ad5e-09947f652001 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.055972 Oct 03 14:52:08.946507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:08.947310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 06b6a44a-0eef-4fef-a7c1-b2b493d86c61] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:08.949025 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2147/4390] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 14:52:08.954387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:08.954944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.955405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:08.955531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.958000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.958946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.959195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.959622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.962673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.963315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.963915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:08.964764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:08.965405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:08.965994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:09.011021 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] HTTP exception thrown: Instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 could not be found. Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Request method failure captured: Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 HTTP/1.1 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSFsPGcfHTyiIVdt9ONxDnLmtREv_MdG2_9wLLGecv0dxj_HABKVJIJwZMg32BcUeg-88n0l_OlMPTus0PqS7uL1gc_aa3dUl-4njIH_WFw8PQpnIWNqnMvrvWrqhBf6wBkgvignqGoulxT_XesLr5FXyHVndy31ho7QskYmDphbUI Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b183c9eff5e549478b3d8de2fe72ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2cd32680b6b342ea962e104cfaf4c311 Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 could not be found. Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '06b6a44a-0eef-4fef-a7c1-b2b493d86c61'} Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 could not be found. Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 could not be found. Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:09.017913 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 could not be found. Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Returning 404 to user: Instance 06b6a44a-0eef-4fef-a7c1-b2b493d86c61 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:09.022292 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b44a3eec-38ce-4352-ba32-a14208340d95 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61" status: 404 len: 111 microversion: 2.1 time: 0.090667 Oct 03 14:52:09.022802 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2244/4391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:08 2022] GET /compute/v2.1/servers/06b6a44a-0eef-4fef-a7c1-b2b493d86c61 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:09.033432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-500908477", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "451", "networks": [{"uuid": "c63b6dcd-ca3a-4858-9a9a-aa9b536a4aae"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:09.105175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] validate_networks() for [('c63b6dcd-ca3a-4858-9a9a-aa9b536a4aae', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:09.687907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:09.705916 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-545c480e-2962-466c-b9a8-fbac7703818e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.755332 Oct 03 14:52:09.715771 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2148/4392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:08 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:09.721574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:09.722085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:09.734003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:09.734514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:09.737489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:09.738414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:09.739037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:09.739894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:09.777971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:52:09.959277 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82a3cba3-42c7-4972-b36e-438e93f2c422 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 204 len: 0 microversion: 2.1 time: 0.241685 Oct 03 14:52:09.961536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2149/4393] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:09 2022] DELETE /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:52:09.982161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:09.986331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.000392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.000615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:10.001058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:10.001525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:10.001982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:10.002310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.002448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:10.002987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.003922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.004573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.005341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.036358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.037268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.038310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.041146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.046023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.046754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.099604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Getting quotas for project d4f161773c114bf2a7472b6136be58f0. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:10.114921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Getting quotas for user 97d4ddc0886040d98942495773b81f57 and project d4f161773c114bf2a7472b6136be58f0. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:10.139766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:10.143364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:10.156881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:10.227391 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd6249c6-a745-466a-ac4c-80d2d365f697 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203739 Oct 03 14:52:10.228779 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2245/4394] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:10.233982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:10.234780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.244444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.245220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.245959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.246848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.247605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.248187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.343792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.361849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.366365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.370071 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-62997348-d2c6-41ae-b308-0a0f4130cc15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1340 microversion: 2.20 time: 0.402415 Oct 03 14:52:10.375948 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2150/4395] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:09 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1340 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:10.398494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:10.400435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.415869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.418692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.419838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.421840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.423867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.425699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.589580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.627665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e2ed356f-07e6-4872-b5fe-61bd1a1e7393 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1275 microversion: 2.1 time: 0.247332 Oct 03 14:52:10.630193 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2151/4396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:10 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1275 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:10.650202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:10.650976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.665439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.667252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.670961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.672497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.673279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.675080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.792310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.808306 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a10816f-7abb-407f-b313-1d29d04d871f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1563 microversion: 2.1 time: 0.578105 Oct 03 14:52:10.811796 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2246/4397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:10 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1563 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:10.822217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-947dd97e-5a69-4cd7-9095-b8be40653dd0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:10.830353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-947dd97e-5a69-4cd7-9095-b8be40653dd0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.852707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:10.869680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6d661ae-915d-4289-a90b-1682a2621f79 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1466 microversion: 2.1 time: 0.235223 Oct 03 14:52:10.871603 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2152/4398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:10 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1466 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:10.889943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:10.890494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:10.911088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.912786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.913270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:10.915312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:10.915776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:10.916206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.015065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-947dd97e-5a69-4cd7-9095-b8be40653dd0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:11.026383 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-947dd97e-5a69-4cd7-9095-b8be40653dd0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1220 microversion: 2.1 time: 0.211477 Oct 03 14:52:11.031332 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2247/4399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:10 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1220 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:11.049128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:11.050197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:11.086387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.086976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.087481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.088390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.089323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.089772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.301545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:11.326489 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-47991310-79a2-4c9e-b904-728a8083c400 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.446947 Oct 03 14:52:11.330036 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2153/4400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:10 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:11.409082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:11.409963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:11.424103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.424701 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7fa1edd-b2a8-4aaa-81f8-7439f5ca6a3e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.389852 Oct 03 14:52:11.424990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.426155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.427163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.427338 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2248/4401] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:52:11 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-interface => generated 285 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:11.427975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.430007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.657574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:11.658570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:11.665081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.665881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.666520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.667424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.668246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.668872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.720951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:11.731029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:11.732616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:11.741373 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7d53e74-d913-42bb-b1b6-50ea4a6bee0a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.329734 Oct 03 14:52:11.756957 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2154/4402] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:11 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:11.863991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:11.887006 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e12c65e2-e124-4b2a-903a-75b904eb86de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1273 microversion: 2.1 time: 0.225433 Oct 03 14:52:11.887717 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2249/4403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:11 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:11.908891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:11.909630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:11.917344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.918089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.918719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:11.921469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:11.922161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:11.922790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.062803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:12.067598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:12.077288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.078284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.078985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.079918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.080664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.081368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.223867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:12.245527 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7821a2af-a17d-48f4-af64-c9b5a0104c2b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1466 microversion: 2.1 time: 0.345407 Oct 03 14:52:12.253350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2155/4404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:11 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1466 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:12.295026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:12.313115 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84038114-1368-4924-9e8e-e965130e90e1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1216 microversion: 2.1 time: 0.253074 Oct 03 14:52:12.314448 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2250/4405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:12 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:12.360789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:12.369987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:12.384373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.384876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.391796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.399772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.400760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.403075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.770008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-36b6e395-0b6b-417b-9be5-499e5fa255f4 req-c6ac32a2-bf0d-4d85-bfc8-842190d70632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abef3-5a4d-48c8-89e6-63862eb6bf37", "name": "network-vif-plugged", "status": "completed", "tag": "7abe5823-b304-4057-b497-e2f4b020ff05"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:12.793210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36b6e395-0b6b-417b-9be5-499e5fa255f4 req-c6ac32a2-bf0d-4d85-bfc8-842190d70632 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.795026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36b6e395-0b6b-417b-9be5-499e5fa255f4 req-c6ac32a2-bf0d-4d85-bfc8-842190d70632 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.796305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-36b6e395-0b6b-417b-9be5-499e5fa255f4 req-c6ac32a2-bf0d-4d85-bfc8-842190d70632 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.832031 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-36b6e395-0b6b-417b-9be5-499e5fa255f4 req-c6ac32a2-bf0d-4d85-bfc8-842190d70632 service nova] Creating event network-vif-plugged:7abe5823-b304-4057-b497-e2f4b020ff05 for instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 on n-h2-781139-2 Oct 03 14:52:12.849505 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-36b6e395-0b6b-417b-9be5-499e5fa255f4 req-c6ac32a2-bf0d-4d85-bfc8-842190d70632 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078660 Oct 03 14:52:12.851278 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2251/4406] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:52:12.870263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:12.873528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:12.898724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.900723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.901918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:12.906023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:12.909391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:12.909967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.368078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.382469 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c265deb4-4d49-406e-89ec-57b8e81f4b01 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 1.026475 Oct 03 14:52:13.384949 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2156/4407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:12 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:13.391179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:13.392122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:13.403337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.404065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.404702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.406916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.407777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.408425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.438891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:13.586825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.598084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.602522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.604075 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0d1af6f-92af-413b-becc-2ac1e07f3603 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.748726 Oct 03 14:52:13.604671 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2252/4408] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:12 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:13.610574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:13.611409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:13.618657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.619908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.620692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.621686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.622426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.623248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.834682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.843369 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa44f249-8ab0-434f-8670-b914281a47de tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1273 microversion: 2.1 time: 0.456963 Oct 03 14:52:13.844250 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2157/4409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:13 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1273 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:13.849455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:13.850613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:13.858393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.859835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.860285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.861124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:13.861556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:13.861982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:13.897561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:13.905942 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac0a1992-2d2b-4062-be04-71a48903edc8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1466 microversion: 2.1 time: 0.300015 Oct 03 14:52:13.906752 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2253/4410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:13 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1466 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:13.998433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:14.011497 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92ca827c-da9a-4c63-affd-cde1f95885fc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1278 microversion: 2.1 time: 0.165730 Oct 03 14:52:14.015529 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2158/4411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:13 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:14.250570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4235d670-08ab-4f85-9a5d-b1e9058c8a8a req-6d9edf85-af58-4363-83c9-b9d65d4af618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ea3c31-c873-4937-b6cc-ebd75656c505", "tag": "9f346b0f-8c27-4255-97c2-a5d960be0a91"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:14.261514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4235d670-08ab-4f85-9a5d-b1e9058c8a8a req-6d9edf85-af58-4363-83c9-b9d65d4af618 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.262345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4235d670-08ab-4f85-9a5d-b1e9058c8a8a req-6d9edf85-af58-4363-83c9-b9d65d4af618 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.263321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4235d670-08ab-4f85-9a5d-b1e9058c8a8a req-6d9edf85-af58-4363-83c9-b9d65d4af618 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.276069 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4235d670-08ab-4f85-9a5d-b1e9058c8a8a req-6d9edf85-af58-4363-83c9-b9d65d4af618 service nova] Creating event network-changed:9f346b0f-8c27-4255-97c2-a5d960be0a91 for instance b9ea3c31-c873-4937-b6cc-ebd75656c505 on n-h2-781139-2 Oct 03 14:52:14.281891 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4235d670-08ab-4f85-9a5d-b1e9058c8a8a req-6d9edf85-af58-4363-83c9-b9d65d4af618 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035742 Oct 03 14:52:14.282936 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2254/4412] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:14.352558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-dfdac53e-78a2-440a-a33b-632132f3f76c req-62c9e8fe-48c0-46ea-aec4-2ca9cff6f64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e5bebb-452f-4fa8-b96b-ba56627f1f8f", "tag": "7495070f-12a3-4132-84fd-79b46cd032fe"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:14.369353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dfdac53e-78a2-440a-a33b-632132f3f76c req-62c9e8fe-48c0-46ea-aec4-2ca9cff6f64c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.370078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dfdac53e-78a2-440a-a33b-632132f3f76c req-62c9e8fe-48c0-46ea-aec4-2ca9cff6f64c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.370552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dfdac53e-78a2-440a-a33b-632132f3f76c req-62c9e8fe-48c0-46ea-aec4-2ca9cff6f64c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.383834 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-dfdac53e-78a2-440a-a33b-632132f3f76c req-62c9e8fe-48c0-46ea-aec4-2ca9cff6f64c service nova] Creating event network-changed:7495070f-12a3-4132-84fd-79b46cd032fe for instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f on n-h2-781139-2 Oct 03 14:52:14.389294 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-dfdac53e-78a2-440a-a33b-632132f3f76c req-62c9e8fe-48c0-46ea-aec4-2ca9cff6f64c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041139 Oct 03 14:52:14.389999 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2159/4413] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:14.408063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:14.409202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:14.416397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.417179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.417716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.418736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.419502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.420269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.632037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:14.632770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:14.644709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.645286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.645657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:14.646456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:14.646797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:14.647215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.074941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:15.089600 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e0f791c-817c-4c4d-b3d1-4610e1a27021 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1517 microversion: 2.1 time: 0.686364 Oct 03 14:52:15.090715 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2255/4414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:14 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1517 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:15.099953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:15.100616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:15.120626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.121167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.121602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.122461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.123133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.123568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.519061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:15.534548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:15.536018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:15.537212 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-af22dec3-e61f-4ded-b50b-ba30df7b030b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.909551 Oct 03 14:52:15.537795 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2160/4415] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:14 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:15.547981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:15.548604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:15.566295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.566788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.567417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.568275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.581787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.582514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.621797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:15.622706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:15.623156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:15.624188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lazy-loading 'fault' on Instance uuid 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:16.057506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:16.067501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a830de14-4383-4671-850c-24646eb30cd8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 200 len: 1305 microversion: 2.1 time: 0.528648 Oct 03 14:52:16.069222 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2161/4416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:15 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 1305 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:16.074557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:16.076166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:16.085189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.086635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.087285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.088345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.089207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.089913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.100901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:16.116896 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-192629ed-0751-48bc-a275-19de210dac69 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 1.024559 Oct 03 14:52:16.124761 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2256/4417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:15 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:16.135953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:16.137061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:16.144011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.145105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.146120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.147230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.148194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.148900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.272421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:16.290191 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1273dca9-1937-4d9d-8f20-1ec55938a3be tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1278 microversion: 2.1 time: 0.218528 Oct 03 14:52:16.291120 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2162/4418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:16 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:16.316134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6f6f506d-cc75-4693-93c9-8d907866a7b3 req-c9322b9e-7711-417f-9b05-c20368c58c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a", "name": "network-vif-deleted", "tag": "4a60185d-a514-45ec-b3b9-cf023e0ef954"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:16.335122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6f6f506d-cc75-4693-93c9-8d907866a7b3 req-c9322b9e-7711-417f-9b05-c20368c58c03 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.335908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6f6f506d-cc75-4693-93c9-8d907866a7b3 req-c9322b9e-7711-417f-9b05-c20368c58c03 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.336382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6f6f506d-cc75-4693-93c9-8d907866a7b3 req-c9322b9e-7711-417f-9b05-c20368c58c03 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.354498 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6f6f506d-cc75-4693-93c9-8d907866a7b3 req-c9322b9e-7711-417f-9b05-c20368c58c03 service nova] Creating event network-vif-deleted:4a60185d-a514-45ec-b3b9-cf023e0ef954 for instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a on n-h1-781139-2 Oct 03 14:52:16.365881 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6f6f506d-cc75-4693-93c9-8d907866a7b3 req-c9322b9e-7711-417f-9b05-c20368c58c03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060213 Oct 03 14:52:16.367827 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2163/4419] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:16.480627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-9906b95c-0e10-4c0e-8583-8d1f7f94b6cd req-d510f327-ad06-411c-b743-275d3e4800fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34f6896-67b3-4663-a15e-350a205c2a59", "tag": "61f60a49-c60f-4431-b990-cacae19b267d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:16.493970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:16.495687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=12 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:16.504036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9906b95c-0e10-4c0e-8583-8d1f7f94b6cd req-d510f327-ad06-411c-b743-275d3e4800fe service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.505497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9906b95c-0e10-4c0e-8583-8d1f7f94b6cd req-d510f327-ad06-411c-b743-275d3e4800fe service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.506112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9906b95c-0e10-4c0e-8583-8d1f7f94b6cd req-d510f327-ad06-411c-b743-275d3e4800fe service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.525402 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-9906b95c-0e10-4c0e-8583-8d1f7f94b6cd req-d510f327-ad06-411c-b743-275d3e4800fe service nova] Creating event network-changed:61f60a49-c60f-4431-b990-cacae19b267d for instance c34f6896-67b3-4663-a15e-350a205c2a59 on n-h1-781139-2 Oct 03 14:52:16.531442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-9906b95c-0e10-4c0e-8583-8d1f7f94b6cd req-d510f327-ad06-411c-b743-275d3e4800fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057582 Oct 03 14:52:16.532598 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2164/4420] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:16.573674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:16.575107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:16.588335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.589421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.590555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.592824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:16.594601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.595809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.596402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.606625 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bfebc24-212a-4462-8e51-adbaf1cb97ca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.480030 Oct 03 14:52:16.610691 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2257/4421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:16 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:16.633244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:16.634283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:16.646367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.647150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.647812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.648759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.649732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.650371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.865437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:16.873732 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac2434de-a8f7-4ed8-9570-a8f95eafd15b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.244393 Oct 03 14:52:16.875263 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2258/4422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:16 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:16.904700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:16.905633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:16.915873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.916833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.917473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:16.918518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:16.919392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:16.920117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.304467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:17.313796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:17.315193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:17.316343 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ce631e9-ffe4-4b29-9199-889501aac8a9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.753226 Oct 03 14:52:17.317274 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2165/4423] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:16 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:17.339497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.343609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:17.350526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.357871 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-983f8d34-9d7b-460d-9b17-0d39291a9dc9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.458533 Oct 03 14:52:17.359410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.360058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.361324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.362203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.362810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.363603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.363908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2259/4424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:16 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:17.383326 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] HTTP exception thrown: Instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a could not be found. Oct 03 14:52:17.387337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.388891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Request method failure captured: Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a HTTP/1.1 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvSFsPGcfHTyiIVdt9ONxDnLmtREv_MdG2_9wLLGecv0dxj_HABKVJIJwZMg32BcUeg-88n0l_OlMPTus0PqS7uL1gc_aa3dUl-4njIH_WFw8PQpnIWNqnMvrvWrqhBf6wBkgvignqGoulxT_XesLr5FXyHVndy31ho7QskYmDphbUI Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b183c9eff5e549478b3d8de2fe72ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2cd32680b6b342ea962e104cfaf4c311 Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a could not be found. Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a'} Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a could not be found. Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a could not be found. Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:17.391253 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a could not be found. Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Returning 404 to user: Instance 6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:17.395626 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-602a4583-2e73-4bd4-9bb6-0191c7101d9b tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a" status: 404 len: 111 microversion: 2.1 time: 0.064283 Oct 03 14:52:17.399934 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2166/4425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:17 2022] GET /compute/v2.1/servers/6f4bfe7b-9737-4b69-82a9-e338aa9e7e6a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:17.405285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.405915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.415560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.416616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.417240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.417885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.418322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.418458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.418808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.419340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.419568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.420211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.420663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.421322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.610580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:17.619547 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-95a459b0-c923-401a-8e99-a7d96e59fb1c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1278 microversion: 2.1 time: 0.222785 Oct 03 14:52:17.633924 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2167/4426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:17 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:17.642155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81a4f744-3257-451f-a039-9b1a65b7416f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:17.649213 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-81a4f744-3257-451f-a039-9b1a65b7416f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 7692f791-f606-4309-a779-8752dd4e089f has no mapping to a cell. Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81a4f744-3257-451f-a039-9b1a65b7416f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/7692f791-f606-4309-a779-8752dd4e089f/action HTTP/1.1 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: {"os-stop": {}} Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 7692f791-f606-4309-a779-8752dd4e089f has no mapping to a cell. Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '7692f791-f606-4309-a779-8752dd4e089f', 'body': {'os-stop': {}}} Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7692f791-f606-4309-a779-8752dd4e089f has no mapping to a cell. Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:17.658071 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7692f791-f606-4309-a779-8752dd4e089f has no mapping to a cell. Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7692f791-f606-4309-a779-8752dd4e089f has no mapping to a cell. Oct 03 14:52:17.663142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:17.665976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81a4f744-3257-451f-a039-9b1a65b7416f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 7692f791-f606-4309-a779-8752dd4e089f has no mapping to a cell. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:17.667113 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-81a4f744-3257-451f-a039-9b1a65b7416f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/7692f791-f606-4309-a779-8752dd4e089f/action" status: 404 len: 117 microversion: 2.1 time: 0.031848 Oct 03 14:52:17.671925 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2168/4427] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:17 2022] POST /compute/v2.1/servers/7692f791-f606-4309-a779-8752dd4e089f/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:17.677871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.678689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.687545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.688425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.689371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.690336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.691008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.691649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.724911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:52:17.762340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:17.773714 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a8bd258-cea1-48a9-81fb-b55adda6a044 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.407403 Oct 03 14:52:17.775057 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2260/4428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:17 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:17.780616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.781580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.789123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.789968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.790613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.791848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.792503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.793150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.892598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:17.900447 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc7fdba3-fcc6-48ac-8335-e938303b16c9 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "DELETE /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 204 len: 0 microversion: 2.1 time: 0.226965 Oct 03 14:52:17.902052 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2169/4429] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:17 2022] DELETE /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:52:17.915775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:17.917023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:17.924975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.925975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.926707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:17.927856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:17.928539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:17.929386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.186616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:18.197840 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bfb253e-dfa3-489f-a6b2-899b2e8d7553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.421458 Oct 03 14:52:18.225092 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2261/4430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:17 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:18.234141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:18.236384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:18.244633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.245959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.246562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.247803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.248436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.248862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.604779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:18.614000 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e30d80bb-f45e-4098-94ae-cec0bf5a6aca tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.386795 Oct 03 14:52:18.631662 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2262/4431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:18 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:18.637411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:18.638398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:18.648167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.649027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.649422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.650135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.650585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.651010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.766656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:18.777252 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eecffdda-0d72-4580-bb33-764473f4752a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1506 microversion: 2.1 time: 0.866997 Oct 03 14:52:18.778051 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2170/4432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:17 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1506 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:18.784173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-4839183d-79df-42aa-a47b-f24e407cad40 req-cdc94555-1e07-4642-90d0-a16c9ec670d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c08890a-047d-4f3e-9c31-f0851d7e243f", "tag": "e7d1d159-deea-4b03-b429-f9b80fef594d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:18.795103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4839183d-79df-42aa-a47b-f24e407cad40 req-cdc94555-1e07-4642-90d0-a16c9ec670d9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.796218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4839183d-79df-42aa-a47b-f24e407cad40 req-cdc94555-1e07-4642-90d0-a16c9ec670d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.796726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4839183d-79df-42aa-a47b-f24e407cad40 req-cdc94555-1e07-4642-90d0-a16c9ec670d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.810319 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4839183d-79df-42aa-a47b-f24e407cad40 req-cdc94555-1e07-4642-90d0-a16c9ec670d9 service nova] Creating event network-changed:e7d1d159-deea-4b03-b429-f9b80fef594d for instance 5c08890a-047d-4f3e-9c31-f0851d7e243f on n-h1-781139-2 Oct 03 14:52:18.815949 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-4839183d-79df-42aa-a47b-f24e407cad40 req-cdc94555-1e07-4642-90d0-a16c9ec670d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035860 Oct 03 14:52:18.817120 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2171/4433] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:18.823997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22693c68-c5b4-4e6e-b3fc-477b348ab139 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:18.824622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22693c68-c5b4-4e6e-b3fc-477b348ab139 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: cae68d55-49b4-4019-83e3-c4a907cdcbdb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:18.831312 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-22693c68-c5b4-4e6e-b3fc-477b348ab139 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance cae68d55-49b4-4019-83e3-c4a907cdcbdb could not be found. Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22693c68-c5b4-4e6e-b3fc-477b348ab139 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/cae68d55-49b4-4019-83e3-c4a907cdcbdb/action HTTP/1.1 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: {"suspend": {}} Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance cae68d55-49b4-4019-83e3-c4a907cdcbdb could not be found. Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'cae68d55-49b4-4019-83e3-c4a907cdcbdb', 'body': {'suspend': {}}} Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae68d55-49b4-4019-83e3-c4a907cdcbdb could not be found. Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae68d55-49b4-4019-83e3-c4a907cdcbdb could not be found. Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:18.833217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:18.837571 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:18.837571 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:18.837571 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae68d55-49b4-4019-83e3-c4a907cdcbdb could not be found. Oct 03 14:52:18.837571 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:18.837571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22693c68-c5b4-4e6e-b3fc-477b348ab139 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance cae68d55-49b4-4019-83e3-c4a907cdcbdb could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:18.837571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-22693c68-c5b4-4e6e-b3fc-477b348ab139 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/cae68d55-49b4-4019-83e3-c4a907cdcbdb/action" status: 404 len: 111 microversion: 2.1 time: 0.016284 Oct 03 14:52:18.837571 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2172/4434] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:18 2022] POST /compute/v2.1/servers/cae68d55-49b4-4019-83e3-c4a907cdcbdb/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:18.840202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:18.841527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:18.849881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.850370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.850967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:18.852314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:18.852961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:18.853400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.120879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.131000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.134082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.134366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f1ac333-926e-479b-b57c-eb8146f80d98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.501314 Oct 03 14:52:19.135220 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2263/4435] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:18 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:19.142690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:19.143820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:19.152557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.163327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.166984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.168337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.169163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.169916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.179782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:19.502206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.512137 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-430697d2-8fca-4f58-83d1-c7efbd2b9081 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.675487 Oct 03 14:52:19.513015 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2173/4436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:18 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:19.534869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:19.536167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:19.547185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.547816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.549707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.550727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.552516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.553120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.670638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:19.680944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f45ad86-9ae3-439f-828a-043ac9e8342e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.544211 Oct 03 14:52:19.681914 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2264/4437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:19 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:19.800905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:19.802044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:19.810395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.811056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.811600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:19.812475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:19.813097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:19.813613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.081371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:20.307066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:20.323554 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-97d782e7-cc5c-4785-b928-80cb5899f768 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.795841 Oct 03 14:52:20.325143 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2174/4438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:19 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:20.343764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:20.344638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:20.362363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.363013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.363709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.365257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.365968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.366606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.456850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:20.473461 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e464385-d233-4005-84e2-de9b607c1f94 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1506 microversion: 2.1 time: 0.676758 Oct 03 14:52:20.474080 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2265/4439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:19 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1506 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:20.485418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:20.486031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:20.506083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.507387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.508015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.509083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.509703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.510838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.808728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:20.817853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:20.819756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:20.821044 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fbe6efff-228b-4593-aafd-b86d0995d46a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.494198 Oct 03 14:52:20.821628 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2175/4440] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:20 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:20.836085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:20.839249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:20.843566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:20.852351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ca1963e-360a-44d4-8256-9b80044b0609 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.377202 Oct 03 14:52:20.856108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.857091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.857341 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2266/4441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:20 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:20.858756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.859709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.861792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.862339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.867594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:20.870082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:20.877870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.878823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.879280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:20.880584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:20.881258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:20.885539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.025701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:21.063862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:21.075272 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a34844f-f000-4cc4-bc5d-b13bee31c532 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.214025 Oct 03 14:52:21.076195 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2267/4442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:20 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:21.081284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c402ae3b-937c-468b-8617-679863d37c5f req-bc942f47-33ff-4121-be30-30e039822a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec3cbb6-07b0-42aa-8617-b2313e173565", "tag": "ee44b0f0-e23e-45cb-83b3-1c72c4deb142"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:21.092078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c402ae3b-937c-468b-8617-679863d37c5f req-bc942f47-33ff-4121-be30-30e039822a1f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.092673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c402ae3b-937c-468b-8617-679863d37c5f req-bc942f47-33ff-4121-be30-30e039822a1f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.093225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c402ae3b-937c-468b-8617-679863d37c5f req-bc942f47-33ff-4121-be30-30e039822a1f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.108899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c402ae3b-937c-468b-8617-679863d37c5f req-bc942f47-33ff-4121-be30-30e039822a1f service nova] Creating event network-changed:ee44b0f0-e23e-45cb-83b3-1c72c4deb142 for instance cec3cbb6-07b0-42aa-8617-b2313e173565 on n-h1-781139-2 Oct 03 14:52:21.118276 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c402ae3b-937c-468b-8617-679863d37c5f req-bc942f47-33ff-4121-be30-30e039822a1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040575 Oct 03 14:52:21.121006 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2268/4443] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:21.135141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:21.136441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:21.143834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.144335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.144823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.145674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.146300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.147065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.177969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lazy-loading 'flavor' on Instance uuid 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:21.195299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:21.222571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9fb73ef8-6fce-49af-9163-361d95bfe4b2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.396775 Oct 03 14:52:21.224341 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2176/4444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:20 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:21.239585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0e46bfcf-dcf4-45f9-9956-a7c20e2d622e req-b14fcca5-b057-4f62-84d7-773ce1489afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddab78bd-d620-450f-b92b-c5ca0201aaff", "tag": "8b8bc5f4-12db-496b-9725-4f3c24d10366"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:21.265318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0e46bfcf-dcf4-45f9-9956-a7c20e2d622e req-b14fcca5-b057-4f62-84d7-773ce1489afd service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.266052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0e46bfcf-dcf4-45f9-9956-a7c20e2d622e req-b14fcca5-b057-4f62-84d7-773ce1489afd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.266681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0e46bfcf-dcf4-45f9-9956-a7c20e2d622e req-b14fcca5-b057-4f62-84d7-773ce1489afd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.278508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:21.299037 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8a9d638-7028-46b8-a605-57acd3f7935b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 202 len: 0 microversion: 2.1 time: 0.174492 Oct 03 14:52:21.299654 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0e46bfcf-dcf4-45f9-9956-a7c20e2d622e req-b14fcca5-b057-4f62-84d7-773ce1489afd service nova] Creating event network-changed:8b8bc5f4-12db-496b-9725-4f3c24d10366 for instance ddab78bd-d620-450f-b92b-c5ca0201aaff on n-h1-781139-2 Oct 03 14:52:21.311050 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2269/4445] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:21 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:52:21.316780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:21.320415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:21.329733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.330340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.331163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.332892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.334062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.335592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.348668 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0e46bfcf-dcf4-45f9-9956-a7c20e2d622e req-b14fcca5-b057-4f62-84d7-773ce1489afd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121480 Oct 03 14:52:21.354040 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2177/4446] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:21.497415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:21.498860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:21.507637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.508390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.509030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.509942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.510552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.511130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.553159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.553871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.554458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.555098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lazy-loading 'fault' on Instance uuid 960d5b6b-7d39-46bb-ba46-3ce634f28f32 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:21.607276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:21.619282 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-022d8909-9e61-4d91-a84c-e7573f651662 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 200 len: 1304 microversion: 2.1 time: 0.125212 Oct 03 14:52:21.620894 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2178/4447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:21 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:21.648265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:21.659035 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c63d641-482c-4ac8-952a-d56a76a1bf98 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1512 microversion: 2.1 time: 0.345735 Oct 03 14:52:21.665789 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2270/4448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:21 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:21.849941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:21.851019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:21.865143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.868299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.868776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:21.873352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:21.875335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:21.875818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.102746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:22.103361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:22.113475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.113886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.114326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.122239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.122784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.123420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.142578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:22.155889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:22.157839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:22.158995 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ddf4090-34fb-47da-8bdb-c899bffa49e6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.314009 Oct 03 14:52:22.164825 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2179/4449] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:21 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:22.251160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:22.251779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:22.277604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.278202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.278692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.279589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.280045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.280471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.564819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:22.576504 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-40e85b39-a7fd-474c-9aed-28dd3be559cf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.329001 Oct 03 14:52:22.581067 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2180/4450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:22 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:22.643287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:22.643856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:22.644560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 960d5b6b-7d39-46bb-ba46-3ce634f28f32] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:22.651517 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03918451-1de6-43ed-959f-2efcf3479409 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.552909 Oct 03 14:52:22.652119 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2271/4451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:22 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:22.655596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.657260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.657812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.659196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.661356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.662242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.680694 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] HTTP exception thrown: Instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 could not be found. Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Request method failure captured: Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 HTTP/1.1 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvSFsPGcfHTyiIVdt9ONxDnLmtREv_MdG2_9wLLGecv0dxj_HABKVJIJwZMg32BcUeg-88n0l_OlMPTus0PqS7uL1gc_aa3dUl-4njIH_WFw8PQpnIWNqnMvrvWrqhBf6wBkgvignqGoulxT_XesLr5FXyHVndy31ho7QskYmDphbUI Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b183c9eff5e549478b3d8de2fe72ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2cd32680b6b342ea962e104cfaf4c311 Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 could not be found. Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '960d5b6b-7d39-46bb-ba46-3ce634f28f32'} Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 could not be found. Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 could not be found. Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:22.682637 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 could not be found. Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:22.687330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Returning 404 to user: Instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:22.688187 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7981c136-f7cd-428c-860f-c2ae8d29f770 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32" status: 404 len: 111 microversion: 2.1 time: 0.048174 Oct 03 14:52:22.690518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:22.691134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:22.692359 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2181/4452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:22 2022] GET /compute/v2.1/servers/960d5b6b-7d39-46bb-ba46-3ce634f28f32 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:22.699660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.700300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.700755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:22.700868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.701313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:22.709229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.710921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.711451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.711887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.717231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.717872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.718879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.729846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.734519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.799501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:52:22.904959 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2594e80-3371-4d37-9ad0-415fbada0d3a tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 204 len: 0 microversion: 2.1 time: 0.210951 Oct 03 14:52:22.909073 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2182/4453] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:22 2022] DELETE /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:52:22.928611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:22.929845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:22.940753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.942024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.942794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:22.943858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:22.944499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:22.945326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.261662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:23.275639 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba5fa9e6-6116-456e-a1c2-30e4a1659b49 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1495 microversion: 2.1 time: 0.588848 Oct 03 14:52:23.276239 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2272/4454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:22 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1495 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:23.289206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3e4cf1a1-07ba-4a56-b7d9-438041dc1a6c req-da236c7a-9b92-4b03-b67c-fd0471f059de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960d5b6b-7d39-46bb-ba46-3ce634f28f32", "name": "network-vif-deleted", "tag": "94dcf015-9131-4d7f-bab0-622a075ed756"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:23.309657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3e4cf1a1-07ba-4a56-b7d9-438041dc1a6c req-da236c7a-9b92-4b03-b67c-fd0471f059de service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.310346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3e4cf1a1-07ba-4a56-b7d9-438041dc1a6c req-da236c7a-9b92-4b03-b67c-fd0471f059de service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.310790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3e4cf1a1-07ba-4a56-b7d9-438041dc1a6c req-da236c7a-9b92-4b03-b67c-fd0471f059de service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.342913 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3e4cf1a1-07ba-4a56-b7d9-438041dc1a6c req-da236c7a-9b92-4b03-b67c-fd0471f059de service nova] Creating event network-vif-deleted:94dcf015-9131-4d7f-bab0-622a075ed756 for instance 960d5b6b-7d39-46bb-ba46-3ce634f28f32 on n-h2-781139-2 Oct 03 14:52:23.349478 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3e4cf1a1-07ba-4a56-b7d9-438041dc1a6c req-da236c7a-9b92-4b03-b67c-fd0471f059de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071679 Oct 03 14:52:23.350655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2273/4455] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:23.357301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:23.358546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:23.371541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.372492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.373514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.375864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.376945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.378047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.654244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:23.662717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e15466b6-88b7-4566-8225-4b8184b96344 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1495 microversion: 2.1 time: 0.751246 Oct 03 14:52:23.679967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2183/4456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:22 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1495 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:23.694598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1dceb6df-04af-49a3-968b-e0346500b008 req-84df8ec0-7158-44ff-8b8d-b4118db2faed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ea3c31-c873-4937-b6cc-ebd75656c505", "name": "network-vif-plugged", "status": "completed", "tag": "9f346b0f-8c27-4255-97c2-a5d960be0a91"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:23.713431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1dceb6df-04af-49a3-968b-e0346500b008 req-84df8ec0-7158-44ff-8b8d-b4118db2faed service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.714175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1dceb6df-04af-49a3-968b-e0346500b008 req-84df8ec0-7158-44ff-8b8d-b4118db2faed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.715088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1dceb6df-04af-49a3-968b-e0346500b008 req-84df8ec0-7158-44ff-8b8d-b4118db2faed service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.728053 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1dceb6df-04af-49a3-968b-e0346500b008 req-84df8ec0-7158-44ff-8b8d-b4118db2faed service nova] Creating event network-vif-plugged:9f346b0f-8c27-4255-97c2-a5d960be0a91 for instance b9ea3c31-c873-4937-b6cc-ebd75656c505 on n-h2-781139-2 Oct 03 14:52:23.733829 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1dceb6df-04af-49a3-968b-e0346500b008 req-84df8ec0-7158-44ff-8b8d-b4118db2faed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051674 Oct 03 14:52:23.734869 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2184/4457] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:23.741638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:23.742459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:23.751772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.752449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.753105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.753961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.754554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.755126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.789824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lazy-loading 'flavor' on Instance uuid 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:23.810760 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Cannot 'suspend' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state suspended Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action HTTP/1.1 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: {"suspend": {}} Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: exception: Cannot 'suspend' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state suspended Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'suspend': {}}} Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 03 14:52:23.814678 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state suspended Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state suspended Oct 03 14:52:23.819463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:23.821406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 409 to user: Cannot 'suspend' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state suspended {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:23.822447 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f75feb13-a3d3-45ec-8fa4-49f777df5db9 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 409 len: 148 microversion: 2.1 time: 0.086244 Oct 03 14:52:23.825707 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2185/4458] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:23 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 148 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:52:23.834091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:23.835319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:23.842777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.843430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.843881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.845339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.846106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.846551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.926022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:23.939192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:23.941087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:23.942413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c84d5a56-2b11-4f8e-adf3-c3648723e894 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.590469 Oct 03 14:52:23.943669 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2274/4459] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:23 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:23.950105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:23.950876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:23.958316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.959866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.960644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:23.961689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:23.962339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:23.963783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:24.367232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:24.391003 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a382b091-f335-4c04-8a64-f15455d2c6a4 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.563277 Oct 03 14:52:24.401860 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2186/4460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:23 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:24.403017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:24.403913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:24.415641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:24.417025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:24.417689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:24.421124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:24.423208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:24.424022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:24.564610 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-865abde5-bb3c-49d1-9307-eeb35aff3dc5 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 202 len: 0 microversion: 2.1 time: 0.171449 Oct 03 14:52:24.565704 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2187/4461] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:24 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:52:24.574121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:24.575315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:24.584585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:24.587545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:24.590044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:24.591284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:24.593498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:24.594188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:24.603016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:24.611690 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b9f7139-2ecf-452e-88dd-0ee2992f06ed tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.666756 Oct 03 14:52:24.623629 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2275/4462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:23 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:24.687902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:24.689038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:24.697690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:24.698239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:24.698845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:24.700335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:24.701509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:24.702069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.026252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:25.037959 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6074f55-f5f7-4913-8bcb-b1d76b77dd19 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 200 len: 1495 microversion: 2.1 time: 0.354717 Oct 03 14:52:25.039181 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2276/4463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:24 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 1495 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:25.045154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:25.045870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:25.052351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.052981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.053504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.054290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.054927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.056326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.065235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:25.076679 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f955cd0a-93d2-4124-ba88-5a82f4812b43 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1501 microversion: 2.1 time: 0.506237 Oct 03 14:52:25.078671 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2188/4464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:24 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:25.251392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:25.275745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:25.277554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:25.278943 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5c8dbc7-fa4f-4fdf-a898-17d809cd4a22 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1407 microversion: 2.20 time: 0.238358 Oct 03 14:52:25.280346 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2277/4465] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:25 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:25.418071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:25.418839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:25.425812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.426380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.426887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.427753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.428396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.428829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.435592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dc00d58c-ce1a-4d0e-b5f5-4985ad6ad1ef req-90562d71-1376-4db8-830a-38cfcf1b5d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bc8d1e-08aa-4b83-9f91-95eb81cae9ce", "name": "network-vif-deleted", "tag": "f9661711-cbbc-4465-b00b-feb7089251d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:25.448643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc00d58c-ce1a-4d0e-b5f5-4985ad6ad1ef req-90562d71-1376-4db8-830a-38cfcf1b5d28 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.449486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc00d58c-ce1a-4d0e-b5f5-4985ad6ad1ef req-90562d71-1376-4db8-830a-38cfcf1b5d28 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.449945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc00d58c-ce1a-4d0e-b5f5-4985ad6ad1ef req-90562d71-1376-4db8-830a-38cfcf1b5d28 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.474759 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dc00d58c-ce1a-4d0e-b5f5-4985ad6ad1ef req-90562d71-1376-4db8-830a-38cfcf1b5d28 service nova] Creating event network-vif-deleted:f9661711-cbbc-4465-b00b-feb7089251d1 for instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce on n-h2-781139-2 Oct 03 14:52:25.480432 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dc00d58c-ce1a-4d0e-b5f5-4985ad6ad1ef req-90562d71-1376-4db8-830a-38cfcf1b5d28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049004 Oct 03 14:52:25.481345 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2278/4466] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:52:25.649195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:25.649899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:25.657036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.657530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.657963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.658674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.659125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.659948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.809591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:25.818536 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f5fceb17-57f0-4e20-8332-20fe2cfbf914 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.173589 Oct 03 14:52:25.819117 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2279/4467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:25 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:25.823718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cc19ad96-90a8-4779-a90c-2689c725175c req-06c40628-df11-40e3-8fd4-ebaf2729f377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e5bebb-452f-4fa8-b96b-ba56627f1f8f", "name": "network-vif-plugged", "status": "completed", "tag": "7495070f-12a3-4132-84fd-79b46cd032fe"}, {"server_uuid": "5c08890a-047d-4f3e-9c31-f0851d7e243f", "name": "network-vif-plugged", "status": "completed", "tag": "e7d1d159-deea-4b03-b429-f9b80fef594d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:25.834722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc19ad96-90a8-4779-a90c-2689c725175c req-06c40628-df11-40e3-8fd4-ebaf2729f377 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:25.835197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc19ad96-90a8-4779-a90c-2689c725175c req-06c40628-df11-40e3-8fd4-ebaf2729f377 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:25.835842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cc19ad96-90a8-4779-a90c-2689c725175c req-06c40628-df11-40e3-8fd4-ebaf2729f377 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:25.849616 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cc19ad96-90a8-4779-a90c-2689c725175c req-06c40628-df11-40e3-8fd4-ebaf2729f377 service nova] Creating event network-vif-plugged:7495070f-12a3-4132-84fd-79b46cd032fe for instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f on n-h2-781139-2 Oct 03 14:52:25.850123 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cc19ad96-90a8-4779-a90c-2689c725175c req-06c40628-df11-40e3-8fd4-ebaf2729f377 service nova] Creating event network-vif-plugged:e7d1d159-deea-4b03-b429-f9b80fef594d for instance 5c08890a-047d-4f3e-9c31-f0851d7e243f on n-h1-781139-2 Oct 03 14:52:25.858283 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cc19ad96-90a8-4779-a90c-2689c725175c req-06c40628-df11-40e3-8fd4-ebaf2729f377 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038002 Oct 03 14:52:25.859365 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2280/4468] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:26.017996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:26.026993 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d5608a0-91d1-49d0-9185-957d7dc1ae40 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.612968 Oct 03 14:52:26.030141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2189/4469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:25 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:26.064591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.065321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.071583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.072070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.072505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.073241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.073690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.074116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.088122 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] HTTP exception thrown: Instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce could not be found. Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Request method failure captured: Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce HTTP/1.1 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSFsPGcfHTyiIVdt9ONxDnLmtREv_MdG2_9wLLGecv0dxj_HABKVJIJwZMg32BcUeg-88n0l_OlMPTus0PqS7uL1gc_aa3dUl-4njIH_WFw8PQpnIWNqnMvrvWrqhBf6wBkgvignqGoulxT_XesLr5FXyHVndy31ho7QskYmDphbUI Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b183c9eff5e549478b3d8de2fe72ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2cd32680b6b342ea962e104cfaf4c311 Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce could not be found. Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '14bc8d1e-08aa-4b83-9f91-95eb81cae9ce'} Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce could not be found. Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce could not be found. Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:26.089828 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce could not be found. Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Returning 404 to user: Instance 14bc8d1e-08aa-4b83-9f91-95eb81cae9ce could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33de0b38-6cda-4eb5-9acf-6b413b77db10 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce" status: 404 len: 111 microversion: 2.1 time: 0.031166 Oct 03 14:52:26.097423 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2281/4470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:26 2022] GET /compute/v2.1/servers/14bc8d1e-08aa-4b83-9f91-95eb81cae9ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:26.103129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.103635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.103830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.104585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.110477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.110950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.111124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.111614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.111894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.112041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.112600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.113159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.113274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.113591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.113694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.114206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.134084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:26.144181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:52:26.254740 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a9f1225a-385f-4c31-9338-787613e220b4 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "DELETE /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 204 len: 0 microversion: 2.1 time: 0.155010 Oct 03 14:52:26.255834 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2190/4471] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:26 2022] DELETE /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:52:26.266466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.267565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.276785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.277015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:26.277806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.278674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.279617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.281637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.282128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.286208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cea02234-4082-4d67-99e9-16a4bb2f9650 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1501 microversion: 2.1 time: 0.186812 Oct 03 14:52:26.286984 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2282/4472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:26 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:26.289750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:26.306305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.306915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.313588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.314348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.314927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.315796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.316393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.316998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.453325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:26.462536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:26.463979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:26.465201 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a58d6aa-dc0c-4636-866f-7cce5eb71c7e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1599 microversion: 2.20 time: 0.163025 Oct 03 14:52:26.465896 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2283/4473] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:26 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:26.490163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.490577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.496817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.497355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.497874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.498566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.499011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.499431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.576776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:26.583392 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4bb1373-b25b-42c7-ade4-3478fc03645a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097219 Oct 03 14:52:26.584476 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2284/4474] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:52:26 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:52:26.589618 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cfb98b77-b6b3-4821-ae46-bccd9cb97af8 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1674 microversion: 2.1 time: 0.323763 Oct 03 14:52:26.590445 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2191/4475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:26 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1674 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:26.843258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:26.843894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:26.850170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.850665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.851114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:26.851826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:26.852280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:26.852707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.055722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:27.056340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:27.074970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.075917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.076542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.077463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.078738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.079330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.203480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.213215 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4cab017-cf8a-4c92-9b00-60d022ac802a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.374947 Oct 03 14:52:27.215159 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2285/4476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:26 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:27.315172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:27.315808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:27.331781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.332954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.333932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.334074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.334503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.336979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.392532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.411000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-93b2cd58-791d-4805-b7aa-cfff765dead9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.359002 Oct 03 14:52:27.411811 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2192/4477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:27 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:27.599660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.608233 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2a74039-56d8-4058-980f-29082c90fd6e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1501 microversion: 2.1 time: 0.299763 Oct 03 14:52:27.612573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:27.613542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:27.625108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.625463 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2286/4478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:27 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:27.626141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.626794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.629776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.630424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.631015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.912326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:27.930574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e1bef09f-3307-4bfe-b813-f728e963f87d tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1674 microversion: 2.1 time: 0.322325 Oct 03 14:52:27.951978 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2193/4479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:27 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1674 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:27.957021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8a010f4a-63ad-489d-b584-c6e8b33496fc req-ef187677-9426-42a8-981f-25b129f1346a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ea3c31-c873-4937-b6cc-ebd75656c505", "tag": "9f346b0f-8c27-4255-97c2-a5d960be0a91"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:27.968185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a010f4a-63ad-489d-b584-c6e8b33496fc req-ef187677-9426-42a8-981f-25b129f1346a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:27.969536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a010f4a-63ad-489d-b584-c6e8b33496fc req-ef187677-9426-42a8-981f-25b129f1346a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:27.970101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a010f4a-63ad-489d-b584-c6e8b33496fc req-ef187677-9426-42a8-981f-25b129f1346a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:27.987891 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8a010f4a-63ad-489d-b584-c6e8b33496fc req-ef187677-9426-42a8-981f-25b129f1346a service nova] Creating event network-changed:9f346b0f-8c27-4255-97c2-a5d960be0a91 for instance b9ea3c31-c873-4937-b6cc-ebd75656c505 on n-h2-781139-2 Oct 03 14:52:27.995757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8a010f4a-63ad-489d-b584-c6e8b33496fc req-ef187677-9426-42a8-981f-25b129f1346a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 Oct 03 14:52:28.004917 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2287/4480] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:52:28.237422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:28.238701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:28.251661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.252613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.253759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.255100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.255768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.256503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.436164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:28.438029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:28.472801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.474722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.475411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.476393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.477093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.477725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.544724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:28.556038 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df11b816-9120-4193-9874-8f4c78728766 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.323285 Oct 03 14:52:28.568957 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2194/4481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:28 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:28.637796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:28.638572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:28.651549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.654200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.654200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.654526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.654982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.655411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.894268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:28.909606 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b3e89d3-2941-4c9d-8efa-3307f084b0e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.477702 Oct 03 14:52:28.910215 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2288/4482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:28 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:28.953411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:28.957970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:28.959168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:28.965816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.966552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.966891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5ce43e99-41c3-4624-9e9d-dee3842d6221 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.333273 Oct 03 14:52:28.967168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.967883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:28.968080 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2195/4483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:28 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:28.975081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:28.975715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:28.994162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:28.994994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.003242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.003965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.004611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.005540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.006158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.006909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.165405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.174753 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82b4e88a-5599-4350-9dcc-8aa018acdcaf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.186862 Oct 03 14:52:29.181678 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2196/4484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:28 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:29.202877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f64d63e-7184-4af6-94ac-5388fa930e90 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:29.203736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f64d63e-7184-4af6-94ac-5388fa930e90 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 90c32ccd-cbd4-4699-b7c8-78126997fca0] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.209694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.209870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-7f64d63e-7184-4af6-94ac-5388fa930e90 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 90c32ccd-cbd4-4699-b7c8-78126997fca0 could not be found. Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f64d63e-7184-4af6-94ac-5388fa930e90 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/90c32ccd-cbd4-4699-b7c8-78126997fca0/action HTTP/1.1 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 15 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: {"unpause": {}} Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 90c32ccd-cbd4-4699-b7c8-78126997fca0 could not be found. Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '90c32ccd-cbd4-4699-b7c8-78126997fca0', 'body': {'unpause': {}}} Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c32ccd-cbd4-4699-b7c8-78126997fca0 could not be found. Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c32ccd-cbd4-4699-b7c8-78126997fca0 could not be found. Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:29.212297 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:29.220416 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:29.220416 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:29.220416 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c32ccd-cbd4-4699-b7c8-78126997fca0 could not be found. Oct 03 14:52:29.220416 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.220416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f64d63e-7184-4af6-94ac-5388fa930e90 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 90c32ccd-cbd4-4699-b7c8-78126997fca0 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:29.220416 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f64d63e-7184-4af6-94ac-5388fa930e90 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/90c32ccd-cbd4-4699-b7c8-78126997fca0/action" status: 404 len: 111 microversion: 2.1 time: 0.017272 Oct 03 14:52:29.220416 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2197/4485] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:29 2022] POST /compute/v2.1/servers/90c32ccd-cbd4-4699-b7c8-78126997fca0/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:29.221109 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c881869-bf30-41e4-866a-10f9fbedb8db tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1674 microversion: 2.1 time: 0.266886 Oct 03 14:52:29.221528 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2289/4486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:28 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1674 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:29.224563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.225203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.232840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.233390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.234015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.234714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.235199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.235791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.394748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.403786 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b2d8047-4e61-48b8-a759-6d5dd7b4bd60 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.183083 Oct 03 14:52:29.404759 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2198/4487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:29.428164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.428394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.435078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.435784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.435959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.436649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.437202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.437545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.583958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.585285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.592531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.593104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.593545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.594487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.594945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.595370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.682036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.691100 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75a9e591-6589-4d0c-8cb1-41d3c3906169 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.267799 Oct 03 14:52:29.692505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2290/4488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:29.718485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:29.719231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.725902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.726593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.727722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.729083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.729699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.730288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.739238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.749980 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-27ed55ac-87c2-431d-8dcd-55200b51d385 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.169346 Oct 03 14:52:29.750586 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2199/4489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:29.755918 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Cannot 'unpause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action HTTP/1.1 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 15 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: {"unpause": {}} Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'unpause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'unpause': {}}} Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 in vm_state active. Cannot unpause while the instance is in this state. Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:29.757753 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:29.761795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:29.761795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:29.761795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:29.761795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:29.761795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:29.761795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 409 to user: Cannot 'unpause' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:29.761795 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8860a81-58d3-4323-88d3-8494bc829e04 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 409 len: 145 microversion: 2.1 time: 0.049537 Oct 03 14:52:29.763314 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2291/4490] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:29 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 145 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:52:29.768393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.769042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.775652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.776508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.777314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.778685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.779466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.780188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.924403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:29.935019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.935019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.941661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.942492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.943715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.944502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.945047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.945413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.957485 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-79116a0d-cb14-400b-976e-781ae452eaf7 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.188475 Oct 03 14:52:29.958130 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2200/4491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:29.980788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:29.982097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:29.988398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.989065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.989510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:29.990251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:29.990687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:29.991112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.149696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.164636 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3bc84f71-6ca0-429d-ba0f-28977904819b tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.187455 Oct 03 14:52:30.170896 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2201/4492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:30.184352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.190097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-119f2935-bd01-450b-87e1-58e2d091bddf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:30.190926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-119f2935-bd01-450b-87e1-58e2d091bddf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 7ab0026b-05c1-4465-9dd4-d610b4084c75] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.194498 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abbfe4ce-69f8-4b86-b472-e4c09d600baa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.265333 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-119f2935-bd01-450b-87e1-58e2d091bddf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 7ab0026b-05c1-4465-9dd4-d610b4084c75 could not be found. Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-119f2935-bd01-450b-87e1-58e2d091bddf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/7ab0026b-05c1-4465-9dd4-d610b4084c75/action HTTP/1.1 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 18 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: {"unshelve": null} Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 7ab0026b-05c1-4465-9dd4-d610b4084c75 could not be found. Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '7ab0026b-05c1-4465-9dd4-d610b4084c75', 'body': {'unshelve': None}} Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab0026b-05c1-4465-9dd4-d610b4084c75 could not be found. Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:30.209214 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab0026b-05c1-4465-9dd4-d610b4084c75 could not be found. Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab0026b-05c1-4465-9dd4-d610b4084c75 could not be found. Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-119f2935-bd01-450b-87e1-58e2d091bddf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 7ab0026b-05c1-4465-9dd4-d610b4084c75 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-119f2935-bd01-450b-87e1-58e2d091bddf tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/7ab0026b-05c1-4465-9dd4-d610b4084c75/action" status: 404 len: 111 microversion: 2.1 time: 0.013741 Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2202/4493] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:30 2022] POST /compute/v2.1/servers/7ab0026b-05c1-4465-9dd4-d610b4084c75/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.213616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.217068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.217690 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2292/4494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:29 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:30.218138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.218930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.219846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.220511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.221185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.245089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.246965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.253736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:30.256118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.256916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.257636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.259303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.260065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.261772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.367740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.376589 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-690ebe2a-fa5d-475c-b1a8-5b4360fda047 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.170995 Oct 03 14:52:30.389235 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2203/4495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:30.400444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.401102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.408165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.408597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.409271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.410207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.411012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.411599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.473360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.482038 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65ca2b17-02c2-4153-ad07-f5b5f976cdb0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1674 microversion: 2.1 time: 0.242186 Oct 03 14:52:30.482648 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2293/4496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1674 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:30.646381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:30.654813 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76ce7e5e-0a44-4c99-bc16-69e49f5d292f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.258281 Oct 03 14:52:30.656326 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2204/4497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:30.677772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:30.678446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.686538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.687040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.687587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.688270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.688727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.689181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.713984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Cannot 'unshelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action HTTP/1.1 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 18 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: {"unshelve": null} Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'unshelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'unshelve': None}} Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 in vm_state active. Cannot unshelve while the instance is in this state. Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:52:30.715827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 409 to user: Cannot 'unshelve' instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 while it is in vm_state active {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:30.720225 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b900c770-3ee3-448d-bef0-aa8e1659d85c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action" status: 409 len: 146 microversion: 2.1 time: 0.043878 Oct 03 14:52:30.725044 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2294/4498] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:30 2022] POST /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37/action => generated 146 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:52:30.726443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.727060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.733706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.734193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.734698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.735350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.735899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.736334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.775431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:30.776377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:30.789398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.789925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.790371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:30.791306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:30.792522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:30.796398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.003639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.017321 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed5de58d-af57-4e35-a5ac-d0c0c769753f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.294589 Oct 03 14:52:31.018075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2205/4499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:31.049501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.050287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.063298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.065670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.066271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.068573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.069196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.069873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.349850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.359038 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da758d5b-707a-4d64-8b81-ad938af115a8 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.316224 Oct 03 14:52:31.363300 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2206/4500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:31.375600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.376531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.410945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.411861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.412462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.413984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.415407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.416494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.472517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.480779 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caa1895a-761a-4ed3-a783-011203f7e1f2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1315 microversion: 2.1 time: 0.710426 Oct 03 14:52:31.497423 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2295/4501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:30 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:31.507488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e48ef596-457d-45dc-a606-2186beabfc0d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-330004778_updated"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:31.510436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e48ef596-457d-45dc-a606-2186beabfc0d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 89de95ae-159c-4dd1-a0f6-38bb4cfde228] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.517605 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e48ef596-457d-45dc-a606-2186beabfc0d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 89de95ae-159c-4dd1-a0f6-38bb4cfde228 could not be found. Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e48ef596-457d-45dc-a606-2186beabfc0d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/servers/89de95ae-159c-4dd1-a0f6-38bb4cfde228 HTTP/1.1 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 80 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-330004778_updated"}} Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 89de95ae-159c-4dd1-a0f6-38bb4cfde228 could not be found. Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '89de95ae-159c-4dd1-a0f6-38bb4cfde228', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-330004778_updated'}}} Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89de95ae-159c-4dd1-a0f6-38bb4cfde228 could not be found. Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 03 14:52:31.520411 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89de95ae-159c-4dd1-a0f6-38bb4cfde228 could not be found. Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89de95ae-159c-4dd1-a0f6-38bb4cfde228 could not be found. Oct 03 14:52:31.524965 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:31.526835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e48ef596-457d-45dc-a606-2186beabfc0d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 89de95ae-159c-4dd1-a0f6-38bb4cfde228 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:31.527931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e48ef596-457d-45dc-a606-2186beabfc0d tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "PUT /compute/v2.1/servers/89de95ae-159c-4dd1-a0f6-38bb4cfde228" status: 404 len: 111 microversion: 2.1 time: 0.029176 Oct 03 14:52:31.528703 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2296/4502] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:52:31 2022] PUT /compute/v2.1/servers/89de95ae-159c-4dd1-a0f6-38bb4cfde228 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:31.533738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-30e2a12a-063a-495a-8828-c4ed67a3f345 req-f5a2979b-148e-43d8-9a18-f2bf8240771a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddab78bd-d620-450f-b92b-c5ca0201aaff", "name": "network-vif-plugged", "status": "completed", "tag": "8b8bc5f4-12db-496b-9725-4f3c24d10366"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:31.545341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-30e2a12a-063a-495a-8828-c4ed67a3f345 req-f5a2979b-148e-43d8-9a18-f2bf8240771a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.546105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-30e2a12a-063a-495a-8828-c4ed67a3f345 req-f5a2979b-148e-43d8-9a18-f2bf8240771a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.547638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-30e2a12a-063a-495a-8828-c4ed67a3f345 req-f5a2979b-148e-43d8-9a18-f2bf8240771a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.562112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-30e2a12a-063a-495a-8828-c4ed67a3f345 req-f5a2979b-148e-43d8-9a18-f2bf8240771a service nova] Creating event network-vif-plugged:8b8bc5f4-12db-496b-9725-4f3c24d10366 for instance ddab78bd-d620-450f-b92b-c5ca0201aaff on n-h1-781139-2 Oct 03 14:52:31.568358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-30e2a12a-063a-495a-8828-c4ed67a3f345 req-f5a2979b-148e-43d8-9a18-f2bf8240771a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038317 Oct 03 14:52:31.569248 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2297/4503] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:31.575959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.577609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.584190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.584964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.586240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.587132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.587743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.588326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.854157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:31.862799 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0587c946-8fb9-4835-9c79-6337e5afa4e2 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1674 microversion: 2.1 time: 0.291561 Oct 03 14:52:31.863407 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2298/4504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1674 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:31.869510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:31.870124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:31.877579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.878476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.879059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:31.879931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:31.880681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:31.881342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.058202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.072482 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b82a3276-bae4-4fe6-9c11-121f20d8166d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.707807 Oct 03 14:52:32.073333 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2207/4505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:32.114616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.124298 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36868c41-83c7-4eda-ae23-aeb542453c82 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.258952 Oct 03 14:52:32.125687 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2299/4506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:31 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:32.151558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.152506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.159557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.160067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.160661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.161406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.161865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.162294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.435247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.451377 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45dfd936-9a98-4aad-a13b-d499b871fd2a tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.304098 Oct 03 14:52:32.452261 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2208/4507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:32.484842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d2928c9e-d461-4a24-af33-7a471480a9d2 req-86ea3241-4c6b-409d-802c-074d5e15abdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c2fbe-6c74-4e2a-9d69-996fcb544f90", "name": "network-vif-deleted", "tag": "1a2c6ae9-9f5c-475b-85ea-392152dff5d1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:32.487328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8ecac97-7e82-4241-983d-fc8662094553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8ecac97-7e82-4241-983d-fc8662094553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: request: PUT /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 HTTP/1.1 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 280 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:32.506763 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 03 14:52:32.510727 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:52:32.512559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8ecac97-7e82-4241-983d-fc8662094553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:32.515127 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8ecac97-7e82-4241-983d-fc8662094553 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "PUT /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 400 len: 619 microversion: 2.1 time: 0.040259 Oct 03 14:52:32.517548 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2209/4508] 10.222.0.20 () {60 vars in 1257 bytes} [Mon Oct 3 14:52:32 2022] PUT /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 619 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:52:32.535604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d2928c9e-d461-4a24-af33-7a471480a9d2 req-86ea3241-4c6b-409d-802c-074d5e15abdf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.536200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d2928c9e-d461-4a24-af33-7a471480a9d2 req-86ea3241-4c6b-409d-802c-074d5e15abdf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.536779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.537183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d2928c9e-d461-4a24-af33-7a471480a9d2 req-86ea3241-4c6b-409d-802c-074d5e15abdf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.538948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.562492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.563152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.563708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.564560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.567202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.567799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.575897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d2928c9e-d461-4a24-af33-7a471480a9d2 req-86ea3241-4c6b-409d-802c-074d5e15abdf service nova] Creating event network-vif-deleted:1a2c6ae9-9f5c-475b-85ea-392152dff5d1 for instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 on n-h1-781139-2 Oct 03 14:52:32.589583 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d2928c9e-d461-4a24-af33-7a471480a9d2 req-86ea3241-4c6b-409d-802c-074d5e15abdf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115911 Oct 03 14:52:32.594228 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2300/4509] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:32.601460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.602551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.611954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.612756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.613237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.614681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.615473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.616110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.782503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:32.790361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:32.792723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0563d417-4a88-46cf-b9c1-890685dd40b4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1502 microversion: 2.1 time: 0.271068 Oct 03 14:52:32.794643 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2210/4510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:32.816141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:32.817092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:32.833806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.834315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.837297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.838319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:32.839027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:32.839754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:32.885045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:52:33.044273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:33.051636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.052909 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f1109698-78b0-4efa-8da8-61f7f2886ec8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 204 len: 0 microversion: 2.1 time: 0.240782 Oct 03 14:52:33.054465 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2211/4511] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:32 2022] DELETE /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:52:33.062330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.063366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.066996 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e753d18-caf1-46d7-8e4e-e4bb20fed37e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.471178 Oct 03 14:52:33.069032 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2301/4512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:32 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.072346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.073499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.074222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.075179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.076215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.076732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.078911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.079539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.100552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.113736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.114724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.116025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.116791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.117437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.125628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.126292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.127141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.127682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lazy-loading 'fault' on Instance uuid 931c2fbe-6c74-4e2a-9d69-996fcb544f90 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:33.187741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.195972 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-73409089-b8ce-4e0f-ba89-d6467d8d2478 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1328 microversion: 2.1 time: 0.138992 Oct 03 14:52:33.196581 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2212/4513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.203843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.203843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.209932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.210428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.210876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.212020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.212494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.212940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.395428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.414235 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c01323d6-5a75-4480-841d-dcd423d6df4f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.216432 Oct 03 14:52:33.415126 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2213/4514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.420736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.422139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.429225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.429976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.430598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.432051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.432711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.442417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.500467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.511956 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c618c265-e2ff-45ef-bc9a-b2e0189eda4a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1508 microversion: 2.1 time: 0.441646 Oct 03 14:52:33.514269 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2302/4515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.526152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de8924d6-4f99-4dd6-a89d-0955f94d532c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de8924d6-4f99-4dd6-a89d-0955f94d532c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 HTTP/1.1 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 24 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": ""}} Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37', 'body': {'server': {'name': ''}}} Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '' Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:52:33.530800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de8924d6-4f99-4dd6-a89d-0955f94d532c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de8924d6-4f99-4dd6-a89d-0955f94d532c tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "PUT /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 400 len: 108 microversion: 2.1 time: 0.015766 Oct 03 14:52:33.536230 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2303/4516] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:52:33 2022] PUT /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:52:33.543113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:33.543925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:33.554455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.554959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.555396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.557090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:33.557559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:33.558071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:33.584672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:33.628958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.639987 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ce36d95-5f5f-42eb-b77f-ce72fcf309da tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.223258 Oct 03 14:52:33.640737 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2214/4517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:33.752563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:33.766037 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddcd7b47-f80c-45e3-8e46-85c89acf9afa tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1504 microversion: 2.1 time: 0.228393 Oct 03 14:52:33.766981 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2304/4518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:33 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:34.218996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:34.219697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:34.233723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.234220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.234674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.235377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.235821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.236430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.316000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.318401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.319194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.319729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lazy-loading 'fault' on Instance uuid 931c2fbe-6c74-4e2a-9d69-996fcb544f90 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:34.387443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.398181 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b356439e-f648-430a-a07a-ebaa46cb44f0 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1328 microversion: 2.1 time: 0.183207 Oct 03 14:52:34.399145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2215/4519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:34 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1328 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:34.537720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:34.539145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:34.547564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.548093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.548526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.549434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.550049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.550474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.663706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:34.664550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:34.676687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.686161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.686814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.687773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:34.688411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:34.689263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:34.793235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.808105 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-345e940b-9990-4fc2-82cf-865f25924ae8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1508 microversion: 2.1 time: 0.276201 Oct 03 14:52:34.808856 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2305/4520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:34 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:34.945162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:34.959902 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c590d178-4ea9-4ce1-8c35-0379634e86d9 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.299788 Oct 03 14:52:34.961331 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2216/4521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:34 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:35.425193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:35.425808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:35.433175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.433660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.434787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.434987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.441489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.441939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.510027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.513858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.518629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.521283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lazy-loading 'fault' on Instance uuid 931c2fbe-6c74-4e2a-9d69-996fcb544f90 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:35.611631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd32680b6b342ea962e104cfaf4c311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b183c9eff5e549478b3d8de2fe72ada3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:35.639836 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f491f606-1bfd-4b90-88ec-ed7852ea5998 tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 200 len: 1328 microversion: 2.1 time: 0.218620 Oct 03 14:52:35.642762 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2306/4522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:35 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 1328 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:35.833824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:35.834573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:35.841979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.842534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.843440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.844146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:35.845137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:35.846113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:35.988912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:35.990097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:36.045181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.047872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.048356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.050412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.067325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.068081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.115233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.132812 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ca47ca48-c315-45db-887c-c28736d55d11 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1466 microversion: 2.1 time: 0.302713 Oct 03 14:52:36.134932 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2217/4523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:35 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1466 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:36.266199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3bb959c1-17ae-4f7c-be13-04b5ec4a23d8 req-d7843319-f5f1-4faa-9136-4ad458382ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c08890a-047d-4f3e-9c31-f0851d7e243f", "name": "network-vif-deleted", "tag": "e7d1d159-deea-4b03-b429-f9b80fef594d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:36.282147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3bb959c1-17ae-4f7c-be13-04b5ec4a23d8 req-d7843319-f5f1-4faa-9136-4ad458382ef6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.283033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3bb959c1-17ae-4f7c-be13-04b5ec4a23d8 req-d7843319-f5f1-4faa-9136-4ad458382ef6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.301966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3bb959c1-17ae-4f7c-be13-04b5ec4a23d8 req-d7843319-f5f1-4faa-9136-4ad458382ef6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.334009 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3bb959c1-17ae-4f7c-be13-04b5ec4a23d8 req-d7843319-f5f1-4faa-9136-4ad458382ef6 service nova] Creating event network-vif-deleted:e7d1d159-deea-4b03-b429-f9b80fef594d for instance 5c08890a-047d-4f3e-9c31-f0851d7e243f on n-h1-781139-2 Oct 03 14:52:36.369781 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3bb959c1-17ae-4f7c-be13-04b5ec4a23d8 req-d7843319-f5f1-4faa-9136-4ad458382ef6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108597 Oct 03 14:52:36.372692 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2218/4524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:52:36.395676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-25f66fc7-45b1-4c7b-ac49-46dd695b18a7 req-dc051481-e25e-4ee7-bd96-da2e46f7a61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec3cbb6-07b0-42aa-8617-b2313e173565", "name": "network-vif-plugged", "status": "completed", "tag": "ee44b0f0-e23e-45cb-83b3-1c72c4deb142"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:36.408409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:36.420953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-25f66fc7-45b1-4c7b-ac49-46dd695b18a7 req-dc051481-e25e-4ee7-bd96-da2e46f7a61e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.422833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-25f66fc7-45b1-4c7b-ac49-46dd695b18a7 req-dc051481-e25e-4ee7-bd96-da2e46f7a61e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.423438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-25f66fc7-45b1-4c7b-ac49-46dd695b18a7 req-dc051481-e25e-4ee7-bd96-da2e46f7a61e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.430606 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-329acc0c-8b9e-4251-9531-7d8cbd635a3f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.447628 Oct 03 14:52:36.452901 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2307/4525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:35 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:36.469843 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-25f66fc7-45b1-4c7b-ac49-46dd695b18a7 req-dc051481-e25e-4ee7-bd96-da2e46f7a61e service nova] Creating event network-vif-plugged:ee44b0f0-e23e-45cb-83b3-1c72c4deb142 for instance cec3cbb6-07b0-42aa-8617-b2313e173565 on n-h1-781139-2 Oct 03 14:52:36.480066 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-25f66fc7-45b1-4c7b-ac49-46dd695b18a7 req-dc051481-e25e-4ee7-bd96-da2e46f7a61e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098541 Oct 03 14:52:36.480962 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2219/4526] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:36.664792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:36.665457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] [instance: 931c2fbe-6c74-4e2a-9d69-996fcb544f90] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:36.674302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.675200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.675796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.676694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:36.677413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:36.678217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:36.693912 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] HTTP exception thrown: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 could not be found. Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Request method failure captured: Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 HTTP/1.1 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvSFsPGcfHTyiIVdt9ONxDnLmtREv_MdG2_9wLLGecv0dxj_HABKVJIJwZMg32BcUeg-88n0l_OlMPTus0PqS7uL1gc_aa3dUl-4njIH_WFw8PQpnIWNqnMvrvWrqhBf6wBkgvignqGoulxT_XesLr5FXyHVndy31ho7QskYmDphbUI Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b183c9eff5e549478b3d8de2fe72ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b183c9eff5e549478b3d8de2fe72ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b183c9eff5e549478b3d8de2fe72ada3 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-996527410 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2cd32680b6b342ea962e104cfaf4c311 Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-996527410-project Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 could not be found. Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '931c2fbe-6c74-4e2a-9d69-996fcb544f90'} Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 could not be found. Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 could not be found. Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:36.696041 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:36.700666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:36.700666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:36.700666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:36.700666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:36.700666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:36.700666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 could not be found. Oct 03 14:52:36.700666 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:36.702090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Returning 404 to user: Instance 931c2fbe-6c74-4e2a-9d69-996fcb544f90 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:36.703103 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60aa4bad-4055-4730-a2e1-2d97805224de tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90" status: 404 len: 111 microversion: 2.1 time: 0.043917 Oct 03 14:52:36.704871 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2308/4527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:36 2022] GET /compute/v2.1/servers/931c2fbe-6c74-4e2a-9d69-996fcb544f90 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:36.714681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f1675c5-78ab-4d9f-882f-5064d170b6df tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] Calling method '.version_select at 0x7fb230ee0160>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:36.745743 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f1675c5-78ab-4d9f-882f-5064d170b6df tempest-ServerActionsTestJSON-996527410 tempest-ServerActionsTestJSON-996527410-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182761437" status: 202 len: 0 microversion: 2.1 time: 0.035918 Oct 03 14:52:36.747233 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2220/4528] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182761437 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:52:37.157102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:37.157945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:37.168298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.169349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.170017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.170954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.171632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.172273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.210115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.210981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.211616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.212270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lazy-loading 'fault' on Instance uuid 5c08890a-047d-4f3e-9c31-f0851d7e243f {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:52:37.323996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.337402 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41219b1b-8535-417e-8f2e-ed71b72277df tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 200 len: 1305 microversion: 2.1 time: 0.184232 Oct 03 14:52:37.339542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2309/4529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:37 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 1305 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:37.464160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:37.464812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:37.477419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.478344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.478995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.479904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:37.480563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:37.481965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:37.675962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:37.685078 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80ecb33f-181e-4e2a-b932-45810a6cc7e6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1320 microversion: 2.1 time: 0.226483 Oct 03 14:52:37.688481 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2221/4530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:37 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:38.364491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:38.365133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:38.374032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.374867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.375324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.381747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.382228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.382664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.410752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f HTTP/1.1 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5c08890a-047d-4f3e-9c31-f0851d7e243f'} Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:38.415584 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:38.421230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:38.421230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:38.421230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:38.421230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:38.421230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:38.421230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:52:38.421230 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:38.424623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:38.425723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd7b2522-e597-4e75-ae23-2cfb1ecf609f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 404 len: 111 microversion: 2.1 time: 0.066585 Oct 03 14:52:38.426791 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2310/4531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:38 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:38.561647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-320006565", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fd28a296-d4d0-487d-b766-c66e0eb4645b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:38.643106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] validate_networks() for [('fd28a296-d4d0-487d-b766-c66e0eb4645b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:52:38.707873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:38.708632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:38.716760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.718019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.718751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.720333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.721923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.722662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.890831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:38.899436 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1616805b-af65-48b2-b1c0-c5cf4e2720a6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1511 microversion: 2.1 time: 0.195785 Oct 03 14:52:38.900275 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2311/4532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:38 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:38.923048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:38.923955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:38.930417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.931145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.931788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:38.932657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:38.933291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:38.933943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.149451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.166533 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f470d896-22cf-483c-8f6a-7dc51e99db8f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1511 microversion: 2.1 time: 0.247905 Oct 03 14:52:39.177096 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2312/4533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:38 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:39.192648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:39.193374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:39.212157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.213094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.213807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.214806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.215657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.216914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.469483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.494940 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8321222a-94b8-4b4b-9338-02a621066f41 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 200 len: 1510 microversion: 2.1 time: 0.306506 Oct 03 14:52:39.497629 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2313/4534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:39 2022] GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:39.523619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:39.535775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.537334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:39.579281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.579819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.580654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.581747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.582953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.584087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.641418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:39.641894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:39.642299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:39.642765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:39.643210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:39.662933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.663437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.663883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.666900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.667400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.667848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.711078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:39.718616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for user 3569fcf74b3b4e3d99b0dbcd5465d97d and project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:39.751491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:39.751746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:39.755462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:39.822822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63445796-0f93-4629-8c20-eb747e43e4fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270576 Oct 03 14:52:39.824786 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2222/4535] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:52:39.837377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17f0f84d-4097-4ed9-b4c3-7c707f0622c5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:39.838307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17f0f84d-4097-4ed9-b4c3-7c707f0622c5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:39.895315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.904010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:39.904690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:39.905539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:39.928737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17f0f84d-4097-4ed9-b4c3-7c707f0622c5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:39.937077 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17f0f84d-4097-4ed9-b4c3-7c707f0622c5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1214 microversion: 2.1 time: 0.104701 Oct 03 14:52:39.946242 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2223/4536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:39 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:40.086960 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b20f505-1e88-4859-a902-9df92b6ac8f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.567791 Oct 03 14:52:40.087837 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2314/4537] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 3 14:52:39 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:40.117372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.125906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.126781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1720043906', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:40.140493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.141032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.141592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.142336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.144591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.145061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.312807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:40.451690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:40.474918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.475590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.476206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.647040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.648259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:40.670024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.671882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.675984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.681254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.684089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.685034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.706222 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 HTTP/1.1 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '6c71dba2-a318-4f5e-a8aa-976b28f82201'} Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:40.708311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:40.711861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79a0fb80-c6bf-4c22-ab2c-4abd7164f4ea tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 404 len: 111 microversion: 2.1 time: 0.068364 Oct 03 14:52:40.717484 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2315/4538] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:40 2022] DELETE /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:52:40.724993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.725624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 6c71dba2-a318-4f5e-a8aa-976b28f82201] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:40.741397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.742327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.743051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.744511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.745431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.746068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.766776 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 HTTP/1.1 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '6c71dba2-a318-4f5e-a8aa-976b28f82201'} Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:40.768951 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.772492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:40.772492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:40.772492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:40.772492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:40.772492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:40.772492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. Oct 03 14:52:40.772492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:40.774783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 6c71dba2-a318-4f5e-a8aa-976b28f82201 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:40.774930 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45adb451-d8d7-4026-8767-1fab71c4423f tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201" status: 404 len: 111 microversion: 2.1 time: 0.056549 Oct 03 14:52:40.775835 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2316/4539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:40 2022] GET /compute/v2.1/servers/6c71dba2-a318-4f5e-a8aa-976b28f82201 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:40.795000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:40.795961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:40.809159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.810404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.812218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.815224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:40.815713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:40.816155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:40.893487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:52:41.019588 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a1307e8-cd82-47d2-9034-0adb2703ef61 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 204 len: 0 microversion: 2.1 time: 0.236919 Oct 03 14:52:41.023498 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2317/4540] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:52:40 2022] DELETE /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:52:41.026405 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba802a51-873d-44cc-b864-3a433d8642f2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1720043906" status: 200 len: 1514 microversion: 2.1 time: 0.912698 Oct 03 14:52:41.027392 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2224/4541] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:52:40 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1720043906 => generated 1514 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:41.035189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.036124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:41.047056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.048808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:41.052592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.054011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.055942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.058795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.059623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.060287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.066713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.067523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.068574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.069935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.070598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.071230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.179713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.188553 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f2c5aa0-6b82-4ce7-bdeb-5a32089ab5f6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1266 microversion: 2.1 time: 0.166234 Oct 03 14:52:41.190124 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2318/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:41.195539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.213849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.217452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:41.228108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.229951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.230709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.232484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.233496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.234213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.418385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.427432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:41.429591 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-20826acf-6cce-4e16-9942-a919d8b68a0e tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.398046 Oct 03 14:52:41.430383 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2225/4543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:41.544468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.552717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.553237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.553667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.557029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:41.775139 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ae4d1f5-a00e-481d-8748-2277f9fa8f62 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.583495 Oct 03 14:52:41.776135 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2319/4544] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:41.805622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:41.811816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.814966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.servers [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Removing options 'limit' from query {{(pid=128868) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 14:52:41.816188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:41.830287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.831940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.833285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.839816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.840560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.841128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:41.890242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:41.897112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:41.897596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:41.898030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.219908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.220692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:42.230999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.231490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.232107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.233053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.233508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.234120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.283704 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4c6bf338-4e3f-4a8c-be05-77beadf0a921 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.481905 Oct 03 14:52:42.284592 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2226/4545] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 14:52:41 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:42.310132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.315659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.323535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.329211 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6121a7fd-97c3-40dc-9d23-fb8e2ac55f0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1272 microversion: 2.1 time: 0.114688 Oct 03 14:52:42.329813 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2320/4546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:42.330276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:42.335799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.336278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.336708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.337469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.337921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.338524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.453453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.454079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:42.467229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.469449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:42.470372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.470909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.472230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.472700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.473183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.577271 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f73d551f-1be9-4897-a281-b001fd22da15 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.271399 Oct 03 14:52:42.578195 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2227/4547] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:42.597649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.603553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.604144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.servers [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Removing options 'limit' from query {{(pid=128868) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 14:52:42.604983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:42.611452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.612129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.612683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.613650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.614177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.614712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.645100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:42.654480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:42.688554 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61220394-2d59-44d5-9c61-cfce0e1313d0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.098488 Oct 03 14:52:42.688902 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2228/4548] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:42.704853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.716599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.717671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:42.738047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.738952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.739456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.740438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.741149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.742400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.778382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:42.788456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.799436 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8afccea-af16-45e4-add1-ad22cc131582 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.349803 Oct 03 14:52:42.821625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3250bae4-1a0f-4843-b7d3-190eb2fcd8dc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.124599 Oct 03 14:52:42.823557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2229/4549] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers => generated 1010 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:42.837836 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2321/4550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:42.844747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:42.851203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:42.867970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:42.902739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.903390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.904145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:42.905121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:42.905821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:42.912729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.027228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:43.142033 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4d0e527-db09-4f9f-85ab-adbb113a5fe0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.306624 Oct 03 14:52:43.143166 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2230/4551] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:52:42 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:43.156278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.163530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.164205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.servers [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Removing options 'limit' from query {{(pid=128869) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 14:52:43.179130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:43.187678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.188154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.188580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.191041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.191717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.192304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.228418 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d923fae-5154-479e-b370-e44e72be90bd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.076160 Oct 03 14:52:43.238408 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2322/4552] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:43.242735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.253530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.254217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1720043906', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:52:43.270077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.270558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.271184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.278293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.278848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.279286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.355092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.356087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:43.367606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.369048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.373518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.375167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.375803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.376385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.452331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:52:43.530704 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-786e7042-d37f-450b-97c1-b6d26dec7176 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1720043906" status: 200 len: 346 microversion: 2.1 time: 0.291843 Oct 03 14:52:43.531950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2231/4553] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1720043906 => generated 346 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:52:43.548201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cc32b315-dd42-4a7a-9196-c7f626983441 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:43.557153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc32b315-dd42-4a7a-9196-c7f626983441 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.557153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc32b315-dd42-4a7a-9196-c7f626983441 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.557153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc32b315-dd42-4a7a-9196-c7f626983441 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.585606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cc32b315-dd42-4a7a-9196-c7f626983441 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Going to try to stop instance {{(pid=128868) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:52:43.665346 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cc32b315-dd42-4a7a-9196-c7f626983441 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "POST /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f/action" status: 202 len: 0 microversion: 2.1 time: 0.120247 Oct 03 14:52:43.673516 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2232/4554] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:52:43 2022] POST /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:52:43.689311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:43.692484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:43.710255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.712381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.713944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.715015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:43.715526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:43.716468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:43.976436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:43.991095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-073b4f86-2893-4463-b774-876b36fc0f9c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1314 microversion: 2.1 time: 0.638994 Oct 03 14:52:43.994413 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2323/4555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:44.021231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:44.022081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:44.030280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:44.031273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:44.036142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.036142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:44.036142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:44.036142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.345949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49662fc3f33c425baace58ea7f3e79aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c05dc202214244af424eddbccfb669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.354988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6a596b1-c566-4a93-9665-3dcfd44817ef tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 200 len: 1510 microversion: 2.1 time: 0.358786 Oct 03 14:52:44.355633 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2324/4556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:44.441412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:44.470102 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-360f5339-f274-49ed-8ab5-238f5de2bd9e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.788419 Oct 03 14:52:44.471699 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2233/4557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:43 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:44.656801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-52473d4c-20db-4841-8286-24d7cd0eef75 req-8eadfca6-19ec-4160-a014-fe925e7f9a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abef3-5a4d-48c8-89e6-63862eb6bf37", "name": "network-vif-deleted", "tag": "7abe5823-b304-4057-b497-e2f4b020ff05"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:44.666915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-52473d4c-20db-4841-8286-24d7cd0eef75 req-8eadfca6-19ec-4160-a014-fe925e7f9a92 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:44.667646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-52473d4c-20db-4841-8286-24d7cd0eef75 req-8eadfca6-19ec-4160-a014-fe925e7f9a92 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:44.668503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-52473d4c-20db-4841-8286-24d7cd0eef75 req-8eadfca6-19ec-4160-a014-fe925e7f9a92 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:44.683459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-52473d4c-20db-4841-8286-24d7cd0eef75 req-8eadfca6-19ec-4160-a014-fe925e7f9a92 service nova] Creating event network-vif-deleted:7abe5823-b304-4057-b497-e2f4b020ff05 for instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 on n-h2-781139-2 Oct 03 14:52:44.689231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-52473d4c-20db-4841-8286-24d7cd0eef75 req-8eadfca6-19ec-4160-a014-fe925e7f9a92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036736 Oct 03 14:52:44.690518 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2325/4558] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:45.018053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:45.018670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:45.027180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.028067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.028692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.029787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.030885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.031609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.287564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:45.297581 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83ce26a2-cb5e-4578-a93d-f7d1bbeacefc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1314 microversion: 2.1 time: 0.283317 Oct 03 14:52:45.298672 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2234/4559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:45 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:45.380791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:45.381556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] [instance: 1a5abef3-5a4d-48c8-89e6-63862eb6bf37] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:45.390911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.393487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.394216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.395199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.395840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.396337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.423612 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] HTTP exception thrown: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 could not be found. Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Request method failure captured: Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 HTTP/1.1 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvY8ffudoytzaw1o_twpzdWk-TWVKAgdroIrecFeBHPpcU5TzPPHwICRqaCoI5DC4cHONt_Ev_A09xD3DoZH1jxoaLO8OHu-XC-h53jojgif8_B8mO0fDj7yuIlF45W4gBERu7k0KVIIbiQQA64x9078P7BRVbkjJhDzjNycKj2ogQk Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59c05dc202214244af424eddbccfb669"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59c05dc202214244af424eddbccfb669", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59c05dc202214244af424eddbccfb669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 59c05dc202214244af424eddbccfb669 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-190961548 Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 49662fc3f33c425baace58ea7f3e79aa Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-190961548-project Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 could not be found. Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1a5abef3-5a4d-48c8-89e6-63862eb6bf37'} Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 could not be found. Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 could not be found. Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:52:45.426197 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 could not be found. Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:52:45.430795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] Returning 404 to user: Instance 1a5abef3-5a4d-48c8-89e6-63862eb6bf37 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:52:45.432809 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-346df697-2876-44a9-ae2a-d8b36f183141 tempest-ServersNegativeTestJSON-190961548 tempest-ServersNegativeTestJSON-190961548-project] 10.222.0.20 "GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37" status: 404 len: 111 microversion: 2.1 time: 0.057161 Oct 03 14:52:45.433554 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2326/4560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:45 2022] GET /compute/v2.1/servers/1a5abef3-5a4d-48c8-89e6-63862eb6bf37 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:52:45.495833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:45.496870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:45.503979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.504707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.505180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.506210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:45.506837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:45.507410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:45.780380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:45.789159 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-64bb35d9-a25c-41bb-8614-b5bdbfe5daee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.297317 Oct 03 14:52:45.789904 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2235/4561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:45 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:46.206869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1880175931", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:46.267266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:46.267691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:46.268160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:46.268572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:46.269011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:46.278148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.278622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.279064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.279934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.280592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.280817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.298481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Getting quotas for project aaa0d1e1b38a46c1b028621abb706c69. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:46.303704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Getting quotas for user 511f515be0a848019a486d4ee1e6052d and project aaa0d1e1b38a46c1b028621abb706c69. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:46.316398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:52:46.318665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:52:46.325620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:46.326320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:46.337112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.337993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.338779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.340161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.341132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.341792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.372458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7726ebc-5985-4d25-ba8c-5f40a9d721bb tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.303567 Oct 03 14:52:46.375924 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2327/4562] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:52:46.389633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f1d1f9e-7183-41ce-94ab-9fafc3ba8312 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:46.390266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f1d1f9e-7183-41ce-94ab-9fafc3ba8312 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:46.404332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:46.503739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f1d1f9e-7183-41ce-94ab-9fafc3ba8312 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:46.516262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f1d1f9e-7183-41ce-94ab-9fafc3ba8312 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:46.517998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f1d1f9e-7183-41ce-94ab-9fafc3ba8312 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:46.520660 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f1d1f9e-7183-41ce-94ab-9fafc3ba8312 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1278 microversion: 2.54 time: 0.137431 Oct 03 14:52:46.522349 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2328/4563] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:46 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:46.542634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:46.551498 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6abb7f57-e11e-4ac9-b5cc-66dc0d9f479e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1314 microversion: 2.1 time: 0.232574 Oct 03 14:52:46.552742 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2236/4564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:46 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:46.745443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9ab5a9c9-3f43-48a4-b72e-d2c4f0eff9eb req-cbe2f5fd-e8ff-4202-81ec-8f99972f238c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce664a9-2425-4660-a623-ed8f73ee21dd", "tag": "695e9625-fef2-499f-9dfd-3dbd7d91e1a5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:46.756762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ab5a9c9-3f43-48a4-b72e-d2c4f0eff9eb req-cbe2f5fd-e8ff-4202-81ec-8f99972f238c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.757311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ab5a9c9-3f43-48a4-b72e-d2c4f0eff9eb req-cbe2f5fd-e8ff-4202-81ec-8f99972f238c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.757746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ab5a9c9-3f43-48a4-b72e-d2c4f0eff9eb req-cbe2f5fd-e8ff-4202-81ec-8f99972f238c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.770302 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9ab5a9c9-3f43-48a4-b72e-d2c4f0eff9eb req-cbe2f5fd-e8ff-4202-81ec-8f99972f238c service nova] Creating event network-changed:695e9625-fef2-499f-9dfd-3dbd7d91e1a5 for instance 1ce664a9-2425-4660-a623-ed8f73ee21dd on n-h1-781139-2 Oct 03 14:52:46.776208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9ab5a9c9-3f43-48a4-b72e-d2c4f0eff9eb req-cbe2f5fd-e8ff-4202-81ec-8f99972f238c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047731 Oct 03 14:52:46.776981 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2329/4565] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:46.815246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:46.816679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:46.830390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.835422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.836060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:46.836827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:46.837326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:46.837858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.047451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.055441 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fbc10046-f2b1-436d-85ca-93353d65efe6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.245457 Oct 03 14:52:47.056039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2237/4566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:46 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:47.555281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:47.556091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:47.566631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.567695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.569764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.570553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.571031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.574852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.575840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:47.576554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:47.586867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.587674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.588322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.589287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:47.590151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:47.590957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:47.680278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.694564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.697566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.699277 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a00a839-215a-44a6-90e5-a1abfe3c5785 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1330 microversion: 2.54 time: 0.152541 Oct 03 14:52:47.705741 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2330/4567] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:47 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1330 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:47.837358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:47.855093 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-548eb0b1-078d-4559-bbf6-4f8a0631cce9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1314 microversion: 2.1 time: 0.283940 Oct 03 14:52:47.858224 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2238/4568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:47 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:48.080746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.081383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.088041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.088725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.089324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.090199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.090795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.091358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.295761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.304466 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-163da9a4-ba2b-4320-bba3-fdac95099268 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.227429 Oct 03 14:52:48.306577 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2331/4569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:48.735999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.736554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.743834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.744620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.745138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.746091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.746810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.747211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.838863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.848940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.850847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:48.852321 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bf96df68-e88d-4581-82e1-98b687981c34 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1336 microversion: 2.54 time: 0.120394 Oct 03 14:52:48.853576 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2239/4570] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:48.882126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:48.884319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:48.899616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.900044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.900482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:48.904725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:48.907532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:48.908217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.164049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.176682 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a8ae294-d6ea-4d5a-9374-3bfa9c5702c2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1314 microversion: 2.1 time: 0.298832 Oct 03 14:52:49.177312 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2332/4571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:48 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:49.331415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:49.332612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:49.343142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.349814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.350429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.351488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.352174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.352664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.636608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:49.645228 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c952320-e5d8-4d3a-9b2e-5b05bfdb534a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.318614 Oct 03 14:52:49.646022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2240/4572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:49 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:49.885208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:49.886813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:49.899918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.903250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.903933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:49.905120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:49.906206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:49.908274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.034847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.046660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.048427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.050129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67faba90-cdec-49e3-b143-a7c63f698aac tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1336 microversion: 2.54 time: 0.169875 Oct 03 14:52:50.051020 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2333/4573] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:49 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1336 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:52:50.201961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:50.202534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:50.209947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.210452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.210881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.211591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.212197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.212636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.458887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.469171 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-987029ec-6024-49c6-8562-08e6f76d169d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1314 microversion: 2.1 time: 0.270689 Oct 03 14:52:50.475240 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2241/4574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:50 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:50.636002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dfe7eb8a-f5ff-448c-9350-48f9215f46e9 req-86712673-f78d-491d-b089-5d7fed39f13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce664a9-2425-4660-a623-ed8f73ee21dd", "name": "network-vif-plugged", "status": "completed", "tag": "695e9625-fef2-499f-9dfd-3dbd7d91e1a5"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:50.655303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dfe7eb8a-f5ff-448c-9350-48f9215f46e9 req-86712673-f78d-491d-b089-5d7fed39f13f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.655872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dfe7eb8a-f5ff-448c-9350-48f9215f46e9 req-86712673-f78d-491d-b089-5d7fed39f13f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.656304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dfe7eb8a-f5ff-448c-9350-48f9215f46e9 req-86712673-f78d-491d-b089-5d7fed39f13f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.668694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:50.669685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:50.678612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.679442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.680279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.681749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:50.682899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:50.683646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:50.693809 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dfe7eb8a-f5ff-448c-9350-48f9215f46e9 req-86712673-f78d-491d-b089-5d7fed39f13f service nova] Creating event network-vif-plugged:695e9625-fef2-499f-9dfd-3dbd7d91e1a5 for instance 1ce664a9-2425-4660-a623-ed8f73ee21dd on n-h1-781139-2 Oct 03 14:52:50.699493 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dfe7eb8a-f5ff-448c-9350-48f9215f46e9 req-86712673-f78d-491d-b089-5d7fed39f13f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066824 Oct 03 14:52:50.700254 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2334/4575] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:50.927154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:50.929991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:50.937777 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-364bd74a-b530-471b-9ff2-190616f6aaac tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.273616 Oct 03 14:52:50.940628 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2242/4576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:50 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:51.080113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:51.081441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.091175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.091777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.092221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.092963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.093564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.093955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.418762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.432216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.435394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.436703 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd030735-5ce3-427e-b7a7-7ddc25925be3 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1357 microversion: 2.54 time: 0.362701 Oct 03 14:52:51.453411 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2335/4577] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:51 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1357 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:51.466194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5385c95a-3a41-4317-b412-860f9641143c tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Action: 'create', calling method: .version_select at 0x7fb2302820d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-461227251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZkM83ArwDsUA4klQWiBAkYXNIJQeD6l+ZaWQWvbshX5kTSh9AdBsOkWMWIENuRQWTaqtRGToOhjHn4FEdIgvngyx8HesZWgrYSABlyxG1tvpcp/762liMw8d0INPslfA=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:51.486017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5385c95a-3a41-4317-b412-860f9641143c tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Getting quotas for project aaa0d1e1b38a46c1b028621abb706c69. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:52:51.491287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5385c95a-3a41-4317-b412-860f9641143c tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Getting quotas for user 511f515be0a848019a486d4ee1e6052d and project aaa0d1e1b38a46c1b028621abb706c69. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:52:51.492749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:51.503723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:51.504387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.512365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.512859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.513350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.514208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.515115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.515546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.521387 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5385c95a-3a41-4317-b412-860f9641143c tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.059202 Oct 03 14:52:51.522198 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2243/4578] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:52:51 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 03 14:52:51.534251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-461227251", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:51.537207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.544592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.545136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.545577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.546550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.547246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.547909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.641870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:52:51.642560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:52:51.643220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:52:51.644168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:52:51.644591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:52:51.691958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.700961 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dec47c24-a19e-4a67-af4e-777d90e62531 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1314 microversion: 2.1 time: 0.204693 Oct 03 14:52:51.701681 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2336/4579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:51 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:51.734359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.741152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.741637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.742070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.742776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.743379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.743844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.776633 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03e74827-a815-49a2-ad6b-60075ab9f4dd tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "POST /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169/action" status: 202 len: 1139 microversion: 2.54 time: 0.246612 Oct 03 14:52:51.777950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2244/4580] 10.222.0.20 () {62 vars in 1320 bytes} [Mon Oct 3 14:52:51 2022] POST /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169/action => generated 1139 bytes in 249 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 03 14:52:51.798683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:51.799745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.807317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.807882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.808781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.809642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.810169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.810655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.895854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.908082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.909709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:51.911563 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36ce65a4-16e1-4a77-9aa0-40dce204cf97 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.117960 Oct 03 14:52:51.912157 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2337/4581] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:51 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:51.963569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:51.964252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:51.972867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.973599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.974093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:51.975038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:51.975595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:51.976141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.166793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:52.177220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d6fb00c4-37b0-410a-9275-aab18e66f552 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.217336 Oct 03 14:52:52.178042 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2245/4582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:51 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:52.724489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:52.725757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:52.736400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.736827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.745555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.746929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.747488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.747931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.939155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:52.940343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:52.951252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.955579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.956355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:52.957296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:52.957762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:52.958198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.093962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.107888 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e413ae2e-6ece-4e45-b764-0b09232aab9e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1501 microversion: 2.1 time: 0.387563 Oct 03 14:52:53.108816 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2338/4583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:52 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1501 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:53.201947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:53.202946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:53.216046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.218090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.220043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.221012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:53.222321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:53.224088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:53.354006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=16 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:53.445658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.455754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.462301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.465212 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-797f430e-abf1-471e-8c26-9cc8a8d4157f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.529995 Oct 03 14:52:53.465818 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2246/4584] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:52 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:53.958892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:53.969021 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b9a10f6-e6d6-4265-b2a1-0c78426c0c69 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.771401 Oct 03 14:52:53.975504 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2339/4585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:53 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:52:54.495826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:54.497093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:54.504765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.505485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.506075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.506962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:54.507558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:54.508318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:54.599170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.609504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.611278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:54.612589 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9fb12f7b-5c3f-419d-b89f-29e205786e55 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.121520 Oct 03 14:52:54.613320 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2247/4586] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:54 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:54.994285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:54.996937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:55.012908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.013568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.013994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.014980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.015431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.015847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.192615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.203719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c8967dd-3e41-4f16-aee7-57ee7d22ac8c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.215012 Oct 03 14:52:55.216955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2340/4587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:54 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:55.642361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:55.644060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:55.651786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.653113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.654110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.655240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.655888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.656497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.754998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.778923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.781638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:55.784241 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25b15471-234e-4843-9c9d-df5befd72a7f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.146898 Oct 03 14:52:55.794295 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2248/4588] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:55 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:55.961675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01d6bc54-7f5e-4099-b37a-8e4a6715b785"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:52:55.964645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:55.971251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.972051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.972712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.973661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:55.974328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:55.974951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:55.994026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:56.230005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:56.231283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:56.243435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.244488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.245933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.246807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.248918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.249871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.291380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:56.396113 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-068527b7-df83-4775-9f91-2cc4db5e3666 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436935 Oct 03 14:52:56.397508 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2341/4589] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:52:55 2022] POST /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:52:56.472121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.485924 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-af9e65ef-9718-4b9e-9240-420998f39bba tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.257375 Oct 03 14:52:56.497263 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2249/4590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:56 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:56.808720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:52:56.817387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:56.818844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:56.828656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.829237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.831512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.833473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:56.834125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:56.834963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:56.928195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.942999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.945620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:56.949779 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c49edb91-ce13-4f72-acad-df38680df68a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.139721 Oct 03 14:52:56.950540 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2342/4591] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:56 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:57.511650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:57.512944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:57.522393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.524577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.525582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.526673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:57.528726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:57.529480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:57.840291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:57.850246 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.342515 Oct 03 14:52:57.850848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2250/4592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:57 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:57.990949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:57.991572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:58.001835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.005246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.005886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.006775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.007383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.008077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.112151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.121886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.123361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:58.124975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e697bc74-7ea5-42c7-b9cc-9e499433567d tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.151204 Oct 03 14:52:58.128055 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2343/4593] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:57 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:52:58.161952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:58.162939 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b31d8474-536b-4bc2-9ba8-0dd6e23e870e tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001352 Oct 03 14:52:58.163282 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2251/4594] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 3 14:52:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 03 14:52:58.874006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:58.875000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:58.885259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.885861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.886476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:58.898499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:58.900159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:58.902472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.092497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.105533 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89fdb4a0-94b5-48f0-aa6b-114afe42ea3d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.234052 Oct 03 14:52:59.106361 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2344/4595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:52:58 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:52:59.160288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:52:59.161075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:52:59.170294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.171144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.171867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.172573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:52:59.173186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:52:59.173611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:52:59.271876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.287718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.290302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:52:59.292778 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8a8de266-70a8-4ba3-8c80-bd4252eeb759 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.139187 Oct 03 14:52:59.294223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2252/4596] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:52:59 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:00.131768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:00.133269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:00.140787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.141612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.142272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.143354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.144040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.144662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.310033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.318223 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4a48344-086e-4d31-866b-22f86b577ba2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.190342 Oct 03 14:53:00.333975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:00.333975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:00.333975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.335068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.335595 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2345/4597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:00 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:00.335725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.336334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:00.336795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:00.337251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:00.502233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.512050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.517978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:00.519819 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7053bb97-65aa-4b7e-91a8-576b25051853 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.202113 Oct 03 14:53:00.521008 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2253/4598] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:00 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:01.341903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:01.343048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:01.353535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.354031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.354473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.355297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.355752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.356183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.502181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.510677 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28ccea06-8078-4582-9528-bd82f4110747 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.172744 Oct 03 14:53:01.511741 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2346/4599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:01 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:01.549988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:01.550698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:01.553753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=16 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:01.559259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.559833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.560336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.561161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:01.561681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:01.562176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:01.681054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.705425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.709074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:01.711564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ccba7cc1-1f17-4b3c-ae30-5d2b86e57592 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.165577 Oct 03 14:53:01.717678 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2254/4600] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:01 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:02.535318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:02.536051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:02.546568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.547239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.547759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.550275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.550958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.551574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.748033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:02.748707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:02.763343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.763755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.766604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.767810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:02.769445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:02.771390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:02.825736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:02.837986 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ed01d4b-e5d8-4bb9-b83e-a35b5a80d3cc tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.306871 Oct 03 14:53:02.853637 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2347/4601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:02 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:02.871373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:02.885517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:02.887288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:02.888603 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3346fca0-7ab3-477f-a62b-691e8d3cae8f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.147114 Oct 03 14:53:02.889308 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2255/4602] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:02 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:03.596707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:03.597435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:03.605017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.605560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.605984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.606696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.607143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.607699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.632462 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8d6832a-3d36-4f9f-a5c5-e8e5f0f3caeb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/ips" status: 200 len: 152 microversion: 2.20 time: 0.039582 Oct 03 14:53:03.639689 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2348/4603] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Oct 3 14:53:03 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:53:03.880284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:03.894080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:03.902323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.903054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.903663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.904481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:03.905447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:03.905870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:03.954185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4e7322f3-4a9d-4975-90a1-a3097082abdc tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Action: 'create', calling method: .version_select at 0x7fb2301ecf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1447939560"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:04.160031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:04.169264 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43058839-396f-41ee-9bc5-6a9935cc6824 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1521 microversion: 2.1 time: 0.304924 Oct 03 14:53:04.170098 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2349/4604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:03 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:04.179020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:04.182143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:04.205887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.206392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.206830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.207618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:04.207995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:04.208416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:04.280973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:04.291777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:04.293816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:04.295031 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26842e77-9402-4c6f-b8ab-366026da5abf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.123919 Oct 03 14:53:04.301444 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2350/4605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:04 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:04.427238 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4e7322f3-4a9d-4975-90a1-a3097082abdc tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.670859 Oct 03 14:53:04.428204 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2256/4606] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Oct 3 14:53:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 672 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 03 14:53:04.442645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6933f50-43f4-4f67-875e-390d0d0b630c tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb230a20310>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:04.505113 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6933f50-43f4-4f67-875e-390d0d0b630c tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 200 len: 345 microversion: 2.1 time: 0.066844 Oct 03 14:53:04.506492 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2351/4607] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:53:04 2022] GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:05.195216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.196723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:05.205890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.206570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.207180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.207878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.208324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.208738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.330965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.331736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:05.366286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.366869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.367343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.368070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.369878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.373309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.494856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:05.495422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:05.505864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-21083fa1-c5a6-418f-ae6b-32b45e9c591d tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1498 microversion: 2.1 time: 0.314906 Oct 03 14:53:05.507224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:05.507555 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2257/4608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1498 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:05.509227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:05.511008 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eeff4920-fac1-4bbb-b5a6-8146905f7f77 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.188264 Oct 03 14:53:05.526645 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2352/4609] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:05.530745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-68e4693e-7405-42fc-aa2d-c6501e5f9957 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb2300db700>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.538388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.560188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:05.562201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:05.575172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.577336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.578163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.579002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.580679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.581135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.612641 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-68e4693e-7405-42fc-aa2d-c6501e5f9957 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 200 len: 345 microversion: 2.1 time: 0.087441 Oct 03 14:53:05.613261 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2258/4610] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:05.629090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:05.644287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:05.645287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:05.654362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.657018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.657995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.659255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.661110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.661913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.690274 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4eca2c6f-a0e5-4e05-8ee3-eae96280d6b0 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.159353 Oct 03 14:53:05.697541 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2353/4611] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:05.697757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lazy-loading 'flavor' on Instance uuid b9ea3c31-c873-4937-b6cc-ebd75656c505 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:05.703171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1af1969a-551e-47c8-ba1b-973b3d6bd727 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:05.710073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1af1969a-551e-47c8-ba1b-973b3d6bd727 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.710571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1af1969a-551e-47c8-ba1b-973b3d6bd727 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.711009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1af1969a-551e-47c8-ba1b-973b3d6bd727 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.739034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1af1969a-551e-47c8-ba1b-973b3d6bd727 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Going to try to start instance {{(pid=128869) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 14:53:05.777962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:05.792651 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1af1969a-551e-47c8-ba1b-973b3d6bd727 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "POST /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f/action" status: 202 len: 0 microversion: 2.1 time: 0.092912 Oct 03 14:53:05.793606 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2354/4612] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:53:05 2022] POST /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:53:05.802257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:05.803204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:05.811743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.812482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.813867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:05.814689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:05.815339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:05.815821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.015456 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7129eddc-ab6b-45d0-80d7-9475fef787fa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/action" status: 202 len: 0 microversion: 2.20 time: 0.374554 Oct 03 14:53:06.023123 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2259/4613] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:53:05 2022] POST /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:53:06.032141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:06.033172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:06.040693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.042755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.043597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.044725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.060683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.062037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.087499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.097803 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc49513d-e268-4dc5-a951-afd4e49938f6 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1507 microversion: 2.1 time: 0.299026 Oct 03 14:53:06.116061 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2355/4614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:05 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:06.337760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.358994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.362955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.364846 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6e09e57a-86c4-4062-a38f-82dbc76de685 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.339254 Oct 03 14:53:06.382458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2260/4615] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:06 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:06.543254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:06.543882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:06.550698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.554490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.555014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.555634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:06.556089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:06.556512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:06.625851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.628192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:06.629247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f7b8e6b-06a0-4c84-a548-78558d9c3a1d tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb230276430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:06.641131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.645477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:06.646999 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0fd17e32-450f-4c9e-9f10-b6fa5939dfd6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.107516 Oct 03 14:53:06.647616 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2356/4616] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:06 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:06.697341 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f7b8e6b-06a0-4c84-a548-78558d9c3a1d tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 200 len: 346 microversion: 2.1 time: 0.073214 Oct 03 14:53:06.698022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2261/4617] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:53:06 2022] GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:06.711611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-935078a6-b0e4-46f8-a512-969ab1fdd205 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Action: 'create', calling method: .version_select at 0x7fb22bb2d8b0>, body: {"snapshot": {"volume_id": "5cc167e1-f81d-42e7-8a6e-e3029bfec013", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-309005928"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:06.902738 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-935078a6-b0e4-46f8-a512-969ab1fdd205 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.195036 Oct 03 14:53:06.903427 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2357/4618] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Oct 3 14:53:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:06.914752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb6c4fb1-1653-4d0d-954c-279a339c44f9 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb2301f0550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:06.984204 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb6c4fb1-1653-4d0d-954c-279a339c44f9 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 200 len: 286 microversion: 2.1 time: 0.073489 Oct 03 14:53:06.985248 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2262/4619] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:53:06 2022] GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:06.997371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-08659148-9453-4400-8014-19e97c546b40 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb230231b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:07.044254 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-08659148-9453-4400-8014-19e97c546b40 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.051274 Oct 03 14:53:07.045310 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2358/4620] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 3 14:53:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:07.057292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b72b7cc-06f4-4fe4-afa4-49b39297ff79 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb2301f0ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:07.089763 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b72b7cc-06f4-4fe4-afa4-49b39297ff79 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 200 len: 286 microversion: 2.1 time: 0.036494 Oct 03 14:53:07.090512 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2263/4621] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:53:07 2022] GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:07.124820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:07.125775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:07.134877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.135965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.136876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.137904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.138511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.139089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.320209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.330373 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30f8e850-7779-4481-8b3a-b4503e7ae969 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1507 microversion: 2.1 time: 0.209992 Oct 03 14:53:07.331793 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2359/4622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:07 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:07.394445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:07.395785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:07.404458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.404968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.405417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.406121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.406749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.407327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.571901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.581124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.583069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.584310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de6c55dc-6745-4ef0-9640-bde72da5f3aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.194414 Oct 03 14:53:07.585013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2264/4623] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:07 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:07.674285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:07.675365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:07.683699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.684228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.684914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.685694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:07.686149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:07.686573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:07.762627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.772182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.773973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:07.775510 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ac833da-ca21-4b5a-a027-f822ab771823 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.105935 Oct 03 14:53:07.776179 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2360/4624] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:07 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:08.102889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ac4dcae-1f6b-4eaa-ad5a-fa337f2ced1f tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb230276dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.135007 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ac4dcae-1f6b-4eaa-ad5a-fa337f2ced1f tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 200 len: 286 microversion: 2.1 time: 0.035968 Oct 03 14:53:08.135648 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2265/4625] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:08.365226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.365226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.372534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.373740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.373740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.374683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.375135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.375919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.536536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.554302 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f6dee25-2076-4c58-a031-bb0790499c5a tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1511 microversion: 2.1 time: 0.199330 Oct 03 14:53:08.554903 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2361/4626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:08.594485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.604648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.605476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.servers [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Removing options 'limit' from query {{(pid=128868) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 14:53:08.608062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:08.613155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.614119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.614692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.615337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.615728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.616536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.622237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.622976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.623686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.625105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.625320 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a09de27e-200e-43a4-9c44-ceba71a8cc8b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.043762 Oct 03 14:53:08.625921 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2266/4627] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:53:08.626645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.628059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.628957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.629707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.639498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.640210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.648305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.648892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.649459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.650239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.650763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.651255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.786024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.797429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.798905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.800484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.802043 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a56c9acf-8009-4e6b-b16e-25bb75276771 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.195095 Oct 03 14:53:08.802793 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2362/4628] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:08.807547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.808628 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ca427fb-5865-42a7-aad0-28ab9be55d48 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1511 microversion: 2.1 time: 0.172974 Oct 03 14:53:08.808846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.809712 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2267/4629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:08.815120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.815594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.816191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.817068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.817664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.818250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.841696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:08.842401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:08.850112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.851061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.852622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.853648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:08.854757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:08.855185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:08.900052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.908797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.910361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:08.911775 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f87d58ae-3c97-420e-a2a3-5e41239b99b6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.107754 Oct 03 14:53:08.912324 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2363/4630] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:09.020221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.028275 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e7c650c-4927-4188-b935-fad3cb746ea2 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 200 len: 1510 microversion: 2.1 time: 0.191324 Oct 03 14:53:09.028848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2268/4631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:08 2022] GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:09.050404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.051144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.057434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.058035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.058478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.059180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.059644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.060062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.147964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3a0a4e10-abb9-4b76-8b66-bf470bdb5bad tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb2301f0430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.179156 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3a0a4e10-abb9-4b76-8b66-bf470bdb5bad tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 200 len: 287 microversion: 2.1 time: 0.035256 Oct 03 14:53:09.180416 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2269/4632] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:09.191023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-af3777eb-e40d-4a63-af61-8ca43f8e0921 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb23067dee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.209696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.217916 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a4c3adc-1f94-41a7-96c0-e74952d004ef tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1511 microversion: 2.1 time: 0.171445 Oct 03 14:53:09.218505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2364/4633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:09.239849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.244898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.245672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:09.277741 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-af3777eb-e40d-4a63-af61-8ca43f8e0921 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 202 len: 0 microversion: 2.1 time: 0.090330 Oct 03 14:53:09.278174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2270/4634] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 3 14:53:09 2022] DELETE /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:53:09.287207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bd1d0bc1-627a-45f0-b893-f8c7a655f6e1 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb230304b80>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.322686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bd1d0bc1-627a-45f0-b893-f8c7a655f6e1 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 200 len: 286 microversion: 2.1 time: 0.040163 Oct 03 14:53:09.323849 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2271/4635] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:09.362078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.362599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.363034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.363769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.364217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.364637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.456987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:09.518662 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06ccc8bd-71d9-4072-b464-c13fc162d3bf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.282632 Oct 03 14:53:09.519292 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2365/4636] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:09.532592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.533288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.539915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.540413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.540835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.541564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.542286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.542482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.716551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.726046 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b750841a-d7b9-4a8d-805d-8c0fc0604ba1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1511 microversion: 2.1 time: 0.197266 Oct 03 14:53:09.735549 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2272/4637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:09.749759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.751142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.761981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.763103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.763809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.764955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.765549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.766144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.772166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.772906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.780977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.782109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.782928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.784327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.785236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.785874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.817452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:09.935756 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b65d4c1-5335-4566-8501-4b29837af7b1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 204 len: 0 microversion: 2.1 time: 0.167769 Oct 03 14:53:09.936560 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2273/4638] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:09 2022] DELETE /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:53:09.945090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.945798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.952881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.953390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.953545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:09.954481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.955502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.956304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.956878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.966181 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d782a44b-72fe-4e9b-b035-d59355d19430 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 200 len: 1510 microversion: 2.1 time: 0.219373 Oct 03 14:53:09.967094 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2366/4639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:09.971549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:09.972154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:09.978626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.979168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.979817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:09.981679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:09.982296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:09.983317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.072780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.084378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.086601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.088570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe4daafe-1f5f-4f03-a178-e7e35ef29b38 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.120386 Oct 03 14:53:10.090055 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2367/4640] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:10.094890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.095828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:10.102247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.103176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.103840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.104806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.105542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.106119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.136546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.146342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.154348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.155910 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a25101e6-d471-4b99-afa9-970c59892bce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.215133 Oct 03 14:53:10.157024 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2274/4641] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:09 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:10.162634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.163325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:10.171795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.172418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.173849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.174904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.175463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.175987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.263421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.277807 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68e5fa94-d3cd-4218-ac46-c63a52f7925a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1553 microversion: 2.1 time: 0.186514 Oct 03 14:53:10.278402 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2368/4642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:10.335760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8fafa42d-c536-4bdd-bdf5-c78a5c5eeb8b tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb234bd6a60>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.345248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.356569 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ad9bc79-b5f6-456c-9ce3-87af0170c9ea tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1511 microversion: 2.1 time: 0.198212 Oct 03 14:53:10.358157 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2275/4643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1511 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:10.370189 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8fafa42d-c536-4bdd-bdf5-c78a5c5eeb8b tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 200 len: 286 microversion: 2.1 time: 0.038141 Oct 03 14:53:10.370908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2369/4644] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:10.380962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.387379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.388419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:10.394931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.395592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.396467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.397148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.397668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.398193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.436027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:10.474442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.483392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.483917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.484299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.643595 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f92d8a9a-8ab4-492a-9acf-ebe8f63c2d4c tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.266724 Oct 03 14:53:10.645224 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2276/4645] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:10.672826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.680443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.681601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:10.754060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.756747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.756747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.756747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.757221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.757732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.788685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:10.821671 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1875d4e-d4f0-44d7-9e42-08be6357526f tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.152610 Oct 03 14:53:10.822273 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2370/4646] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:10.836281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:10.841804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:10.842550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:10.848056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.848670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.849228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.850185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:10.850706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:10.851192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:10.938123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:10.997531 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a550622-ff7a-4b8a-a234-c4629f3b3a82 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.165100 Oct 03 14:53:11.005713 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2277/4647] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 3 14:53:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:11.012116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.017267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.017934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:11.023540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.024018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.024447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.025194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.025649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.026071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.115865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.116155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:11.116366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:11.126413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.126899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.127567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.128266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.128707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.129188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.175944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7f5a3d6-47c1-4ced-978e-bd3baef727ee tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.168736 Oct 03 14:53:11.176546 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2371/4648] 10.222.0.20 () {58 vars in 1196 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:11.185747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.186369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:11.192497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.193017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.193460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.195916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.195916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.195916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.203248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.211780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.213474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.215042 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e4875fb-c359-4497-9c7e-e79ddc044e26 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.103311 Oct 03 14:53:11.229195 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2278/4649] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:11.238415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.243373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.244047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'name': '1720043906', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:11.250071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.250555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.250985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.251692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.252131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.252546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.343237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.352382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.356108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.357480 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ecefec32-8b9a-44e8-8b49-acc4d5e6df4e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.175885 Oct 03 14:53:11.358270 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2372/4650] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:11.364616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.365257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:11.372710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.373450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.374710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.375584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.376054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.376688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.533396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.542287 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f85e5c73-ede3-4ba1-807a-9a70740260dd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1553 microversion: 2.1 time: 0.182914 Oct 03 14:53:11.542883 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2373/4651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:11.563462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54b90584-c610-4276-b380-2d543a07228a tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb22bb2d4c0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.590112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-54b90584-c610-4276-b380-2d543a07228a tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] HTTP exception thrown: Snapshot 9d4a5bec-25c6-4198-8683-9ba46aa38b7d could not be found. Oct 03 14:53:11.613371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54b90584-c610-4276-b380-2d543a07228a tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Request method failure captured: Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d HTTP/1.1 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvdPmbp3cm2sjR-hpyM0M5U_iQvKYIgu40K0dBUAioccP-FMaPNFKZ3_joFnB4RpRbKat27bIoQGwmmIhQCGjgrjoee36Sj2oHSzFp7blwr-4JR0JJL2-lWddrUcO23Qf4LRH2AVu5d0keF2Xakc9euqC134hJ6kqStB_hQdk3BG24M Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef2d7fba4810415fb9fbec2540177325", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1d8a048d937d48648df3c170660ead08 Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: exception: Snapshot 9d4a5bec-25c6-4198-8683-9ba46aa38b7d could not be found. Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '9d4a5bec-25c6-4198-8683-9ba46aa38b7d'} Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9d4a5bec-25c6-4198-8683-9ba46aa38b7d could not be found. (HTTP 404) (Request-ID: req-eea86b6a-5161-41ea-b74d-d0aaa95fc913) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:53:11.620198 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9d4a5bec-25c6-4198-8683-9ba46aa38b7d could not be found. Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9d4a5bec-25c6-4198-8683-9ba46aa38b7d could not be found. Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9d4a5bec-25c6-4198-8683-9ba46aa38b7d could not be found. Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54b90584-c610-4276-b380-2d543a07228a tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Returning 404 to user: Snapshot 9d4a5bec-25c6-4198-8683-9ba46aa38b7d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54b90584-c610-4276-b380-2d543a07228a tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d" status: 404 len: 111 microversion: 2.1 time: 0.062790 Oct 03 14:53:11.628500 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2374/4652] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/os-snapshots/9d4a5bec-25c6-4198-8683-9ba46aa38b7d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:11.631797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1802b8db-be31-4715-ae29-d15f564713a3 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb22b99ce50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.674365 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7fa70a1-4686-42b1-892b-b4c9acfe2fdd tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?name=1720043906" status: 200 len: 346 microversion: 2.1 time: 0.443486 Oct 03 14:53:11.675174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2279/4653] 10.222.0.20 () {58 vars in 1156 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers?name=1720043906 => generated 346 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:11.688879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.694233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.694915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:11.700555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.701145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.701862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.702673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.703017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.703694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.715189 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1802b8db-be31-4715-ae29-d15f564713a3 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 202 len: 0 microversion: 2.1 time: 0.087470 Oct 03 14:53:11.715972 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2375/4654] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:53:11 2022] DELETE /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:53:11.726632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a2bfa03-fe44-4314-aa98-da1ec591d844 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb22b99c820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.800088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:11.804391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:11.809628 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a2bfa03-fe44-4314-aa98-da1ec591d844 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 200 len: 345 microversion: 2.1 time: 0.089272 Oct 03 14:53:11.810802 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2376/4655] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:11.862481 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5311d87d-2aee-44f3-a851-53a1ee119158 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.178457 Oct 03 14:53:11.863685 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2280/4656] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:11.878171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:11.883486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:11.884202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-172004390', 'deleted': False, 'project_id': 'd4f161773c114bf2a7472b6136be58f0'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:11.890690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.891251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.891751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.892538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:11.893101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:11.893577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:11.989416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:53:12.054998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da84b182-8709-46fc-a851-7fda487c4ff3 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-172004390" status: 200 len: 346 microversion: 2.1 time: 0.181125 Oct 03 14:53:12.063528 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2377/4657] 10.222.0.20 () {58 vars in 1228 bytes} [Mon Oct 3 14:53:11 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-172004390 => generated 346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:12.069213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.069890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.076343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.077001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.077442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.078171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.078616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.079031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.107328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:12.193703 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-acd8780a-cd23-4529-a25c-14d7d493fe06 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 204 len: 0 microversion: 2.1 time: 0.128340 Oct 03 14:53:12.197137 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2281/4658] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:12 2022] DELETE /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:53:12.204121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.205036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.213386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.214741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.215332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.216095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.216650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.217221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.241001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:12.250909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.251895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.261830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.262336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.262750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.263462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.264187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.264672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.342651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.353554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.355748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.357204 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3600cd8-a696-4a93-8648-51bec88cdbd2 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.117151 Oct 03 14:53:12.357896 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2282/4659] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:12.369107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.377998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89cdf1f6-ae93-4124-a971-543d59a4dafa tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1517 microversion: 2.1 time: 0.178428 Oct 03 14:53:12.378827 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2378/4660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:12.392512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.393160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.400422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.400908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.401436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.402143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.402587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.403001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.560951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.565561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.566165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:12.572289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.573706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.574053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.574304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.574794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.575280 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ec2bbe9-0248-47f4-9f58-51be30573442 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.189835 Oct 03 14:53:12.575501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:12.585006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:12.585185 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2283/4661] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:12.585273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:12.729892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:12.743330 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33b71aca-c633-449d-af22-c25b0c48c67c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1553 microversion: 2.1 time: 0.181653 Oct 03 14:53:12.750521 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2379/4662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:12.826106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61bb91fd-ad1a-4003-8e23-977450c5115e tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb230888940>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:12.891021 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61bb91fd-ad1a-4003-8e23-977450c5115e tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 200 len: 345 microversion: 2.1 time: 0.069540 Oct 03 14:53:12.896983 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2284/4663] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:53:12 2022] GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:13.386521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:13.387171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:13.396355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.397100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.397730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.398435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.398904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.399336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.403252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:13.404227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:13.435280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.435939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.436493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.437425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.437925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.438407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.503111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.517596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.519868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.521831 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78d49d65-fe14-463d-abf9-88c2f6ed091a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.139694 Oct 03 14:53:13.523200 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2380/4664] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:13 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:13.603437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:13.604014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:13.613499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.614303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.614706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.615822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.616509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.617116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.744073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.754357 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ed3d8bd-53fe-46aa-be97-0de62223e555 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1517 microversion: 2.1 time: 0.356491 Oct 03 14:53:13.758235 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2285/4665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:13 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:13.774276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:13.775346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:13.782999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.783500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.783943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.784659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:13.785152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:13.785580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:13.790672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.802171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.804195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:13.805791 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cf17592-2d10-4b18-8229-29e73a97b7b1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.207879 Oct 03 14:53:13.807274 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2381/4666] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:13 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:13.906804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64ad2aeb-7b27-4a66-8427-65001914af4d tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb22b8b9790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:13.952692 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-64ad2aeb-7b27-4a66-8427-65001914af4d tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] HTTP exception thrown: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64ad2aeb-7b27-4a66-8427-65001914af4d tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Request method failure captured: Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 HTTP/1.1 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvdPmbp3cm2sjR-hpyM0M5U_iQvKYIgu40K0dBUAioccP-FMaPNFKZ3_joFnB4RpRbKat27bIoQGwmmIhQCGjgrjoee36Sj2oHSzFp7blwr-4JR0JJL2-lWddrUcO23Qf4LRH2AVu5d0keF2Xakc9euqC134hJ6kqStB_hQdk3BG24M Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef2d7fba4810415fb9fbec2540177325", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1d8a048d937d48648df3c170660ead08 Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: exception: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5cc167e1-f81d-42e7-8a6e-e3029bfec013'} Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. (HTTP 404) (Request-ID: req-5ed91dd7-ac1b-43d4-bfcb-99cf3ed65936) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:53:13.957040 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64ad2aeb-7b27-4a66-8427-65001914af4d tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Returning 404 to user: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64ad2aeb-7b27-4a66-8427-65001914af4d tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 404 len: 109 microversion: 2.1 time: 0.056113 Oct 03 14:53:13.960787 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2382/4667] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:53:13 2022] GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:13.972251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52409958-989f-43e5-b320-43ad0a088e89 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb22b9bc8b0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:14.021471 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-52409958-989f-43e5-b320-43ad0a088e89 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] HTTP exception thrown: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52409958-989f-43e5-b320-43ad0a088e89 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Request method failure captured: Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 HTTP/1.1 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvdPmbp3cm2sjR-hpyM0M5U_iQvKYIgu40K0dBUAioccP-FMaPNFKZ3_joFnB4RpRbKat27bIoQGwmmIhQCGjgrjoee36Sj2oHSzFp7blwr-4JR0JJL2-lWddrUcO23Qf4LRH2AVu5d0keF2Xakc9euqC134hJ6kqStB_hQdk3BG24M Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef2d7fba4810415fb9fbec2540177325", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1d8a048d937d48648df3c170660ead08 Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: exception: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5cc167e1-f81d-42e7-8a6e-e3029bfec013'} Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. (HTTP 404) (Request-ID: req-fbb45b74-fee1-4770-a9d1-7a404a8a00be) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:53:14.023788 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.027663 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.032741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52409958-989f-43e5-b320-43ad0a088e89 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Returning 404 to user: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:14.033807 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52409958-989f-43e5-b320-43ad0a088e89 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 404 len: 109 microversion: 2.1 time: 0.068157 Oct 03 14:53:14.034841 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2383/4668] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:53:13 2022] DELETE /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:14.043240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:14.060055 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ef3c9f3-6247-4498-a3d1-8e3b527605ae tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1553 microversion: 2.1 time: 0.292258 Oct 03 14:53:14.060778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc0ef278-3728-464c-8ac0-aa644fde27c0 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Calling method '.version_select at 0x7fb22b8b99d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:14.064528 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2286/4669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:13 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:14.100651 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-fc0ef278-3728-464c-8ac0-aa644fde27c0 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] HTTP exception thrown: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc0ef278-3728-464c-8ac0-aa644fde27c0 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Request method failure captured: Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 HTTP/1.1 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvdPmbp3cm2sjR-hpyM0M5U_iQvKYIgu40K0dBUAioccP-FMaPNFKZ3_joFnB4RpRbKat27bIoQGwmmIhQCGjgrjoee36Sj2oHSzFp7blwr-4JR0JJL2-lWddrUcO23Qf4LRH2AVu5d0keF2Xakc9euqC134hJ6kqStB_hQdk3BG24M Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ef2d7fba4810415fb9fbec2540177325", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ef2d7fba4810415fb9fbec2540177325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: ef2d7fba4810415fb9fbec2540177325 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1879725103 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1d8a048d937d48648df3c170660ead08 Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1879725103-project Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: exception: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5cc167e1-f81d-42e7-8a6e-e3029bfec013'} Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. (HTTP 404) (Request-ID: req-60ee8c74-b9dd-46cc-8eff-866fac202e2d) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:53:14.102933 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. Oct 03 14:53:14.106710 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:14.109918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc0ef278-3728-464c-8ac0-aa644fde27c0 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] Returning 404 to user: Volume 5cc167e1-f81d-42e7-8a6e-e3029bfec013 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:14.110719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc0ef278-3728-464c-8ac0-aa644fde27c0 tempest-VolumesSnapshotsTestJSON-1879725103 tempest-VolumesSnapshotsTestJSON-1879725103-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013" status: 404 len: 109 microversion: 2.1 time: 0.060467 Oct 03 14:53:14.111526 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2384/4670] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:53:14 2022] GET /compute/v2.1/os-volumes/5cc167e1-f81d-42e7-8a6e-e3029bfec013 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:14.368444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6bdf8aa6-426f-4f21-92b7-bec77ce36e31 req-b637cdc0-b6b1-4882-8cd4-2da08ba6efba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce664a9-2425-4660-a623-ed8f73ee21dd", "name": "network-vif-deleted", "tag": "695e9625-fef2-499f-9dfd-3dbd7d91e1a5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:14.383811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bdf8aa6-426f-4f21-92b7-bec77ce36e31 req-b637cdc0-b6b1-4882-8cd4-2da08ba6efba service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.384716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bdf8aa6-426f-4f21-92b7-bec77ce36e31 req-b637cdc0-b6b1-4882-8cd4-2da08ba6efba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.385406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bdf8aa6-426f-4f21-92b7-bec77ce36e31 req-b637cdc0-b6b1-4882-8cd4-2da08ba6efba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.421050 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6bdf8aa6-426f-4f21-92b7-bec77ce36e31 req-b637cdc0-b6b1-4882-8cd4-2da08ba6efba service nova] Creating event network-vif-deleted:695e9625-fef2-499f-9dfd-3dbd7d91e1a5 for instance 1ce664a9-2425-4660-a623-ed8f73ee21dd on n-h1-781139-2 Oct 03 14:53:14.436455 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6bdf8aa6-426f-4f21-92b7-bec77ce36e31 req-b637cdc0-b6b1-4882-8cd4-2da08ba6efba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073509 Oct 03 14:53:14.437109 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2287/4671] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:14.557060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:14.559960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:14.568986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.570254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.570917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.576949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.578519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.579984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.720595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:14.735535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:14.737178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:14.738439 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4acce7cf-d505-407d-92ad-daed47ce5039 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.189211 Oct 03 14:53:14.743550 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2385/4672] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:14 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:14.785176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:14.786539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:14.800382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.805104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.805649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.806458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.807981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.808894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.833015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:14.834133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:14.856457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.857244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.857901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:14.858826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:14.859493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:14.860248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.128628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.145014 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-330b0587-f3b3-4eea-85f6-e99eab350732 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1475 microversion: 2.1 time: 0.365364 Oct 03 14:53:15.149208 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2288/4673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:14 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:15.283573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.294803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.299932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.301433 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56890c00-8882-4b2d-a964-12c4ae0b3f7b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.472571 Oct 03 14:53:15.302191 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2386/4674] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:14 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:15.319177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9b6e3363-219d-4bb6-ab5a-ab1e8b8c3c50 req-3f7f4c07-17bf-4167-be7e-4802fd93e9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec3cbb6-07b0-42aa-8617-b2313e173565", "name": "network-vif-deleted", "tag": "ee44b0f0-e23e-45cb-83b3-1c72c4deb142"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:15.341633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9b6e3363-219d-4bb6-ab5a-ab1e8b8c3c50 req-3f7f4c07-17bf-4167-be7e-4802fd93e9c6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.342385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9b6e3363-219d-4bb6-ab5a-ab1e8b8c3c50 req-3f7f4c07-17bf-4167-be7e-4802fd93e9c6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.343709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9b6e3363-219d-4bb6-ab5a-ab1e8b8c3c50 req-3f7f4c07-17bf-4167-be7e-4802fd93e9c6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.380723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9b6e3363-219d-4bb6-ab5a-ab1e8b8c3c50 req-3f7f4c07-17bf-4167-be7e-4802fd93e9c6 service nova] Creating event network-vif-deleted:ee44b0f0-e23e-45cb-83b3-1c72c4deb142 for instance cec3cbb6-07b0-42aa-8617-b2313e173565 on n-h1-781139-2 Oct 03 14:53:15.393371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9b6e3363-219d-4bb6-ab5a-ab1e8b8c3c50 req-3f7f4c07-17bf-4167-be7e-4802fd93e9c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089704 Oct 03 14:53:15.399647 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2387/4675] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:15.417672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:15.418802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:15.430346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.437516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.438551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.439537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.440216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.440861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.634609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.651446 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f90e0ee-f17c-41c9-aa85-364ecf0c5423 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1345 microversion: 2.1 time: 0.250046 Oct 03 14:53:15.654281 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2388/4676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:15 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:15.723951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:15.725274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:15.747343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.748522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.749587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.750591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.751273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.751915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.774179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:15.774831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:15.792402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.795514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.797441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.800892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:15.801391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:15.801900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:15.817471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:15.970345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.983957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.987829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:15.989371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa0d89c2-79ac-47c0-b0a5-2ace61d6cdcf tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.219898 Oct 03 14:53:15.990646 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2389/4677] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:15 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:16.056463 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d0345f7-0f23-420a-8103-d93c4a9a87ff tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 204 len: 0 microversion: 2.32 time: 0.905755 Oct 03 14:53:16.059435 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2289/4678] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:53:15 2022] DELETE /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 0 bytes in 909 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:53:16.068741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:16.069288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:16.072367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:16.078099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.078869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.079015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.079732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.080180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.080602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.177700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:16.178446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:16.184632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:16.208824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.209676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.210285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.211035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.211491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.211918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.285839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.287463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.289773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.290412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lazy-loading 'fault' on Instance uuid cec3cbb6-07b0-42aa-8617-b2313e173565 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:16.347062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.360368 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53e6d92d-ff17-48f7-81ed-bae8943cfe88 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1310 microversion: 2.1 time: 0.187321 Oct 03 14:53:16.360989 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2290/4679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:16 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1310 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:16.365575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:16.366179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:16.381670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.382593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.383016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.384193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.384798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.385540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.398972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.415694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.421761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.423313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35a149f6-c79c-4976-8427-eb4bc5e95f6a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2960 microversion: 2.32 time: 0.359968 Oct 03 14:53:16.424072 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2390/4680] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:16 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2960 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:16.576311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.592313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.594612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.596285 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49515343-226a-4814-95ff-99c1408e3c84 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.234148 Oct 03 14:53:16.606137 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2291/4681] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:16 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:16.679458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:16.680070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:16.687296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.687986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.688586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.689314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:16.689990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:16.690551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:16.768969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:16.778654 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f56d5fe-bcc1-4dc4-982e-6912e76a65c3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1345 microversion: 2.1 time: 0.102971 Oct 03 14:53:16.779555 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2391/4682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:16 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:17.018700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.019319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.025802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.026462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.026993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.027698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.028151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.029150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.125123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.138758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.140669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.142300 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b69ab89-4586-4cc8-b751-0a7449b6a1de tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.127372 Oct 03 14:53:17.143473 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2292/4683] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:17.389747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.390569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.397042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.397771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.398253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.399192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.399648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.400070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.435465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.435948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.436386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.436837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lazy-loading 'fault' on Instance uuid cec3cbb6-07b0-42aa-8617-b2313e173565 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:17.461855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.463392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.474092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.474832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.475429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.480183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.482305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.482763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.497591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.507672 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-732f3a83-9a1d-4352-b02a-4495bb0f8fcf tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 200 len: 1310 microversion: 2.1 time: 0.124500 Oct 03 14:53:17.509275 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2392/4684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 1310 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:17.622213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.622822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.631001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.637663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.638123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.638859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.639313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.639740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.791091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.804239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.808013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.812338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-858ad7dd-64a4-4c56-a0e2-1bdec6fb4823 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2960 microversion: 2.32 time: 0.352986 Oct 03 14:53:17.814644 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2293/4685] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2960 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:17.831704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:17.833303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:17.851607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.853299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.854830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.855655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:17.856118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.857070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:17.860456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:17.865133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.873566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.875399 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d45894f7-82bb-4d46-be28-fba04ff11b19 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.257206 Oct 03 14:53:17.875977 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2393/4686] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:17.951148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:17.961821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db2c96fd-b967-457c-95cd-585d70998f49 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1345 microversion: 2.1 time: 0.142399 Oct 03 14:53:17.962673 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2294/4687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:17 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:18.169350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.170260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.183104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.183851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.184462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.185353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.185942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.188427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.322742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:18.332859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:18.334770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:18.336138 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-742f2240-a452-4a9d-9a42-0e517fce2631 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1408 microversion: 2.54 time: 0.170803 Oct 03 14:53:18.337285 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2394/4688] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:18 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:18.530849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.531463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: cec3cbb6-07b0-42aa-8617-b2313e173565] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.543660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.544433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.545051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.546571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.547177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.547747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.552570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:18.565607 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] HTTP exception thrown: Instance cec3cbb6-07b0-42aa-8617-b2313e173565 could not be found. Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Request method failure captured: Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 HTTP/1.1 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcQ94t2k2kKUuPIXcur9x8nqTUHcEvcPIUKce2zwOrVRJfAhASdOa8HLB8h_ApVHsa5InbruDajKPREmdCMMDl5uNlzUOCDTeO9Ljltbw6JXGdqO24mcsrkzuHfJegKZIbkZDdgj-1QGebwpkreuw01N2nQFlkrCSrL3i1R0B-eGpk Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: d4f161773c114bf2a7472b6136be58f0 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4f161773c114bf2a7472b6136be58f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: d4f161773c114bf2a7472b6136be58f0 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListServerFiltersTestJSON-1421546135-project Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 97d4ddc0886040d98942495773b81f57 Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListServerFiltersTestJSON-1421546135-project Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance cec3cbb6-07b0-42aa-8617-b2313e173565 could not be found. Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'cec3cbb6-07b0-42aa-8617-b2313e173565'} Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec3cbb6-07b0-42aa-8617-b2313e173565 could not be found. Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec3cbb6-07b0-42aa-8617-b2313e173565 could not be found. Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:18.567803 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:18.572400 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:18.572400 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:18.572400 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:18.572400 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:18.572400 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:18.572400 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec3cbb6-07b0-42aa-8617-b2313e173565 could not be found. Oct 03 14:53:18.572400 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:18.575053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Returning 404 to user: Instance cec3cbb6-07b0-42aa-8617-b2313e173565 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:18.576164 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0682dc2d-0071-45b5-aa9d-7a31f5660a55 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565" status: 404 len: 111 microversion: 2.1 time: 0.049358 Oct 03 14:53:18.577385 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2295/4689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:18 2022] GET /compute/v2.1/servers/cec3cbb6-07b0-42aa-8617-b2313e173565 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:18.585938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.586563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.594731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.596001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.597185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.597938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.598448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.598868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.639954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:18.750238 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45537f8a-9cf3-4071-8aad-4c5682ad9043 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 204 len: 0 microversion: 2.1 time: 0.168290 Oct 03 14:53:18.752974 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2395/4690] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:18 2022] DELETE /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:53:18.761406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.762334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.770794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.771885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.773036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.774037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.774664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.775382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.842443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.843146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.850336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.851106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.851776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.853137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.853977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.854680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.878622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:18.930497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:18.939660 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-728cdf19-9aab-454f-b7c8-00c8aa9a2f5b tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 200 len: 1516 microversion: 2.1 time: 0.182345 Oct 03 14:53:18.940701 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2296/4691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:18 2022] GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:18.945684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:18.946299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:18.952639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.953438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.954171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:18.955065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:18.955821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:18.956428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.106569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.123276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.125042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.126296 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be127632-5087-4614-b696-0b51d5fbb88b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2960 microversion: 2.32 time: 0.288290 Oct 03 14:53:19.147945 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2396/4692] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:18 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2960 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:19.153942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:19.154659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:19.162510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.162786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.163237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.163995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.164507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.164979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.224751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.237880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.240592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.243000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7e7426c-b7c6-4b8f-9206-35eb27774c21 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.300971 Oct 03 14:53:19.244174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2297/4693] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:18 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:19.262772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.273071 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-007502f3-d7e2-4ac5-981b-7ee8475f7b61 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1345 microversion: 2.1 time: 0.123935 Oct 03 14:53:19.273958 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2397/4694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:19 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:19.366190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:19.367369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:19.376413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.377142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.377847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.378828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.379473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.380135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.463331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.487909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.489608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:19.490902 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b45eac4-ae6b-4005-918f-89c6f4e3b7a6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1414 microversion: 2.54 time: 0.129778 Oct 03 14:53:19.495667 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2298/4695] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:19 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:19.964017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:19.965627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:19.976033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.976593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.980878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:19.981875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:19.982692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:19.983223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.155865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:20.156479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:20.172854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.173309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.173756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.174475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.174935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.175362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.180120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.189784 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37706eb2-4871-4c6b-a6bd-3428dfd26f65 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 200 len: 1516 microversion: 2.1 time: 0.229987 Oct 03 14:53:20.190375 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2398/4696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:19 2022] GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:20.279212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:20.280120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:20.291011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.291943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.292793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.293707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.294308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.295316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.439869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.451297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.452778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.454616 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff195012-0f23-4635-9a96-79dd2d968e7e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2960 microversion: 2.32 time: 0.303394 Oct 03 14:53:20.455721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2299/4697] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:20 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2960 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:20.462446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:20.463247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:20.471154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.471875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.472475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.473407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.474202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.474772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.476121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:20.565431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.578036 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6767155-1551-4c38-ba1b-bec303832844 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 200 len: 1345 microversion: 2.1 time: 0.120650 Oct 03 14:53:20.578677 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2300/4698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:20 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 1345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:20.586385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.590396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:20.593259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:20.603065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.604660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.605891 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acb0f744-6e5d-4ce6-86a0-e86fab4d33d0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.335714 Oct 03 14:53:20.610070 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2399/4699] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:20 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:20.611361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.612035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.612646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.613855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:20.614484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:20.615302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:20.803012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.814550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.817645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:20.819864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43637e97-c33c-4900-a1e3-0feb27c4b170 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1414 microversion: 2.54 time: 0.239986 Oct 03 14:53:20.820734 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2301/4700] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:20 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1414 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:21.213847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:21.216415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:21.237821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.241647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.254952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.257303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.258310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.260799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.472989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:21.490452 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f82cdd44-0679-44bb-a03b-e3b0b510e758 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 200 len: 1474 microversion: 2.1 time: 0.280965 Oct 03 14:53:21.502816 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2400/4701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:21 2022] GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 1474 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:21.549677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:21.552485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:21.588326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.588326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.588326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.588993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.600408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.602568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.730324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:21.909033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-58366a59-4e00-4ac1-8ed6-a350cc689903 req-3193524d-c659-472d-ada1-ae9fe89ce0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddab78bd-d620-450f-b92b-c5ca0201aaff", "name": "network-vif-deleted", "tag": "8b8bc5f4-12db-496b-9725-4f3c24d10366"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:21.922536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:21.925071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-58366a59-4e00-4ac1-8ed6-a350cc689903 req-3193524d-c659-472d-ada1-ae9fe89ce0d9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.925989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-58366a59-4e00-4ac1-8ed6-a350cc689903 req-3193524d-c659-472d-ada1-ae9fe89ce0d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:21.926842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-58366a59-4e00-4ac1-8ed6-a350cc689903 req-3193524d-c659-472d-ada1-ae9fe89ce0d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:21.948666 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-58366a59-4e00-4ac1-8ed6-a350cc689903 req-3193524d-c659-472d-ada1-ae9fe89ce0d9 service nova] Creating event network-vif-deleted:8b8bc5f4-12db-496b-9725-4f3c24d10366 for instance ddab78bd-d620-450f-b92b-c5ca0201aaff on n-h1-781139-2 Oct 03 14:53:21.954982 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-58366a59-4e00-4ac1-8ed6-a350cc689903 req-3193524d-c659-472d-ada1-ae9fe89ce0d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.621127 Oct 03 14:53:21.955929 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2302/4702] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:21.963878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:21.964994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:21.981792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:21.994759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.009762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.012570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.013690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.014886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.015797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.016279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.016548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.018413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60658e39-96fd-4115-b01e-848f5917ba97 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2960 microversion: 2.32 time: 0.497881 Oct 03 14:53:22.019056 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2401/4703] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:21 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2960 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:22.035468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.035468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.035468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.035468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.035865 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.035961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.035961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd HTTP/1.1 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1ce664a9-2425-4660-a623-ed8f73ee21dd'} Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:22.036125 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.040541 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.040541 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:22.040541 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:22.040541 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:22.040541 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:22.040541 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.040541 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.041608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.042507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:22.042673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.042836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-91860d8a-dc37-4df1-b2e3-8cd36d042363 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 404 len: 111 microversion: 2.1 time: 0.077209 Oct 03 14:53:22.042836 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2303/4704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:21 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:22.045528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.046267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.052597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.053111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.053559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.054281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.054713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.055136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.172672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.186191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.187907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.189534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e34e06d-7c2d-4f7f-ba0a-2288cb74114f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1399 microversion: 2.54 time: 0.148481 Oct 03 14:53:22.201607 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2304/4705] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1399 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:22.204773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.215967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.217118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.218572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.219817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.220538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0e342b2-b4f6-4330-81ae-658a58d89217 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1745 microversion: 2.20 time: 0.200144 Oct 03 14:53:22.221604 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2402/4706] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:22.226508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1985367-242e-4496-9b58-2cf672f401f9 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '.version_select at 0x7fb22b81f550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.240767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.241773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.243262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.244402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.245759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.246566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.267871 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd/os-volume_attachments HTTP/1.1 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': '1ce664a9-2425-4660-a623-ed8f73ee21dd'} Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:22.269905 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:53:22.274160 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.275991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:22.277155 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1985367-242e-4496-9b58-2cf672f401f9 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-461227251" status: 204 len: 0 microversion: 2.54 time: 0.053972 Oct 03 14:53:22.277346 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b42642d9-66c4-4ddf-91c1-604df353dac3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074152 Oct 03 14:53:22.277799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2403/4707] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-461227251 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:53:22.278224 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2305/4708] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd/os-volume_attachments => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:22.293008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.298925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.314749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.315329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.316159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.316950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.317696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.318201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.345293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:22.471787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76d2f86f-350a-4552-a8d2-56ed61aeea1a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 204 len: 0 microversion: 2.54 time: 0.183300 Oct 03 14:53:22.472850 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2404/4709] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:53:22 2022] DELETE /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:53:22.481198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.482446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.495430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.497644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.499902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.501315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.502201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.506116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.520150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.521175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: ddab78bd-d620-450f-b92b-c5ca0201aaff] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.533590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.534108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.534548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.535441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.540730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.541403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.569767 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] HTTP exception thrown: Instance ddab78bd-d620-450f-b92b-c5ca0201aaff could not be found. Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Request method failure captured: Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff HTTP/1.1 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcQ94t2k2kKUuPIXcur9x8nqTUHcEvcPIUKce2zwOrVRJfAhASdOa8HLB8h_ApVHsa5InbruDajKPREmdCMMDl5uNlzUOCDTeO9Ljltbw6JXGdqO24mcsrkzuHfJegKZIbkZDdgj-1QGebwpkreuw01N2nQFlkrCSrL3i1R0B-eGpk Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: d4f161773c114bf2a7472b6136be58f0 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4f161773c114bf2a7472b6136be58f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: d4f161773c114bf2a7472b6136be58f0 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ListServerFiltersTestJSON-1421546135-project Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 97d4ddc0886040d98942495773b81f57 Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ListServerFiltersTestJSON-1421546135-project Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance ddab78bd-d620-450f-b92b-c5ca0201aaff could not be found. Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ddab78bd-d620-450f-b92b-c5ca0201aaff'} Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddab78bd-d620-450f-b92b-c5ca0201aaff could not be found. Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddab78bd-d620-450f-b92b-c5ca0201aaff could not be found. Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:22.571838 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddab78bd-d620-450f-b92b-c5ca0201aaff could not be found. Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Returning 404 to user: Instance ddab78bd-d620-450f-b92b-c5ca0201aaff could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b94103e-8238-43b7-846e-0ade879527ff tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff" status: 404 len: 111 microversion: 2.1 time: 0.059245 Oct 03 14:53:22.576667 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2405/4710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/ddab78bd-d620-450f-b92b-c5ca0201aaff => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:53:22.583834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.584331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.594426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.595018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.595728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.597317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.597788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.598319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.633954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:22.752152 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd7d01d0-d01c-4409-a4bf-3b5b32c586c1 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 204 len: 0 microversion: 2.1 time: 0.171917 Oct 03 14:53:22.754229 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2406/4711] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:22 2022] DELETE /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:53:22.764092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1905139636", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fd28a296-d4d0-487d-b766-c66e0eb4645b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:22.781212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.795999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.798000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:22.800280 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8855c284-b622-4179-baad-1112b02c4027 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1405 microversion: 2.54 time: 0.323255 Oct 03 14:53:22.800848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2306/4712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1405 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:22.808594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:22.809475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:22.818663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.827035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.827497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.831304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:22.832714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:22.834026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:22.838785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] validate_networks() for [('fd28a296-d4d0-487d-b766-c66e0eb4645b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:53:23.167963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.177307 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c37f06e1-7b34-4e5a-83ca-d9bce44de561 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1517 microversion: 2.1 time: 0.372709 Oct 03 14:53:23.195369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2307/4713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:22 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1517 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:23.201720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:23.203357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:23.210455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.211369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.212140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.213122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.213894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.214513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.416776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:53:23.417534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:53:23.418809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:53:23.419437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:53:23.420209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:53:23.431473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.432619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.433299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.434540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.435242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.435887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.457024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:53:23.463851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for user 3569fcf74b3b4e3d99b0dbcd5465d97d and project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:53:23.480642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:53:23.484450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:53:23.542025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cab8c05-d822-40bc-b221-8873d0e34438 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786194 Oct 03 14:53:23.543332 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2407/4714] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:53:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:53:23.554676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:23.555715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:23.563282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.564685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.565375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.566282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.566917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.567522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.745009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.754909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.756351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.758472 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a12ee8e-a983-44ae-886f-d6e61f51410f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1745 microversion: 2.20 time: 0.213642 Oct 03 14:53:23.774418 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2408/4715] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:23 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:23.784722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61cc1fb9-ac0f-4431-9b75-8201b933d860 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:23.785616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61cc1fb9-ac0f-4431-9b75-8201b933d860 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:23.910223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-61cc1fb9-ac0f-4431-9b75-8201b933d860 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:23.922526 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61cc1fb9-ac0f-4431-9b75-8201b933d860 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf" status: 200 len: 1215 microversion: 2.1 time: 0.146536 Oct 03 14:53:23.923399 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2409/4716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:23 2022] GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:23.958169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:23.963504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:23.978847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.981468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.985312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:23.987910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:23.988596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:23.989520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.095094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.105528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.106987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.107750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.108269 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c066941-1819-4c48-8993-6c7337bd1f51 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2918 microversion: 2.32 time: 0.911464 Oct 03 14:53:24.121188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.121188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.121790 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f30673d-4544-404c-b20d-bd26a970b69a tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1405 microversion: 2.54 time: 0.182931 Oct 03 14:53:24.122177 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2308/4717] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:23 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2918 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:24.134023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2410/4718] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:23 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:24.137382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b473e3d4-1a0c-4614-9dbb-ad10c62f899a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:24.137890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b473e3d4-1a0c-4614-9dbb-ad10c62f899a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:24.174587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b473e3d4-1a0c-4614-9dbb-ad10c62f899a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:24.203807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:24.204722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:24.217356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.217895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.218337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.221882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.222373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.222814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.445193 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.scheduler.client.report [None req-b473e3d4-1a0c-4614-9dbb-ad10c62f899a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Deleted allocations for instance e2ba685b-daf7-4814-8275-14c6354f5bbf Oct 03 14:53:24.454802 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.compute.api [None req-b473e3d4-1a0c-4614-9dbb-ad10c62f899a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] Instance Mapping does not exist while attempting local delete cleanup. Oct 03 14:53:24.456237 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b473e3d4-1a0c-4614-9dbb-ad10c62f899a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf" status: 204 len: 0 microversion: 2.1 time: 0.333008 Oct 03 14:53:24.457500 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2309/4719] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:24 2022] DELETE /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:53:24.468755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14b180c6-ff17-47a0-bde9-53cb60a64e87 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:24.469713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14b180c6-ff17-47a0-bde9-53cb60a64e87 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:24.478342 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-14b180c6-ff17-47a0-bde9-53cb60a64e87 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14b180c6-ff17-47a0-bde9-53cb60a64e87 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf HTTP/1.1 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'e2ba685b-daf7-4814-8275-14c6354f5bbf'} Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:24.483045 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:24.488142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:24.488142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:24.488142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:24.488142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:53:24.488142 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:24.491236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14b180c6-ff17-47a0-bde9-53cb60a64e87 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:24.492474 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14b180c6-ff17-47a0-bde9-53cb60a64e87 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf" status: 404 len: 111 microversion: 2.1 time: 0.030518 Oct 03 14:53:24.493482 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2310/4720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:24 2022] GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:53:24.605582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:24.623396 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68a96967-323d-41a8-8203-f7685ac4e2ab tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1517 microversion: 2.1 time: 0.423795 Oct 03 14:53:24.636957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2411/4721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:24 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1517 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:24.734428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1631050465", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fd28a296-d4d0-487d-b766-c66e0eb4645b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:24.789228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:24.789857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:24.809002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.809495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.809935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.810672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:24.811126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:24.811541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:24.828601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] validate_networks() for [('fd28a296-d4d0-487d-b766-c66e0eb4645b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:53:25.136689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.150536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.153006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.154245 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcce995f-49fc-4144-8bdf-10d83f54f1da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1745 microversion: 2.20 time: 0.369124 Oct 03 14:53:25.154821 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2412/4722] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:24 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1745 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:25.168673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-34405c09-36d0-4407-844b-a1ecbb3174fb req-e82b7c34-8c37-4954-aa39-886ada97767a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba87e27-28db-4125-80ed-aaec86bd861c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:25.191296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34405c09-36d0-4407-844b-a1ecbb3174fb req-e82b7c34-8c37-4954-aa39-886ada97767a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.191831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34405c09-36d0-4407-844b-a1ecbb3174fb req-e82b7c34-8c37-4954-aa39-886ada97767a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.203351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-34405c09-36d0-4407-844b-a1ecbb3174fb req-e82b7c34-8c37-4954-aa39-886ada97767a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.207798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:25.229000 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-34405c09-36d0-4407-844b-a1ecbb3174fb req-e82b7c34-8c37-4954-aa39-886ada97767a service nova] Creating event network-vif-unplugged:3ba87e27-28db-4125-80ed-aaec86bd861c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:25.240823 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-34405c09-36d0-4407-844b-a1ecbb3174fb req-e82b7c34-8c37-4954-aa39-886ada97767a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084541 Oct 03 14:53:25.245963 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2413/4723] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:25.252947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:25.253848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:25.261234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.261966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.262565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.263452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.264051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.264619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.649544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.661961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.673544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.675572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8b98df0-068e-4b14-a1cc-43f4d12f5378 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2871 microversion: 2.32 time: 0.427924 Oct 03 14:53:25.690095 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2414/4724] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:25 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2871 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:25.700313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:25.714969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:25.730889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.731932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.732632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.734503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.735779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.736434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.813549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.815113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.816015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:25.817076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lazy-loading 'fault' on Instance uuid 9787af21-4ab6-4589-bd9e-e3679d835169 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:25.892799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.915374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.920001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '511f515be0a848019a486d4ee1e6052d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa0d1e1b38a46c1b028621abb706c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:25.923352 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-170036d5-21c8-4a0d-8ef2-13277328aa9f tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 200 len: 1410 microversion: 2.54 time: 0.231855 Oct 03 14:53:25.929911 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2415/4725] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:25 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 1410 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:25.935626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8b375e8f-ce47-45ec-89df-055417a36306 req-3b70da25-29ab-4c73-9d06-bf985cc76818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-deleted", "tag": "e14485b9-4cd9-42c0-9cf6-f51ba0ee151c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:25.964606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b375e8f-ce47-45ec-89df-055417a36306 req-3b70da25-29ab-4c73-9d06-bf985cc76818 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:25.965407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b375e8f-ce47-45ec-89df-055417a36306 req-3b70da25-29ab-4c73-9d06-bf985cc76818 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:25.966005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8b375e8f-ce47-45ec-89df-055417a36306 req-3b70da25-29ab-4c73-9d06-bf985cc76818 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.030903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8b375e8f-ce47-45ec-89df-055417a36306 req-3b70da25-29ab-4c73-9d06-bf985cc76818 service nova] Creating event network-vif-deleted:e14485b9-4cd9-42c0-9cf6-f51ba0ee151c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:26.046025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8b375e8f-ce47-45ec-89df-055417a36306 req-3b70da25-29ab-4c73-9d06-bf985cc76818 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108535 Oct 03 14:53:26.048379 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2416/4726] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:26.064460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:26.068513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:26.081079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.087535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.088621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.092903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.094376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.095072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.530745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:26.548231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-777b1de5-278f-4ce6-a59a-de4dd18fe498 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1517 microversion: 2.1 time: 0.494692 Oct 03 14:53:26.549347 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2417/4727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:26 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1517 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:26.560911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:26.561560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:26.581871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.584669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.585319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.586284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.586757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.587191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.850843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:26.861778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:26.868410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:26.872807 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcb9aaa8-f356-4e81-aaec-990a46e952db tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.320689 Oct 03 14:53:26.874080 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2418/4728] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:26 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:26.880862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:26.881811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:26.905597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.906006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.906458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:26.909857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:26.910748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:26.911602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:27.465193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:53:27.466308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:53:27.468082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:53:27.468686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:53:27.469306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:53:27.494378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:27.498111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:27.502872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:27.505720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:27.508503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:27.509632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:27.610653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:53:27.634645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for user 3569fcf74b3b4e3d99b0dbcd5465d97d and project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:53:27.690393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:53:27.698127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:53:27.855213 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8731a1c4-29c5-4aed-bc2b-c5979956d54b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.124939 Oct 03 14:53:27.855886 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2311/4729] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:53:27.871042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:27.874094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] [instance: 9787af21-4ab6-4589-bd9e-e3679d835169] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:27.888748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:27.892961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:27.904547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:27.905630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:27.906602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:27.907259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:27.908876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:27.909185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:27.912688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:27.916117 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c7e9903-f039-4d20-8ec8-55a3a0e4f65c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2536 microversion: 2.32 time: 1.039481 Oct 03 14:53:27.917067 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2419/4730] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:26 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2536 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:27.925653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-58b54305-69d8-469c-ba0f-dabc23f164dc req-e17210cf-f165-4d50-8c70-2e58c43b9e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-unplugged", "status": "completed", "tag": "a8a8304b-3890-4398-adc1-3a98e17e1e35"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:27.962501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] HTTP exception thrown: Instance 9787af21-4ab6-4589-bd9e-e3679d835169 could not be found. Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Request method failure captured: Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 HTTP/1.1 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvc9YrApOntCOfjqXT8sCou4BDwZGmRq4a-1fb-3cK5y83n-SePCJAuI3XGlXfzd1u_44vPJ9zBWm8uFGyJke3KqNMDVnKqKUsV_xbcUavCAgNKFK7YivHSI2FfU9N7QRC7RH7zqZ5P33BZqFkjghjyC6KsfB9OxVtdgWNvMP2REOzc Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.54 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: aaa0d1e1b38a46c1b028621abb706c69 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerShowV254Test-807031727 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaa0d1e1b38a46c1b028621abb706c69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaa0d1e1b38a46c1b028621abb706c69", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaa0d1e1b38a46c1b028621abb706c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaa0d1e1b38a46c1b028621abb706c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerShowV254Test-807031727 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: aaa0d1e1b38a46c1b028621abb706c69 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerShowV254Test-807031727 Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerShowV254Test-807031727-project Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 511f515be0a848019a486d4ee1e6052d Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerShowV254Test-807031727-project Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 9787af21-4ab6-4589-bd9e-e3679d835169 could not be found. Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '9787af21-4ab6-4589-bd9e-e3679d835169'} Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9787af21-4ab6-4589-bd9e-e3679d835169 could not be found. Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9787af21-4ab6-4589-bd9e-e3679d835169 could not be found. Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:27.964209 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9787af21-4ab6-4589-bd9e-e3679d835169 could not be found. Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] Returning 404 to user: Instance 9787af21-4ab6-4589-bd9e-e3679d835169 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:27.968995 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05a35678-906a-4d10-82dc-e1d8298a69c6 tempest-ServerShowV254Test-807031727 tempest-ServerShowV254Test-807031727-project] 10.222.0.20 "GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169" status: 404 len: 111 microversion: 2.54 time: 0.106472 Oct 03 14:53:27.982103 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2312/4731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:27 2022] GET /compute/v2.1/servers/9787af21-4ab6-4589-bd9e-e3679d835169 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:53:27.992823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:27.998425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-58b54305-69d8-469c-ba0f-dabc23f164dc req-e17210cf-f165-4d50-8c70-2e58c43b9e5b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:27.999283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-58b54305-69d8-469c-ba0f-dabc23f164dc req-e17210cf-f165-4d50-8c70-2e58c43b9e5b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:27.999721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-58b54305-69d8-469c-ba0f-dabc23f164dc req-e17210cf-f165-4d50-8c70-2e58c43b9e5b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.019382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:28.020510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:28.040194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.042057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.042738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.043865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.044876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.046686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.071469 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-58b54305-69d8-469c-ba0f-dabc23f164dc req-e17210cf-f165-4d50-8c70-2e58c43b9e5b service nova] Creating event network-vif-unplugged:a8a8304b-3890-4398-adc1-3a98e17e1e35 for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:28.092066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-58b54305-69d8-469c-ba0f-dabc23f164dc req-e17210cf-f165-4d50-8c70-2e58c43b9e5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173317 Oct 03 14:53:28.095821 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2420/4732] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:28.111499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eba0044c-63a5-473f-b3a9-21e9bb83cf9d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:28.111812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eba0044c-63a5-473f-b3a9-21e9bb83cf9d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:28.226050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eba0044c-63a5-473f-b3a9-21e9bb83cf9d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:28.235375 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eba0044c-63a5-473f-b3a9-21e9bb83cf9d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1215 microversion: 2.1 time: 0.136628 Oct 03 14:53:28.238241 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2421/4733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:28 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:28.268959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:28.269601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:28.297110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.302115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.302833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:28.305348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:28.309151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:28.311464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.100659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d4ddc0886040d98942495773b81f57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f161773c114bf2a7472b6136be58f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.127866 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5ee0c3b-61a4-4555-bea2-7c75fc743142 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 200 len: 1475 microversion: 2.1 time: 1.144170 Oct 03 14:53:29.133784 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2313/4734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:27 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 1475 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:29.153439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:29.154369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:29.165467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.168762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.169713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.170693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.176201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.186067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.187280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.188799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.197685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.204099 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80f87ca9-043b-4f31-8297-141b3dd2d7da tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.949223 Oct 03 14:53:29.206688 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2422/4735] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:28 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:29.212649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cce66948-5824-415a-aa25-6cae932a0715 req-30a5106b-6833-4eba-b2a6-3c4e1d914dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-deleted", "tag": "79e408f7-cad2-401d-8e68-4887a9dd2e6b"}, {"server_uuid": "60e5bebb-452f-4fa8-b96b-ba56627f1f8f", "name": "network-vif-deleted", "tag": "7495070f-12a3-4132-84fd-79b46cd032fe"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:29.244726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cce66948-5824-415a-aa25-6cae932a0715 req-30a5106b-6833-4eba-b2a6-3c4e1d914dda service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.246219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cce66948-5824-415a-aa25-6cae932a0715 req-30a5106b-6833-4eba-b2a6-3c4e1d914dda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.247158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cce66948-5824-415a-aa25-6cae932a0715 req-30a5106b-6833-4eba-b2a6-3c4e1d914dda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.344026 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cce66948-5824-415a-aa25-6cae932a0715 req-30a5106b-6833-4eba-b2a6-3c4e1d914dda service nova] Creating event network-vif-deleted:79e408f7-cad2-401d-8e68-4887a9dd2e6b for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:29.344545 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cce66948-5824-415a-aa25-6cae932a0715 req-30a5106b-6833-4eba-b2a6-3c4e1d914dda service nova] Creating event network-vif-deleted:7495070f-12a3-4132-84fd-79b46cd032fe for instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f on n-h2-781139-2 Oct 03 14:53:29.376638 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cce66948-5824-415a-aa25-6cae932a0715 req-30a5106b-6833-4eba-b2a6-3c4e1d914dda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.167728 Oct 03 14:53:29.381968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2423/4736] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:29.409930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:29.410644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:29.425080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.433847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.435324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.438666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:29.442169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:29.447811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:29.620040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:29.636093 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92b9f5c4-59ce-4735-a788-14f825f2af46 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1219 microversion: 2.1 time: 0.250676 Oct 03 14:53:29.638791 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2424/4737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:29 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1219 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:30.050646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:30.063501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:30.065509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:30.067375 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00960019-1416-4ac2-a461-17ab69233047 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2536 microversion: 2.32 time: 0.932248 Oct 03 14:53:30.068977 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2314/4738] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:29 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2536 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:30.181512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:30.183924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] [instance: 60e5bebb-452f-4fa8-b96b-ba56627f1f8f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:30.200808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.201655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.202417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.203548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.204236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.204877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.232811 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] HTTP exception thrown: Instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f could not be found. Oct 03 14:53:30.239195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:30.239815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Request method failure captured: Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f HTTP/1.1 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcQ94t2k2kKUuPIXcur9x8nqTUHcEvcPIUKce2zwOrVRJfAhASdOa8HLB8h_ApVHsa5InbruDajKPREmdCMMDl5uNlzUOCDTeO9Ljltbw6JXGdqO24mcsrkzuHfJegKZIbkZDdgj-1QGebwpkreuw01N2nQFlkrCSrL3i1R0B-eGpk Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: d4f161773c114bf2a7472b6136be58f0 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d4f161773c114bf2a7472b6136be58f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d4f161773c114bf2a7472b6136be58f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: d4f161773c114bf2a7472b6136be58f0 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1421546135 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ListServerFiltersTestJSON-1421546135-project Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 97d4ddc0886040d98942495773b81f57 Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ListServerFiltersTestJSON-1421546135-project Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f could not be found. Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '60e5bebb-452f-4fa8-b96b-ba56627f1f8f'} Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f could not be found. Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f could not be found. Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:30.255049 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f could not be found. Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] Returning 404 to user: Instance 60e5bebb-452f-4fa8-b96b-ba56627f1f8f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd8053c5-65d2-413f-a266-dc9a67bbcd75 tempest-ListServerFiltersTestJSON-1421546135 tempest-ListServerFiltersTestJSON-1421546135-project] 10.222.0.20 "GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f" status: 404 len: 111 microversion: 2.1 time: 0.079794 Oct 03 14:53:30.260694 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2425/4739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:30 2022] GET /compute/v2.1/servers/60e5bebb-452f-4fa8-b96b-ba56627f1f8f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:30.262540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.263026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.263644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.264728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.265358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.265948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.360046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5812e180-8c00-4834-a6b0-3dc64765a6b5 req-be6dadc1-9348-49ac-92be-cc10e6bab01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ea3c31-c873-4937-b6cc-ebd75656c505", "name": "network-vif-plugged", "status": "completed", "tag": "9f346b0f-8c27-4255-97c2-a5d960be0a91"}, {"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-unplugged", "status": "completed", "tag": "cba80c5c-277c-4207-a6d7-6870affdac4f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:30.376763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5812e180-8c00-4834-a6b0-3dc64765a6b5 req-be6dadc1-9348-49ac-92be-cc10e6bab01f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.377274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5812e180-8c00-4834-a6b0-3dc64765a6b5 req-be6dadc1-9348-49ac-92be-cc10e6bab01f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.377700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5812e180-8c00-4834-a6b0-3dc64765a6b5 req-be6dadc1-9348-49ac-92be-cc10e6bab01f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.416892 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5812e180-8c00-4834-a6b0-3dc64765a6b5 req-be6dadc1-9348-49ac-92be-cc10e6bab01f service nova] Creating event network-vif-plugged:9f346b0f-8c27-4255-97c2-a5d960be0a91 for instance b9ea3c31-c873-4937-b6cc-ebd75656c505 on n-h2-781139-2 Oct 03 14:53:30.418300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5812e180-8c00-4834-a6b0-3dc64765a6b5 req-be6dadc1-9348-49ac-92be-cc10e6bab01f service nova] Creating event network-vif-unplugged:cba80c5c-277c-4207-a6d7-6870affdac4f for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:30.443319 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5812e180-8c00-4834-a6b0-3dc64765a6b5 req-be6dadc1-9348-49ac-92be-cc10e6bab01f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.088849 Oct 03 14:53:30.444603 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2426/4740] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:30.663089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:30.664103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:30.690806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.691313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.692489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:30.693980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:30.698969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:30.699597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.026910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.044844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.051891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.057315 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5cf36924-6877-49ed-b706-c8d45fb39595 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.822371 Oct 03 14:53:31.060195 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2315/4741] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:30 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:31.104974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:31.105974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:31.110636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.120453 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee514250-cbe6-4df2-bbb5-36165955c44c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1285 microversion: 2.1 time: 0.462383 Oct 03 14:53:31.125481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.125913 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2427/4742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:30 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1285 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:31.128600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.129206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.132001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.134395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.135509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.536095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-eaefaada-d5e1-429e-81bc-66554f112343 req-0c676bf0-93ee-46dd-8bdf-0ee1df3ed06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-deleted", "tag": "3ba87e27-28db-4125-80ed-aaec86bd861c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:31.553636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eaefaada-d5e1-429e-81bc-66554f112343 req-0c676bf0-93ee-46dd-8bdf-0ee1df3ed06f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.554134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eaefaada-d5e1-429e-81bc-66554f112343 req-0c676bf0-93ee-46dd-8bdf-0ee1df3ed06f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.554583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-eaefaada-d5e1-429e-81bc-66554f112343 req-0c676bf0-93ee-46dd-8bdf-0ee1df3ed06f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.603901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-eaefaada-d5e1-429e-81bc-66554f112343 req-0c676bf0-93ee-46dd-8bdf-0ee1df3ed06f service nova] Creating event network-vif-deleted:3ba87e27-28db-4125-80ed-aaec86bd861c for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:31.631118 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-eaefaada-d5e1-429e-81bc-66554f112343 req-0c676bf0-93ee-46dd-8bdf-0ee1df3ed06f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092681 Oct 03 14:53:31.633326 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2428/4743] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:53:31.654432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85fa1f48-4c53-4567-a882-de604864711d"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:31.657694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:31.682492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.685574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.688825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.691118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:31.693781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:31.696971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:31.742679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.769186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.771493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:31.785825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4dc75d12-23e4-4bde-9bd8-2f10187b5366 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2375 microversion: 2.32 time: 0.684140 Oct 03 14:53:31.803465 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2316/4744] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:31 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2375 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:32.089779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:32.091275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:32.116861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.121904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.127434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:32.136277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.137719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.142235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:32.675714 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9bc9106-c582-4954-94a1-c09ce2b01f71 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.035169 Oct 03 14:53:32.677128 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2429/4745] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:53:31 2022] POST /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 194 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:32.698560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:32.704199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:32.729088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.732799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.733551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:32.743744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:32.744754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:32.755294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.061155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:33.074290 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25769770-4151-4a23-886e-b7ae00ab430b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1273 microversion: 2.1 time: 0.392539 Oct 03 14:53:33.078749 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2430/4746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:32 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1273 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:33.376644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:33.388648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:33.388648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:33.403877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:33.410555 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f613c8e8-b409-4236-9e4a-7e503680e668 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 1.321027 Oct 03 14:53:33.411490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2317/4747] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:32 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:33.445698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:33.450192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:33.452718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:33.480783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.481337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.481957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.485845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.486535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.487114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.720481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-977349476", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:33.852064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:53:33.852489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:53:33.852983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:53:33.853394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:53:33.854097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:53:33.889462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.889940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.890372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:33.891103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:33.891544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:33.891992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.011824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Getting quotas for project 624a6131d5ca4ed68c9c1c6b6656275a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:53:34.054784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Getting quotas for user d07b106da3ac4159b0a4b9819b6904ae and project 624a6131d5ca4ed68c9c1c6b6656275a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:53:34.083746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:53:34.086992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:53:34.147696 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad07fb74-9a1f-45b8-baa1-a4f9afbfa1f2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.064463 Oct 03 14:53:34.155426 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2431/4748] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:53:34.161974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-57a74b96-98aa-4a51-aabb-9378812b25a5 req-4e22bc48-e7a1-43df-88cf-d255ff6fe322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-deleted", "tag": "a8a8304b-3890-4398-adc1-3a98e17e1e35"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:34.218880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-57a74b96-98aa-4a51-aabb-9378812b25a5 req-4e22bc48-e7a1-43df-88cf-d255ff6fe322 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.222782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-57a74b96-98aa-4a51-aabb-9378812b25a5 req-4e22bc48-e7a1-43df-88cf-d255ff6fe322 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.223948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-57a74b96-98aa-4a51-aabb-9378812b25a5 req-4e22bc48-e7a1-43df-88cf-d255ff6fe322 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.253978 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-57a74b96-98aa-4a51-aabb-9378812b25a5 req-4e22bc48-e7a1-43df-88cf-d255ff6fe322 service nova] Creating event network-vif-deleted:a8a8304b-3890-4398-adc1-3a98e17e1e35 for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:34.260160 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-57a74b96-98aa-4a51-aabb-9378812b25a5 req-4e22bc48-e7a1-43df-88cf-d255ff6fe322 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103089 Oct 03 14:53:34.265922 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2432/4749] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:34.276401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:34.279585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:34.295235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.295235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.296727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.299840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:34.300426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:34.300956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:34.765597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.777277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.779207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.780696 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a2ae755-ccf1-4eb2-b29b-10b8b3253dbb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 2214 microversion: 2.32 time: 1.354291 Oct 03 14:53:34.782096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2318/4750] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:33 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 2214 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:34.789175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0ec6e6b6-79e5-4987-8964-6ba789ebc62c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:34.790306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0ec6e6b6-79e5-4987-8964-6ba789ebc62c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:34.946532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0ec6e6b6-79e5-4987-8964-6ba789ebc62c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.958669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0ec6e6b6-79e5-4987-8964-6ba789ebc62c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.962344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0ec6e6b6-79e5-4987-8964-6ba789ebc62c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:34.967233 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0ec6e6b6-79e5-4987-8964-6ba789ebc62c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1277 microversion: 2.57 time: 0.181933 Oct 03 14:53:34.982550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2319/4751] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:34 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:35.016676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:35.021772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:35.044359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.048375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.049144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.051076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.052356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.054108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.417341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:35.432689 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-018e1262-c499-4631-8b43-dce84412ea48 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1315 microversion: 2.1 time: 1.165207 Oct 03 14:53:35.439765 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2433/4752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:34 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1315 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:35.817723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:35.818374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:35.849370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.849901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.850329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.850731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:35.851227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:35.851507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:35.851945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:35.867351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:35.872301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:35.874699 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6fead1d8-d358-45a7-94c8-6c13cf5e69ce tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.891007 Oct 03 14:53:35.875803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2320/4753] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:34 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:36.016513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:36.017393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:36.032476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.033436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.037816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.039580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.040747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.042385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.224554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.238466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.250155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.253884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.257137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.258095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.259345 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64526192-8912-4add-97af-f8290abd0597 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.446614 Oct 03 14:53:36.260029 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2434/4754] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:35 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:36.266938 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fab14f9c-c521-4e56-a511-fe1c1742b4b9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1329 microversion: 2.57 time: 0.268870 Oct 03 14:53:36.267931 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2321/4755] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:35 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1329 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:36.436597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-12928195-66d5-4929-82c6-982a03e2b3ed req-be4d7bae-e37b-46f9-ba8e-ab93c62c5883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16ab3a3-6ac6-45cd-9f58-5e908acd153b", "name": "network-vif-deleted", "tag": "cba80c5c-277c-4207-a6d7-6870affdac4f"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:36.476379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:36.477332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:36.489811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.493842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.497529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.499535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.500231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.500874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.502305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-12928195-66d5-4929-82c6-982a03e2b3ed req-be4d7bae-e37b-46f9-ba8e-ab93c62c5883 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.503226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-12928195-66d5-4929-82c6-982a03e2b3ed req-be4d7bae-e37b-46f9-ba8e-ab93c62c5883 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.503932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-12928195-66d5-4929-82c6-982a03e2b3ed req-be4d7bae-e37b-46f9-ba8e-ab93c62c5883 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.562368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:36.569713 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-12928195-66d5-4929-82c6-982a03e2b3ed req-be4d7bae-e37b-46f9-ba8e-ab93c62c5883 service nova] Creating event network-vif-deleted:cba80c5c-277c-4207-a6d7-6870affdac4f for instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b on n-h1-781139-2 Oct 03 14:53:36.593828 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-12928195-66d5-4929-82c6-982a03e2b3ed req-be4d7bae-e37b-46f9-ba8e-ab93c62c5883 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157660 Oct 03 14:53:36.597456 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2435/4756] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:36.619523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3146651a-c22b-4c86-9a10-6a63e64be5a7 req-23c82cc8-d0d3-485c-bcea-960a4ace09f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9f8245-5349-4f3d-bd11-83b4ac3d717b", "tag": "99c7f860-beb9-47bd-a87a-89c77418760e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:36.650581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3146651a-c22b-4c86-9a10-6a63e64be5a7 req-23c82cc8-d0d3-485c-bcea-960a4ace09f1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.651262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3146651a-c22b-4c86-9a10-6a63e64be5a7 req-23c82cc8-d0d3-485c-bcea-960a4ace09f1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.651880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3146651a-c22b-4c86-9a10-6a63e64be5a7 req-23c82cc8-d0d3-485c-bcea-960a4ace09f1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.702966 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3146651a-c22b-4c86-9a10-6a63e64be5a7 req-23c82cc8-d0d3-485c-bcea-960a4ace09f1 service nova] Creating event network-changed:99c7f860-beb9-47bd-a87a-89c77418760e for instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b on n-h1-781139-2 Oct 03 14:53:36.712380 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3146651a-c22b-4c86-9a10-6a63e64be5a7 req-23c82cc8-d0d3-485c-bcea-960a4ace09f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112120 Oct 03 14:53:36.713514 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2436/4757] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:36.907220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:36.909865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:36.910380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:36.930328 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70818bcb-72f5-4df6-90fe-15adf8745ed2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1315 microversion: 2.1 time: 0.458056 Oct 03 14:53:36.931231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2322/4758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:36 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:36.934202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.936382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.938716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:36.939729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:36.940283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:36.941817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.291539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:37.292705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:37.310987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.311810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.315474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.320297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.325125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.326142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.565440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:37.619773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.658131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.683145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.687886 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7b30554-80f9-401d-a1a3-74b50b824535 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.402215 Oct 03 14:53:37.695016 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2323/4759] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:37 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:37.721786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:37.723528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:37.754420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.757077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.762155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.764360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:37.765372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:37.767536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:37.932296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.956199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.961598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:37.962910 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54ac27d1-7f6d-4098-bdaf-1ee295b22c98 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1335 microversion: 2.57 time: 0.265828 Oct 03 14:53:37.969238 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2324/4760] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:37 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1335 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:37.990654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:37.992634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:38.005652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.042851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.043755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.044496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.045118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.046161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.054222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.058763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.060747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.065062 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdb9fea9-7397-40a2-9e91-947eaf656379 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 1.161945 Oct 03 14:53:38.078407 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2437/4761] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:36 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:38.390725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.402445 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-93199944-5086-4596-bd5b-1da4a8f0686f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1315 microversion: 2.1 time: 0.427911 Oct 03 14:53:38.409803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2325/4762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:37 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:38.726018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:38.729734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:38.751013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.751730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.752286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.753260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:38.770188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:38.770715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:38.959514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.971905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.975040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:38.976630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62d2249f-735e-4723-8aa3-a9430de17b00 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.255063 Oct 03 14:53:38.996337 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2438/4763] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:38 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:39.000492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:39.006278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.021798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:39.029156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.031758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.033429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.035101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.037027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.039201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.113081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:39.114417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.129337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.134973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.139197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.140186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.141241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.148105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.224052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.233947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.242953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.249786 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f56b37b-9885-4610-9ef5-73bfa6e8928d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1356 microversion: 2.57 time: 0.253516 Oct 03 14:53:39.251495 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2326/4764] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:38 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1356 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:39.287692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:39.292147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.304672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.310530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.311502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.312861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.314494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.316773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.506906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:53:39.507696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:53:39.508568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:53:39.509165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:53:39.510184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:53:39.585525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.610774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.617897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:39.625872 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f077784-21a2-4a37-8fec-5a0122eead3b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.522695 Oct 03 14:53:39.626906 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2439/4765] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:39 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:39.633343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:39.636000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.660002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.661101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.668916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.670488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.671361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.673158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.747833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.786237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.794702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.804458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.805999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.813185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.816555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.947785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-910f1bdf-2822-42f3-ba2b-0a2be6d420c8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "POST /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68/action" status: 202 len: 1137 microversion: 2.57 time: 0.665951 Oct 03 14:53:39.960989 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2327/4766] 10.222.0.20 () {62 vars in 1320 bytes} [Mon Oct 3 14:53:39 2022] POST /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68/action => generated 1137 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 03 14:53:39.975345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:39.976981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:39.985075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.985719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.986288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:39.987004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:39.987456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:39.987879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.151315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.162006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.177941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.179508 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d08914c9-ee92-4410-89e4-144007837cc0 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.210692 Oct 03 14:53:40.180236 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2328/4767] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:39 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:40.203866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:40.204666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:40.222061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.222807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.223410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.224277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.224891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.227953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.358818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.377158 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b61241c-e0e5-4998-9379-a6f1dcfd428f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1315 microversion: 2.1 time: 0.748532 Oct 03 14:53:40.378432 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2440/4768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:39 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:40.519615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.545593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.556092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:40.558146 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d19301ff-df05-4db6-b76a-358468c6b239 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.358728 Oct 03 14:53:40.561022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2329/4769] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:40 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:40.660845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:40.661750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:40.677851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.678355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.678792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:40.679927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:40.679927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:40.680395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.207353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:41.208692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:41.224900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.230038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.230914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.231906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.234245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.234702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.392893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.409039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.412647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.414418 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4678bc6-b23b-4233-a8e9-b9f7f3ce1b4d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.213080 Oct 03 14:53:41.416063 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2330/4770] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:41 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:41.421386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:41.422359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:41.430282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.431032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.431760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.432820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.433585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.434324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.543596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.559660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.561814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.567137 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01e6ca03-416b-4623-8d99-06fb71ffd7c4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.911822 Oct 03 14:53:41.584583 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2441/4771] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:40 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:41.611510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:41.618002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:41.643956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.644455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.644888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.667781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:41.668463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:41.672833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:41.729592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.738000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07f3dba5-037b-464b-b247-91ec8b6eca04 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1315 microversion: 2.1 time: 0.320382 Oct 03 14:53:41.753581 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2331/4772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:41 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:41.937851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.951732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.955606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:41.959989 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9097001d-bae8-4e5c-8b84-fb2e0f2d035d tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.370654 Oct 03 14:53:41.961116 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2442/4773] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:41 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:42.446329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:42.448010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:42.470400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.471356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.472000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:42.473091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.473700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.474727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:42.599192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:42.599815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:42.619127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.633332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.633790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:42.634637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.635137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.635491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:42.773298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:42.785817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:42.788456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:42.810516 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d986e4a-5a0f-4720-a27c-0151150b937f tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.368607 Oct 03 14:53:42.814976 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2332/4774] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:42 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:42.820378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:42.835603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:42.856564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.862868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.863162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:42.863948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:42.864424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:42.864857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:42.918361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:43.019049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.042382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.044455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.050358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abc7c99a-a3b2-45ef-b2a0-d51a2a7eeb9b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.455687 Oct 03 14:53:43.060034 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2443/4775] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:42 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:43.065269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:43.074495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:43.095316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:43.097521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:43.098182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:43.100248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:43.102672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:43.107499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:43.254636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.282008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.283686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.285055 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f12d509a-6c01-4236-b4d4-701f0a7abd8f tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.223673 Oct 03 14:53:43.285628 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2444/4776] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:43 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:43.632991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:43.650019 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e38e119a-6429-456a-b77e-58cdffa32ac4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1315 microversion: 2.1 time: 0.833495 Oct 03 14:53:43.655135 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2333/4777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:42 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1315 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:43.844888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-245af4a4-69c9-45d3-bb45-83b94d707fde req-22cb2c4b-5095-4447-91bf-e5ec6eb69116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9f8245-5349-4f3d-bd11-83b4ac3d717b", "name": "network-vif-plugged", "status": "completed", "tag": "99c7f860-beb9-47bd-a87a-89c77418760e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:43.848850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:43.849761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:43.868152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:43.871956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:43.872740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:43.872980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-245af4a4-69c9-45d3-bb45-83b94d707fde req-22cb2c4b-5095-4447-91bf-e5ec6eb69116 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:43.873837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-245af4a4-69c9-45d3-bb45-83b94d707fde req-22cb2c4b-5095-4447-91bf-e5ec6eb69116 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:43.875262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-245af4a4-69c9-45d3-bb45-83b94d707fde req-22cb2c4b-5095-4447-91bf-e5ec6eb69116 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:43.877462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:43.882765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:43.895535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:43.906907 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-245af4a4-69c9-45d3-bb45-83b94d707fde req-22cb2c4b-5095-4447-91bf-e5ec6eb69116 service nova] Creating event network-vif-plugged:99c7f860-beb9-47bd-a87a-89c77418760e for instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b on n-h1-781139-2 Oct 03 14:53:43.918912 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-245af4a4-69c9-45d3-bb45-83b94d707fde req-22cb2c4b-5095-4447-91bf-e5ec6eb69116 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602584 Oct 03 14:53:43.926944 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2445/4778] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:44.088511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:44.089672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:44.115094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:44.116838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:44.120482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.121872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.125542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.127095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.128536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.129149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.251532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.260873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.265911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.269554 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b959af5-950e-4593-bbc0-c374e599c8dc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.428357 Oct 03 14:53:44.274748 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2334/4779] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:43 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:44.310704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:44.313108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:44.326750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.327620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.328298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.329296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.334470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.335243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.477621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.488756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.490820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.492428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a78b1975-11ea-42dd-88df-d13697ea0621 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.185668 Oct 03 14:53:44.516919 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2335/4780] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:44 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:44.613090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.642027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.647313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:44.648586 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83c451ec-4026-42be-a60d-428d1e3fcdc4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.567500 Oct 03 14:53:44.674805 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2446/4781] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:44 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:44.680049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:44.680813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:44.697076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.697076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.697490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.702072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:44.705246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:44.706124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:44.952287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:45.300721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:45.302012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:45.324755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.329198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.330192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:45.334505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.340565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:45.340746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.341113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:45.366531 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e2faf886-4027-4047-ac6f-5d52c760c971 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1315 microversion: 2.1 time: 0.690562 Oct 03 14:53:45.377309 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2336/4782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:44 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:45.522871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:45.523574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:45.539374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:45.542914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.548071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.549968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:45.553467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:45.556075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:45.557997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.558438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.558894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:45.561608 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2754abaf-0260-43dd-993d-c00f08068dd2 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.262453 Oct 03 14:53:45.566913 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2447/4783] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:45 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:45.682296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:45.683368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:45.697861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.698708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.699364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:45.704398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:45.705169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:45.705840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.097507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.112181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.118111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.120648 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e107f2a-9804-4d1e-bac7-714b93a1d522 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.444669 Oct 03 14:53:46.124357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2448/4784] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:45 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:46.400581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:46.402304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:46.419806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.420693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.421727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.423799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.431646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.434167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.441504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.464693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.471064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.478327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0dd3918-160e-40e3-96db-d642bc55c722 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.960591 Oct 03 14:53:46.480049 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2337/4785] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:45 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:46.595806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:46.596743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:46.612998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.617563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.619719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.621805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.622820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.626880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.787916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.806911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.812065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.817676 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a67c3735-6328-49a7-8b6a-1a4e1b62c246 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.227179 Oct 03 14:53:46.820738 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2338/4786] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:46 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:46.838611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:46.848439 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae915b09-a220-496e-9f3c-b5ec1d7dbf93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1503 microversion: 2.1 time: 0.452537 Oct 03 14:53:46.849544 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2449/4787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:46 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:46.874489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:46.877228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:46.884829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.885577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.886259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:46.887205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:46.887910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:46.888579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.048563 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56286dcc-622a-48aa-83fe-b6b080bd7b86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b/action" status: 202 len: 0 microversion: 2.1 time: 0.179421 Oct 03 14:53:47.056451 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2339/4788] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:53:46 2022] POST /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:53:47.058378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:47.058704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:47.067080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.067583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.068025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.068749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.073619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.074155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.155856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:47.156547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:47.170486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.171248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.171868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.172763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.173387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.173993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.480128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:47.506712 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e9f92e6-109b-42a2-a6e2-b3376f71a912 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1508 microversion: 2.1 time: 0.452900 Oct 03 14:53:47.513171 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2450/4789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:47 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1508 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:47.525987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:47.526870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:47.558854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.563686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.564419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.569329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.570101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.574667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.819123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:47.838816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:47.841706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:47.887197 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-768b8d7f-7e7d-4287-a8a1-a692b09d59d1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.370598 Oct 03 14:53:47.892639 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2451/4790] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:47 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:47.908197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:47.909146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:47.912456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:47.920846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.922929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.926847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:47.928377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:47.929662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:47.929803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:47.930905 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a965032c-2039-4f46-878d-4a186a4d4424 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.779364 Oct 03 14:53:47.931565 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2340/4791] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:47 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:47.932403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:47.933313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:48.034983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:48.064814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:48.067494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:48.069569 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5dd175be-9826-42fd-9b97-01a3f2a155a6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.165148 Oct 03 14:53:48.070823 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2452/4792] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:47 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:48.537419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:48.538717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:48.575878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:48.576447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:48.580279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:48.581140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:48.581583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:48.582053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:48.920985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:48.922307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:48.956391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:48.956950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:48.957412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:48.961394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:48.962304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:48.965676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.168760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.183303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.183512 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b0ebc2e3-baf8-4104-a5c2-0fb405c3fb5a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1488 microversion: 2.1 time: 0.651968 Oct 03 14:53:49.187596 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2341/4793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:48 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1488 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:49.200774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:49.202943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:49.203763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:49.228186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.228406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.228979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.230221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.230853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.231645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.245215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.264319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.266068 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18a196d7-6bd3-4b8c-acc1-14451fadbd96 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.350643 Oct 03 14:53:49.274196 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2453/4794] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:48 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:49.286112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:49.312103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:49.350356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.350899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.351295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.352022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.361701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.363175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.579159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.588541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.592847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.598750 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a0b3f7a-048d-4c42-94be-81f7effc499b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.410095 Oct 03 14:53:49.599547 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2342/4795] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:49 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:49.606979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:49.615815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:49.625157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.630289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.630930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.631818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.632438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.633056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.637690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.648389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.667323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:49.673878 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2d41469-99fa-4bea-aa80-c785a23b8f49 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.389496 Oct 03 14:53:49.692987 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2454/4796] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:49 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:49.704603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:53:49.860400 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14952e04-f4ca-4c34-b142-fd2a2f7eb39b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 204 len: 0 microversion: 2.1 time: 0.258201 Oct 03 14:53:49.861679 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2343/4797] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:53:49 2022] DELETE /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:53:49.875577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:49.877322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:49.898561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.903337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.904080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:49.910333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:49.911209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:49.911769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.308038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:50.308866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:50.325528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.327183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.330681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.336603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.339719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.345204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.464062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:50.475448 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8c35098-d6f9-4894-be8c-7cb90138733e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1494 microversion: 2.1 time: 0.605469 Oct 03 14:53:50.481059 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2455/4798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:49 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1494 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:50.630600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:50.632019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:50.643343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.651074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.652106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.660975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.661977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.662648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.817032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:50.849246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:50.852263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:50.855137 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49a60e3a-b18f-4ffe-be4d-05d2a3021a1a tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.552010 Oct 03 14:53:50.856674 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2344/4799] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:50 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:50.871943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:50.877796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:50.901630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.904600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.907642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:50.908558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:50.913584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:50.914529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:51.133397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:51.143672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:51.150330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:51.152660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:51.154758 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df7f2cfa-2d21-49d1-8b22-89c2c54101a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.528215 Oct 03 14:53:51.165219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:51.170573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:51.172004 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-632e3e91-bc67-4ea1-8cb2-f7796b31738e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.312258 Oct 03 14:53:51.180671 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2456/4800] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:50 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:51.185312 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2345/4801] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:50 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:51.518998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:51.529456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:51.563227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:51.563745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:51.569962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:51.572393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:51.572957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:51.573417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:51.888117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:51.889462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:51.903364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:51.912911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:51.915172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:51.933483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:51.934426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:51.935987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:52.331444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:52.350307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:52.362912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:52.374842 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-673ec786-0558-4aef-adf4-ed387117f1cb tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.491169 Oct 03 14:53:52.397046 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2346/4802] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:51 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:52.402815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:52.403772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:52.416519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:52.425727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:52.433652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:52.434812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:52.435515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:52.436185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:52.510685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:53.260219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.285168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.286989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.288393 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-938ab059-25aa-4dd4-9b47-5a9c166fe171 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.889898 Oct 03 14:53:53.298425 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2347/4803] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:52 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:53.303775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:53.304559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:53.318606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:53.319338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:53.319909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:53.320778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:53.333755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:53.335071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:53.642218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.652731 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e5b18f2-91ad-42ac-a0f7-1a5b121bd97a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1494 microversion: 2.1 time: 2.147256 Oct 03 14:53:53.665772 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2457/4804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:51 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1494 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:53.670239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.681442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.690600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:53.697680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-22e7b8f9-7a67-4a73-885b-2b3be042a465 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.396551 Oct 03 14:53:53.698147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:53.699128 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2348/4805] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:53 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:53.709297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:53.734438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:53.735652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:53.736348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:53.737354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:53.738036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:53.739809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:54.129854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:54.143817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:54.158978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:54.166530 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7f3ef7b-5dbe-4d13-8db7-c140b8e36c4c tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.499230 Oct 03 14:53:54.193022 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2458/4806] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:53 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:54.265854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-32fd8044-86cd-4e41-b120-7db6dc5ce0b9 req-ff3761b7-acdb-44c2-bd90-1ec493382250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9f8245-5349-4f3d-bd11-83b4ac3d717b", "name": "network-vif-deleted", "tag": "99c7f860-beb9-47bd-a87a-89c77418760e"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:54.324439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-32fd8044-86cd-4e41-b120-7db6dc5ce0b9 req-ff3761b7-acdb-44c2-bd90-1ec493382250 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:54.331260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-32fd8044-86cd-4e41-b120-7db6dc5ce0b9 req-ff3761b7-acdb-44c2-bd90-1ec493382250 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:54.331719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-32fd8044-86cd-4e41-b120-7db6dc5ce0b9 req-ff3761b7-acdb-44c2-bd90-1ec493382250 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:54.337750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:54.337750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:54.346825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:54.358786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:54.359438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:54.360355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:54.361015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:54.361598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:54.427581 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-32fd8044-86cd-4e41-b120-7db6dc5ce0b9 req-ff3761b7-acdb-44c2-bd90-1ec493382250 service nova] Creating event network-vif-deleted:99c7f860-beb9-47bd-a87a-89c77418760e for instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b on n-h1-781139-2 Oct 03 14:53:54.456156 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-32fd8044-86cd-4e41-b120-7db6dc5ce0b9 req-ff3761b7-acdb-44c2-bd90-1ec493382250 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195974 Oct 03 14:53:54.456787 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2349/4807] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:53:54.691594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:54.692855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:54.717577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:54.722979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:54.723822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:54.731472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:54.736276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:54.737310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:54.931045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:54.944109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:54.947703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:54.948357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lazy-loading 'fault' on Instance uuid ba9f8245-5349-4f3d-bd11-83b4ac3d717b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:53:55.341639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.360534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.388017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.395445 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53b3d23f-6115-4950-b2f3-38d19f7a0125 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 1.063535 Oct 03 14:53:55.448984 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2459/4808] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:54 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:55.457603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:55.467277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:55.487800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:55.489202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:55.489202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:55.503324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:55.505367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:55.507998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:55.617432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.627597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-985ef27c-a6f9-4309-a89b-481adb04298d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 200 len: 1305 microversion: 2.1 time: 0.942475 Oct 03 14:53:55.628761 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2350/4809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:54 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 1305 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:53:55.656468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.667088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.668981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.670542 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db552787-a6c8-415a-8b41-bd0b6a3db7ca tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.221145 Oct 03 14:53:55.671612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2460/4810] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:55 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:55.678271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:55.679131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:55.687820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:55.688695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:55.689482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:55.690631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:55.691453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:55.693135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:55.829523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.846865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.851697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:55.852472 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cc1e8d7-fd31-4a92-9d21-3a49dc028295 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.179166 Oct 03 14:53:55.855467 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2461/4811] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:55 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:56.454775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1396284698", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c1d13082-d519-4d41-92e1-3ab9b74dfbc3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:56.460731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:56.461451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:56.471310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:53:56.474056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:56.474879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:56.475621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:56.476702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:56.477452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:56.478114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:56.591364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] validate_networks() for [('c1d13082-d519-4d41-92e1-3ab9b74dfbc3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:53:56.952838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:56.970134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:56.972139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:56.973665 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f904e35-39ee-450e-9c54-f145daa8be8f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.517796 Oct 03 14:53:56.974962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2462/4812] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:56 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:53:57.017213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:57.041237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:57.050532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:57.050532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:57.053420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:57.057733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:57.059777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:57.063788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:57.104129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b HTTP/1.1 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ba9f8245-5349-4f3d-bd11-83b4ac3d717b'} Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:53:57.108432 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:57.113896 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:53:57.113896 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:53:57.113896 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:53:57.113896 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:53:57.113896 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:53:57.113896 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:53:57.113896 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:53:57.117254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:53:57.118483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ca2c813-dad1-4a60-97e7-bba0b49b727f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 404 len: 111 microversion: 2.1 time: 0.142308 Oct 03 14:53:57.119997 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2463/4813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:56 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:53:57.140207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:57.141269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:57.151112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:57.152134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:57.152857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:57.153772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:57.154540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:57.155626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:57.240854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:57.252530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:57.254122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:57.255346 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8de2376-7d5b-4695-a8ec-7867a0418c0c tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.122103 Oct 03 14:53:57.256383 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2464/4814] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:57 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:57.261755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:57.262726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:57.273047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:57.273548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:57.273991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:57.274788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:57.275261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:57.275686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:57.387749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:57.401567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:57.404179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:57.406644 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-593ed98b-dc66-41be-9d14-8d457e0336b3 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.148723 Oct 03 14:53:57.407425 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2465/4815] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:57 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:57.477428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1029903506", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fd28a296-d4d0-487d-b766-c66e0eb4645b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:53:57.597093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] validate_networks() for [('fd28a296-d4d0-487d-b766-c66e0eb4645b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:53:58.298757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:53:58.299875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:53:58.300586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:53:58.301184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:53:58.301779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:53:58.324543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:58.325080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:58.325526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:58.326276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:58.326741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:58.327175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:58.420223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Getting quotas for project 86fd90c18f324aa9b38ecdd9a225af9e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:53:58.433361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Getting quotas for user 6bd37b8f66f945548f26f6100400623c and project 86fd90c18f324aa9b38ecdd9a225af9e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:53:58.484915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Going to run 3 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:53:58.489310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:53:58.571654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=c5cc1094-bb23-4039-a3a4-b7434ce0bb75,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:53:58.650565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:53:58.652566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:53:58.653418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:53:58.654051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:53:58.654695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:53:58.671028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=d315eb8c-e25c-49bd-80cc-aab46e8bf424,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:53:58.673341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:58.674792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:58.675493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:58.676470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:58.677400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:58.678061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:58.704279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:53:58.714165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for user 3569fcf74b3b4e3d99b0dbcd5465d97d and project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:53:58.737940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:53:58.744982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:53:58.856372 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b9d3842e-cfc7-4319-9cfb-243b32e7e0a3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.226098 Oct 03 14:53:58.857787 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2351/4816] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:53:58.868302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:58.869304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:58.881398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:58.882104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:58.882710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:58.883489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:58.883931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:58.897995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:58.954555 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b77dce7-9d20-43b5-8f0f-06c9d76bcbf0 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476526 Oct 03 14:53:58.965519 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2466/4817] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:53:58.989316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:58.989316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:59.060391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:59.060908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:59.061384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:59.072022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:59.072919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:59.084643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:59.280602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.306872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.311436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.313884 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-debe86ce-b57f-457e-a914-5145833ace61 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.347285 Oct 03 14:53:59.316279 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2467/4818] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:58 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:59.331734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:59.332755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:59.350594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:59.354528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.362729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:59.365848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:59.370003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:59.370873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.371517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:59.374604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:59.376087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.380107 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b598d8d7-fe22-40f1-8f75-8832d10d7b64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.519805 Oct 03 14:53:59.384745 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2352/4819] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:58 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:59.394034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:59.403729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.410219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:53:59.507994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:59.510263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:59.513320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:59.518503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:53:59.521659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:53:59.522166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:53:59.578144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.602881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.605421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.606699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d19034f-9371-407c-a6fb-c7dcc4c69e09 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.288653 Oct 03 14:53:59.614976 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2468/4820] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:53:59 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:53:59.625256 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b906ee1-5a78-4f60-bfee-555169dfc5ff tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.239217 Oct 03 14:53:59.630303 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2353/4821] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:53:59 2022] GET /compute/v2.1/servers => generated 1018 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:59.632043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c101ccb-fb97-4339-855c-958d5405ed52 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:59.639074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-84e343ed-1e1a-41a1-a44b-b221589693b8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:53:59.641481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c101ccb-fb97-4339-855c-958d5405ed52 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:59.648233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-84e343ed-1e1a-41a1-a44b-b221589693b8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:53:59.874742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c101ccb-fb97-4339-855c-958d5405ed52 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.889559 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c101ccb-fb97-4339-855c-958d5405ed52 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1215 microversion: 2.1 time: 0.263152 Oct 03 14:53:59.895620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84e343ed-1e1a-41a1-a44b-b221589693b8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:53:59.904506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-84e343ed-1e1a-41a1-a44b-b221589693b8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1223 microversion: 2.1 time: 0.269289 Oct 03 14:53:59.905191 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2354/4822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:59 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1223 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:53:59.906443 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2469/4823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:53:59 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1215 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:00.346124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:00.346797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:00.353787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.354290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.354726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.355438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.355889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.356307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.413298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:00.414072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:00.453573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.457056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.457705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.460853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.476264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.476864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.621787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.634313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.636294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.637897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47bb3055-69a0-4df4-a66b-68721f450de9 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.295892 Oct 03 14:54:00.639064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2470/4824] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:00 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:54:00.645319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:00.646200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:00.653794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.654881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.655575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.656521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.657560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.659058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.893732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.915091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.928293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.929912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.932474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.933330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:00.934841 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92e95a8f-6092-4407-8968-8a2bdb1619ea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.525693 Oct 03 14:54:00.936851 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2355/4825] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:00 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:00.937427 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbe0e290-22b6-428a-b57b-a3e1510df6f1 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.297042 Oct 03 14:54:00.939346 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2471/4826] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:00 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:00.947443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:00.948095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b735ea8e-e38a-4992-a557-0b64fb8a85ee tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:00.948757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b735ea8e-e38a-4992-a557-0b64fb8a85ee tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:00.949771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:00.963603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.965304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.966813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:00.969744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:00.971223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:00.972026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:01.089839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b735ea8e-e38a-4992-a557-0b64fb8a85ee tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:01.110845 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b735ea8e-e38a-4992-a557-0b64fb8a85ee tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1223 microversion: 2.1 time: 0.167680 Oct 03 14:54:01.110845 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2472/4827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:00 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1223 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:01.161459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:01.183426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e750b8bb-bbd5-4a0f-8337-73833dcc69bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1211 microversion: 2.1 time: 0.238059 Oct 03 14:54:01.186241 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2356/4828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:00 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1211 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:01.669062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:01.669998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:01.694336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:01.694870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:01.698460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:01.700327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:01.703949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:01.706808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:01.984052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:01.986108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:01.995803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:01.999991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:02.014080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.014907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.015492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.017153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.018615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.022587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.025530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.029309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.031993 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8a1f2e2-d33a-4f59-9c77-1285a7126f42 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.368202 Oct 03 14:54:02.044143 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2473/4829] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:01 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:02.052866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:02.063925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:02.093058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.093936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.098519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.099652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.100336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.101020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.228854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.245778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.248798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.250737 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb930375-32c5-4501-a699-81fbe9a92a18 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.270667 Oct 03 14:54:02.251993 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2357/4830] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:01 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:02.257100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:02.258078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:02.262327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:02.266472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.267304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.268473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.269491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.270236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.270892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.439131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.452284 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a1182cba-81e6-40f4-857a-09fd046df1f1 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1219 microversion: 2.1 time: 0.198850 Oct 03 14:54:02.453736 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2358/4831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:02 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:02.473788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:02.474827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:02.484450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.492183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.493373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.494868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:02.495507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:02.496238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:02.521300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.544367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.548729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.552985 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c1c3cfd-bf38-49f2-999f-e294feddda07 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1740 microversion: 2.20 time: 0.507141 Oct 03 14:54:02.553631 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2474/4832] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:02 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:02.844031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:02.864398 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6486338-f524-464a-8c99-3d76ba56ace6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1275 microversion: 2.1 time: 0.407620 Oct 03 14:54:02.866043 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2359/4833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:02 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1275 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:03.062166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:03.063454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:03.079158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.082532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.083750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.098479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.108340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.109099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.242787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:03.247431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:03.255962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.256855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.257575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.258886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.259922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.260556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.321478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:03.327155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lazy-loading 'flavor' on Instance uuid c34f6896-67b3-4663-a15e-350a205c2a59 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:54:03.352889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:03.356649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:03.359702 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31bbea8f-30cf-46d6-9866-24d8ef2e03fc tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.302661 Oct 03 14:54:03.361057 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2475/4834] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:03 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:03.369767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:03.370842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:03.379914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.380745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.381610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.400335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.401249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.402348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.784082 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b121ec25-6981-481c-a3b6-0b414f9f9951 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/action" status: 200 len: 32 microversion: 2.1 time: 0.546605 Oct 03 14:54:03.793895 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2360/4835] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:54:03 2022] POST /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/action => generated 32 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:54:03.810414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:03.814685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:03.839343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.841473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.842328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.847802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:03.849321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:03.850924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:03.971979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:03.990554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:03.992294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:03.993757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1dd7a697-6ac0-43de-8bc9-1205f1e90e8e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.630066 Oct 03 14:54:03.994998 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2476/4836] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:03 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:04.015299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:04.019480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:04.042159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:04.043166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:04.043870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:04.045030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:04.045793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:04.046441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:04.315716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:04.324810 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bd57a0f1-5202-4518-99bf-dc3102ead912 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1281 microversion: 2.1 time: 0.528028 Oct 03 14:54:04.330944 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2361/4837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:03 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1281 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:04.346630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:04.347737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:04.354347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:04.356325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:04.357755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:04.358724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:04.363718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:04.364135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.114499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.135313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.137385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.139806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75619c67-2652-4121-8495-9a0b175bbbb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1722 microversion: 2.20 time: 1.143364 Oct 03 14:54:05.159592 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2477/4838] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:03 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1722 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:05.170647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:05.171698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:05.179668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.181651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.182338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.183297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.183941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.184564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.378704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.405210 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2e323cf-e82e-4111-a185-a1140e99576a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1273 microversion: 2.1 time: 0.233940 Oct 03 14:54:05.406846 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2478/4839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:05 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:05.414718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:05.415397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:05.421720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.422453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.423105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.423993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.424595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.425209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.570415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.577856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.581360 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6bc7536e-5115-40d5-9889-9fd9f5d5445e tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 1.249029 Oct 03 14:54:05.586611 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2362/4840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:04 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:05.591769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.593294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.594530 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c755ffd9-83be-4e87-ba84-7e7cf97d8bc4 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.185737 Oct 03 14:54:05.599299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:05.602495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:05.615605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.617254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.617942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.620357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2479/4841] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:05 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:05.621553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.624073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.624720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.635121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:05.636980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:05.650598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.653689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.655218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.661131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:05.662941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:05.663572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:05.802415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.832865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.842179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.844768 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de1d32e0-825d-4726-8ec8-633b1c200a27 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.256600 Oct 03 14:54:05.846535 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2363/4842] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:05 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:05.954803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:05.974142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2ce9f60-a45a-4b73-86f9-f73e351b9205 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 0.351900 Oct 03 14:54:05.975884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2480/4843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:05 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:06.183717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:06.187247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:06.205985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.208225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.209310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:06.211538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.218830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.220317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:06.434792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:06.435511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:06.442370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.443490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.444098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:06.445228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.445850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.447525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:06.896985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:06.906020 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75f9b0f0-5cd7-4c56-8cfd-0e9d77de8e72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1315 microversion: 2.1 time: 0.477718 Oct 03 14:54:06.906645 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2481/4844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:06 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:06.915397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:06.916171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:06.940827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.941604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.942622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:06.944495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:06.945470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:06.946255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.189704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.194533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:07.213608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.216683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.219117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f4c9710-584b-420f-88bf-0778ab428d5d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1722 microversion: 2.20 time: 1.047538 Oct 03 14:54:07.220029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.220536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2364/4845] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:06 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1722 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:07.229369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:07.230275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:07.240708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.242102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.243892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.245521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.246445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.249925 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66f881e9-513e-4e48-88fa-beff7b4c84d6 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.339014 Oct 03 14:54:07.250526 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2482/4846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:06 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:07.260836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.261992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-10f905a1-14cb-46bc-8f0d-35a1c096a684 req-c8c6f0e7-49b6-4c6f-9641-28d4975b8090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ea3c31-c873-4937-b6cc-ebd75656c505", "name": "network-vif-unplugged", "status": "completed", "tag": "9f346b0f-8c27-4255-97c2-a5d960be0a91"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:07.305458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10f905a1-14cb-46bc-8f0d-35a1c096a684 req-c8c6f0e7-49b6-4c6f-9641-28d4975b8090 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.305951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10f905a1-14cb-46bc-8f0d-35a1c096a684 req-c8c6f0e7-49b6-4c6f-9641-28d4975b8090 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.306374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10f905a1-14cb-46bc-8f0d-35a1c096a684 req-c8c6f0e7-49b6-4c6f-9641-28d4975b8090 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.332484 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-10f905a1-14cb-46bc-8f0d-35a1c096a684 req-c8c6f0e7-49b6-4c6f-9641-28d4975b8090 service nova] Creating event network-vif-unplugged:9f346b0f-8c27-4255-97c2-a5d960be0a91 for instance b9ea3c31-c873-4937-b6cc-ebd75656c505 on n-h2-781139-2 Oct 03 14:54:07.353344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-10f905a1-14cb-46bc-8f0d-35a1c096a684 req-c8c6f0e7-49b6-4c6f-9641-28d4975b8090 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096450 Oct 03 14:54:07.354020 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2483/4847] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:07.366711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:07.367523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:07.384444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.385158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.385522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.389906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.390410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.390984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.766405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.793109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.798095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.802627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.807997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.809208 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fdca487a-9d20-4648-ba73-b9be16f871e3 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1365 microversion: 2.57 time: 0.584961 Oct 03 14:54:07.811256 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2365/4848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:07 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1365 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:07.824051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:07.833218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:07.835686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:07.841344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e41ad2a-b511-4311-8566-8087c81f73a2 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.470190 Oct 03 14:54:07.842665 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2484/4849] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:07 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:07.857021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ce26fc7f-2e15-4d21-8812-9947c6cd9e8d req-e4031158-c381-4ab2-a151-cbb93413fa02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e6319e-de09-4df3-9695-6a571b44dc00", "tag": "1bc7b76c-ec37-4846-9019-39d5816c9cea"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:07.878665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce26fc7f-2e15-4d21-8812-9947c6cd9e8d req-e4031158-c381-4ab2-a151-cbb93413fa02 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.879553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce26fc7f-2e15-4d21-8812-9947c6cd9e8d req-e4031158-c381-4ab2-a151-cbb93413fa02 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.880251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ce26fc7f-2e15-4d21-8812-9947c6cd9e8d req-e4031158-c381-4ab2-a151-cbb93413fa02 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.880375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.881790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.882498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.883471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.884103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.884686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.896509 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ce26fc7f-2e15-4d21-8812-9947c6cd9e8d req-e4031158-c381-4ab2-a151-cbb93413fa02 service nova] Creating event network-changed:1bc7b76c-ec37-4846-9019-39d5816c9cea for instance 87e6319e-de09-4df3-9695-6a571b44dc00 on n-h1-781139-2 Oct 03 14:54:07.914994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ce26fc7f-2e15-4d21-8812-9947c6cd9e8d req-e4031158-c381-4ab2-a151-cbb93413fa02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070433 Oct 03 14:54:07.916091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2485/4850] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:07.931974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:07.933066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:07.945228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.946216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.949608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:07.950714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:07.951406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:07.952051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.236210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:08.247280 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18416322-cf01-45f2-ba49-1b9eb64df28e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1315 microversion: 2.1 time: 0.319706 Oct 03 14:54:08.264953 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2486/4851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:07 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:08.264953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:08.264953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:08.286582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.287483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.288152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.291846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.292618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.294813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.636027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:08.653192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:08.654976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:08.656403 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13101e47-9c79-4f13-b4ef-47bdde423bca tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1725 microversion: 2.20 time: 0.396638 Oct 03 14:54:08.659606 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2487/4852] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:08 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:08.677832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:08.680142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:08.688975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.689874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.690561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:08.691795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.692916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.693607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.694354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.695355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:08.704692 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12f94765-599a-4793-876f-a70974f637da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 0.889887 Oct 03 14:54:08.705339 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2366/4853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:07 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:08.711190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "492439a7-2f70-4b30-9c1b-1558267eb48b"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:08.723340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:08.743012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.745873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.748066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.750350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.752488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.754103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.924749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:08.936297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f015bca3-203c-4474-864a-005c3a1761db tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.275380 Oct 03 14:54:08.937305 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2488/4854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:08 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:08.942686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:08.943591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:08.950408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.950897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.951671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:08.952392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:08.953148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:08.953759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.132850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:09.155262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:09.160001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:09.163437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7a9bce3-bcb3-47cd-b43e-2c184d3b197b tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1371 microversion: 2.57 time: 0.223995 Oct 03 14:54:09.167204 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2489/4855] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:08 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:09.188989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:09.191153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:09.208309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.209225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.211198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.214657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.215520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.217720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.384760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:09.399070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:09.409764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:09.411224 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2ff51ab-ee22-465c-b818-a49bb9a4a4c4 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.237907 Oct 03 14:54:09.412300 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2490/4856] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:09 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:09.417290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:09.418114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:09.425144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.429652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.430456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.430864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13d551cb-8a8b-434c-88cd-aae419ac4342 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.723839 Oct 03 14:54:09.431540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2367/4857] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 3 14:54:08 2022] POST /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 188 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:54:09.431861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.432652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.433323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.706172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:09.707422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:09.715145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:09.718643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.719161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.720218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.721130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.721767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.722368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.786282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128868) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 14:54:09.901288 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6f7ff63-16e5-46e6-81ac-816ceef62722 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/action" status: 202 len: 0 microversion: 2.20 time: 0.198581 Oct 03 14:54:09.903260 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2368/4858] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:54:09 2022] POST /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:54:09.934964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:09.936576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:09.952244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:09.953842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.954338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.954797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:09.960312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:09.960981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:09.962757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.036910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:10.040912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:10.067504 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa82f8c9-8b22-4fcf-909c-cab05e479ea6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1315 microversion: 2.1 time: 0.653296 Oct 03 14:54:10.080958 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2491/4859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:09 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:10.080958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:10.081766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:10.094774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.096577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.101081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.102445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.103307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.104045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.295456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:10.305415 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04181bd6-77d7-4c51-b182-848f3c351913 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 0.380725 Oct 03 14:54:10.311092 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2369/4860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:09 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:10.320278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:10.323113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:10.336417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.340481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.341830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.344719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.345498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.349478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.582357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:10.599876 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-47834439-45fd-4e03-bc25-10549b02167f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.282875 Oct 03 14:54:10.601220 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2370/4861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:10 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:10.613322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:10.615994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:10.658873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.664083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.664083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:10.664083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:10.668832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:10.672451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.051706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.074968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.076911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.093670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87b154be-67f0-48a0-9f50-d29a35caff20 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1356 microversion: 2.57 time: 0.475158 Oct 03 14:54:11.094921 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2371/4862] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:10 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1356 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:11.105774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:11.106642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:11.107587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:11.119547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.120319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.121130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.121992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.123703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.126173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.328288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.344791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.346478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.352529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e2588e76-1105-4df3-918f-8e05d56ec73b tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.254306 Oct 03 14:54:11.353478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2372/4863] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:11 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:11.369578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.377180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:11.378166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:11.384823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.387753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.390310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.392331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.393733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.398110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.398706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.409853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:11.412223 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ed801ca-60fb-42cc-908d-70c30e5738de tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1751 microversion: 2.20 time: 1.337303 Oct 03 14:54:11.414848 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2492/4864] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:10 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1751 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:11.424052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:11.426393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:11.450342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.451232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.451896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.452918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.453656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.454317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.538935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:54:11.703787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1864db1a-e2d2-4379-8cdf-aa56495f5ee8 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 204 len: 0 microversion: 2.57 time: 0.287272 Oct 03 14:54:11.707612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2493/4865] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:54:11 2022] DELETE /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:54:11.713685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:11.716171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:11.729803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.732111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.733142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:11.734513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:11.736380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:11.738158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:12.556050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:12.571740 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-237f612c-7767-449a-b63c-ad59d925e580 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1315 microversion: 2.1 time: 1.201642 Oct 03 14:54:12.578817 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2373/4866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:11 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1315 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:12.583749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:12.590980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:12.630918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:12.631705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:12.632354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:12.633273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:12.639429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:12.640092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:12.746631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:12.764959 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee15d7a6-37d9-4e61-a983-d24defd2d6f4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 1.054071 Oct 03 14:54:12.779633 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2494/4867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:11 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:12.804740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:12.805827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:12.819287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:12.820161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:12.820860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:12.821799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:12.822436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:12.823064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.061949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.075778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.080061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.088735 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-584ff86d-650e-47f5-bbe5-3e3836914fb6 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1362 microversion: 2.57 time: 0.307636 Oct 03 14:54:13.090212 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2495/4868] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:12 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:13.100985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-db970ebf-45ad-4f1d-a6f2-265e440ae631 req-2e34b570-ef1d-4490-9b61-d738e2588dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178e30c6-88b2-47f9-a992-6a5b28e21200", "tag": "b7fdd165-ae58-49e8-8d85-71ce06def13b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:13.150222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db970ebf-45ad-4f1d-a6f2-265e440ae631 req-2e34b570-ef1d-4490-9b61-d738e2588dda service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.152271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db970ebf-45ad-4f1d-a6f2-265e440ae631 req-2e34b570-ef1d-4490-9b61-d738e2588dda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.154837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db970ebf-45ad-4f1d-a6f2-265e440ae631 req-2e34b570-ef1d-4490-9b61-d738e2588dda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.205297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-db970ebf-45ad-4f1d-a6f2-265e440ae631 req-2e34b570-ef1d-4490-9b61-d738e2588dda service nova] Creating event network-changed:b7fdd165-ae58-49e8-8d85-71ce06def13b for instance 178e30c6-88b2-47f9-a992-6a5b28e21200 on n-h2-781139-2 Oct 03 14:54:13.218665 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-db970ebf-45ad-4f1d-a6f2-265e440ae631 req-2e34b570-ef1d-4490-9b61-d738e2588dda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126965 Oct 03 14:54:13.225631 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2496/4869] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:13.231591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:13.238143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:13.254046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.256299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.258283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.262547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.263791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.264390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.269815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.281431 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a0080c9-8065-44e0-aa14-c13b1e31c01b tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.701316 Oct 03 14:54:13.282623 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2374/4870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:12 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:13.301205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:13.302552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:13.313969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.325355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.326055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.326959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.329846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.330497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.482070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.499995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.501834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.506044 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf77e210-a367-46e9-b3bc-49b9e8a48c71 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.278730 Oct 03 14:54:13.521358 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2497/4871] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:13 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:13.521358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4509182e-8ccb-43ac-ac7f-e9aa8f5bceb6 req-5a585994-0ada-46a4-a238-7cc143a562c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e6319e-de09-4df3-9695-6a571b44dc00", "name": "network-vif-plugged", "status": "completed", "tag": "1bc7b76c-ec37-4846-9019-39d5816c9cea"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:13.541887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4509182e-8ccb-43ac-ac7f-e9aa8f5bceb6 req-5a585994-0ada-46a4-a238-7cc143a562c4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.542377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4509182e-8ccb-43ac-ac7f-e9aa8f5bceb6 req-5a585994-0ada-46a4-a238-7cc143a562c4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.542824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4509182e-8ccb-43ac-ac7f-e9aa8f5bceb6 req-5a585994-0ada-46a4-a238-7cc143a562c4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.566958 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4509182e-8ccb-43ac-ac7f-e9aa8f5bceb6 req-5a585994-0ada-46a4-a238-7cc143a562c4 service nova] Creating event network-vif-plugged:1bc7b76c-ec37-4846-9019-39d5816c9cea for instance 87e6319e-de09-4df3-9695-6a571b44dc00 on n-h1-781139-2 Oct 03 14:54:13.577535 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4509182e-8ccb-43ac-ac7f-e9aa8f5bceb6 req-5a585994-0ada-46a4-a238-7cc143a562c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068914 Oct 03 14:54:13.586099 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2498/4872] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:13.641715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:13.642932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:13.679475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.680300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.680961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.692119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.693558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.695019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.890619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.901246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.921661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:13.922972 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2109ab1-fc69-4ee7-ade4-d6e1ba2948e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1753 microversion: 2.20 time: 0.639251 Oct 03 14:54:13.923578 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2375/4873] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:13 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1753 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:13.936364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:13.937370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:13.952735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.969921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.970650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:13.971673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:13.972284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:13.972870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.011043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.026854 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59287bc5-049f-4b31-ab2e-d49e84966eb5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1315 microversion: 2.1 time: 0.402175 Oct 03 14:54:14.028152 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2499/4874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:13 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:14.120216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:14.120876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:14.131016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:14.138829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.144249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.144955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.148184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.148880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.154409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.349884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.361524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.369646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.373339 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4185d375-6e09-4e9e-865e-501b08acf474 tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1362 microversion: 2.57 time: 0.257455 Oct 03 14:54:14.378074 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2500/4875] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:14 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:14.388227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:14.393281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:14.407925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.412335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.413192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.416848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.417689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.418283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.667850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.679066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12c5808f-68f7-41d1-a1ac-318fd1a2bb31 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.299064 Oct 03 14:54:14.692981 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2501/4876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:14 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:14.692981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:14.692981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:14.695316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.698878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.698878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.701308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.701795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.702233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.832483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.850691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.857523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.863364 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e7701ab2-dc05-47de-89f1-c9748beebc02 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1605 microversion: 2.32 time: 0.180109 Oct 03 14:54:14.877072 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2502/4877] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:14 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1605 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:14.911050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:14.923133 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-654c85e4-3c03-401d-86cf-179b39cabae3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 0.990701 Oct 03 14:54:14.926533 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2376/4878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:13 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:14.955100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:14.955725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:14.964171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.964679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.965149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:14.965866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:14.966320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:14.966748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.060280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:15.062137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:15.077084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:15.079145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:15.080292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.083932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:15.084914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:15.085632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.304386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.316344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.317842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.319061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2dede0af-1a1a-4aea-80c3-8baecfa7d239 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1753 microversion: 2.20 time: 0.369142 Oct 03 14:54:15.319646 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2503/4879] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:14 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1753 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:15.458839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.461902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:15.476231 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5dd8b704-bd31-4854-8c35-e3f2f42d2463 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1315 microversion: 2.1 time: 0.422315 Oct 03 14:54:15.479778 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2377/4880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:15 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:15.496237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:15.497094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:15.512331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:15.513104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:15.519417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.520396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:15.521112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:15.521706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.814210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-303c75db-0399-4fc0-bea7-d90144053086 req-58d78547-802d-4816-95a9-aafc48fd103d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5cc1094-bb23-4039-a3a4-b7434ce0bb75", "tag": "eb23d923-f246-455d-b91d-6ebb13385706"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:15.839048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-303c75db-0399-4fc0-bea7-d90144053086 req-58d78547-802d-4816-95a9-aafc48fd103d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:15.842292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-303c75db-0399-4fc0-bea7-d90144053086 req-58d78547-802d-4816-95a9-aafc48fd103d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:15.843780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-303c75db-0399-4fc0-bea7-d90144053086 req-58d78547-802d-4816-95a9-aafc48fd103d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:15.944590 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-303c75db-0399-4fc0-bea7-d90144053086 req-58d78547-802d-4816-95a9-aafc48fd103d service nova] Creating event network-changed:eb23d923-f246-455d-b91d-6ebb13385706 for instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 on n-h1-781139-2 Oct 03 14:54:15.958988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.960252 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-303c75db-0399-4fc0-bea7-d90144053086 req-58d78547-802d-4816-95a9-aafc48fd103d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.637016 Oct 03 14:54:15.963007 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2504/4881] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:15.972523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:15.980298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:15.984432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.993770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07b106da3ac4159b0a4b9819b6904ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624a6131d5ca4ed68c9c1c6b6656275a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:15.995013 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d95afff5-71eb-4be3-bd55-9e591d79b05e tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 200 len: 1362 microversion: 2.57 time: 0.513862 Oct 03 14:54:15.995601 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2378/4882] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:15 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:16.008354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.009417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.010296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.012973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.013892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.019056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.032613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:16.033292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:16.050639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.051367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.052247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.060416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.061561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.062028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.169592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.170339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.170932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.173873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lazy-loading 'fault' on Instance uuid b16ab3a3-6ac6-45cd-9f58-5e908acd153b {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:54:16.273773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.285263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.286935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5f6c97e624784092a1302a2ba80f23bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e82f647a944e6db03d55e48bb87c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.288605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e2b135a-1377-4a6c-868c-3ad032f139bd tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 200 len: 1610 microversion: 2.32 time: 0.291945 Oct 03 14:54:16.297258 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2379/4883] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:15 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 1610 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:16.312678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:16.317410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:16.330972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.333214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.342367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.343943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.344811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.345434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.352120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.361299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0596579-8e92-457a-a87c-7d6d7e529031 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.396974 Oct 03 14:54:16.364108 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2505/4884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:15 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:16.373596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:16.374470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:16.391271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.393596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.394419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.396269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.408183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.410178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.854489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.877188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.877188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:16.877188 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63a3fab2-749d-46e4-88b2-34d5a8a5ab70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1753 microversion: 2.20 time: 0.509699 Oct 03 14:54:16.883341 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2506/4885] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:16 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1753 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:16.897729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:16.898375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:16.926755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.931877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.934912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:16.935706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:16.936192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:16.942025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.204136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:17.222124 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-727b553e-cebb-46cd-b419-ae7a4223387f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 0.917207 Oct 03 14:54:17.223519 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2380/4886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:16 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:17.240669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:17.241586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] [instance: 07769480-9210-4ea6-8b9a-8bf1880a7c68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.266365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.274771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.277175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.281298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.282956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.288477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.312774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:17.324557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65a793d8-b531-47a1-8fc6-5fc05bba9454 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1503 microversion: 2.1 time: 0.439242 Oct 03 14:54:17.325201 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2507/4887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:16 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:17.351300 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] HTTP exception thrown: Instance 07769480-9210-4ea6-8b9a-8bf1880a7c68 could not be found. Oct 03 14:54:17.351858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:17.352530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Request method failure captured: Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 HTTP/1.1 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvdscgT9rUzYEtImF_ycL-4wrGJM7ROyFzZoYW3aXla_ZWVp_6antuajVFB6aI4c4DIEYZ7SR5SrVB6Ev8aF6rwgHwGYsTO9Ak6cQvs_yqcWyjKFo9vcPMMVmYTHBUVtiurzYmyC8krJv-kg2k_IFrsAbMyfm7FGFrI-wyrm75OvGcc Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.57 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 624a6131d5ca4ed68c9c1c6b6656275a Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerShowV257Test-33475353 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/624a6131d5ca4ed68c9c1c6b6656275a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_624a6131d5ca4ed68c9c1c6b6656275a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/624a6131d5ca4ed68c9c1c6b6656275a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/624a6131d5ca4ed68c9c1c6b6656275a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerShowV257Test-33475353 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 624a6131d5ca4ed68c9c1c6b6656275a Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerShowV257Test-33475353 Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerShowV257Test-33475353-project Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d07b106da3ac4159b0a4b9819b6904ae Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerShowV257Test-33475353-project Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 07769480-9210-4ea6-8b9a-8bf1880a7c68 could not be found. Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '07769480-9210-4ea6-8b9a-8bf1880a7c68'} Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07769480-9210-4ea6-8b9a-8bf1880a7c68 could not be found. Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07769480-9210-4ea6-8b9a-8bf1880a7c68 could not be found. Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:17.354934 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.359884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.359884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:17.359884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:17.359884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:17.359884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:17.359884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07769480-9210-4ea6-8b9a-8bf1880a7c68 could not be found. Oct 03 14:54:17.359884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.369580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] Returning 404 to user: Instance 07769480-9210-4ea6-8b9a-8bf1880a7c68 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:17.370914 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f06f61d-424a-45d3-ad5f-aa1cd67cff6d tempest-ServerShowV257Test-33475353 tempest-ServerShowV257Test-33475353-project] 10.222.0.20 "GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68" status: 404 len: 111 microversion: 2.57 time: 0.142874 Oct 03 14:54:17.371889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2381/4888] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:17 2022] GET /compute/v2.1/servers/07769480-9210-4ea6-8b9a-8bf1880a7c68 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:54:17.381948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:17.385577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.400394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.401597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.405368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.408193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.409220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.410217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.415305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.416092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.417051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.417922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.422220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.422862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.474726 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] HTTP exception thrown: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Request method failure captured: Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b HTTP/1.1 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvXf18nR4GabaFxWanB21oeV_h5upzDhoowpdGjkIcERycjYWQEW7VF-YRMG5F9h0EoQNeYo1PulDTSGKK5mLcS2eIdIdYD1n0Uv_F1GNJXwMVIWK7ZRm5ecyGpOfUefjZjVdcP2J65A3-_O96NW-5sV8iKGmDjekCa-PwRiMv-38cM Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.32 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57e82f647a944e6db03d55e48bb87c49 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57e82f647a944e6db03d55e48bb87c49", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57e82f647a944e6db03d55e48bb87c49 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TaggedBootDevicesTest-58283716-project Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5f6c97e624784092a1302a2ba80f23bf Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TaggedBootDevicesTest-58283716-project Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b16ab3a3-6ac6-45cd-9f58-5e908acd153b'} Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:17.476426 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.481787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:17.481787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:17.481787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:17.481787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:17.481787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:17.481787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:17.481787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:17.486002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Returning 404 to user: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:17.488773 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33b2ac78-e9bb-4eed-83f7-a29f55e30e33 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 404 len: 111 microversion: 2.32 time: 0.155534 Oct 03 14:54:17.492321 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2508/4889] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:17 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:54:17.500255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lazy-loading 'flavor' on Instance uuid 87e6319e-de09-4df3-9695-6a571b44dc00 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:54:17.503845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:17.505624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:17.520108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.521203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.522075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.524643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:17.525617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:17.527278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:17.558854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:17.931156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:17.945437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc93c63d-a850-4f45-89b3-61187bedbae2 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.449404 Oct 03 14:54:17.946819 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2509/4890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:17 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:17.954561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ee062eb-ee2c-4bdc-a7f9-e4c7943d4e3e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '.version_select at 0x7fb234bfa550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:17.995957 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ee062eb-ee2c-4bdc-a7f9-e4c7943d4e3e tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417664208" status: 204 len: 0 microversion: 2.32 time: 0.042551 Oct 03 14:54:17.996683 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2510/4891] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:54:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417664208 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:54:18.009924 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ccab841b-b03b-4f6a-9a0e-0c74b1bccca7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00/action" status: 202 len: 0 microversion: 2.1 time: 0.622044 Oct 03 14:54:18.011340 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2382/4892] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:54:17 2022] POST /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:54:18.018602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:18.019262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:18.038632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:18.038968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.040012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.041873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:18.042879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.046343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.047245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.047852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.060724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.061278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.061853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.062672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.063266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.063790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.481821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:18.491312 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cc9a85c3-3e64-4c16-b3ff-884a03125035 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.473378 Oct 03 14:54:18.491935 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2383/4893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:18 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:18.505753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:18.506618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:18.521220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.521996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.524789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.525782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.526423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.533112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.769931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:18.790523 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d624497e-42a3-41f5-b3a5-f5104540d613 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 0.293775 Oct 03 14:54:18.791416 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2384/4894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:18 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:18.806586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-abb5d37f-0fca-491c-ae6a-eb509396487e req-ebd396fd-c9b0-4b95-ad4e-e8d40338fbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d315eb8c-e25c-49bd-80cc-aab46e8bf424", "tag": "dcd66891-2d33-44d2-8a1b-831b7bdf4c6a"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:18.821452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abb5d37f-0fca-491c-ae6a-eb509396487e req-ebd396fd-c9b0-4b95-ad4e-e8d40338fbe7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.828282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abb5d37f-0fca-491c-ae6a-eb509396487e req-ebd396fd-c9b0-4b95-ad4e-e8d40338fbe7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.828282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abb5d37f-0fca-491c-ae6a-eb509396487e req-ebd396fd-c9b0-4b95-ad4e-e8d40338fbe7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.878180 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-abb5d37f-0fca-491c-ae6a-eb509396487e req-ebd396fd-c9b0-4b95-ad4e-e8d40338fbe7 service nova] Creating event network-changed:dcd66891-2d33-44d2-8a1b-831b7bdf4c6a for instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 on n-h1-781139-2 Oct 03 14:54:18.897667 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-abb5d37f-0fca-491c-ae6a-eb509396487e req-ebd396fd-c9b0-4b95-ad4e-e8d40338fbe7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100599 Oct 03 14:54:18.899946 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2385/4895] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:18.936244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ada6e9de-387f-48f5-9a06-0a74ac0550e5 req-3025713e-aac1-4ea0-93d5-7edf2e3f2c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178e30c6-88b2-47f9-a992-6a5b28e21200", "name": "network-vif-plugged", "status": "completed", "tag": "b7fdd165-ae58-49e8-8d85-71ce06def13b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:18.955200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ada6e9de-387f-48f5-9a06-0a74ac0550e5 req-3025713e-aac1-4ea0-93d5-7edf2e3f2c92 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:18.959102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ada6e9de-387f-48f5-9a06-0a74ac0550e5 req-3025713e-aac1-4ea0-93d5-7edf2e3f2c92 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:18.959739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ada6e9de-387f-48f5-9a06-0a74ac0550e5 req-3025713e-aac1-4ea0-93d5-7edf2e3f2c92 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:18.987429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ada6e9de-387f-48f5-9a06-0a74ac0550e5 req-3025713e-aac1-4ea0-93d5-7edf2e3f2c92 service nova] Creating event network-vif-plugged:b7fdd165-ae58-49e8-8d85-71ce06def13b for instance 178e30c6-88b2-47f9-a992-6a5b28e21200 on n-h2-781139-2 Oct 03 14:54:18.998814 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ada6e9de-387f-48f5-9a06-0a74ac0550e5 req-3025713e-aac1-4ea0-93d5-7edf2e3f2c92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066746 Oct 03 14:54:19.009514 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2386/4896] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:54:19.012087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:19.013037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:19.032074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.032849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.033864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:19.039024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.039741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.040184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:19.076367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:19.092699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:19.094732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:19.097206 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e57aff15-87eb-4d28-9e91-b3c90e7d12e8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1753 microversion: 2.20 time: 1.093363 Oct 03 14:54:19.099963 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2511/4897] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:17 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1753 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:19.515348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:19.516231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:19.532764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.537751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.538486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:19.544014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.544797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.549210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:19.580151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:19.602359 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8e58d531-dc97-4805-992e-7d3feb9f268a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.599575 Oct 03 14:54:19.606009 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2387/4898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:18 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:19.819006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:19.819633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:19.821018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:19.830458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1f7f965-e4b6-43c1-8a9a-32f22877af73 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.318959 Oct 03 14:54:19.834513 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2512/4899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:19 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:19.834932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.837113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.837526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:19.838467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:19.843570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:19.844180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.156831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:20.158477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:20.176218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.177907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.178493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.182774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.185058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.185683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.232777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:20.247408 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4c547a15-cf53-4db1-9c54-766ef45aaee9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1323 microversion: 2.1 time: 0.434768 Oct 03 14:54:20.252243 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2388/4900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:19 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:20.458762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:20.472769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:20.476348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:20.480821 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46f70e39-7b4b-4646-9686-67bdc8baa5c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1753 microversion: 2.20 time: 0.327273 Oct 03 14:54:20.498640 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2513/4901] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:20 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1753 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:54:20.629018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:20.630652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:20.642891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.649485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.650619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.651569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.652242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.652834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.865835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:20.866603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:20.891273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.894480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.897630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:20.898532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:20.901297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:20.904210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.380913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:21.395772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57822890-fc2e-4fbb-874b-3436ff1ded8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.535507 Oct 03 14:54:21.396975 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2514/4902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:20 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:21.411531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:21.412658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:21.421078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.423664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.424317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.426371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.433689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.434466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.622327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:21.662997 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24c4ab4f-09ba-4d83-abbb-64a6b0ffbdd4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 1.036560 Oct 03 14:54:21.666474 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2389/4903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:20 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:21.671595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:21.682507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:21.700574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.701369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.702020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.703720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.708696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.709433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.907693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:21.918196 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb6be1b3-24e7-4c7e-bd9e-251fbe905682 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 200 len: 1516 microversion: 2.1 time: 0.519857 Oct 03 14:54:21.928260 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2515/4904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:21 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 1516 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:21.945752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:21.946415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:21.964991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.965632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.966079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.966817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:21.970972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:21.972593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:21.973127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:22.000391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:22.004435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:22.007184 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f537479b-69f8-4812-8666-f1c7ec03be98 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1753 microversion: 2.20 time: 0.339427 Oct 03 14:54:22.008431 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2390/4905] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:21 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1753 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:22.424117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:22.425435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:22.434358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:22.438431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:22.439523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:22.442401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:22.443189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:22.446745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:22.603167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:22.615097 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b8b0c0e-a437-406d-b240-bfa70bc51a26 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1323 microversion: 2.1 time: 0.674313 Oct 03 14:54:22.637802 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2516/4906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:21 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1323 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:22.700428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:22.702078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:22.711239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:22.713674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:22.715439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:22.717380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:22.723097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:22.723730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:22.792028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:22.801850 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-344700eb-48f1-4eba-aa0d-2ab592dcd6e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.385293 Oct 03 14:54:22.809378 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2391/4907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:22 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:23.005629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:23.019413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db1010d0-ef3c-4adf-b756-09365daa97f4 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.324036 Oct 03 14:54:23.025953 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2517/4908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:22 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:23.034841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:23.035536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:23.043788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.050094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.059432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:23.061347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.062034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.062659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:23.427537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:23.454378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:23.461473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:23.470732 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e95e9e9e-be62-463e-af9a-04df6312142f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1753 microversion: 2.20 time: 0.435413 Oct 03 14:54:23.477462 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2392/4909] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:23 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1753 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:54:23.651928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:23.652690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:23.671845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.672470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.672989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:23.673690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.678410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.678883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:23.828733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:23.829811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:23.840257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.840765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.841242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:23.845358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:23.846449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:23.847779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:24.122218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:24.134019 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa6f7884-cab2-45f2-a48b-46f7bd90c409 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1323 microversion: 2.1 time: 0.489449 Oct 03 14:54:24.136224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2518/4910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:23 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1323 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:24.141497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-339d51c6-0351-4839-881f-634a704528a3 req-ad8c1e49-3437-4854-84f3-16af4d96e77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cc1094-bb23-4039-a3a4-b7434ce0bb75", "name": "network-vif-plugged", "status": "completed", "tag": "eb23d923-f246-455d-b91d-6ebb13385706"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:24.170167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-339d51c6-0351-4839-881f-634a704528a3 req-ad8c1e49-3437-4854-84f3-16af4d96e77a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:24.171129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-339d51c6-0351-4839-881f-634a704528a3 req-ad8c1e49-3437-4854-84f3-16af4d96e77a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:24.171574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-339d51c6-0351-4839-881f-634a704528a3 req-ad8c1e49-3437-4854-84f3-16af4d96e77a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:24.207069 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-339d51c6-0351-4839-881f-634a704528a3 req-ad8c1e49-3437-4854-84f3-16af4d96e77a service nova] Creating event network-vif-plugged:eb23d923-f246-455d-b91d-6ebb13385706 for instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 on n-h1-781139-2 Oct 03 14:54:24.217955 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-339d51c6-0351-4839-881f-634a704528a3 req-ad8c1e49-3437-4854-84f3-16af4d96e77a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080311 Oct 03 14:54:24.225109 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2519/4911] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:24.234253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:24.235375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:24.242846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:24.243865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:24.244466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:24.245372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:24.245978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:24.246597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:24.483484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:24.513133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b4070ad-7be2-48c4-8baf-2a02049aea4d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.285384 Oct 03 14:54:24.515923 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2520/4912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:24 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:24.549207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:24.550165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:24.583974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:24.584748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:24.586851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:24.591262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:24.595916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:24.598616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:25.028763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:25.044998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:25.053672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:25.059009 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5ce6483-629b-4c88-bf7e-999566747acc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.540421 Oct 03 14:54:25.062368 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2521/4913] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:24 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:25.162875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:25.163603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:25.172704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:25.175479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:25.176269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:25.179470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:25.183467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:25.184553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:25.264050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:25.272960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5cb983de-e9fa-4348-87c9-8702203425c8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 1.449978 Oct 03 14:54:25.277217 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2393/4914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:23 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:25.542395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:25.543476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:25.552916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:25.555153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:25.556228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:25.558852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:25.560179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:25.562072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:25.611898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:25.672113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:25.680887 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a0a1e54-dfaa-4f9f-938e-4d152737dd3f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1323 microversion: 2.1 time: 0.522443 Oct 03 14:54:25.701041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2522/4915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:25 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1323 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:26.088146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:26.090358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:26.115913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.116842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.117363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.120856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.123635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.124274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.293146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:26.332656 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7fd9c25-6430-4514-b247-5c6dcf670a96 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.792166 Oct 03 14:54:26.332656 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2394/4916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:25 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:26.339653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:26.340393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:26.350333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.351016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.353625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.356319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.357198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.359397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.679417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:26.701486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:26.713921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:26.715199 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3094523-e1b2-4ebc-acd3-6fb24a7dfad6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.631157 Oct 03 14:54:26.715787 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2523/4917] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:26 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:54:26.741003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:26.744019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:26.761633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.762144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.762596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.763329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:26.765686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:26.765840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:26.971781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:26.986224 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ae2b5c1-8be3-419d-bb07-01ed71e391fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.653429 Oct 03 14:54:26.989469 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2395/4918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:26 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:26.995221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:27.009937 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29ce4a3a-a885-48e2-a5b9-dcc2ae79dd6f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1323 microversion: 2.1 time: 0.282695 Oct 03 14:54:27.010704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2524/4919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:26 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:27.235900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:27.240147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:27.253669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.254361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.254844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.255819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.256546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.257014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.298988 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] HTTP exception thrown: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Request method failure captured: Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b HTTP/1.1 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvXf18nR4GabaFxWanB21oeV_h5upzDhoowpdGjkIcERycjYWQEW7VF-YRMG5F9h0EoQNeYo1PulDTSGKK5mLcS2eIdIdYD1n0Uv_F1GNJXwMVIWK7ZRm5ecyGpOfUefjZjVdcP2J65A3-_O96NW-5sV8iKGmDjekCa-PwRiMv-38cM Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Openstack-Nova-Api-Version: 2.32 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57e82f647a944e6db03d55e48bb87c49 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57e82f647a944e6db03d55e48bb87c49", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57e82f647a944e6db03d55e48bb87c49 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TaggedBootDevicesTest-58283716-project Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 5f6c97e624784092a1302a2ba80f23bf Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TaggedBootDevicesTest-58283716-project Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'b16ab3a3-6ac6-45cd-9f58-5e908acd153b'} Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:27.314805 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Returning 404 to user: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:27.319620 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61a22c0f-34bc-4809-9abe-188f3e20e505 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 404 len: 111 microversion: 2.32 time: 0.086788 Oct 03 14:54:27.323159 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2396/4920] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:54:27 2022] DELETE /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:54:27.332446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:27.333154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] [instance: b16ab3a3-6ac6-45cd-9f58-5e908acd153b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:27.346012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.346535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.346981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.347714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.348177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.348611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.356712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:27.357841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:27.371447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.372220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.373404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.374480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.376900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.377693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.377872 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] HTTP exception thrown: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Request method failure captured: Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b HTTP/1.1 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvXf18nR4GabaFxWanB21oeV_h5upzDhoowpdGjkIcERycjYWQEW7VF-YRMG5F9h0EoQNeYo1PulDTSGKK5mLcS2eIdIdYD1n0Uv_F1GNJXwMVIWK7ZRm5ecyGpOfUefjZjVdcP2J65A3-_O96NW-5sV8iKGmDjekCa-PwRiMv-38cM Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.32 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57e82f647a944e6db03d55e48bb87c49 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57e82f647a944e6db03d55e48bb87c49", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57e82f647a944e6db03d55e48bb87c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57e82f647a944e6db03d55e48bb87c49 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TaggedBootDevicesTest-58283716 Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TaggedBootDevicesTest-58283716-project Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 5f6c97e624784092a1302a2ba80f23bf Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TaggedBootDevicesTest-58283716-project Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b16ab3a3-6ac6-45cd-9f58-5e908acd153b'} Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:27.380392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.384434 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:27.384434 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:27.384434 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:27.384434 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:27.384434 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:27.384434 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. Oct 03 14:54:27.384434 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:27.388968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] Returning 404 to user: Instance b16ab3a3-6ac6-45cd-9f58-5e908acd153b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:27.391049 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cda5c3cd-9f68-4afa-bf33-b5929a4e1949 tempest-TaggedBootDevicesTest-58283716 tempest-TaggedBootDevicesTest-58283716-project] 10.222.0.20 "GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b" status: 404 len: 111 microversion: 2.32 time: 0.063998 Oct 03 14:54:27.392191 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2525/4921] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:27 2022] GET /compute/v2.1/servers/b16ab3a3-6ac6-45cd-9f58-5e908acd153b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:54:27.657098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:27.670834 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9db5862b-ef25-451a-8c2d-84948c93c905 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.319749 Oct 03 14:54:27.673000 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2397/4922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:27 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:27.742692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:27.744025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:27.755220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.755730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.756179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:27.756897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:27.761325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:27.764497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.016327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:28.017888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:28.032526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.033425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.038929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:28.048756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.052793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.058198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:28.059236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.061298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.063604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:28.073633 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6849577a-7d15-450d-8ee7-179f9e4f0050 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.334577 Oct 03 14:54:28.077678 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2526/4923] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:27 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:28.098473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:28.101880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:28.128410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.129252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.129868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.130771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.135169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.140215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.386967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:28.396387 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76d5e480-5c72-4924-8ce4-f5dacf036af3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.388268 Oct 03 14:54:28.409075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2398/4924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:28 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:28.431728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5fbe25d9-dafd-4fd3-a04c-723f02a82d36 req-fddad7e5-b617-4314-90f1-c5b3c69c5083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d315eb8c-e25c-49bd-80cc-aab46e8bf424", "name": "network-vif-plugged", "status": "completed", "tag": "dcd66891-2d33-44d2-8a1b-831b7bdf4c6a"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:28.463807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5fbe25d9-dafd-4fd3-a04c-723f02a82d36 req-fddad7e5-b617-4314-90f1-c5b3c69c5083 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.464561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5fbe25d9-dafd-4fd3-a04c-723f02a82d36 req-fddad7e5-b617-4314-90f1-c5b3c69c5083 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.465243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5fbe25d9-dafd-4fd3-a04c-723f02a82d36 req-fddad7e5-b617-4314-90f1-c5b3c69c5083 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.496821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5fbe25d9-dafd-4fd3-a04c-723f02a82d36 req-fddad7e5-b617-4314-90f1-c5b3c69c5083 service nova] Creating event network-vif-plugged:dcd66891-2d33-44d2-8a1b-831b7bdf4c6a for instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 on n-h1-781139-2 Oct 03 14:54:28.511027 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5fbe25d9-dafd-4fd3-a04c-723f02a82d36 req-fddad7e5-b617-4314-90f1-c5b3c69c5083 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096941 Oct 03 14:54:28.514387 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2399/4925] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:28.700591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:28.701595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:28.722189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.726252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.727932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:28.733682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:28.736415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:28.738916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:29.018081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:29.028895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50fdd81a-1c89-4d85-adf2-bdbf08d24d85 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1323 microversion: 2.1 time: 0.946637 Oct 03 14:54:29.046115 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2527/4926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:28 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1323 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:29.107842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:29.108460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:29.133930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:29.136478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:29.136997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:29.143383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:29.151880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:29.155744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:29.240176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:29.274876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:29.293253 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bfcc6606-4c15-42e0-b8d7-be617f407d40 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.592353 Oct 03 14:54:29.294128 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2400/4927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:28 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:29.428012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:29.428671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:29.440754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:29.443730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:29.444555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:29.445462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:29.446639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:29.447807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:29.738664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:29.753127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:29.769051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:29.774760 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-065df78f-7c70-4cab-a431-e6d5465d3fad tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.667243 Oct 03 14:54:29.775406 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2528/4928] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:29 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:54:29.840075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:29.853317 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-018c4754-c886-4ecf-aeeb-cd02f1b9c577 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.430356 Oct 03 14:54:29.854695 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2401/4929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:29 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:30.056242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:30.056865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:30.071507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.077716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.079152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:30.080137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.080697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.086976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:30.323732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:30.324846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:30.353386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.355672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.360580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:30.367002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.367689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.380592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:30.661826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:30.691180 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-670bd6f0-c20b-4ab5-a825-cf24c2968fdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1323 microversion: 2.1 time: 0.639127 Oct 03 14:54:30.696061 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2529/4930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:30 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1323 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:30.800845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:30.801493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:30.819343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.819891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.827739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:30.833308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:30.835339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:30.835854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:31.018408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:31.034370 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-149275ed-5194-4a6c-9610-14dee007f9fc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.713979 Oct 03 14:54:31.035306 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2402/4931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:30 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:31.058902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:31.065813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:31.101765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:31.105059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:31.108392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:31.109148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:31.110194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:31.111225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:31.452187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:31.475467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:31.481153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:31.482822 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0b492ed-9048-49c3-aa7b-cf6b4858a9fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.686090 Oct 03 14:54:31.493719 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2530/4932] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:30 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:31.727497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:31.728872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:31.778859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:31.779459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:31.779923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:31.780740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:31.781366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:31.795737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:31.839073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:31.852391 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ccf79db-8f55-4c26-8471-fef3547ffa72 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.815117 Oct 03 14:54:31.853009 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2403/4933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:31 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:32.064131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:32.064961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:32.080267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:32.086771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:32.087299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:32.087738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:32.096537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:32.097330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:32.097951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:32.361542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:32.371536 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0e3ac0e-db7e-40ef-b807-dc69e1b0e446 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1323 microversion: 2.1 time: 0.656305 Oct 03 14:54:32.406848 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2531/4934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:31 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1323 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:32.546627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:32.554505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:32.586627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:32.588850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:32.592916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:32.594085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:32.596058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:32.599676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:32.802374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:32.822169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-daf3cc9d-e810-4679-949c-4d92f2f10c56 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1734 microversion: 2.1 time: 0.762082 Oct 03 14:54:32.837094 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2404/4935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:32 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1734 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:32.883000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:32.884047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:32.895979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:32.898864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:32.899392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:32.904411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:32.905050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:32.910987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:33.082174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:33.099622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:33.116219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:33.125509 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c224ad7-d7a9-4de4-afdd-43567420aa4f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.602350 Oct 03 14:54:33.141032 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2532/4936] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:32 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:33.413723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:33.414370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:33.433546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:33.434396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:33.435001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:33.435974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:33.437556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:33.439691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:33.489701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:33.548723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-456d07fa-a8a6-4510-911f-497341693721 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.668034 Oct 03 14:54:33.555265 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2405/4937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:32 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:33.855960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:33.857018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:33.871201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:33.877534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:33.878508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:33.879854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:33.884682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:33.885524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:33.918589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:33.931025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bec7b69f-e79f-441a-b521-7b2697d051da tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1517 microversion: 2.1 time: 0.521184 Oct 03 14:54:33.970560 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2533/4938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:33 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1517 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:33.981268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:33.983872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:33.998131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.004337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.005184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.006248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.006914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.007606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.349091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:34.360113 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7bed454e-bc12-424b-9b0e-06609c864bfe tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 200 len: 1516 microversion: 2.1 time: 0.385882 Oct 03 14:54:34.395160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2534/4939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:33 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:34.409116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:34.410381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:34.418835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.419743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.420759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.421913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.425148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.426309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.761426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:34.780632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:34.788077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:34.797293 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2548a054-cfde-4740-876a-c65216ba681d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.397641 Oct 03 14:54:34.797985 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2535/4940] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:34 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:34.824502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:34.834075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:34.854300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.857891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.859920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.862188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:34.863685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:34.866310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:34.971926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:54:35.140488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:35.164427 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d395cc1-cd1d-4db5-b3ca-020f5c2b7e03 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1714 microversion: 2.1 time: 1.313292 Oct 03 14:54:35.177126 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2406/4941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:33 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1714 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:35.184649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:35.185704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:35.213768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.215541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.217549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.223573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.225051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.228994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.262461 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce7c7632-14e4-4b52-9fe6-4258113ee0af tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 204 len: 0 microversion: 2.1 time: 0.449612 Oct 03 14:54:35.273761 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2536/4942] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:54:34 2022] DELETE /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:54:35.284963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:35.294497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:35.316224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.316730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.317197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.318054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.318352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.318780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.733300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:35.751381 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c9424de-6210-46be-a5e3-52675aa18b38 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 200 len: 1522 microversion: 2.1 time: 0.475753 Oct 03 14:54:35.752277 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2537/4943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:35 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:35.776621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:35.777800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:35.832335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.833002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.833519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:35.834255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:35.835263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:35.835263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.193607 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Cannot 'detach_volume' instance c34f6896-67b3-4663-a15e-350a205c2a59 while it is in vm_state rescued Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments/85fa1f48-4c53-4567-a882-de604864711d HTTP/1.1 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'detach_volume' instance c34f6896-67b3-4663-a15e-350a205c2a59 while it is in vm_state rescued Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': 'c34f6896-67b3-4663-a15e-350a205c2a59', 'id': '85fa1f48-4c53-4567-a882-de604864711d'} Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c34f6896-67b3-4663-a15e-350a205c2a59 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c34f6896-67b3-4663-a15e-350a205c2a59 while it is in vm_state rescued Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:36.201518 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:36.205721 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:36.205721 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:36.205721 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:36.205721 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:36.205721 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c34f6896-67b3-4663-a15e-350a205c2a59 while it is in vm_state rescued Oct 03 14:54:36.205721 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:36.209474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 409 to user: Cannot 'detach_volume' instance c34f6896-67b3-4663-a15e-350a205c2a59 while it is in vm_state rescued {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:36.213673 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20492273-4ce6-4051-b885-aa8f9a1a4439 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments/85fa1f48-4c53-4567-a882-de604864711d" status: 409 len: 152 microversion: 2.1 time: 0.457768 Oct 03 14:54:36.219852 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2538/4944] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 14:54:35 2022] DELETE /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments/85fa1f48-4c53-4567-a882-de604864711d => generated 152 bytes in 467 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:54:36.246141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:36.251093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:36.282658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.288492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.290563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.295364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.295829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.296282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.661336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:36.671724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-daf68072-644a-44a9-b8e5-75f77685e46e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 1.492804 Oct 03 14:54:36.678860 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2407/4945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:35 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:36.690440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:36.699620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:36.701805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:36.707774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:36.718386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:36.719939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.720442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.724774 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ade24da7-5f21-4f62-b089-9dac9318f4dc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.500180 Oct 03 14:54:36.724969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.725684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.726670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.727780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.731040 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2539/4946] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:36 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:36.779300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:36.780221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:36.791600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.792358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.795840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.797762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.798400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.798998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.907115 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ed97dde-c4ab-437c-b524-cc82e7297109 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/action" status: 202 len: 0 microversion: 2.1 time: 0.222518 Oct 03 14:54:36.909135 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2408/4947] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:54:36 2022] POST /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:54:36.919702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:36.920534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:36.928595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.929664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.930371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:36.931546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:36.932355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:36.932994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.418056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:37.429197 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc356207-ded9-4919-871c-98db57dcf6df tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 200 len: 1522 microversion: 2.1 time: 0.653167 Oct 03 14:54:37.448533 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2540/4948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:36 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:37.706300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:37.706945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:37.729846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.737327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.738844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.741090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.742716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.744098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.845062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:37.857821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7c2f5be0-eb34-4825-872d-4bf5f45e5352 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1722 microversion: 2.1 time: 0.944603 Oct 03 14:54:37.883054 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2409/4949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:36 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1722 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:37.900395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:37.901277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:37.922927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.923790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.924416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:37.926417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:37.927350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:37.929668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:38.160899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:38.173551 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-092714cb-1651-479b-b374-6fb1884178b7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.471981 Oct 03 14:54:38.192375 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2541/4950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:37 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:38.458534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:38.459896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:38.475408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:38.477799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:38.480181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:38.481207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:38.481856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:38.484406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.144448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:39.157727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:39.157896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:39.159198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:39.160415 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ab356cd-bbcf-4e6d-99a5-630edb2e1002 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 1.275888 Oct 03 14:54:39.161003 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2410/4951] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:37 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:39.194561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:39.197719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:39.199596 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05f84563-c51d-462c-90a8-fcf0a61ae206 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 200 len: 1522 microversion: 2.1 time: 0.737722 Oct 03 14:54:39.200318 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2542/4952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:38 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 1522 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:39.211390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.214655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.215411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.216423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.218714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.219451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.231056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:39.233158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:39.233693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:39.277372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.283776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.284410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.288308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:39.289396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:39.290399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:39.421427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:39.692465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:39.708799 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b509e547-547a-4f23-b164-00ea967bc032 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.507228 Oct 03 14:54:39.709963 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2543/4953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:39 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:40.062513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:40.082290 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2f4a620-03e4-4fad-93db-6e0984c26627 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1722 microversion: 2.1 time: 0.897481 Oct 03 14:54:40.091230 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2411/4954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:39 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1722 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:40.187135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:40.187818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:40.207933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:40.217107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:40.217704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:40.223951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:40.223951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:40.230012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:40.230641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:40.239710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:40.256880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:40.257471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:40.264182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:40.264884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:40.275603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:40.276403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:40.978440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:41.023636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:41.031083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:41.035309 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c14c0b4e-4cb3-490d-bf53-b3284e6e4ce9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.852459 Oct 03 14:54:41.039907 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2544/4955] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:40 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:41.083819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-89721f8e-5e2f-47a1-b911-fda097d48b03 req-c407f7f7-2be9-40e4-a6f4-3db61e5a24d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cc1094-bb23-4039-a3a4-b7434ce0bb75", "name": "network-vif-unplugged", "status": "completed", "tag": "eb23d923-f246-455d-b91d-6ebb13385706"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:41.110764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-89721f8e-5e2f-47a1-b911-fda097d48b03 req-c407f7f7-2be9-40e4-a6f4-3db61e5a24d2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.111676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-89721f8e-5e2f-47a1-b911-fda097d48b03 req-c407f7f7-2be9-40e4-a6f4-3db61e5a24d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.112342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-89721f8e-5e2f-47a1-b911-fda097d48b03 req-c407f7f7-2be9-40e4-a6f4-3db61e5a24d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.140394 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-89721f8e-5e2f-47a1-b911-fda097d48b03 req-c407f7f7-2be9-40e4-a6f4-3db61e5a24d2 service nova] Creating event network-vif-unplugged:eb23d923-f246-455d-b91d-6ebb13385706 for instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 on n-h1-781139-2 Oct 03 14:54:41.155626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-89721f8e-5e2f-47a1-b911-fda097d48b03 req-c407f7f7-2be9-40e4-a6f4-3db61e5a24d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114126 Oct 03 14:54:41.157750 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2545/4956] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:41.168361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:41.174476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:41.178022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:41.191688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.192552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.193611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.199628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.200484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.203931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.567969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:41.584889 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db209a15-0b0a-4273-a7e6-fd0eed067ec8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 200 len: 1522 microversion: 2.1 time: 1.358845 Oct 03 14:54:41.586796 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2412/4957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:40 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 1522 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:41.595748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:41.597982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:41.630090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.630883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.634105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.635198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:41.635961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:41.642198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:41.937366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:41.961783 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-005ddf42-b6ad-4e93-81b6-e1d54a1941e9 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1722 microversion: 2.1 time: 0.361758 Oct 03 14:54:41.961783 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2413/4958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:41 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:41.973403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e868b8b5-b568-422d-ab7a-94f62cbe61c1 req-aa24161e-3834-4253-be28-13be18701cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5cc1094-bb23-4039-a3a4-b7434ce0bb75", "name": "network-vif-deleted", "tag": "eb23d923-f246-455d-b91d-6ebb13385706"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:42.000182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e868b8b5-b568-422d-ab7a-94f62cbe61c1 req-aa24161e-3834-4253-be28-13be18701cdb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.001388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e868b8b5-b568-422d-ab7a-94f62cbe61c1 req-aa24161e-3834-4253-be28-13be18701cdb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.002059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e868b8b5-b568-422d-ab7a-94f62cbe61c1 req-aa24161e-3834-4253-be28-13be18701cdb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.017882 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e868b8b5-b568-422d-ab7a-94f62cbe61c1 req-aa24161e-3834-4253-be28-13be18701cdb service nova] Creating event network-vif-deleted:eb23d923-f246-455d-b91d-6ebb13385706 for instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 on n-h1-781139-2 Oct 03 14:54:42.024014 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e868b8b5-b568-422d-ab7a-94f62cbe61c1 req-aa24161e-3834-4253-be28-13be18701cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070886 Oct 03 14:54:42.025213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2414/4959] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:42.071460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:42.074012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:42.100540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.105727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.106516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.108085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.111599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.114548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.429914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:42.443504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:42.446179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:42.448409 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f27219d-3b51-41f8-9ad2-b2ecb843fba8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.381625 Oct 03 14:54:42.461023 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2415/4960] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:42 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:42.613263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:42.613958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:42.631798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.636262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.637889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.639728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.644623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.647024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.749510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:42.753365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:42.754100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:42.755023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lazy-loading 'fault' on Instance uuid c5cc1094-bb23-4039-a3a4-b7434ce0bb75 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:54:42.889853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:42.915860 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f0869a72-17f6-4a15-b9ba-bba0a28dcba4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 200 len: 1313 microversion: 2.1 time: 0.307534 Oct 03 14:54:42.937530 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2416/4961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:42 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:42.948690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:42.969769 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b028ffc9-3cfa-46cb-b578-bfb1de1d689a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 1.806620 Oct 03 14:54:42.983713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:42.984387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:42.988491 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2546/4962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:41 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:43.017896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.020526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.021051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.021793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.022252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.025613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.395136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:43.405487 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1aad30d2-b1a1-46d8-a1eb-e119b3c8b34a tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1728 microversion: 2.1 time: 0.425442 Oct 03 14:54:43.411175 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2417/4963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:42 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1728 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:43.437282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:43.437876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:43.451599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.453386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.455009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.456554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.457856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.460341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.478981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:43.479859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:43.493654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.498217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.498820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.499739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.500450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.501278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.830587 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f53ada00-e19f-4733-a9eb-e1b2faaa0495 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.397634 Oct 03 14:54:43.831242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2547/4964] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:54:43 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-interface => generated 285 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:43.951992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:43.952782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:43.970778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.973724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.977442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:43.981712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:43.982300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:43.986695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.085093 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] HTTP exception thrown: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 HTTP/1.1 Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c5cc1094-bb23-4039-a3a4-b7434ce0bb75'} Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.089529 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:44.094566 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.097850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 404 to user: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:44.100223 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bb1011f-aa4e-4dbd-ae74-8668339249f2 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 404 len: 111 microversion: 2.1 time: 0.152436 Oct 03 14:54:44.105321 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2548/4965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:43 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:54:44.125598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:44.128253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:44.131537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:44.188069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.188069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.191555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:44.193763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.195540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.196043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.196485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.199769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:44.201171 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bcd0843b-55de-40ee-9548-c690c7224f15 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.726531 Oct 03 14:54:44.201777 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2418/4966] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:43 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:44.233910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:44.267895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:44.271476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:44.306512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.308205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.308660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.313591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.315617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.316103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.700187 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fc4a4d1-10b0-4a51-abba-6dc6b6b60c13 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.483993 Oct 03 14:54:44.702742 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2419/4967] 10.222.0.20 () {58 vars in 1230 bytes} [Mon Oct 3 14:54:44 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:54:44.717433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-310427e6-0ac9-4e0d-bb15-0199c842ecd7 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-310427e6-0ac9-4e0d-bb15-0199c842ecd7 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 03 14:54:44.732961 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-310427e6-0ac9-4e0d-bb15-0199c842ecd7 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:44.737217 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-310427e6-0ac9-4e0d-bb15-0199c842ecd7 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.021416 Oct 03 14:54:44.741208 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2420/4968] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 3 14:54:44 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:54:44.755462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:44.781429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:44.784350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:44.810629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.819031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.821121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.824385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:44.828058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:44.828565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:44.896500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:54:44.975510 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-22af67dd-0416-4e1c-b1a3-1982f9f3f1d3 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.232868 Oct 03 14:54:44.976126 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2421/4969] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:54:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:44.998715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.004095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.010039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.servers [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Removing options 'limit' from query {{(pid=128868) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 03 14:54:45.011029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:45.029575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.030369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.030991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.031880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.032491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.033107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.091095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:54:45.138645 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e001d20f-2056-46ae-8697-49efd701ab87 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.152341 Oct 03 14:54:45.141642 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2422/4970] 10.222.0.20 () {58 vars in 1144 bytes} [Mon Oct 3 14:54:44 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:45.159074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eeac5217-6e0f-4f58-9aa4-f2a33c79e39f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eeac5217-6e0f-4f58-9aa4-f2a33c79e39f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '-1' Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 03 14:54:45.164790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 03 14:54:45.169283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.173784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eeac5217-6e0f-4f58-9aa4-f2a33c79e39f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:45.174877 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eeac5217-6e0f-4f58-9aa4-f2a33c79e39f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.020055 Oct 03 14:54:45.175632 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2423/4971] 10.222.0.20 () {58 vars in 1142 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:54:45.186691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0fd17e85-2b61-4557-8c8a-1d95e91b55a9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0fd17e85-2b61-4557-8c8a-1d95e91b55a9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: action_args: {} Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'testing' Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 03 14:54:45.195615 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 03 14:54:45.200553 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:45.202665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0fd17e85-2b61-4557-8c8a-1d95e91b55a9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:45.205918 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0fd17e85-2b61-4557-8c8a-1d95e91b55a9 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023089 Oct 03 14:54:45.206716 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2424/4972] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:54:45.226855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33437150-f0c6-4aee-b092-b396de8c5cdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.234996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.237444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33437150-f0c6-4aee-b092-b396de8c5cdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.242563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33437150-f0c6-4aee-b092-b396de8c5cdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:45.245746 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec7809d5-d3c8-43c3-8f43-e028e8ff6ffc tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 1.138871 Oct 03 14:54:45.246365 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2549/4973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:44 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:45.256433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.servers [None req-33437150-f0c6-4aee-b092-b396de8c5cdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Flavor 'non_existing_flavor' could not be found {{(pid=128868) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 03 14:54:45.259093 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33437150-f0c6-4aee-b092-b396de8c5cdd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.044928 Oct 03 14:54:45.262600 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2425/4974] 10.222.0.20 () {58 vars in 1178 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:54:45.285235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.286049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:45.297660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.305605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.306062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.306226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.306530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.307435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.308442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:45.309142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.314692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.321091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.321843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.323443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.324951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.326046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.327810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.468029 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ad89734d-4b09-4df1-917d-571b45a3dd65 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.175041 Oct 03 14:54:45.478203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2426/4975] 10.222.0.20 () {58 vars in 1174 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 14:54:45.483355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.502491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.513687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:45.539186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.540119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.540758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.545764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.546454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.547772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.746419 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56f1dd46-2794-4cb7-9733-f51352fb3bc4 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.266635 Oct 03 14:54:45.750232 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2427/4976] 10.222.0.20 () {58 vars in 1184 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:54:45.765194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:45.770334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.777416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:45.783723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.793759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.794394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.795338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.795961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.796525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:45.846043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:54:45.900670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.929235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.935149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.941071 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ec1afbb-4a94-4f7b-be99-829676cec70d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.690871 Oct 03 14:54:45.952975 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2550/4977] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:45.975848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:45.994254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:45.996947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:45.998422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.276276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.276807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:46.286442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.286941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.287392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.288107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.288631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.295111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.712366 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14d92702-b50c-4d4e-9aa7-1e86cbcf72e6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.951231 Oct 03 14:54:46.713908 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2428/4978] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 14:54:45 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:46.731707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:46.745239 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2a9d818-9610-40f7-98ff-262818fe8cad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.471346 Oct 03 14:54:46.747336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2551/4979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:46 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:46.756076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56c0b200-11a9-4d1c-ae12-180b482d8c1f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.764622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-56c0b200-11a9-4d1c-ae12-180b482d8c1f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:46.774893 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56c0b200-11a9-4d1c-ae12-180b482d8c1f tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013955 Oct 03 14:54:46.775594 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2429/4980] 10.222.0.20 () {58 vars in 1178 bytes} [Mon Oct 3 14:54:46 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:54:46.790380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.796166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:46.797082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Searching by: {'deleted': False, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:54:46.804451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.805533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.806257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.807270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.807931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.808786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.839375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:54:46.908341 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ba9cc1d-d1d8-453a-a532-70ca3b03c792 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.122258 Oct 03 14:54:46.908969 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2552/4981] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 14:54:46 2022] GET /compute/v2.1/servers => generated 683 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:46.923598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.924400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:46.931685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.932440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.933072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.933976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.934653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.935814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.957703 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] HTTP exception thrown: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 HTTP/1.1 Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c5cc1094-bb23-4039-a3a4-b7434ce0bb75'} Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:46.959893 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:46.964956 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:46.967514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 404 to user: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:46.968815 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3d619a2-0412-460e-afa0-d96e75020d5a tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 404 len: 111 microversion: 2.1 time: 0.049082 Oct 03 14:54:46.973671 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2430/4982] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:54:46 2022] DELETE /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:54:46.976165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.976720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:46.981153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:46.981943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:46.988540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.989572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.990262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.991552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.992238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.993111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.994838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:46.995365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:46.995817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:46.996563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.002683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.003406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.083383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:54:47.237460 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ad82ddb6-a50a-45a0-bbfc-e763e4d0ff22 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 204 len: 0 microversion: 2.1 time: 0.261400 Oct 03 14:54:47.238171 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2431/4983] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:54:46 2022] DELETE /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:54:47.252909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:47.254003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:47.268652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.269180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.273210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.274414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.274903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.275340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.311585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:54:47.314673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:47.474073 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-463180c4-6c44-40c2-bd34-326ed2db82cd tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "DELETE /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 204 len: 0 microversion: 2.1 time: 0.230897 Oct 03 14:54:47.478610 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2432/4984] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:54:47 2022] DELETE /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:54:47.506292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:47.508036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: c5cc1094-bb23-4039-a3a4-b7434ce0bb75] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:47.517541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.518444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.519159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.520107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.520776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.521499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.541682 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] HTTP exception thrown: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 HTTP/1.1 Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c5cc1094-bb23-4039-a3a4-b7434ce0bb75'} Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:47.544752 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. Oct 03 14:54:47.548655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:47.552950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 404 to user: Instance c5cc1094-bb23-4039-a3a4-b7434ce0bb75 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:47.555006 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8bbf5f00-c0c7-44d9-be75-6cab7bddf440 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75" status: 404 len: 111 microversion: 2.1 time: 0.073505 Oct 03 14:54:47.555823 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2433/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:47 2022] GET /compute/v2.1/servers/c5cc1094-bb23-4039-a3a4-b7434ce0bb75 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:54:47.569334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:47.570602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:47.576389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:47.580846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.581772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.582574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.583552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.585763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.586532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.625246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:47.627626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:47.640813 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe60a7e0-29e2-47c3-900e-8b091f7c06ab tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.671314 Oct 03 14:54:47.642218 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2553/4986] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:46 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:54:47.774524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:47.775151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:47.782135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.782631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.783187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:47.783770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:47.784234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:47.784666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.033897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:48.044806 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d99eb20e-6292-43d0-926f-21f7a62c236d tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1523 microversion: 2.1 time: 0.483294 Oct 03 14:54:48.046709 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2434/4987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:47 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:48.053342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-02670d7c-0f4a-49af-9302-240dff31bc4d req-49e4a7da-b4d2-4de5-840c-6fc3f1975a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34f6896-67b3-4663-a15e-350a205c2a59", "tag": "61f60a49-c60f-4431-b990-cacae19b267d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:48.067618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-02670d7c-0f4a-49af-9302-240dff31bc4d req-49e4a7da-b4d2-4de5-840c-6fc3f1975a71 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:48.068498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-02670d7c-0f4a-49af-9302-240dff31bc4d req-49e4a7da-b4d2-4de5-840c-6fc3f1975a71 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:48.069282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-02670d7c-0f4a-49af-9302-240dff31bc4d req-49e4a7da-b4d2-4de5-840c-6fc3f1975a71 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.092526 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-02670d7c-0f4a-49af-9302-240dff31bc4d req-49e4a7da-b4d2-4de5-840c-6fc3f1975a71 service nova] Creating event network-changed:61f60a49-c60f-4431-b990-cacae19b267d for instance c34f6896-67b3-4663-a15e-350a205c2a59 on n-h1-781139-2 Oct 03 14:54:48.107555 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-02670d7c-0f4a-49af-9302-240dff31bc4d req-49e4a7da-b4d2-4de5-840c-6fc3f1975a71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058411 Oct 03 14:54:48.108181 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2435/4988] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:48.147073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:48.157210 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-128e50b1-4f77-4bbb-a192-81851f00c7f8 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 0.387397 Oct 03 14:54:48.158356 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2554/4989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:47 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:48.672760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:48.673594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:48.693002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:48.693609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:48.695207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.697567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:48.698125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:48.699081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:48.976610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:48.998323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:49.011112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:49.012488 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-69da195c-bd50-4525-b217-f2634335a8e0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.345894 Oct 03 14:54:49.013141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2436/4990] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:48 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:49.076541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:49.077350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:49.091873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.093453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.094735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.096067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.102203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.102717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.182419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:49.183947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:49.194845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.196617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.198563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.199702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:49.201476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:49.203308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:49.557922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:49.574264 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50e0e433-7da5-4825-a3fa-de5c9cbfeaed tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1523 microversion: 2.1 time: 0.504135 Oct 03 14:54:49.580111 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2555/4991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:49 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:50.041416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:50.042506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:50.054327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.055271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.058222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.059355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.060058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.060712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.398311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:50.410476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:50.412032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:50.413370 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-365575e5-9f1b-4035-a0a9-88203afc7474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.376159 Oct 03 14:54:50.432363 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2556/4992] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:50 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:50.447973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9ee2ec57-6674-4e25-b6b0-73163092c877 req-0a60abbc-ae56-4361-8681-29d49cda28ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34f6896-67b3-4663-a15e-350a205c2a59", "tag": "61f60a49-c60f-4431-b990-cacae19b267d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:50.471957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:50.482707 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58dee19f-762c-41b2-b7aa-e6dff08308c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1509 microversion: 2.1 time: 1.304916 Oct 03 14:54:50.484309 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2437/4993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:49 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1509 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:50.499163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ee2ec57-6674-4e25-b6b0-73163092c877 req-0a60abbc-ae56-4361-8681-29d49cda28ce service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.499862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ee2ec57-6674-4e25-b6b0-73163092c877 req-0a60abbc-ae56-4361-8681-29d49cda28ce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.501160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ee2ec57-6674-4e25-b6b0-73163092c877 req-0a60abbc-ae56-4361-8681-29d49cda28ce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.531500 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9ee2ec57-6674-4e25-b6b0-73163092c877 req-0a60abbc-ae56-4361-8681-29d49cda28ce service nova] Creating event network-changed:61f60a49-c60f-4431-b990-cacae19b267d for instance c34f6896-67b3-4663-a15e-350a205c2a59 on n-h1-781139-2 Oct 03 14:54:50.542638 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9ee2ec57-6674-4e25-b6b0-73163092c877 req-0a60abbc-ae56-4361-8681-29d49cda28ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108620 Oct 03 14:54:50.543715 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2557/4994] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:50.601931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:50.602309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:50.620954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.621462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.622291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:50.623412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:50.624043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:50.624633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:51.451768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:51.454194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:51.466352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:51.467402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:51.468319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:51.469168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:51.469799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:51.470523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:51.651911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:51.668088 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5aa953e-97e3-4906-9574-0ed88e691ab8 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1523 microversion: 2.1 time: 1.070280 Oct 03 14:54:51.689368 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2438/4995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:50 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1523 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:51.695206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:51.695837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:51.716229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:51.716754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:51.717267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:51.718088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:51.718498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:51.721501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.099987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:52.114762 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8efd8848-9925-4683-b70f-8ad00bd033c7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1530 microversion: 2.1 time: 0.423888 Oct 03 14:54:52.150277 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2439/4996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:51 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1530 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:52.363889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:52.398569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:52.403967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:52.407022 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46942207-7646-4492-86bb-96c3f41db7a7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.965163 Oct 03 14:54:52.429391 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2558/4997] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:51 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:52.698698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:52.700226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:52.713728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dc317120-0645-41c3-87b0-899c285cb6fd req-8baeffc0-d53c-45a5-83b7-13e091132d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178e30c6-88b2-47f9-a992-6a5b28e21200", "name": "network-vif-deleted", "tag": "b7fdd165-ae58-49e8-8d85-71ce06def13b"}, {"server_uuid": "d315eb8c-e25c-49bd-80cc-aab46e8bf424", "name": "network-vif-deleted", "tag": "dcd66891-2d33-44d2-8a1b-831b7bdf4c6a"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:52.714744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:52.715442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:52.717650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.719832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:52.722774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:52.723420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.759324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc317120-0645-41c3-87b0-899c285cb6fd req-8baeffc0-d53c-45a5-83b7-13e091132d6e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:52.759832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc317120-0645-41c3-87b0-899c285cb6fd req-8baeffc0-d53c-45a5-83b7-13e091132d6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:52.764574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dc317120-0645-41c3-87b0-899c285cb6fd req-8baeffc0-d53c-45a5-83b7-13e091132d6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.802428 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dc317120-0645-41c3-87b0-899c285cb6fd req-8baeffc0-d53c-45a5-83b7-13e091132d6e service nova] Creating event network-vif-deleted:b7fdd165-ae58-49e8-8d85-71ce06def13b for instance 178e30c6-88b2-47f9-a992-6a5b28e21200 on n-h2-781139-2 Oct 03 14:54:52.804646 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dc317120-0645-41c3-87b0-899c285cb6fd req-8baeffc0-d53c-45a5-83b7-13e091132d6e service nova] Creating event network-vif-deleted:dcd66891-2d33-44d2-8a1b-831b7bdf4c6a for instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 on n-h1-781139-2 Oct 03 14:54:52.827257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:52.828283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:52.829100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:52.830748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lazy-loading 'fault' on Instance uuid d315eb8c-e25c-49bd-80cc-aab46e8bf424 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:54:52.840841 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dc317120-0645-41c3-87b0-899c285cb6fd req-8baeffc0-d53c-45a5-83b7-13e091132d6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.136032 Oct 03 14:54:52.846787 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2559/4998] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:53.072876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bd37b8f66f945548f26f6100400623c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fd90c18f324aa9b38ecdd9a225af9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:53.089119 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fce47f41-2821-454a-b027-1431787d62d6 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 200 len: 1313 microversion: 2.1 time: 0.394960 Oct 03 14:54:53.092117 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2440/4999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:52 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:53.150467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:53.151565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:53.167936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.170640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.171099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.174462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.174957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.176699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.435456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:53.436468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:53.452450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.456669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.457294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.458792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:53.459417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:53.460774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:53.814133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:53.829221 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a851407-962f-4329-b12c-9976a1016ef6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1530 microversion: 2.1 time: 0.688577 Oct 03 14:54:53.833712 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2560/5000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:53 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1530 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:53.979123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:54.003038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:54.012079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:54.016809 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ccbb6e0-aaf2-4532-b242-30a6b77085c3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.585031 Oct 03 14:54:54.017449 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2441/5001] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:53 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:54.117384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:54.118337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: d315eb8c-e25c-49bd-80cc-aab46e8bf424] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:54.147634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.148473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.149143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.150572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.151526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.152104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.171774 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] HTTP exception thrown: Instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 could not be found. Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 HTTP/1.1 Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 could not be found. Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd315eb8c-e25c-49bd-80cc-aab46e8bf424'} Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 could not be found. Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 could not be found. Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.175649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 could not be found. Oct 03 14:54:54.183419 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.185632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 404 to user: Instance d315eb8c-e25c-49bd-80cc-aab46e8bf424 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:54.187158 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27ef8c7a-296b-49aa-bdbd-80313b597d07 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424" status: 404 len: 111 microversion: 2.1 time: 0.075408 Oct 03 14:54:54.205394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:54.206028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] [instance: 178e30c6-88b2-47f9-a992-6a5b28e21200] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:54.215393 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2561/5002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:54 2022] GET /compute/v2.1/servers/d315eb8c-e25c-49bd-80cc-aab46e8bf424 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:54:54.222262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.223268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.225412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.226984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.234237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.235011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.270186 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] HTTP exception thrown: Instance 178e30c6-88b2-47f9-a992-6a5b28e21200 could not be found. Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Request method failure captured: Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 HTTP/1.1 Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOveCsObIMHL23PB7RTugWcG7CSc4fz6c8llZhBBAAMMwEEBO9_e9m8fLvkOfXGWtlqucd2OmSHbvp3Pdkc16H7aqhh0yDY5VrH31HhkoJlavtH2bZDxn8FdsekflaHyBI_XJ4NnOAg5lOtsOqrtcoJcbg_XtRsE_x4HlbJKRwuppJNo Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_86fd90c18f324aa9b38ecdd9a225af9e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/86fd90c18f324aa9b38ecdd9a225af9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 86fd90c18f324aa9b38ecdd9a225af9e Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1206250492 Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 6bd37b8f66f945548f26f6100400623c Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ListServersNegativeTestJSON-1206250492-project Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 178e30c6-88b2-47f9-a992-6a5b28e21200 could not be found. Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '178e30c6-88b2-47f9-a992-6a5b28e21200'} Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178e30c6-88b2-47f9-a992-6a5b28e21200 could not be found. Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178e30c6-88b2-47f9-a992-6a5b28e21200 could not be found. Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.275431 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178e30c6-88b2-47f9-a992-6a5b28e21200 could not be found. Oct 03 14:54:54.279915 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:54:54.283852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] Returning 404 to user: Instance 178e30c6-88b2-47f9-a992-6a5b28e21200 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:54:54.287374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b4f13028-61d4-42c5-944f-8d4e4eb76b84 tempest-ListServersNegativeTestJSON-1206250492 tempest-ListServersNegativeTestJSON-1206250492-project] 10.222.0.20 "GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200" status: 404 len: 111 microversion: 2.1 time: 0.090523 Oct 03 14:54:54.294455 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2442/5003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:54 2022] GET /compute/v2.1/servers/178e30c6-88b2-47f9-a992-6a5b28e21200 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:54:54.322584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-02d2a73a-d8e8-44a1-86e7-6d68cd00bcec req-8d853753-bb6c-4e19-a903-7b53428b20a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e6319e-de09-4df3-9695-6a571b44dc00", "name": "network-vif-plugged", "status": "completed", "tag": "1bc7b76c-ec37-4846-9019-39d5816c9cea"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:54.345263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-02d2a73a-d8e8-44a1-86e7-6d68cd00bcec req-8d853753-bb6c-4e19-a903-7b53428b20a1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.347540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-02d2a73a-d8e8-44a1-86e7-6d68cd00bcec req-8d853753-bb6c-4e19-a903-7b53428b20a1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.349055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-02d2a73a-d8e8-44a1-86e7-6d68cd00bcec req-8d853753-bb6c-4e19-a903-7b53428b20a1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.397529 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-02d2a73a-d8e8-44a1-86e7-6d68cd00bcec req-8d853753-bb6c-4e19-a903-7b53428b20a1 service nova] Creating event network-vif-plugged:1bc7b76c-ec37-4846-9019-39d5816c9cea for instance 87e6319e-de09-4df3-9695-6a571b44dc00 on n-h1-781139-2 Oct 03 14:54:54.413843 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-02d2a73a-d8e8-44a1-86e7-6d68cd00bcec req-8d853753-bb6c-4e19-a903-7b53428b20a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096500 Oct 03 14:54:54.415694 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2562/5004] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:54.857950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:54.858626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:54.870660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.872720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.874390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:54.875464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:54.877081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:54.878910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:55.050314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:55.051209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:55.075339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:55.075858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:55.076306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:55.077055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:55.077686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:55.078450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:55.430436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:55.434875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:55.442384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87ab7174-82a4-4f46-a0fa-c76e31b2de05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1530 microversion: 2.1 time: 0.589194 Oct 03 14:54:55.445642 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2443/5005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:54 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1530 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:54:55.448719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:55.450263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:55.451496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46bff0de-7874-4bc3-8841-3e1a0442d614 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.406154 Oct 03 14:54:55.452053 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2563/5006] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:55 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:56.462566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=12 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:56.463149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:56.468783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:56.469458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:56.471976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1fcd95db-f817-4e97-b77e-a7c85748d25f req-ba43e1ef-7493-4fca-83dc-eaddbf49019e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ea3c31-c873-4937-b6cc-ebd75656c505", "name": "network-vif-plugged", "status": "completed", "tag": "9f346b0f-8c27-4255-97c2-a5d960be0a91"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:54:56.499074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.499645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.500099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.504446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.508834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.512953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.526891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1fcd95db-f817-4e97-b77e-a7c85748d25f req-ba43e1ef-7493-4fca-83dc-eaddbf49019e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.527465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1fcd95db-f817-4e97-b77e-a7c85748d25f req-ba43e1ef-7493-4fca-83dc-eaddbf49019e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.527900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1fcd95db-f817-4e97-b77e-a7c85748d25f req-ba43e1ef-7493-4fca-83dc-eaddbf49019e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.535309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:56.575401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1fcd95db-f817-4e97-b77e-a7c85748d25f req-ba43e1ef-7493-4fca-83dc-eaddbf49019e service nova] Creating event network-vif-plugged:9f346b0f-8c27-4255-97c2-a5d960be0a91 for instance b9ea3c31-c873-4937-b6cc-ebd75656c505 on n-h2-781139-2 Oct 03 14:54:56.590036 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1fcd95db-f817-4e97-b77e-a7c85748d25f req-ba43e1ef-7493-4fca-83dc-eaddbf49019e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130589 Oct 03 14:54:56.593436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2444/5007] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:54:56.619893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:56.625361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:56.652974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.655843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.657081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.663937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:56.666207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:56.667648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:56.814882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:54:57.369111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:57.378262 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5919f13d-126a-47df-a84c-83856b4d7bbe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.914285 Oct 03 14:54:57.388797 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2564/5008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:56 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:54:57.520775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:57.539481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:57.542044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:57.545342 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7f5b68a-4af0-4ed4-a4ff-fa6d343a54d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.949604 Oct 03 14:54:57.546608 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2445/5009] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:56 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:54:58.414845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:58.415370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:58.426804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:58.432214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:58.432744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:58.433547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:58.434019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:58.434447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:58.573868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:54:58.574468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:54:58.582100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:58.582593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:58.583026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:58.583714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:54:58.584162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:54:58.584576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:54:59.185093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:59.198258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:59.199910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:59.207486 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45e5b61a-fce9-446e-a438-101de77fb8a2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.638164 Oct 03 14:54:59.208871 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2446/5010] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:54:58 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:54:59.360404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:54:59.369051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c59d026-086f-4832-b9d1-69966b9976e4 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.961238 Oct 03 14:54:59.380095 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2565/5011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:54:58 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:00.239470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:00.240723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:00.265998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.266561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.267010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.267734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.268189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.268622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.411291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:00.412404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:00.436441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.442317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.444699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.457655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:00.464433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:00.465275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:00.980173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:00.996275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:01.025914 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11b888bd-efd7-4269-a4a4-881d6ff19b3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.620028 Oct 03 14:55:01.030039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2566/5012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:00 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:01.052266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:01.063600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:01.075324 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c933e5ad-b27f-4006-b48c-197dff58814e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1809 microversion: 2.20 time: 0.831559 Oct 03 14:55:01.077764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2447/5013] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:00 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1809 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:02.084042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:02.092835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:02.106908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:02.108832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:02.142397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.143374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.144192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.146949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.148223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.148975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.150517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.152656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:02.153593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.154333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:02.155494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.156162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:02.979852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:02.999372 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c23824c-4a8d-4f9b-97e3-527fd90f8de9 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.941564 Oct 03 14:55:03.003453 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2567/5014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:02 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:03.003867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:03.025140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:03.031815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:03.039981 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-acc1340b-3eda-4a4d-8b6d-3354373581e2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1796 microversion: 2.20 time: 0.938295 Oct 03 14:55:03.042317 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2448/5015] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:02 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1796 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:04.028163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:04.028774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:04.055248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:04.055870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:04.059558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:04.060610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:04.061278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:04.063547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:04.598449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:04.607545 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f302ac6f-1c3d-4349-81b7-dc4e16af3cbb tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.583337 Oct 03 14:55:04.611314 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2568/5016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:04 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:05.635357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:05.636113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:05.650627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:05.655598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:05.659359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:05.661159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:05.662971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:05.665973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:05.669790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:07.035539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:07.048307 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3340f672-759c-475a-8a56-367a6bc728bf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 1.417071 Oct 03 14:55:07.051018 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2449/5017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:05 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:08.085775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:08.086602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:08.099885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:08.100380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:08.100817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:08.101566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:08.102018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:08.107406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:09.690524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:09.705692 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0cff86c7-2eac-4c30-8b63-7da86071fc86 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 1.632448 Oct 03 14:55:09.723453 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2569/5018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:08 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:10.735660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:10.737076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:10.752811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:10.754840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:10.756506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:10.759796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:10.760558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:10.761916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:10.826673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:11.151902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:11.160102 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-756ddc5e-9ffb-474a-b1d7-93cad8c37585 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.430484 Oct 03 14:55:11.165409 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2450/5019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:10 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:12.187994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:12.188754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:12.191620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=47 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:12.205284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:12.209668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:12.210681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:12.211711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:12.213870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:12.216632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:13.040892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:13.081034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-371d4672-b607-4e7b-bb84-439da287801d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.892745 Oct 03 14:55:13.085557 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2570/5020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:12 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:14.189283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:14.192047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:14.298329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:14.304058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:14.309757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:14.310400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:14.310871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:14.311290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:15.238123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:15.248138 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35e24855-21e6-4a94-8b70-d5ea58152aa2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 1.136981 Oct 03 14:55:15.257598 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2451/5021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:14 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:16.300240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:16.300998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:16.337788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:16.341238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:16.342397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:16.343758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:16.346635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:16.351073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:17.208254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:17.218312 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15464e7f-096c-4a2d-913e-59dc4202b2fd tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.933653 Oct 03 14:55:17.257416 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2571/5022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:16 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:18.267276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:18.272891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:18.289185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:18.297443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:18.297930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:18.300169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:18.300661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:18.304215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:19.308833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:19.319479 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-647155d0-b80c-4e0e-8cc7-438d47f77597 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 1.057567 Oct 03 14:55:19.334140 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2452/5023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:18 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:20.348260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:20.349652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:20.367548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:20.386038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:20.392877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:20.397532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:20.403994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:20.406299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:21.099159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:21.125579 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6761fd9-25bd-4fbe-b29f-4c1468d6ff6d tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.781588 Oct 03 14:55:21.126850 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2572/5024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:20 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:22.156255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:22.157566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:22.166253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:22.167169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:22.167921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:22.168852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:22.169711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:22.170367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:22.582582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:22.595469 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94634ba6-b58c-449b-b84c-b2af30e2c263 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1525 microversion: 2.1 time: 0.443449 Oct 03 14:55:22.597716 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2453/5025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:22 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1525 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:22.832647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-431948684", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "15162825-df83-4d78-9b55-1db57a5aaea0"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:22.948009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] validate_networks() for [('15162825-df83-4d78-9b55-1db57a5aaea0', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:55:23.624254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:23.625027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:23.643523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:23.646701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:23.647366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:23.650856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:23.651545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:23.652128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:23.935683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:55:23.938273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:55:23.938790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:55:23.939389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:55:23.940550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:55:23.968836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:23.969396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:23.969891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:23.970573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:23.971029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:23.974545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:24.007769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Getting quotas for project 1af6c558ff0e46b4a8d91dac1cc25e79. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:24.019117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Getting quotas for user e65964f82c4646739d5965a06689c210 and project 1af6c558ff0e46b4a8d91dac1cc25e79. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:24.042110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:55:24.045617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:55:24.105585 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68f82f20-0a61-4afc-a197-163abfdfff85 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533787 Oct 03 14:55:24.107206 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2573/5026] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:55:24.126190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8d7e903-e166-4454-a9f0-33a2e22808a1 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:24.128110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8d7e903-e166-4454-a9f0-33a2e22808a1 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:24.208623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8d7e903-e166-4454-a9f0-33a2e22808a1 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:24.219625 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8d7e903-e166-4454-a9f0-33a2e22808a1 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1224 microversion: 2.1 time: 0.104682 Oct 03 14:55:24.220884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2574/5027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:24 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:25.247283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:25.249031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:25.256957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:25.257718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:25.258350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:25.259403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:25.259889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:25.260308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:25.368179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:25.380378 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83c842b5-fc6b-4833-8933-52ec44a1e53d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1220 microversion: 2.1 time: 0.141353 Oct 03 14:55:25.383319 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2575/5028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:25 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:25.439011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:25.448201 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-298d7551-2a22-4c23-8980-6d2364dae20c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1507 microversion: 2.1 time: 1.830137 Oct 03 14:55:25.448801 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2454/5029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:23 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1507 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:26.406698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:26.407318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:26.430911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:26.431677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:26.432277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:26.433213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:26.433816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:26.434394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:26.480383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:26.481042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:26.501029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:26.501313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:26.501752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:26.515333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:26.518909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:26.519577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:26.588456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:26.596826 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85f31439-2ff7-4e76-ade0-27eeebf2cd88 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1284 microversion: 2.1 time: 0.193991 Oct 03 14:55:26.598099 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2576/5030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:26 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:26.741872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-563ee666-0960-4aa4-8bc1-107eb126dcb9 req-0d641349-5469-4b64-97e5-32e8a7ef22e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e6319e-de09-4df3-9695-6a571b44dc00", "name": "network-vif-unplugged", "status": "completed", "tag": "1bc7b76c-ec37-4846-9019-39d5816c9cea"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:26.753593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-563ee666-0960-4aa4-8bc1-107eb126dcb9 req-0d641349-5469-4b64-97e5-32e8a7ef22e3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:26.754319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-563ee666-0960-4aa4-8bc1-107eb126dcb9 req-0d641349-5469-4b64-97e5-32e8a7ef22e3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:26.754924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-563ee666-0960-4aa4-8bc1-107eb126dcb9 req-0d641349-5469-4b64-97e5-32e8a7ef22e3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:26.767378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=68 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:26.769822 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-563ee666-0960-4aa4-8bc1-107eb126dcb9 req-0d641349-5469-4b64-97e5-32e8a7ef22e3 service nova] Creating event network-vif-unplugged:1bc7b76c-ec37-4846-9019-39d5816c9cea for instance 87e6319e-de09-4df3-9695-6a571b44dc00 on n-h1-781139-2 Oct 03 14:55:26.775857 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-563ee666-0960-4aa4-8bc1-107eb126dcb9 req-0d641349-5469-4b64-97e5-32e8a7ef22e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038252 Oct 03 14:55:26.777213 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2577/5031] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:26.945866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:26.961700 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9f4f8f9-3f95-4851-9453-22f899157691 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1507 microversion: 2.1 time: 0.492968 Oct 03 14:55:26.963231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2455/5032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:26 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:27.626243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:27.626934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:27.643904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:27.644427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:27.644857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:27.652744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:27.653573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:27.654168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:27.833822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:27.847244 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e987a39-f923-4184-864d-020bdb091fa3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1282 microversion: 2.1 time: 0.224929 Oct 03 14:55:27.848144 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2578/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:27 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1282 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:27.985660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:27.986279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:27.998706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:27.999699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.006303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.007399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:28.008069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.008724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.575476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:28.588138 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c836183b-fcae-489c-a995-1707d854b359 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 200 len: 1510 microversion: 2.1 time: 0.605830 Oct 03 14:55:28.592181 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2456/5034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:27 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 1510 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:28.612703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:28.613241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:28.623206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:28.624829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.625579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.628057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:28.629547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.630226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.683748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:55:28.694060 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Working on deleting snapshot 7eadd80b-eaf8-456a-befb-f72a9d39328e from shelved instance... Oct 03 14:55:28.769212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:28.769941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:28.778746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:28.781047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.781686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.785089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:28.786124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.789425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.855158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fbc80190-add5-4679-b9bb-4082dea8297d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments/492439a7-2f70-4b30-9c1b-1558267eb48b" status: 200 len: 194 microversion: 2.20 time: 0.089832 Oct 03 14:55:28.863036 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2457/5035] 10.222.0.20 () {60 vars in 1454 bytes} [Mon Oct 3 14:55:28 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments/492439a7-2f70-4b30-9c1b-1558267eb48b => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:55:28.880044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:28.880912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:28.888441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:28.889585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.890525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.891848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:28.892483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:28.893219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:28.991079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:29.020105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f630257-b02a-4de3-8448-aa61e36097f6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1282 microversion: 2.1 time: 0.141896 Oct 03 14:55:29.042328 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2458/5036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:28 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:29.084876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:29.085447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:29.100265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:29.100777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:29.102220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:29.104013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:29.105462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:29.107361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:29.284805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lazy-loading 'services' on Instance uuid b9ea3c31-c873-4937-b6cc-ebd75656c505 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:55:29.454827 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba88dd86-f289-413b-816e-058a4fbe90c0 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments/492439a7-2f70-4b30-9c1b-1558267eb48b" status: 202 len: 0 microversion: 2.20 time: 0.382900 Oct 03 14:55:29.455854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2459/5037] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 3 14:55:29 2022] DELETE /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments/492439a7-2f70-4b30-9c1b-1558267eb48b => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:55:29.467699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:29.470821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:29.478741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:29.479388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:29.479891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:29.480621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:29.481296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:29.482914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:29.587938 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5184281-cf34-446b-808f-c53575a6cff3 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126808 Oct 03 14:55:29.602115 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2460/5038] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:29 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:55:29.907810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Doing local delete in cell 54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) {{(pid=128869) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 03 14:55:29.916221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:29.917153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:29.917795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:29.918395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 03 14:55:29.927449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] deallocate_for_instance() {{(pid=128869) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 03 14:55:30.077808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:30.078742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:30.094839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:30.097204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:30.097895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:30.098808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:30.100643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:30.101288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:30.549613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:30.562144 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ad4acf48-f78d-41ff-89d1-347043a7107f tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.488669 Oct 03 14:55:30.581540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2461/5039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:30 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:30.603020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:30.605501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:30.618843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:30.619888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:30.620591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:30.621596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:30.623288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:30.623288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:30.704389 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ec5504f-cbba-41f4-a35a-fb3799931fea tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101896 Oct 03 14:55:30.706782 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2462/5040] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:30 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:55:31.273292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Updating instance_info_cache with network_info: [] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:55:31.295568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-73c26bf6-bb83-443a-9cca-45e6bd7083c9 req-0c8d4b2c-4619-488e-bc09-d2f380d31097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e6319e-de09-4df3-9695-6a571b44dc00", "name": "network-vif-deleted", "tag": "1bc7b76c-ec37-4846-9019-39d5816c9cea"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:31.349923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-73c26bf6-bb83-443a-9cca-45e6bd7083c9 req-0c8d4b2c-4619-488e-bc09-d2f380d31097 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.350527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-73c26bf6-bb83-443a-9cca-45e6bd7083c9 req-0c8d4b2c-4619-488e-bc09-d2f380d31097 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.353342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-73c26bf6-bb83-443a-9cca-45e6bd7083c9 req-0c8d4b2c-4619-488e-bc09-d2f380d31097 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.404858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.server_external_events [req-73c26bf6-bb83-443a-9cca-45e6bd7083c9 req-0c8d4b2c-4619-488e-bc09-d2f380d31097 service nova] Unable to find a host for instance 87e6319e-de09-4df3-9695-6a571b44dc00. Dropping event network-vif-deleted {{(pid=128868) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 14:55:31.405964 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-73c26bf6-bb83-443a-9cca-45e6bd7083c9 req-0c8d4b2c-4619-488e-bc09-d2f380d31097 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.116556 Oct 03 14:55:31.406810 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2463/5041] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 118 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 14:55:31.595264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:31.595978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:31.609281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.610425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.611108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.613413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.620401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.621133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.624653 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c5a703c-556c-463b-a32b-ac6b74d585d3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 204 len: 0 microversion: 2.1 time: 3.015044 Oct 03 14:55:31.626620 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2579/5042] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:55:28 2022] DELETE /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 0 bytes in 3019 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:55:31.639718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:31.643605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:31.654244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.655254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.655928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.656877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.657651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.659046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.706439 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 HTTP/1.1 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '87e6319e-de09-4df3-9695-6a571b44dc00'} Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:31.708473 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:31.713498 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:31.713498 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:31.713498 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:31.713498 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:55:31.713498 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:55:31.713498 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:55:31.713498 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:31.716228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:55:31.717338 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29a5134a-4e05-4fdb-acf9-f928cd79dc9a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 404 len: 111 microversion: 2.1 time: 0.086087 Oct 03 14:55:31.718605 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2580/5043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:31 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:55:31.731850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:31.738029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:31.748859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.749578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.750255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.751145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:31.751797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:31.752490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:31.790369 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a20d90f-e30d-468b-9864-6284ff2b7e36 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070377 Oct 03 14:55:31.791609 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2581/5044] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:31 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:55:31.909042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-590342341", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fd28a296-d4d0-487d-b766-c66e0eb4645b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:32.007737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] validate_networks() for [('fd28a296-d4d0-487d-b766-c66e0eb4645b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:55:32.224097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:32.237411 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba5ffbc3-2e12-4c63-815e-13640e9fa4cb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.646194 Oct 03 14:55:32.242257 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2464/5045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:31 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:32.249843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ff5bc387-4aae-4e3e-b762-2f8fbbeb8421 req-9e8a2186-98f8-442c-ab8f-fb9bc1539387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fdd670-6c22-4e84-8ff9-b79017391b22", "tag": "a457bf56-e8fc-4047-94db-6cbe7fde3ac0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:32.277617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ff5bc387-4aae-4e3e-b762-2f8fbbeb8421 req-9e8a2186-98f8-442c-ab8f-fb9bc1539387 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:32.280722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ff5bc387-4aae-4e3e-b762-2f8fbbeb8421 req-9e8a2186-98f8-442c-ab8f-fb9bc1539387 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:32.281291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ff5bc387-4aae-4e3e-b762-2f8fbbeb8421 req-9e8a2186-98f8-442c-ab8f-fb9bc1539387 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:32.300303 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ff5bc387-4aae-4e3e-b762-2f8fbbeb8421 req-9e8a2186-98f8-442c-ab8f-fb9bc1539387 service nova] Creating event network-changed:a457bf56-e8fc-4047-94db-6cbe7fde3ac0 for instance c1fdd670-6c22-4e84-8ff9-b79017391b22 on n-h1-781139-2 Oct 03 14:55:32.311104 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ff5bc387-4aae-4e3e-b762-2f8fbbeb8421 req-9e8a2186-98f8-442c-ab8f-fb9bc1539387 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065892 Oct 03 14:55:32.317385 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2465/5046] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:32.806104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:32.811025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:32.823846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:32.828631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:32.829282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:32.830296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:32.831660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:32.833523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:32.909781 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b167568f-4292-4360-8fa8-014288362e3c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109733 Oct 03 14:55:32.910700 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2466/5047] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:32 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:55:33.265450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:33.269200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:33.281843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.282486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.283634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:33.284694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.287054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.287760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:33.341841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:33.465442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:55:33.465987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:55:33.466318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:55:33.471055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:55:33.471677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:55:33.489390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.495543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.498305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:33.499341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.499975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.507775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:33.547820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:33.563606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for user 3569fcf74b3b4e3d99b0dbcd5465d97d and project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:33.589395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:55:33.591902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:55:33.663630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de8e08fb-ab7b-4e11-b9cd-8b906c78c70f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759394 Oct 03 14:55:33.671812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2582/5048] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:55:33.683524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8d219ec-ce09-41c3-aa98-b25bcaeac3ad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:33.683790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8d219ec-ce09-41c3-aa98-b25bcaeac3ad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:33.799894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8d219ec-ce09-41c3-aa98-b25bcaeac3ad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:33.814897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8d219ec-ce09-41c3-aa98-b25bcaeac3ad tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1214 microversion: 2.1 time: 0.135816 Oct 03 14:55:33.817537 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2583/5049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:33 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:33.923721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:33.926263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:33.943254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.943895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.946209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:33.949283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:33.949913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:33.950185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:34.050931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc5546e9-073c-4727-ae5d-4a0ab1df3d38 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129865 Oct 03 14:55:34.052620 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2584/5050] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:33 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:55:34.153201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:34.203772 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b8059fdb-e326-49a5-bd32-2981cc85b379 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.942166 Oct 03 14:55:34.210141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2467/5051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:33 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:34.845948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:34.846608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:34.858853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:34.860593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:34.861510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:34.862848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:34.865007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:34.866295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:34.975072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:34.986332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dae6b741-3207-4f97-a11e-47379e952b89 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1266 microversion: 2.1 time: 0.144205 Oct 03 14:55:34.992962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2585/5052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:34 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:35.065414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:35.081107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:35.118746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:35.133356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:35.134210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:35.135182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:35.135846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:35.136512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:35.224142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc18cf5b-2598-4fc6-b87b-2fa1db94169a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159419 Oct 03 14:55:35.231638 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2468/5053] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:35 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:55:35.236685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:35.237394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:35.249073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:35.249586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:35.250032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:35.252031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:35.256131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:35.257352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:35.625485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:35.639499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-470c2384-5802-4681-9cce-69d6bbbc9ed4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.403494 Oct 03 14:55:35.640613 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2586/5054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:35 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:36.018290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:36.018913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:36.020838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=40 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:36.030840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:36.032068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:36.032663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:36.033565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:36.034173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:36.034751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:36.210914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:36.221901 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5fd482f-e1c9-4e60-abbc-a8fdff067312 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1272 microversion: 2.1 time: 0.207414 Oct 03 14:55:36.231943 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2469/5055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:36 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:36.239013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:36.241382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:36.278806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:36.279762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:36.280813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:36.285139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:36.286258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:36.287036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:36.334165 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1442518c-1bf3-42b8-a4c3-4e2cbea63df1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099172 Oct 03 14:55:36.335401 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2587/5056] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:36 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:55:36.674777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:36.675651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:36.685063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:36.685926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:36.686661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:36.687658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:36.688344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:36.690180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:36.764331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ff522c0-a65e-48ff-b26c-76bb8c608c5d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Action: 'create', calling method: .version_select at 0x7fb230aac940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-789680098", "policies": ["affinity"]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:36.822936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4ff522c0-a65e-48ff-b26c-76bb8c608c5d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:36.844504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4ff522c0-a65e-48ff-b26c-76bb8c608c5d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:36.947056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:36.972964 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c64a627b-69b5-4127-90af-e9d192921041 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.299373 Oct 03 14:55:36.974664 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2588/5057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:36 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:36.999566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4ff522c0-a65e-48ff-b26c-76bb8c608c5d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:37.018995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4ff522c0-a65e-48ff-b26c-76bb8c608c5d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:37.044324 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ff522c0-a65e-48ff-b26c-76bb8c608c5d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.522478 Oct 03 14:55:37.053523 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2470/5058] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Oct 3 14:55:36 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:37.066995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bb7442a6-f571-41ca-b211-971ed0e4aadc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Action: 'create', calling method: .version_select at 0x7fb230a21b80>, body: {"server_group": {"name": "tempest-server-group-2032973307", "policies": ["affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:37.119341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bb7442a6-f571-41ca-b211-971ed0e4aadc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:37.135989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bb7442a6-f571-41ca-b211-971ed0e4aadc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:37.250707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bb7442a6-f571-41ca-b211-971ed0e4aadc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:37.253310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:37.254479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:37.265514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:37.269133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:37.270370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:37.271333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:37.272565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bb7442a6-f571-41ca-b211-971ed0e4aadc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:37.273858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:37.275451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:37.276491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:37.319157 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bb7442a6-f571-41ca-b211-971ed0e4aadc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.256405 Oct 03 14:55:37.327442 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2589/5059] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 3 14:55:37 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:37.338264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7edc16c0-37fb-4578-8009-d8f44551fb84 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Action: 'create', calling method: .version_select at 0x7fb22be06ca0>, body: {"server_group": {"name": "tempest-server-group-2032973307", "policies": ["affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:37.378200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7edc16c0-37fb-4578-8009-d8f44551fb84 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:37.388796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7edc16c0-37fb-4578-8009-d8f44551fb84 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:37.462134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7edc16c0-37fb-4578-8009-d8f44551fb84 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:37.489138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7edc16c0-37fb-4578-8009-d8f44551fb84 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:37.549117 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7edc16c0-37fb-4578-8009-d8f44551fb84 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.214855 Oct 03 14:55:37.550440 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2590/5060] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 3 14:55:37 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:37.568640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:37.574729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:37.613415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:37.616469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:37.617167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:37.617834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:37.618300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:37.618722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:37.679915 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96c0e318-d81c-4c4c-9269-91aa71b9d73f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.128098 Oct 03 14:55:37.680874 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2591/5061] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:37 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:55:37.689330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c189fc73-272f-4067-96a9-781e7837fa4b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:37.740207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c189fc73-272f-4067-96a9-781e7837fa4b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/ca759368-1a96-49e3-82d0-4e35957c62e1" status: 204 len: 0 microversion: 2.1 time: 0.056942 Oct 03 14:55:37.744613 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2592/5062] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:55:37 2022] DELETE /compute/v2.1/os-server-groups/ca759368-1a96-49e3-82d0-4e35957c62e1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:55:37.752283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2943ebe1-6de2-45fc-89e4-f98a8b8e0d05 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:37.774712 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2943ebe1-6de2-45fc-89e4-f98a8b8e0d05 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.028129 Oct 03 14:55:37.786255 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2593/5063] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:55:37 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:37.792670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63b293ae-2ea7-417d-8334-22fe0a620b28 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:37.836226 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63b293ae-2ea7-417d-8334-22fe0a620b28 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/26f54886-a7c1-49a5-bd72-d572bf64db43" status: 204 len: 0 microversion: 2.1 time: 0.048194 Oct 03 14:55:37.840886 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2594/5064] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:55:37 2022] DELETE /compute/v2.1/os-server-groups/26f54886-a7c1-49a5-bd72-d572bf64db43 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:55:37.846729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ef24a0b-04c6-4c35-b1a8-9d8ecb339c10 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:37.865174 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ef24a0b-04c6-4c35-b1a8-9d8ecb339c10 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.022502 Oct 03 14:55:37.866733 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2595/5065] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:55:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:37.884848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cfa9882e-1177-4484-8d30-ad376d4a7eb4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Action: 'create', calling method: .version_select at 0x7fb22bce3f70>, body: {"server_group": {"name": "tempest-server-group-693406736", "policies": ["affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:37.917278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cfa9882e-1177-4484-8d30-ad376d4a7eb4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:37.927054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cfa9882e-1177-4484-8d30-ad376d4a7eb4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:38.021103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cfa9882e-1177-4484-8d30-ad376d4a7eb4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:38.038019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-cfa9882e-1177-4484-8d30-ad376d4a7eb4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:38.102360 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cfa9882e-1177-4484-8d30-ad376d4a7eb4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.218696 Oct 03 14:55:38.108516 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2596/5066] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 3 14:55:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:55:38.113555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:38.114270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:38.132130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:38.133045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:38.133496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:38.137152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:38.137804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:38.138257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:38.180896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:38.503858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:38.513786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-386af2b7-7637-4138-9fc1-a6b576d308f3 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.409161 Oct 03 14:55:38.528963 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2597/5067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:38 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:38.528963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe045ee0-61ad-4e94-a7d5-72a6e9570058 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:38.571260 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe045ee0-61ad-4e94-a7d5-72a6e9570058 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a9eece0a-d87d-4651-b72c-97865b76fa6a" status: 204 len: 0 microversion: 2.1 time: 0.055158 Oct 03 14:55:38.571874 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2598/5068] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:55:38 2022] DELETE /compute/v2.1/os-server-groups/a9eece0a-d87d-4651-b72c-97865b76fa6a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:55:38.584777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4199fcc8-79bd-4d7b-b16f-333c97b9d57a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:38.623859 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4199fcc8-79bd-4d7b-b16f-333c97b9d57a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.047011 Oct 03 14:55:38.624469 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2599/5069] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:55:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:38.641541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c786738b-532e-40fd-a0ff-69c8793a1c78 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Action: 'create', calling method: .version_select at 0x7fb22bf3ec10>, body: {"server_group": {"name": "tempest-server-group-1712348619", "policies": ["anti-affinity"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:38.703499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c786738b-532e-40fd-a0ff-69c8793a1c78 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:38.722445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c786738b-532e-40fd-a0ff-69c8793a1c78 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:38.726114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:38.734132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:38.752907 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-826f3e10-3afe-4266-930f-e74a85de04c1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 1.504559 Oct 03 14:55:38.761848 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2471/5070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:37 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:38.775044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:38.791082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:38.796422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c786738b-532e-40fd-a0ff-69c8793a1c78 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:38.806095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c786738b-532e-40fd-a0ff-69c8793a1c78 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_groups'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:38.809998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:38.810798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:38.811409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:38.812470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:38.813207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:38.814430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:38.827362 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c786738b-532e-40fd-a0ff-69c8793a1c78 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.193102 Oct 03 14:55:38.830344 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2600/5071] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 3 14:55:38 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:38.839777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ed0b057-4029-4211-82c6-dc1b8d4bd4bc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:38.884284 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74e55a63-25be-4182-8766-ed924304914b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.120526 Oct 03 14:55:38.886981 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2472/5072] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:55:38 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:38.917001 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ed0b057-4029-4211-82c6-dc1b8d4bd4bc tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/8adb7a94-2621-40ab-b655-c580255b942b" status: 204 len: 0 microversion: 2.1 time: 0.081941 Oct 03 14:55:38.923329 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2601/5073] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:55:38 2022] DELETE /compute/v2.1/os-server-groups/8adb7a94-2621-40ab-b655-c580255b942b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:55:38.932967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cde95e83-1f8e-49ae-b64f-d933c8611e6c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:38.984196 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cde95e83-1f8e-49ae-b64f-d933c8611e6c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.055141 Oct 03 14:55:38.984827 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2473/5074] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:55:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:39.062666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:39.063563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:39.077738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:39.082230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:39.084281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:39.087506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:39.088265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:39.089281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:39.110244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1735073932", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "8d3d9f5c-78cf-4be4-9d8d-69eaacfb918a"}]}, "os:scheduler_hints": {"group": "7d9ec5be-4526-4c4b-a697-5d7af4c5eec2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:39.186292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:55:39.241105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] validate_networks() for [('8d3d9f5c-78cf-4be4-9d8d-69eaacfb918a', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:55:39.398565 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b591b4c-6ae0-41ee-9b13-fa01420948f2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 204 len: 0 microversion: 2.20 time: 0.340552 Oct 03 14:55:39.402822 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2602/5075] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:55:39 2022] DELETE /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:55:39.412350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:39.422291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:39.441595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:39.442166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:39.442650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:39.444786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:39.445352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:39.445787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:39.885589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:39.896084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:39.897896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:39.899204 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d97d8c4d-869f-4c6a-8d8d-ba17c7b293f4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.495137 Oct 03 14:55:39.902201 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2603/5076] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:39 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:39.932073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:39.934687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:39.947389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:39.948241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:39.948754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:39.949897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:39.951061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:39.951584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:40.194481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:40.210539 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66089218-7e31-4931-a313-87614bdcaef7 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.295201 Oct 03 14:55:40.213090 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2604/5077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:39 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:40.223715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:40.224377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:40.232005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:40.232505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:40.233023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:40.233696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:40.234855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:40.235290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:40.452647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:40.488557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d69f4050-cfc6-4c5b-b46c-b6338538939a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.275666 Oct 03 14:55:40.500786 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2605/5078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:40 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:40.939450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:40.940232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:40.953585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:40.956243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:40.956915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:40.958139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:40.958918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:40.961075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.381748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.398746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.400296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.401580 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c1ce9f8-933b-44b5-9da8-a76e66392083 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1724 microversion: 2.20 time: 0.474459 Oct 03 14:55:41.402150 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2606/5079] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:40 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:55:41.413171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9e308d54-2608-4990-beee-83df6248b9ef req-148c7d51-850c-42d3-a650-126a2c890f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fdd670-6c22-4e84-8ff9-b79017391b22", "name": "network-vif-plugged", "status": "completed", "tag": "a457bf56-e8fc-4047-94db-6cbe7fde3ac0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:41.441714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e308d54-2608-4990-beee-83df6248b9ef req-148c7d51-850c-42d3-a650-126a2c890f69 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.442216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e308d54-2608-4990-beee-83df6248b9ef req-148c7d51-850c-42d3-a650-126a2c890f69 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.442700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e308d54-2608-4990-beee-83df6248b9ef req-148c7d51-850c-42d3-a650-126a2c890f69 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.463276 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9e308d54-2608-4990-beee-83df6248b9ef req-148c7d51-850c-42d3-a650-126a2c890f69 service nova] Creating event network-vif-plugged:a457bf56-e8fc-4047-94db-6cbe7fde3ac0 for instance c1fdd670-6c22-4e84-8ff9-b79017391b22 on n-h1-781139-2 Oct 03 14:55:41.472268 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9e308d54-2608-4990-beee-83df6248b9ef req-148c7d51-850c-42d3-a650-126a2c890f69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060180 Oct 03 14:55:41.472268 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2607/5080] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:41.476070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:41.476805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:41.484063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.484592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.485059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.485792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.486244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.486668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.738086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.758584 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57151634-e09e-4f3d-a719-59fe682f6046 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.287394 Oct 03 14:55:41.759485 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2608/5081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:41 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:41.764332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:41.765181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:41.772022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.772673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.773311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.774166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.774770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.775344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.899733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:55:41.909670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:55:41.910186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:55:41.910603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:55:41.911216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:55:41.941909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.942659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.943255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.944158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:41.944785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:41.945379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:41.965634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:41.975724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:41.986358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a64823ec-ece6-48bc-8c11-104de0b4ee0b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.225613 Oct 03 14:55:41.987825 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2609/5082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:41 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:41.990751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:42.049340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:55:42.055597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:55:42.137123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128868) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 03 14:55:42.185918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_group_members'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:42.197104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_group_members'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:42.275772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_group_members'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:42.284305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Getting quotas for user d4ee1c01265f4451aab1705b075bc93a and project c519472b9aae4cca8a2581f09ee5595f. Resources: {'server_group_members'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:42.320634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53fa9b69-6823-4296-b263-e016465e928f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.214648 Oct 03 14:55:42.322099 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2474/5083] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:55:42.333525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-387445ad-3132-4a6c-b729-2329fad7cd16 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:42.334438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-387445ad-3132-4a6c-b729-2329fad7cd16 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:42.428622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:42.429543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:42.448642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.449178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.449613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.450316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.450939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.451530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.692147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:42.701781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:42.708948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:42.710404 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35bd589c-1ebc-4610-ae67-239350f5b215 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1657 microversion: 2.20 time: 0.286330 Oct 03 14:55:42.713151 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2475/5084] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:42 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1657 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:55:42.757218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-793fbeb6-d135-4fba-9fdf-d28f96f0a670 req-e3488c8a-6295-48a6-b709-92fecd799bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fa2c58-10bb-41ea-98b9-b1d88d631fcd", "tag": "1b7189fd-c12e-4f0e-b050-7ba65fc46796"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:42.787760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-793fbeb6-d135-4fba-9fdf-d28f96f0a670 req-e3488c8a-6295-48a6-b709-92fecd799bb4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.788267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-793fbeb6-d135-4fba-9fdf-d28f96f0a670 req-e3488c8a-6295-48a6-b709-92fecd799bb4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.788700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-793fbeb6-d135-4fba-9fdf-d28f96f0a670 req-e3488c8a-6295-48a6-b709-92fecd799bb4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.826848 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-793fbeb6-d135-4fba-9fdf-d28f96f0a670 req-e3488c8a-6295-48a6-b709-92fecd799bb4 service nova] Creating event network-changed:1b7189fd-c12e-4f0e-b050-7ba65fc46796 for instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd on n-h2-781139-2 Oct 03 14:55:42.838795 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-793fbeb6-d135-4fba-9fdf-d28f96f0a670 req-e3488c8a-6295-48a6-b709-92fecd799bb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086686 Oct 03 14:55:42.839904 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2476/5085] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:55:42.845307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:42.846028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:42.870222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.870693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.871314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.872569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:42.873220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:42.873804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:42.893227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-387445ad-3132-4a6c-b729-2329fad7cd16 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:42.915448 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-387445ad-3132-4a6c-b729-2329fad7cd16 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1213 microversion: 2.1 time: 0.575131 Oct 03 14:55:42.921883 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2610/5086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:42 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1213 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:43.011366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:43.012648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:43.035680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.038995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.039633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.045903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.046583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.047208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.457243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:43.469706 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-131662fb-8d44-4026-be1c-ef5894c5513d tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1324 microversion: 2.1 time: 0.628361 Oct 03 14:55:43.470749 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2477/5087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:42 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1324 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:43.482857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:43.483365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:43.496530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.497415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.497885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.498565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.499050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.526222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:43.529495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.758888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lazy-loading 'services' on Instance uuid c34f6896-67b3-4663-a15e-350a205c2a59 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:55:43.813595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:43.823081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75c23b00-5f59-4f2a-999e-48d3b0736f30 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.816510 Oct 03 14:55:43.829222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2611/5088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:43 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:43.834593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2d5c63cc-4160-4546-b280-29aa4b495431 req-81bbbe84-9437-4aef-b5a6-492da89437c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ea3c31-c873-4937-b6cc-ebd75656c505", "name": "network-vif-deleted", "tag": "9f346b0f-8c27-4255-97c2-a5d960be0a91"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:43.858425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d5c63cc-4160-4546-b280-29aa4b495431 req-81bbbe84-9437-4aef-b5a6-492da89437c9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.861401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d5c63cc-4160-4546-b280-29aa4b495431 req-81bbbe84-9437-4aef-b5a6-492da89437c9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.862197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d5c63cc-4160-4546-b280-29aa4b495431 req-81bbbe84-9437-4aef-b5a6-492da89437c9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.903124 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2d5c63cc-4160-4546-b280-29aa4b495431 req-81bbbe84-9437-4aef-b5a6-492da89437c9 service nova] Creating event network-vif-deleted:9f346b0f-8c27-4255-97c2-a5d960be0a91 for instance b9ea3c31-c873-4937-b6cc-ebd75656c505 on n-h2-781139-2 Oct 03 14:55:43.914772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2d5c63cc-4160-4546-b280-29aa4b495431 req-81bbbe84-9437-4aef-b5a6-492da89437c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083933 Oct 03 14:55:43.915403 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2612/5089] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:43.927121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:43.927840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:43.956013 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5ac3c579-42a0-4a5e-94ba-7047b8e74705 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments/85fa1f48-4c53-4567-a882-de604864711d" status: 202 len: 0 microversion: 2.1 time: 0.482419 Oct 03 14:55:43.959339 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2478/5090] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 14:55:43 2022] DELETE /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments/85fa1f48-4c53-4567-a882-de604864711d => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:55:43.966237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:43.967811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.970877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.971551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.973661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:43.975882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:43.976607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:43.977914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:43.995204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.016852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.017463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.019819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.023660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.025092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.079891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.081293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.081971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.089682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lazy-loading 'fault' on Instance uuid b9ea3c31-c873-4937-b6cc-ebd75656c505 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:55:44.257297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.271785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-48f048c5-2ccd-4a11-9ef6-c0c5f625d4b7 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1217 microversion: 2.1 time: 0.306489 Oct 03 14:55:44.279823 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2479/5091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:43 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:44.290918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.301128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.305864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.307093 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42c2409e-e05c-4a9d-8d46-e80267ba7799 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 200 len: 1372 microversion: 2.20 time: 0.390403 Oct 03 14:55:44.307687 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2613/5092] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:43 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:44.314314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:44.324191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:44.383564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.384102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.384563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.385352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.385817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.386248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.437823 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8664f53d-9ae5-4013-9100-da5ea7fe17e1 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151495 Oct 03 14:55:44.439063 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2480/5093] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:44 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:44.502684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:44.504132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:44.517679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.518461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.519258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.522093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.522577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.523164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.854663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:44.856584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:44.872410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.873684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.879649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.881936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:44.882784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:44.893244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:44.972419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:44.981634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76a7784b-1a74-4fd7-92ed-2f85843214ee tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1521 microversion: 2.1 time: 0.492632 Oct 03 14:55:45.002487 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2614/5094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:44 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:45.008791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.010785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.028816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.031695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.032151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.032887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.033390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.033820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.111609 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] HTTP exception thrown: Instance is not a member of specified network Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Request method failure captured: Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22/ips/invalid HTTP/1.1 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvfaHfbux7McivkvurGPEwufQRnQVH_KAEGQ1PqmiugEkEuG-UM5DMKZknDIwpn99ewJ4hVLqamJ334XFJvafvwBfo5gvyjKR2sVGcGQihW7ayRAOo9zBB3H4g7IJe6GXPkCTd_fX-fBO1mr1PcBoV3mNXS9YYbFsMLdbXdaU4qJC0k Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 1af6c558ff0e46b4a8d91dac1cc25e79 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1af6c558ff0e46b4a8d91dac1cc25e79", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 1af6c558ff0e46b4a8d91dac1cc25e79 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerAddressesNegativeTestJSON-1713637683-project Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e65964f82c4646739d5965a06689c210 Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1713637683-project Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance is not a member of specified network Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': 'c1fdd670-6c22-4e84-8ff9-b79017391b22', 'id': 'invalid'} Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 03 14:55:45.131084 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.135287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:55:45.135287 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ada8105-10ef-4a56-a1e8-124ca5c139eb tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.128441 Oct 03 14:55:45.139792 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2615/5095] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22/ips/invalid => generated 91 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:55:45.151442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-659a0dca-9f47-43fb-bce3-4b7d463052b4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.151928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-659a0dca-9f47-43fb-bce3-4b7d463052b4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Failed to fetch instance by id 999 {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 03 14:55:45.156595 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-659a0dca-9f47-43fb-bce3-4b7d463052b4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] HTTP exception thrown: Instance 999 could not be found. Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-659a0dca-9f47-43fb-bce3-4b7d463052b4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Request method failure captured: Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvfaHfbux7McivkvurGPEwufQRnQVH_KAEGQ1PqmiugEkEuG-UM5DMKZknDIwpn99ewJ4hVLqamJ334XFJvafvwBfo5gvyjKR2sVGcGQihW7ayRAOo9zBB3H4g7IJe6GXPkCTd_fX-fBO1mr1PcBoV3mNXS9YYbFsMLdbXdaU4qJC0k Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 1af6c558ff0e46b4a8d91dac1cc25e79 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1af6c558ff0e46b4a8d91dac1cc25e79", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 1af6c558ff0e46b4a8d91dac1cc25e79 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerAddressesNegativeTestJSON-1713637683-project Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e65964f82c4646739d5965a06689c210 Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1713637683-project Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 999 could not be found. Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': '999'} Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 03 14:55:45.162077 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.166259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-659a0dca-9f47-43fb-bce3-4b7d463052b4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:55:45.166259 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-659a0dca-9f47-43fb-bce3-4b7d463052b4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.022815 Oct 03 14:55:45.185199 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2616/5096] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:55:45.196974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:45.199804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.200312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.223317 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-89b5a5b1-02e0-4977-99fa-1c20cdb835ca tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.375341 Oct 03 14:55:45.224095 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2481/5097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:44 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:45.266464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.266958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.267389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.268107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.268566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.269028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.299785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.300322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.314205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.314717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.315159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.315881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.330478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.336088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.337547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:55:45.644695 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e1c33ba-0bc1-4d9e-b4b6-9a3c67b1b1a4 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 204 len: 0 microversion: 2.1 time: 0.452645 Oct 03 14:55:45.645608 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2617/5098] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:55:45 2022] DELETE /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:55:45.662138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.665100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.683897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.685464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.686776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.689861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.690911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.693028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.725171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:45.730901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] HTTP exception thrown: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Request method failure captured: Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 HTTP/1.1 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcFDdBYOCJuLVLlX6uB4UD0BUo5pKuKml-W2ySioby_wLB4m1Ois7kSMbxEM1tT5vam8scRC7-BXc_WfRQlmWvecOcv6cQkPByzAKKJHeXhy0PkegjGDIY9-1V2Tds-ZVuGfkcubzMxZrdY9QZLXlRimLEwRJb57ixoNsJtJJby-mc Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82632b5ccf0a49cb83a76bac46f80c97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb80c02a281e4132aa50bb4de496525c Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b9ea3c31-c873-4937-b6cc-ebd75656c505'} Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.733556 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 14:55:45.737704 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:45.743372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Returning 404 to user: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:55:45.745988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8407661f-c3f6-44f7-85c6-cd5ec25732a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 404 len: 111 microversion: 2.20 time: 0.095747 Oct 03 14:55:45.747205 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2618/5099] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:55:45.764576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.770957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.783148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.783920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.785198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.789973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.791354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.792179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.871319 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cc46408-6745-4c58-8434-8df40c4c11de tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120473 Oct 03 14:55:45.872284 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2619/5100] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:45.885753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:45.902970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:45.903384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:45.917440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.917846 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0bd2aa41-a688-4674-8643-3fea0a9d5126 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1265 microversion: 2.1 time: 0.621826 Oct 03 14:55:45.918106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.918982 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2482/5101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1265 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:45.919604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.920569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:45.925910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:45.926902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:45.945279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b1032f19-25cf-4ba2-9315-597066499e83 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '.version_select at 0x7fb230118ee0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:46.013950 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b1032f19-25cf-4ba2-9315-597066499e83 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153873761" status: 204 len: 0 microversion: 2.20 time: 0.091413 Oct 03 14:55:46.014850 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2483/5102] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 3 14:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153873761 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:55:46.251205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:46.252871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:46.266127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:46.272365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.278347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.279075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.280024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.280642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.281238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.562651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:46.574304 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8f9cf8a-0e50-4683-96c3-17e86066c5e6 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1527 microversion: 2.1 time: 0.694708 Oct 03 14:55:46.580797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:46.589799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2620/5103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:45 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1527 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:46.600908 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d49cdc67-fa27-4a10-9b05-6f4d7fbe8429 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.353720 Oct 03 14:55:46.630341 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2484/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:46 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:46.886327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:46.888602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:46.902217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.904225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.904891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.908970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.909961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.910618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.941678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:46.943022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:46.964964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.966443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.969464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.970483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:46.971179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:46.973180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:46.985384 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52c75452-eb24-40c4-869b-7f545d9c2acc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104615 Oct 03 14:55:46.990130 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2621/5105] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:46 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:47.133831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:47.147988 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49830fbb-f9cd-4f7c-8f52-8350e99fcc2c tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1271 microversion: 2.1 time: 0.210077 Oct 03 14:55:47.161497 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2485/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:46 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:47.605090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:47.605714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:47.623432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.623950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.624392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:47.625152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.625738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.626167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:47.629698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:47.631319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:47.642132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.648732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.650066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:47.651068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:47.651758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:47.652840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.076067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:48.088778 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1bd52ba1-084f-4f7b-93c2-6810a5a9fc31 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1527 microversion: 2.1 time: 0.488863 Oct 03 14:55:48.093186 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2622/5107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:47 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1527 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:48.123998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:48.126258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:48.140835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:48.141419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:48.141867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.142632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:48.143081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:48.145826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.191836 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d42885ae-b55f-44da-977b-efda203103e3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079828 Oct 03 14:55:48.192787 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2623/5108] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:48 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:48.197361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:48.198245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:48.206493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:48.207212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:48.208025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.209109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:48.209752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:48.210358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:48.419067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:48.428400 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6e65601-1521-4ea4-b4c3-c7f3b28b02d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.803124 Oct 03 14:55:48.434841 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2486/5109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:47 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:48.476043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:48.485649 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e76c4f38-d551-43fc-8fc8-de3760ca018a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.291746 Oct 03 14:55:48.486247 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2624/5110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:48 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:49.116113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:49.116747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:49.133990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.145096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.154634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.156260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.156913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.164216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.205902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:49.209454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:49.228030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.230684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.232436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.236598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.237427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.239371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.308550 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14eb8eaf-bf41-4372-8dd2-7580213d4864 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107398 Oct 03 14:55:49.311887 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2625/5111] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:49 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:49.395658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2f94f482-571c-4c8d-b85f-f25f88ab6a70 req-251e3dfc-8638-4849-86a7-b01f2768b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fa2c58-10bb-41ea-98b9-b1d88d631fcd", "name": "network-vif-plugged", "status": "completed", "tag": "1b7189fd-c12e-4f0e-b050-7ba65fc46796"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:49.414164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2f94f482-571c-4c8d-b85f-f25f88ab6a70 req-251e3dfc-8638-4849-86a7-b01f2768b0d0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.414650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2f94f482-571c-4c8d-b85f-f25f88ab6a70 req-251e3dfc-8638-4849-86a7-b01f2768b0d0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.415088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2f94f482-571c-4c8d-b85f-f25f88ab6a70 req-251e3dfc-8638-4849-86a7-b01f2768b0d0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.441591 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2f94f482-571c-4c8d-b85f-f25f88ab6a70 req-251e3dfc-8638-4849-86a7-b01f2768b0d0 service nova] Creating event network-vif-plugged:1b7189fd-c12e-4f0e-b050-7ba65fc46796 for instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd on n-h2-781139-2 Oct 03 14:55:49.452326 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2f94f482-571c-4c8d-b85f-f25f88ab6a70 req-251e3dfc-8638-4849-86a7-b01f2768b0d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059699 Oct 03 14:55:49.453151 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2626/5112] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:55:49.474949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:49.475932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:49.498531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.499048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.499523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.500215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.500671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.505576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.814371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:49.825532 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58183799-094e-48f5-b60a-fa1f90883289 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.362547 Oct 03 14:55:49.827851 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2627/5113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:49 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:49.834924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:49.835870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:49.856997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.858753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.859551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:49.862225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:49.866510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:49.868169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.134962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:50.145491 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d4f5b90-fd39-40d9-8b06-dde2c5031e7f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.313003 Oct 03 14:55:50.148220 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2628/5114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:49 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:50.176614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:50.178712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:50.195825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1204fa1d-0397-456a-aa0c-f392fec46988 tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1527 microversion: 2.1 time: 1.083908 Oct 03 14:55:50.206537 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2487/5115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:49 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1527 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:50.334255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:50.347602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:50.372440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.373973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.379672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.380469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.380979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.383241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.469631 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4748b8e8-f5a7-41bf-a291-7d55f9a86984 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151652 Oct 03 14:55:50.471181 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2629/5116] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:50 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:50.555113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ab11b201-7c4b-47e0-83d1-b1ee8e404dcb req-07bdc1fa-507d-4c3f-9c25-0c284b633cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fdd670-6c22-4e84-8ff9-b79017391b22", "name": "network-vif-deleted", "tag": "a457bf56-e8fc-4047-94db-6cbe7fde3ac0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:50.572647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ab11b201-7c4b-47e0-83d1-b1ee8e404dcb req-07bdc1fa-507d-4c3f-9c25-0c284b633cde service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.573334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ab11b201-7c4b-47e0-83d1-b1ee8e404dcb req-07bdc1fa-507d-4c3f-9c25-0c284b633cde service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.580020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ab11b201-7c4b-47e0-83d1-b1ee8e404dcb req-07bdc1fa-507d-4c3f-9c25-0c284b633cde service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.613665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ab11b201-7c4b-47e0-83d1-b1ee8e404dcb req-07bdc1fa-507d-4c3f-9c25-0c284b633cde service nova] Creating event network-vif-deleted:a457bf56-e8fc-4047-94db-6cbe7fde3ac0 for instance c1fdd670-6c22-4e84-8ff9-b79017391b22 on n-h1-781139-2 Oct 03 14:55:50.622998 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ab11b201-7c4b-47e0-83d1-b1ee8e404dcb req-07bdc1fa-507d-4c3f-9c25-0c284b633cde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068766 Oct 03 14:55:50.624350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2488/5117] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:50.852089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:50.852713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:50.870130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.870651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.871096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:50.877767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:50.880765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:50.882206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.169963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:51.171512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:51.192198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.193430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.198354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.199473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.204656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:51.205638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.209913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.216715 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab03076a-49b9-46d3-9922-8c94b69d0556 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1314 microversion: 2.1 time: 0.367697 Oct 03 14:55:51.218373 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2630/5118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:50 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:51.224161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:51.224652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:51.230480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:51.233126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.233126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.233126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.233487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.233944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.234366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.300804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.301357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.307514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.308032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lazy-loading 'fault' on Instance uuid c1fdd670-6c22-4e84-8ff9-b79017391b22 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:55:51.388455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e65964f82c4646739d5965a06689c210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6c558ff0e46b4a8d91dac1cc25e79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:51.402479 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-958ba327-5e62-47fb-9aa7-6a96a38eecda tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 200 len: 1314 microversion: 2.1 time: 0.182676 Oct 03 14:55:51.403576 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2631/5119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:51 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:51.482889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:51.485977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:51.506357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.507029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.507565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.510551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:51.512239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:51.514340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:51.621164 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4c0651b-3687-4b4b-aabb-79402769d487 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140001 Oct 03 14:55:51.623439 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2632/5120] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:51 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:55:51.795004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:51.809023 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a81d4dc5-1021-4f09-a2b5-8bcb40c2153a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.643302 Oct 03 14:55:51.811786 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2489/5121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:51 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:51.874628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-181e0e72-edf9-494b-91c9-889a674f6008 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'create', calling method: .version_select at 0x7fb230136430>, body: {"keypair": {"name": "tempest-keypair-561435831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk0opC+H3pJq+0AtYCbSHxOcX3PkxpZlCE5iTGA9+Yefsn+HIM9Ut0OeD1THOWNM97VWR39kNsn/VXkXmRcgaYK1oeFUUHrWCRi0GNXVaH8w3q5VdQ6MI65OXJ9ZYHkcw=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:51.904291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-181e0e72-edf9-494b-91c9-889a674f6008 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:51.910857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-181e0e72-edf9-494b-91c9-889a674f6008 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for user cb80c02a281e4132aa50bb4de496525c and project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:51.964581 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-181e0e72-edf9-494b-91c9-889a674f6008 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.095333 Oct 03 14:55:51.965456 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2633/5122] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 3 14:55:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 14:55:52.243825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:52.246067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:52.255036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:52.259709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.261255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.262689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.263918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.264616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.265974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.308974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=22 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:52.437756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:52.438324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] [instance: c1fdd670-6c22-4e84-8ff9-b79017391b22] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:52.459009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.459521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.460018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.461014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.461537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.462097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.503908 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] HTTP exception thrown: Instance c1fdd670-6c22-4e84-8ff9-b79017391b22 could not be found. Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Request method failure captured: Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 HTTP/1.1 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvfaHfbux7McivkvurGPEwufQRnQVH_KAEGQ1PqmiugEkEuG-UM5DMKZknDIwpn99ewJ4hVLqamJ334XFJvafvwBfo5gvyjKR2sVGcGQihW7ayRAOo9zBB3H4g7IJe6GXPkCTd_fX-fBO1mr1PcBoV3mNXS9YYbFsMLdbXdaU4qJC0k Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 1af6c558ff0e46b4a8d91dac1cc25e79 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1af6c558ff0e46b4a8d91dac1cc25e79", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1af6c558ff0e46b4a8d91dac1cc25e79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 1af6c558ff0e46b4a8d91dac1cc25e79 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1713637683 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerAddressesNegativeTestJSON-1713637683-project Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e65964f82c4646739d5965a06689c210 Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1713637683-project Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance c1fdd670-6c22-4e84-8ff9-b79017391b22 could not be found. Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c1fdd670-6c22-4e84-8ff9-b79017391b22'} Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fdd670-6c22-4e84-8ff9-b79017391b22 could not be found. Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fdd670-6c22-4e84-8ff9-b79017391b22 could not be found. Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:52.506833 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fdd670-6c22-4e84-8ff9-b79017391b22 could not be found. Oct 03 14:55:52.513657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:52.518847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] Returning 404 to user: Instance c1fdd670-6c22-4e84-8ff9-b79017391b22 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:55:52.521160 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b02635d7-1773-442c-a6b3-fda20ffa106a tempest-ServerAddressesNegativeTestJSON-1713637683 tempest-ServerAddressesNegativeTestJSON-1713637683-project] 10.222.0.20 "GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22" status: 404 len: 111 microversion: 2.1 time: 0.092200 Oct 03 14:55:52.527483 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2634/5123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:52 2022] GET /compute/v2.1/servers/c1fdd670-6c22-4e84-8ff9-b79017391b22 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:55:52.651886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:52.666352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:52.680713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.681741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.682290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.685599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.686240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.686981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.700166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:52.721942 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7c601c0-f4b4-463a-8eb7-0bba8564ba66 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1501 microversion: 2.1 time: 0.483449 Oct 03 14:55:52.723362 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2490/5124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:52 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1501 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:52.730354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-8bda3a6e-7e11-48fe-acc9-9417e60c5ce6 req-7c2336b1-889e-469d-918d-90a6feb773c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42a07ad5-2bbf-4204-89df-ea6d6b687935", "tag": "14c05fb6-7f6c-431b-b7f6-7b46ea0eb248"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:52.765780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8bda3a6e-7e11-48fe-acc9-9417e60c5ce6 req-7c2336b1-889e-469d-918d-90a6feb773c6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.766669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8bda3a6e-7e11-48fe-acc9-9417e60c5ce6 req-7c2336b1-889e-469d-918d-90a6feb773c6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.767300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8bda3a6e-7e11-48fe-acc9-9417e60c5ce6 req-7c2336b1-889e-469d-918d-90a6feb773c6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.779458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-766c6e35-0fb7-4a32-89a5-d0d94faa5839 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146959 Oct 03 14:55:52.780814 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-8bda3a6e-7e11-48fe-acc9-9417e60c5ce6 req-7c2336b1-889e-469d-918d-90a6feb773c6 service nova] Creating event network-changed:14c05fb6-7f6c-431b-b7f6-7b46ea0eb248 for instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 on n-h1-781139-2 Oct 03 14:55:52.783222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2635/5125] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:52 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:52.790732 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-8bda3a6e-7e11-48fe-acc9-9417e60c5ce6 req-7c2336b1-889e-469d-918d-90a6feb773c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064621 Oct 03 14:55:52.791483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2491/5126] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:55:52.795272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e00b646-3477-4c02-993c-6892699dc937 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:52.814005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e00b646-3477-4c02-993c-6892699dc937 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.816693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e00b646-3477-4c02-993c-6892699dc937 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.817519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e00b646-3477-4c02-993c-6892699dc937 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.833367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:52.834169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:52.852593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.853222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.853729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.854500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.855021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.855520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.856355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e00b646-3477-4c02-993c-6892699dc937 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 14:55:52.888858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:52.934552 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e00b646-3477-4c02-993c-6892699dc937 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd/action" status: 202 len: 0 microversion: 2.1 time: 0.149481 Oct 03 14:55:52.936183 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2636/5127] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:55:52 2022] POST /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:55:52.947082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:52.947792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:52.956221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.956815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.957375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:52.958426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:52.958976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:52.959467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:53.186122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:53.195253 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5ad3c6f-aa20-4ed9-b769-f6162d544706 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.366175 Oct 03 14:55:53.195843 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2492/5128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:52 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:53.625481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:53.641892 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33cdd092-1e85-40c4-857d-c15f8c68ea7a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.700893 Oct 03 14:55:53.644054 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2637/5129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:52 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:53.796020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:53.798980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:53.815090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:53.815860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:53.825192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:53.826301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:53.826770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:53.827234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:53.864675 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59c4df45-9596-413b-9b88-9b2f3a6005a3 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073237 Oct 03 14:55:53.870630 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2493/5130] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 14:55:53 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:55:53.995940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:53.999031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.006851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.007596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.008205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.009146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.010263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.010887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.049983 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Cannot 'reboot' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action HTTP/1.1 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 28 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: {"reboot": {"type": "HARD"}} Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: exception: Cannot 'reboot' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b04994ce-f544-4364-9887-e60b13b07143', 'body': {'reboot': {'type': 'HARD'}}} Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b04994ce-f544-4364-9887-e60b13b07143 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:55:54.053513 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 409 to user: Cannot 'reboot' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:55:54.058407 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bffd56b2-3261-4177-8ae9-3e8534391fc0 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action" status: 409 len: 145 microversion: 2.1 time: 0.063531 Oct 03 14:55:54.068234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:54.069124 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2638/5131] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:55:53 2022] POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:55:54.073032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.085469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.086358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.086992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.087906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.088534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.089906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.170909 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Cannot 'rebuild' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action HTTP/1.1 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 65 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: exception: Cannot 'rebuild' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'b04994ce-f544-4364-9887-e60b13b07143', 'body': {'rebuild': {'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca'}}} Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b04994ce-f544-4364-9887-e60b13b07143 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:55:54.176056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued Oct 03 14:55:54.181064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:55:54.189700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 409 to user: Cannot 'rebuild' instance b04994ce-f544-4364-9887-e60b13b07143 while it is in vm_state rescued {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:55:54.190837 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ace82066-8d94-415f-9c72-b70161ffeaa5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action" status: 409 len: 146 microversion: 2.1 time: 0.127650 Oct 03 14:55:54.192155 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2494/5132] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:55:54 2022] POST /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143/action => generated 146 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:55:54.204382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:54.204895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.223868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:54.224887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.232102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.232317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.235362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.236071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.237386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.237907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.241087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.241894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.242337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.242476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.243643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.244753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.319452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:55:54.488990 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74d41974-0d10-45c7-827f-9b4b07557e90 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 204 len: 0 microversion: 2.1 time: 0.289631 Oct 03 14:55:54.493870 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2639/5133] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:55:54 2022] DELETE /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:55:54.499869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:54.500943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.508733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.509263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.509707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.510569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.511027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.511453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.725093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:54.743559 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e85509e3-a1ed-4aaa-aee6-73a880b321fa tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.523434 Oct 03 14:55:54.744213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2495/5134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:54 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:54.760652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:54.763332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:54.778020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.790056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.794120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.795498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:54.797783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:54.798267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:54.851700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:54.869047 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a3b907f-fd86-47b2-bbb6-af5b142fad4f tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1688 microversion: 2.1 time: 0.373780 Oct 03 14:55:54.869662 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2640/5135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:54 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1688 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:55.768231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:55.769325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:55.779531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:55.780337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:55.780955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:55.781948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:55.782750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:55.783345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:55.966092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:55.993228 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2acb71d4-438b-4c70-b564-74cd70313c9b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 1.247484 Oct 03 14:55:55.994711 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2496/5136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:54 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:56.001375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:56.002284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:56.011138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:56.012044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:56.012696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:56.013750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:56.014444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:56.015680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:56.165625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:56.174771 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5510b1c6-6173-41fb-af7a-e67448d55bc8 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.410815 Oct 03 14:55:56.175375 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2641/5137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:55 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:56.639244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:56.656446 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b919ffa-e61e-46b5-bc0e-06b64aac4709 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1688 microversion: 2.1 time: 0.660087 Oct 03 14:55:56.658976 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2497/5138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:55 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1688 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:56.795919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1476796725", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b94ff4e8-3464-467f-854f-9f26bf9c658a"}], "security_groups": [{"name": "tempest-securitygroup--1059519272"}], "key_name": "tempest-keypair-561435831", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:55:57.026482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:57.027456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:57.040738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.041722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.042319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.044252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.044865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.045471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.509608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] validate_networks() for [('b94ff4e8-3464-467f-854f-9f26bf9c658a', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:55:57.625245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:57.637726 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c49d551-5463-433b-8da0-6a975d209319 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.615210 Oct 03 14:55:57.639178 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2498/5139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:57 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:57.644276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:57.645452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:57.652859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.654998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.655614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.656478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.657140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.657872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.844207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:57.853561 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2f011ce3-cd81-44e1-b8d8-f52e78136a2a tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.212779 Oct 03 14:55:57.877715 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2499/5140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:57 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:57.887125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:57.888080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:57.903052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.903537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.903988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:57.904680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:57.905648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:57.905648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:58.184281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:58.195154 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dce07b0c-350a-4900-81ad-ac5c3f3bdc65 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1688 microversion: 2.1 time: 0.315689 Oct 03 14:55:58.201504 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2500/5141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:57 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1688 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:55:58.666832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:58.667454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:58.678067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:58.681668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:58.682203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:58.689265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:58.690366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:58.690967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.000023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:55:59.003150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:55:59.003656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:55:59.004316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:55:59.005545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:55:59.016453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=55 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:55:59.020554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.021193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.021724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.022567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.023330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.023854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.048967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:55:59.057603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Getting quotas for user cb80c02a281e4132aa50bb4de496525c and project 82632b5ccf0a49cb83a76bac46f80c97. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:55:59.075705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:55:59.078793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:55:59.140151 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb197aa9-b4fc-4068-863d-b9528aea1138 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.353182 Oct 03 14:55:59.141711 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2642/5142] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:55:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2355 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:55:59.153179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:59.154884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:59.165285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.166343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.167157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.168272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.169191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.169887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.306238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.322698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e2f638c0-c01d-43e6-877b-d4e6f3d81cee tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.659755 Oct 03 14:55:59.326359 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2501/5143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:58 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:55:59.338675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a376e5fa-c7f4-44b8-97eb-1e7393937c4d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:59.343914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a376e5fa-c7f4-44b8-97eb-1e7393937c4d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:59.462302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a376e5fa-c7f4-44b8-97eb-1e7393937c4d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.485965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a376e5fa-c7f4-44b8-97eb-1e7393937c4d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.489864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a376e5fa-c7f4-44b8-97eb-1e7393937c4d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.493192 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a376e5fa-c7f4-44b8-97eb-1e7393937c4d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1281 microversion: 2.20 time: 0.163376 Oct 03 14:55:59.495870 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2502/5144] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:55:59 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:55:59.507208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:55:59.507867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:55:59.541728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.542420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.543104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.544639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:55:59.546369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:55:59.547282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:55:59.799892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:55:59.811851 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f050c39-ec91-4769-8285-36b078863cf9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.668835 Oct 03 14:55:59.812471 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2643/5145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:59 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:00.349925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:00.350970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:00.365043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.366059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.366798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.368113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.368786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.369581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.430997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.442675 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0a7ce43-e761-4002-b237-81cdc6eae3a7 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1688 microversion: 2.1 time: 0.944952 Oct 03 14:56:00.443672 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2503/5146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:55:59 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1688 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:00.526057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:00.527051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:00.534181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.534990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.536147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.537726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.538880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.539583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.754825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.768852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.772291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.773569 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7742ef8-8bfa-4010-beaf-ffb12d1ae498 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1333 microversion: 2.20 time: 0.251794 Oct 03 14:56:00.788952 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2504/5147] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:00 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1333 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:00.803707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:00.815198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71e1df68-41a3-4424-ab33-5379ab7c2119 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.470844 Oct 03 14:56:00.818247 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2644/5148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:00 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:00.839795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:00.840357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:00.847046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.847539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.848044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:00.848758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:00.849293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:00.849723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.288787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:01.302450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5548ee84-47cd-4e01-9e87-6a8702b9bae6 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.465997 Oct 03 14:56:01.322286 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2505/5149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:00 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:01.468380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:01.469442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:01.487936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.489978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.491456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.492228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.492697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.493172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.600601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-24476b8a-2b11-4f88-9093-c2c0664567d3 req-2fce9692-f475-451a-9273-d4e4a08f91a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a07ad5-2bbf-4204-89df-ea6d6b687935", "name": "network-vif-plugged", "status": "completed", "tag": "14c05fb6-7f6c-431b-b7f6-7b46ea0eb248"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:01.637057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24476b8a-2b11-4f88-9093-c2c0664567d3 req-2fce9692-f475-451a-9273-d4e4a08f91a5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.638138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24476b8a-2b11-4f88-9093-c2c0664567d3 req-2fce9692-f475-451a-9273-d4e4a08f91a5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.638827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24476b8a-2b11-4f88-9093-c2c0664567d3 req-2fce9692-f475-451a-9273-d4e4a08f91a5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.677817 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-24476b8a-2b11-4f88-9093-c2c0664567d3 req-2fce9692-f475-451a-9273-d4e4a08f91a5 service nova] Creating event network-vif-plugged:14c05fb6-7f6c-431b-b7f6-7b46ea0eb248 for instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 on n-h1-781139-2 Oct 03 14:56:01.692211 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-24476b8a-2b11-4f88-9093-c2c0664567d3 req-2fce9692-f475-451a-9273-d4e4a08f91a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095462 Oct 03 14:56:01.703272 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2506/5150] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:01.730620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:01.745365 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e080f8eb-e8dc-43aa-9caa-4400ac94a286 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1622 microversion: 2.1 time: 0.277612 Oct 03 14:56:01.746985 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2645/5151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:01 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1622 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:01.804758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:01.806015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:01.837309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.839405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:01.840050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:01.841550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.842637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.844296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.846206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.847784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.851934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.852687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.853617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:01.854528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:01.859154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:01.859865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:02.489010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:02.497165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:02.507252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:02.509179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:02.511021 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de6bc0d4-b19c-4bd0-991b-fe7db35f0157 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1339 microversion: 2.20 time: 0.714247 Oct 03 14:56:02.526061 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2507/5152] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:01 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1339 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:02.537878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:02.538827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:02.547861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:02.548620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:02.549325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:02.550189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:02.551187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:02.551823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:02.758249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:02.768905 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77a3c72e-1a78-4efa-893d-724573e096f3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.933798 Oct 03 14:56:02.786461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2646/5153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:01 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:02.803797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:02.804741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:02.817001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:02.817498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:02.825015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:02.826734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:02.827446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:02.828066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:02.993079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:03.027930 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-67cb4b06-7196-4513-a05d-18a4b4f22d47 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1622 microversion: 2.1 time: 0.235490 Oct 03 14:56:03.028714 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2647/5154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:02 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1622 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:03.193560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:03.203512 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0560b487-08ed-4437-a77d-61920f336532 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1313 microversion: 2.1 time: 0.675594 Oct 03 14:56:03.206608 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2508/5155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:02 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:03.406876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-74279412-f816-4c22-9342-6f6e85d6d9be req-ebe59a13-201e-4441-a2e7-f9beb4ee3c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34f6896-67b3-4663-a15e-350a205c2a59", "name": "network-vif-deleted", "tag": "61f60a49-c60f-4431-b990-cacae19b267d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:03.425500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74279412-f816-4c22-9342-6f6e85d6d9be req-ebe59a13-201e-4441-a2e7-f9beb4ee3c81 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.426124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74279412-f816-4c22-9342-6f6e85d6d9be req-ebe59a13-201e-4441-a2e7-f9beb4ee3c81 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.426564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-74279412-f816-4c22-9342-6f6e85d6d9be req-ebe59a13-201e-4441-a2e7-f9beb4ee3c81 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.452197 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-74279412-f816-4c22-9342-6f6e85d6d9be req-ebe59a13-201e-4441-a2e7-f9beb4ee3c81 service nova] Creating event network-vif-deleted:61f60a49-c60f-4431-b990-cacae19b267d for instance c34f6896-67b3-4663-a15e-350a205c2a59 on n-h1-781139-2 Oct 03 14:56:03.466398 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-74279412-f816-4c22-9342-6f6e85d6d9be req-ebe59a13-201e-4441-a2e7-f9beb4ee3c81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062690 Oct 03 14:56:03.467057 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2648/5156] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:03.541252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:03.541900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:03.552804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.553219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.555141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.555900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.556420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.556776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.814737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:03.819345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:03.872574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.873117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.873573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:03.874313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:03.874801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:03.875200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.032756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.048808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.056834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.062038 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74682faf-2e5c-40d1-9369-30ec2109d9a8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1339 microversion: 2.20 time: 0.521461 Oct 03 14:56:04.083659 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2509/5157] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:03 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1339 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:04.099254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:04.102356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:04.126063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.126840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.127584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.130421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.147092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.147840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.284333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.285800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.287677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.291635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lazy-loading 'fault' on Instance uuid c34f6896-67b3-4663-a15e-350a205c2a59 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:56:04.497586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.535084 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1646051-fd54-4e8c-b367-83cdbb1dafa3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.735900 Oct 03 14:56:04.537783 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2649/5158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:03 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:04.551140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:04.553896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:04.584027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.585207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.586274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.590371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:04.591042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:04.591966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:04.866427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:04.897841 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6dced2ee-5018-4e22-82c2-12c63b08133c tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 200 len: 1334 microversion: 2.1 time: 0.807734 Oct 03 14:56:04.912808 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2510/5159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:04 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 1334 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:05.092218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.093275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:05.106142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.108611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.109409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.112347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.113456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.120020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.286773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.302398 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b2e7221-cf9b-4bf7-a1f5-78d4b1a954f4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1499 microversion: 2.1 time: 0.757140 Oct 03 14:56:05.303646 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2650/5160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:04 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1499 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:05.326441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4b878c86-9a08-412c-a577-20df4a938c22 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.357496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.server_groups [None req-4b878c86-9a08-412c-a577-20df4a938c22 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Querying cell 54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) for 1 instances {{(pid=128869) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 14:56:05.360257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b878c86-9a08-412c-a577-20df4a938c22 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.361038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b878c86-9a08-412c-a577-20df4a938c22 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.361646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4b878c86-9a08-412c-a577-20df4a938c22 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.405417 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4b878c86-9a08-412c-a577-20df4a938c22 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/7d9ec5be-4526-4c4b-a697-5d7af4c5eec2" status: 200 len: 221 microversion: 2.1 time: 0.083035 Oct 03 14:56:05.406439 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2651/5161] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:56:05 2022] GET /compute/v2.1/os-server-groups/7d9ec5be-4526-4c4b-a697-5d7af4c5eec2 => generated 221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:05.420009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.420661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:05.429664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.431067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.432337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.437868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.439367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.440217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.465539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.480842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:56:05.492768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.497815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:05.503592 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5504a96-d747-4063-a10a-14c7cf4d9a4a tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.416098 Oct 03 14:56:05.506360 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2511/5162] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:05 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:05.521809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:05.568645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.573829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:05.638203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.638883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.639339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.640079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.640540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.640993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.736424 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-036c8ea2-2ff3-484d-bb74-61c1d3d89e29 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 204 len: 0 microversion: 2.1 time: 0.321617 Oct 03 14:56:05.737664 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2652/5163] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:56:05 2022] DELETE /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:56:05.781996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:05.782756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:05.794402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.799914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.800558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:05.801550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:05.802300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:05.802903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.169808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.184976 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5145326f-e4e8-44ae-9b95-61a29023d15f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1505 microversion: 2.1 time: 0.427274 Oct 03 14:56:06.186065 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2653/5164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:05 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:06.214320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:06.215221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: c34f6896-67b3-4663-a15e-350a205c2a59] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:06.222694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.224707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.225604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.226519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.227135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.227738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.248130 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Instance c34f6896-67b3-4663-a15e-350a205c2a59 could not be found. Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 HTTP/1.1 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance c34f6896-67b3-4663-a15e-350a205c2a59 could not be found. Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c34f6896-67b3-4663-a15e-350a205c2a59'} Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34f6896-67b3-4663-a15e-350a205c2a59 could not be found. Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34f6896-67b3-4663-a15e-350a205c2a59 could not be found. Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:06.250133 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34f6896-67b3-4663-a15e-350a205c2a59 could not be found. Oct 03 14:56:06.255216 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:06.257401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 404 to user: Instance c34f6896-67b3-4663-a15e-350a205c2a59 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:06.258455 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25bb69e2-0222-4446-9204-2edd0b4037bf tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59" status: 404 len: 111 microversion: 2.1 time: 0.050038 Oct 03 14:56:06.259514 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2654/5165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:06 2022] GET /compute/v2.1/servers/c34f6896-67b3-4663-a15e-350a205c2a59 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:06.271951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d7e25bd-37e4-4d52-86c2-5b5ebed66dbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '.version_select at 0x7fb22bccfca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:06.304263 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d7e25bd-37e4-4d52-86c2-5b5ebed66dbd tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507661167" status: 202 len: 0 microversion: 2.1 time: 0.040387 Oct 03 14:56:06.305667 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2655/5166] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 14:56:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507661167 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:56:06.361846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.382614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ed46a16-4da7-4f83-8282-11bd4180ce3a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.825017 Oct 03 14:56:06.383242 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2512/5167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:05 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:06.537934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:06.539600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:06.560895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.561603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.562109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.562827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:06.563533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:06.564119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:06.839495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.855189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.856989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:06.860167 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a403dd28-979d-4a70-8981-59c1ee78eabf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.328482 Oct 03 14:56:06.874908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2656/5168] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:06 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:07.208488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:07.209135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:07.217725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.218961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.219944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.221921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.222699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.223366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.408006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:07.409353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:07.422256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.422912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.423912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.424957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.427943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.429986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.690438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:07.719821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fa90ed1e-8a74-4c25-898a-77b4ee4e07df tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1505 microversion: 2.1 time: 0.515035 Oct 03 14:56:07.736148 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2513/5169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:07 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:07.892953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:07.893771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:07.913014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.913683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.914231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.915064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:07.915619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:07.916150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:07.997446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:08.009917 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc8339ca-70e6-46e1-9568-2a1a1d6892db tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.605682 Oct 03 14:56:08.012079 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2657/5170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:07 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:08.421747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8a003216-f2bd-4c2f-9222-c02eb09608b5 req-2dd541dc-d026-4a70-8607-35a80cdce6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:08.462891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a003216-f2bd-4c2f-9222-c02eb09608b5 req-2dd541dc-d026-4a70-8607-35a80cdce6c4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:08.463943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a003216-f2bd-4c2f-9222-c02eb09608b5 req-2dd541dc-d026-4a70-8607-35a80cdce6c4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:08.464718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8a003216-f2bd-4c2f-9222-c02eb09608b5 req-2dd541dc-d026-4a70-8607-35a80cdce6c4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:08.486237 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8a003216-f2bd-4c2f-9222-c02eb09608b5 req-2dd541dc-d026-4a70-8607-35a80cdce6c4 service nova] Creating event network-changed:cfa9cd2b-641c-46a2-88cf-0a0614f33cdb for instance 796f59f0-d25e-440a-8a63-d6cedc50b955 on n-h2-781139-2 Oct 03 14:56:08.491618 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8a003216-f2bd-4c2f-9222-c02eb09608b5 req-2dd541dc-d026-4a70-8607-35a80cdce6c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075928 Oct 03 14:56:08.492706 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2658/5171] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:08.684451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:08.697222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:08.699077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:08.700756 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b5aaaee-23ab-4926-98ee-c8eee9eb7b85 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.812464 Oct 03 14:56:08.721434 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2514/5172] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:07 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:08.745193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:08.745867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:08.757275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:08.768684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:08.769614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:08.770381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:08.771323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:08.771941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:08.773478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.033943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:09.035378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:09.043276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:09.052304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.053839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.058510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.059364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.059977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.060541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.072605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=5 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:09.266192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:09.283399 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f46479dd-5e13-47bc-9e9b-892a64d2bbe4 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1505 microversion: 2.1 time: 0.542649 Oct 03 14:56:09.283999 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2659/5173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:08 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:09.481469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:09.727489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:09.728256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:09.738854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.749758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.750543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.756184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:09.756966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:09.757718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:09.877159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:09.900081 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ab5308c9-a10c-4822-aaa1-d1d4190fe7e2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.856580 Oct 03 14:56:09.900979 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2515/5174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:09 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:10.225137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.236051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.246912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.248539 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1d57bee-53a2-463d-985a-7fb4dbcea9e1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.525489 Oct 03 14:56:10.262611 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2660/5175] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:09 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:10.319882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:10.322558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:10.363940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.367997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.368621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.369484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.370030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.370528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.439741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.440318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.440822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.442336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lazy-loading 'fault' on Instance uuid 42a07ad5-2bbf-4204-89df-ea6d6b687935 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:56:10.543878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2772824a-6f1c-435b-b225-77be966de58a req-efaedac0-e81b-4c54-8106-aadeefe45804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a07ad5-2bbf-4204-89df-ea6d6b687935", "name": "network-vif-deleted", "tag": "14c05fb6-7f6c-431b-b7f6-7b46ea0eb248"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:10.566439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2772824a-6f1c-435b-b225-77be966de58a req-efaedac0-e81b-4c54-8106-aadeefe45804 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.567048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2772824a-6f1c-435b-b225-77be966de58a req-efaedac0-e81b-4c54-8106-aadeefe45804 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.567548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2772824a-6f1c-435b-b225-77be966de58a req-efaedac0-e81b-4c54-8106-aadeefe45804 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.589450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ee1c01265f4451aab1705b075bc93a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c519472b9aae4cca8a2581f09ee5595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:10.596156 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2772824a-6f1c-435b-b225-77be966de58a req-efaedac0-e81b-4c54-8106-aadeefe45804 service nova] Creating event network-vif-deleted:14c05fb6-7f6c-431b-b7f6-7b46ea0eb248 for instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 on n-h1-781139-2 Oct 03 14:56:10.597255 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-297feb3c-9979-49b8-9a11-c4988c68616d tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 200 len: 1303 microversion: 2.1 time: 0.285167 Oct 03 14:56:10.597965 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2516/5176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:10 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 1303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:10.608002 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2772824a-6f1c-435b-b225-77be966de58a req-efaedac0-e81b-4c54-8106-aadeefe45804 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067443 Oct 03 14:56:10.609566 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2661/5177] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:10.927054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:10.927795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:10.939163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.944059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.944759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:10.945700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:10.946319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:10.946928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.297034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.298192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:11.313802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.314746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.315437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.320879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.322808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.323466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.457383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.471063 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5294b8d-bd57-4fba-8b8d-19a9ee7e5dc1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.547549 Oct 03 14:56:11.472242 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2517/5178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:10 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:11.625661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.626283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:11.653478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.653985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.654446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.655461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.655922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.656354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.681392 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] HTTP exception thrown: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Request method failure captured: Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 HTTP/1.1 Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvfoPU1AYFCB4OFN34krDehfixqMWHzWFVSGPm1mNWpB4ImE7CuRRa7a7_FuMkF4SV5oPozLU6Zx5GmOWZ0QyYoTKUpXavTdLAQo9NyDDtPBff_I9Z-iEwWtTCikTRwiZXbRje-LjMTqaC9iXtFQkRJQ8qmOI-Xv65yp0GztsHNnhww Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c519472b9aae4cca8a2581f09ee5595f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4ee1c01265f4451aab1705b075bc93a Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '42a07ad5-2bbf-4204-89df-ea6d6b687935'} Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:11.683105 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Returning 404 to user: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:11.687068 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c4969841-70e1-4959-ab14-3154bc06b7c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 404 len: 111 microversion: 2.1 time: 0.063594 Oct 03 14:56:11.701358 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2518/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:11 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:11.710562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d958a5de-593a-4b46-b5cc-cf406238af6f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.735926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.server_groups [None req-d958a5de-593a-4b46-b5cc-cf406238af6f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Querying cell 54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) for 1 instances {{(pid=128868) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 14:56:11.736715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d958a5de-593a-4b46-b5cc-cf406238af6f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.737405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d958a5de-593a-4b46-b5cc-cf406238af6f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.737930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d958a5de-593a-4b46-b5cc-cf406238af6f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.751793 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d958a5de-593a-4b46-b5cc-cf406238af6f tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.048918 Oct 03 14:56:11.753200 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2519/5180] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 14:56:11 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:11.774217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91a5f129-1561-44cc-858f-7a5f3863d032 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.800790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.server_groups [None req-91a5f129-1561-44cc-858f-7a5f3863d032 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Querying cell 54ca0d6f-7d1c-418e-8501-0d401bcb0ee5(cell1) for 1 instances {{(pid=128868) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 03 14:56:11.801568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91a5f129-1561-44cc-858f-7a5f3863d032 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.802058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91a5f129-1561-44cc-858f-7a5f3863d032 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.802496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91a5f129-1561-44cc-858f-7a5f3863d032 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.821768 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-91a5f129-1561-44cc-858f-7a5f3863d032 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/7d9ec5be-4526-4c4b-a697-5d7af4c5eec2" status: 200 len: 183 microversion: 2.1 time: 0.055289 Oct 03 14:56:11.829047 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2520/5181] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:56:11 2022] GET /compute/v2.1/os-server-groups/7d9ec5be-4526-4c4b-a697-5d7af4c5eec2 => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:11.834608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.835116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:11.839276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.841738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.845910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.846859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.847985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.848717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.849348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.856254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.866704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:11.869602 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b9db8db-e5b2-4a83-be58-4bd7d5828451 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.576969 Oct 03 14:56:11.872396 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2662/5182] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:11 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:11.886996 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] HTTP exception thrown: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Request method failure captured: Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 HTTP/1.1 Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvfoPU1AYFCB4OFN34krDehfixqMWHzWFVSGPm1mNWpB4ImE7CuRRa7a7_FuMkF4SV5oPozLU6Zx5GmOWZ0QyYoTKUpXavTdLAQo9NyDDtPBff_I9Z-iEwWtTCikTRwiZXbRje-LjMTqaC9iXtFQkRJQ8qmOI-Xv65yp0GztsHNnhww Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c519472b9aae4cca8a2581f09ee5595f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4ee1c01265f4451aab1705b075bc93a Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '42a07ad5-2bbf-4204-89df-ea6d6b687935'} Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:56:11.892876 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.897666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Returning 404 to user: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:11.898564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7c503a5a-dcb8-478a-be77-9f37cea9658b tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 404 len: 111 microversion: 2.1 time: 0.064256 Oct 03 14:56:11.899431 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2521/5183] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:56:11 2022] DELETE /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:11.908097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:11.909009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] [instance: 42a07ad5-2bbf-4204-89df-ea6d6b687935] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:11.917920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.918682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.919287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.920196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:11.920907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:11.921519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:11.964458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] HTTP exception thrown: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Request method failure captured: Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 HTTP/1.1 Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvfoPU1AYFCB4OFN34krDehfixqMWHzWFVSGPm1mNWpB4ImE7CuRRa7a7_FuMkF4SV5oPozLU6Zx5GmOWZ0QyYoTKUpXavTdLAQo9NyDDtPBff_I9Z-iEwWtTCikTRwiZXbRje-LjMTqaC9iXtFQkRJQ8qmOI-Xv65yp0GztsHNnhww Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c519472b9aae4cca8a2581f09ee5595f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4ee1c01265f4451aab1705b075bc93a Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '42a07ad5-2bbf-4204-89df-ea6d6b687935'} Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:11.972013 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Returning 404 to user: Instance 42a07ad5-2bbf-4204-89df-ea6d6b687935 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77c73bfc-f465-4538-a90c-4cd2123b70fe tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935" status: 404 len: 111 microversion: 2.1 time: 0.070526 Oct 03 14:56:11.976800 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2663/5184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:11 2022] GET /compute/v2.1/servers/42a07ad5-2bbf-4204-89df-ea6d6b687935 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:11.984449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1bce6dd-a853-41aa-90eb-c68faa4a2316 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.010153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d1bce6dd-a853-41aa-90eb-c68faa4a2316 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] HTTP exception thrown: Instance group 8adb7a94-2621-40ab-b655-c580255b942b could not be found. Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1bce6dd-a853-41aa-90eb-c68faa4a2316 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Request method failure captured: Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-server-groups/8adb7a94-2621-40ab-b655-c580255b942b HTTP/1.1 Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvfoPU1AYFCB4OFN34krDehfixqMWHzWFVSGPm1mNWpB4ImE7CuRRa7a7_FuMkF4SV5oPozLU6Zx5GmOWZ0QyYoTKUpXavTdLAQo9NyDDtPBff_I9Z-iEwWtTCikTRwiZXbRje-LjMTqaC9iXtFQkRJQ8qmOI-Xv65yp0GztsHNnhww Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c519472b9aae4cca8a2581f09ee5595f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4ee1c01265f4451aab1705b075bc93a Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance group 8adb7a94-2621-40ab-b655-c580255b942b could not be found. Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '8adb7a94-2621-40ab-b655-c580255b942b'} Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8adb7a94-2621-40ab-b655-c580255b942b could not be found. Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8adb7a94-2621-40ab-b655-c580255b942b could not be found. Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.030339 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8adb7a94-2621-40ab-b655-c580255b942b could not be found. Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1bce6dd-a853-41aa-90eb-c68faa4a2316 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Returning 404 to user: Instance group 8adb7a94-2621-40ab-b655-c580255b942b could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:12.035087 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1bce6dd-a853-41aa-90eb-c68faa4a2316 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/8adb7a94-2621-40ab-b655-c580255b942b" status: 404 len: 117 microversion: 2.1 time: 0.054724 Oct 03 14:56:12.037889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2522/5185] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:56:11 2022] DELETE /compute/v2.1/os-server-groups/8adb7a94-2621-40ab-b655-c580255b942b => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:12.046133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac3cb721-d226-4a09-a496-741f4512d3a5 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.053100 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ac3cb721-d226-4a09-a496-741f4512d3a5 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] HTTP exception thrown: Instance group a9eece0a-d87d-4651-b72c-97865b76fa6a could not be found. Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac3cb721-d226-4a09-a496-741f4512d3a5 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Request method failure captured: Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-server-groups/a9eece0a-d87d-4651-b72c-97865b76fa6a HTTP/1.1 Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvfoPU1AYFCB4OFN34krDehfixqMWHzWFVSGPm1mNWpB4ImE7CuRRa7a7_FuMkF4SV5oPozLU6Zx5GmOWZ0QyYoTKUpXavTdLAQo9NyDDtPBff_I9Z-iEwWtTCikTRwiZXbRje-LjMTqaC9iXtFQkRJQ8qmOI-Xv65yp0GztsHNnhww Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c519472b9aae4cca8a2581f09ee5595f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4ee1c01265f4451aab1705b075bc93a Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance group a9eece0a-d87d-4651-b72c-97865b76fa6a could not be found. Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a9eece0a-d87d-4651-b72c-97865b76fa6a'} Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a9eece0a-d87d-4651-b72c-97865b76fa6a could not be found. Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a9eece0a-d87d-4651-b72c-97865b76fa6a could not be found. Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.055190 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a9eece0a-d87d-4651-b72c-97865b76fa6a could not be found. Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac3cb721-d226-4a09-a496-741f4512d3a5 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Returning 404 to user: Instance group a9eece0a-d87d-4651-b72c-97865b76fa6a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:12.059897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac3cb721-d226-4a09-a496-741f4512d3a5 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a9eece0a-d87d-4651-b72c-97865b76fa6a" status: 404 len: 117 microversion: 2.1 time: 0.014672 Oct 03 14:56:12.062428 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2664/5186] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:56:12 2022] DELETE /compute/v2.1/os-server-groups/a9eece0a-d87d-4651-b72c-97865b76fa6a => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:12.071317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff02b1da-becc-4fe1-89fd-4178e47803c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.084902 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-ff02b1da-becc-4fe1-89fd-4178e47803c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] HTTP exception thrown: Instance group 26f54886-a7c1-49a5-bd72-d572bf64db43 could not be found. Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff02b1da-becc-4fe1-89fd-4178e47803c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Request method failure captured: Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-server-groups/26f54886-a7c1-49a5-bd72-d572bf64db43 HTTP/1.1 Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvfoPU1AYFCB4OFN34krDehfixqMWHzWFVSGPm1mNWpB4ImE7CuRRa7a7_FuMkF4SV5oPozLU6Zx5GmOWZ0QyYoTKUpXavTdLAQo9NyDDtPBff_I9Z-iEwWtTCikTRwiZXbRje-LjMTqaC9iXtFQkRJQ8qmOI-Xv65yp0GztsHNnhww Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c519472b9aae4cca8a2581f09ee5595f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4ee1c01265f4451aab1705b075bc93a Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance group 26f54886-a7c1-49a5-bd72-d572bf64db43 could not be found. Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '26f54886-a7c1-49a5-bd72-d572bf64db43'} Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 26f54886-a7c1-49a5-bd72-d572bf64db43 could not be found. Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 26f54886-a7c1-49a5-bd72-d572bf64db43 could not be found. Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.087766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 26f54886-a7c1-49a5-bd72-d572bf64db43 could not be found. Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff02b1da-becc-4fe1-89fd-4178e47803c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Returning 404 to user: Instance group 26f54886-a7c1-49a5-bd72-d572bf64db43 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:12.094029 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff02b1da-becc-4fe1-89fd-4178e47803c9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/26f54886-a7c1-49a5-bd72-d572bf64db43" status: 404 len: 117 microversion: 2.1 time: 0.025656 Oct 03 14:56:12.094940 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2523/5187] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:56:12 2022] DELETE /compute/v2.1/os-server-groups/26f54886-a7c1-49a5-bd72-d572bf64db43 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:12.108452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7599765-8dd1-489d-bf6b-905e98514fe9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.138868 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a7599765-8dd1-489d-bf6b-905e98514fe9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] HTTP exception thrown: Instance group ca759368-1a96-49e3-82d0-4e35957c62e1 could not be found. Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7599765-8dd1-489d-bf6b-905e98514fe9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Request method failure captured: Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-server-groups/ca759368-1a96-49e3-82d0-4e35957c62e1 HTTP/1.1 Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvfoPU1AYFCB4OFN34krDehfixqMWHzWFVSGPm1mNWpB4ImE7CuRRa7a7_FuMkF4SV5oPozLU6Zx5GmOWZ0QyYoTKUpXavTdLAQo9NyDDtPBff_I9Z-iEwWtTCikTRwiZXbRje-LjMTqaC9iXtFQkRJQ8qmOI-Xv65yp0GztsHNnhww Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c519472b9aae4cca8a2581f09ee5595f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c519472b9aae4cca8a2581f09ee5595f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: c519472b9aae4cca8a2581f09ee5595f Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerGroupTestJSON-288221105 Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4ee1c01265f4451aab1705b075bc93a Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerGroupTestJSON-288221105-project Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance group ca759368-1a96-49e3-82d0-4e35957c62e1 could not be found. Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ca759368-1a96-49e3-82d0-4e35957c62e1'} Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ca759368-1a96-49e3-82d0-4e35957c62e1 could not be found. Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ca759368-1a96-49e3-82d0-4e35957c62e1 could not be found. Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.140448 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ca759368-1a96-49e3-82d0-4e35957c62e1 could not be found. Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7599765-8dd1-489d-bf6b-905e98514fe9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Returning 404 to user: Instance group ca759368-1a96-49e3-82d0-4e35957c62e1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:12.145984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7599765-8dd1-489d-bf6b-905e98514fe9 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/ca759368-1a96-49e3-82d0-4e35957c62e1" status: 404 len: 117 microversion: 2.1 time: 0.045551 Oct 03 14:56:12.158545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1079aea4-a590-4b65-ad8a-8f89e0b759f0 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.169018 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2665/5188] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:56:12 2022] DELETE /compute/v2.1/os-server-groups/ca759368-1a96-49e3-82d0-4e35957c62e1 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:56:12.209740 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1079aea4-a590-4b65-ad8a-8f89e0b759f0 tempest-ServerGroupTestJSON-288221105 tempest-ServerGroupTestJSON-288221105-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/7d9ec5be-4526-4c4b-a697-5d7af4c5eec2" status: 204 len: 0 microversion: 2.1 time: 0.061023 Oct 03 14:56:12.210648 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2524/5189] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 3 14:56:12 2022] DELETE /compute/v2.1/os-server-groups/7d9ec5be-4526-4c4b-a697-5d7af4c5eec2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:56:12.514767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.516839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:12.546339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.548137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.549784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.550737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.552372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.554531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.906691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:12.907632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:12.914615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.915390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.915997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.917190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:12.917826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:12.918412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:12.936420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:12.948160 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18e1b5b8-243e-451b-9513-6e5bc0604dd5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.439884 Oct 03 14:56:12.949029 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2666/5190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:12 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:13.200213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:13.214723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:13.219137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:13.224495 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3e399d2-2c72-4876-81c4-20b2322aaec7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.322613 Oct 03 14:56:13.225759 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2525/5191] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:12 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:56:13.974229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:13.974851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:14.001808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:14.001808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:14.015167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:14.016221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:14.018146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:14.033195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:14.251590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:14.252659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:14.258418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:14.271015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:14.271901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:14.272541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:14.277060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:14.277776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:14.278375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:14.885366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:14.901769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:14.906718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:14.912060 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-728093c9-f07c-4a17-a6b9-4ae2b80ddcbb tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.665848 Oct 03 14:56:14.913218 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2526/5192] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:14 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:15.411099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:15.424112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7edf3587-e398-4d1a-bde0-08db8818957c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 1.450496 Oct 03 14:56:15.425441 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2667/5193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:13 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:15.950967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:15.952793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:15.984370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:15.985358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:15.986050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:15.987041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:15.987713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:15.988707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:16.356845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:16.373331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:16.375102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:16.387531 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cf9bfac7-fd75-434c-b018-cf0dbc406596 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 0.441488 Oct 03 14:56:16.388509 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2527/5194] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:15 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:16.452135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:16.452905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:16.477378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:16.477378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:16.477378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:16.477378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:16.477378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:16.477378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:17.056873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:17.077020 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5ad6e5d-b67f-4a4b-a3ca-e9161a984e0e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 0.626432 Oct 03 14:56:17.089242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2668/5195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:16 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:17.414865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:17.416059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:17.430906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:17.433901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:17.434630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:17.439692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:17.440991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:17.442025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.103472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:18.104711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:18.120856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.123100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.126181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.127320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:18.127944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:18.129875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:18.572455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.586401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.592266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:18.594064 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-22dca3d5-2366-4fe0-a56b-f2170c64b0f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 1.183428 Oct 03 14:56:18.617142 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2528/5196] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:17 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:19.467085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6ec0242-16f7-46b7-b423-71cadea38f2a tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Action: 'create', calling method: .version_select at 0x7fb2300dbb80>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:19.469877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:19.478141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9d319d3-3e7c-4907-948d-e6210b0f96da tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1511 microversion: 2.1 time: 1.379356 Oct 03 14:56:19.478739 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2669/5197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:18 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1511 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:19.503053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b2bdb46e-6a50-4d05-8d5c-3e09cb81bbf8 req-f8cfcee2-69c0-4081-af19-35703ea599d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "name": "network-vif-plugged", "status": "completed", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:19.533906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e6ec0242-16f7-46b7-b423-71cadea38f2a tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Getting quotas for project 246c21b2e5b24d029977830b66a6aab2. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:19.535302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2bdb46e-6a50-4d05-8d5c-3e09cb81bbf8 req-f8cfcee2-69c0-4081-af19-35703ea599d9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.535792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2bdb46e-6a50-4d05-8d5c-3e09cb81bbf8 req-f8cfcee2-69c0-4081-af19-35703ea599d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.536231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b2bdb46e-6a50-4d05-8d5c-3e09cb81bbf8 req-f8cfcee2-69c0-4081-af19-35703ea599d9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.550948 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b2bdb46e-6a50-4d05-8d5c-3e09cb81bbf8 req-f8cfcee2-69c0-4081-af19-35703ea599d9 service nova] Creating event network-vif-plugged:cfa9cd2b-641c-46a2-88cf-0a0614f33cdb for instance 796f59f0-d25e-440a-8a63-d6cedc50b955 on n-h2-781139-2 Oct 03 14:56:19.552270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e6ec0242-16f7-46b7-b423-71cadea38f2a tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Getting quotas for user 170b4fa041ce4ad0b15bf95ab763da6b and project 246c21b2e5b24d029977830b66a6aab2. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:19.570659 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b2bdb46e-6a50-4d05-8d5c-3e09cb81bbf8 req-f8cfcee2-69c0-4081-af19-35703ea599d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071154 Oct 03 14:56:19.571273 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2670/5198] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:19.653339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:19.654058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:19.673009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.673506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.674343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.675516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.676144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.676727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.681180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e6ec0242-16f7-46b7-b423-71cadea38f2a tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Getting quotas for project 246c21b2e5b24d029977830b66a6aab2. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:19.695861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e6ec0242-16f7-46b7-b423-71cadea38f2a tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Getting quotas for user 170b4fa041ce4ad0b15bf95ab763da6b and project 246c21b2e5b24d029977830b66a6aab2. Resources: {'server_groups'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:19.743955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6ec0242-16f7-46b7-b423-71cadea38f2a tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.545824 Oct 03 14:56:19.751226 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2529/5199] 10.222.0.20 () {62 vars in 1214 bytes} [Mon Oct 3 14:56:19 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:56:19.758880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b4dfe08-9f63-403a-8617-1249ea7503da tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:19.797492 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b4dfe08-9f63-403a-8617-1249ea7503da tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.045163 Oct 03 14:56:19.798102 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2530/5200] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 3 14:56:19 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 14:56:19.817817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:19.818338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:19.848107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.848606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.849105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.849823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:19.850271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:19.855223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:19.900776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:19.925929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:56:20.098911 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4cc1de3-2f73-4e8f-8ae0-f900dedefcc8 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 204 len: 0 microversion: 2.1 time: 0.296155 Oct 03 14:56:20.099964 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2531/5201] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:56:19 2022] DELETE /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:56:20.111415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98a790e8-cfc0-46e9-80e7-8e0a1296699d tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.144196 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98a790e8-cfc0-46e9-80e7-8e0a1296699d tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/c353fbf2-9f37-4834-8a9a-4263d7b19d3d" status: 200 len: 235 microversion: 2.64 time: 0.042834 Oct 03 14:56:20.145098 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2532/5202] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Oct 3 14:56:20 2022] GET /compute/v2.1/os-server-groups/c353fbf2-9f37-4834-8a9a-4263d7b19d3d => generated 235 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:56:20.150104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.151611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:20.160301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.161151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.161782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.162731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.163340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.164095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.390805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.401094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b0857b6b-faaa-4521-a7b8-ac95d5e179fe tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1508 microversion: 2.1 time: 0.254646 Oct 03 14:56:20.405096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2533/5203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:20 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:20.413032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec834242-e32d-4018-880b-d4d6e4321559 tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.498617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec834242-e32d-4018-880b-d4d6e4321559 tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c353fbf2-9f37-4834-8a9a-4263d7b19d3d" status: 204 len: 0 microversion: 2.64 time: 0.090065 Oct 03 14:56:20.499563 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2534/5204] 10.222.0.20 () {60 vars in 1307 bytes} [Mon Oct 3 14:56:20 2022] DELETE /compute/v2.1/os-server-groups/c353fbf2-9f37-4834-8a9a-4263d7b19d3d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:56:20.511972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.512608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:20.540241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.540972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.544234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.545039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:20.545512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:20.546217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:20.631954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.642314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.656442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:20.664221 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28336188-32d6-4fc9-8656-41609dfb7a10 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1407 microversion: 2.20 time: 1.010154 Oct 03 14:56:20.678564 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2671/5205] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:19 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1407 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:20.683205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7434b91f-3708-413f-8ebc-f9bc8d90fd70 tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:20.702650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7434b91f-3708-413f-8ebc-f9bc8d90fd70 tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] HTTP exception thrown: Instance group c353fbf2-9f37-4834-8a9a-4263d7b19d3d could not be found. Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7434b91f-3708-413f-8ebc-f9bc8d90fd70 tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Request method failure captured: Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/os-server-groups/c353fbf2-9f37-4834-8a9a-4263d7b19d3d HTTP/1.1 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgT9J-A9aHoA4C39Bkfrlmolr0hj7DDWj92EuAL998zdT5a8X0ZtuovOD5ROKVI4NqSvx1aWKtYjefkF7j1-mM4x92HANlfq7vqRMSiJta55UN6klOahxM7EJGsXZwTodS_S8hZWrBrspFU3oPTtq8Qu02bblpvEN7DdQ7sHeBISP4 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.64 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 246c21b2e5b24d029977830b66a6aab2 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerGroup264TestJSON-1290236822 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/246c21b2e5b24d029977830b66a6aab2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_246c21b2e5b24d029977830b66a6aab2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/246c21b2e5b24d029977830b66a6aab2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/246c21b2e5b24d029977830b66a6aab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerGroup264TestJSON-1290236822 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 246c21b2e5b24d029977830b66a6aab2 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1290236822 Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerGroup264TestJSON-1290236822-project Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 170b4fa041ce4ad0b15bf95ab763da6b Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerGroup264TestJSON-1290236822-project Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance group c353fbf2-9f37-4834-8a9a-4263d7b19d3d could not be found. Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c353fbf2-9f37-4834-8a9a-4263d7b19d3d'} Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c353fbf2-9f37-4834-8a9a-4263d7b19d3d could not be found. Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c353fbf2-9f37-4834-8a9a-4263d7b19d3d could not be found. Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:20.704701 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:20.710800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:20.710800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:20.710800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:20.710800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:20.710800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c353fbf2-9f37-4834-8a9a-4263d7b19d3d could not be found. Oct 03 14:56:20.710800 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:20.721904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7434b91f-3708-413f-8ebc-f9bc8d90fd70 tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] Returning 404 to user: Instance group c353fbf2-9f37-4834-8a9a-4263d7b19d3d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:20.723513 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7434b91f-3708-413f-8ebc-f9bc8d90fd70 tempest-ServerGroup264TestJSON-1290236822 tempest-ServerGroup264TestJSON-1290236822-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/c353fbf2-9f37-4834-8a9a-4263d7b19d3d" status: 404 len: 117 microversion: 2.64 time: 0.056840 Oct 03 14:56:20.724701 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2672/5206] 10.222.0.20 () {60 vars in 1307 bytes} [Mon Oct 3 14:56:20 2022] DELETE /compute/v2.1/os-server-groups/c353fbf2-9f37-4834-8a9a-4263d7b19d3d => generated 117 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:56:21.424609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:21.429434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:21.430055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:21.438139 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a857e18a-6af0-4505-a340-bb605a84e503 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1488 microversion: 2.1 time: 0.933420 Oct 03 14:56:21.439089 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2535/5207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:20 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1488 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:21.466130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:21.467272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:21.480489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.481258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.481882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.485842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.486311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.486746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.502881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.503765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.504284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.506584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.507386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.510023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.569648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:56:21.789564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-900fe33a-e30a-4634-85cb-9a8cd1426378 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 204 len: 0 microversion: 2.1 time: 0.327029 Oct 03 14:56:21.790539 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2536/5208] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:56:21 2022] DELETE /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:56:21.800824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:21.801916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:21.817852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.819701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.820219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.824259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:21.827920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:21.828453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:21.987071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:21.998442 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2cea393-a2b0-4d5d-8649-014b00a8d163 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1508 microversion: 2.1 time: 0.573885 Oct 03 14:56:22.001239 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2673/5209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:21 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:22.018190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:22.019088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:22.039770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:22.040434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:22.041109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:22.042872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:22.044592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:22.053415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:22.571630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:22.579686 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-925b4643-ff1d-4e82-93af-37b5d6cb2dd3 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1494 microversion: 2.1 time: 0.577349 Oct 03 14:56:22.580278 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2674/5210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:22 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1494 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:23.025023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:23.041831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:23.055923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.064423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.065152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.066317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.075129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.076593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.569969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.585538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.587197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.589267 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fa70abfa-46be-4e6b-9947-ed3a874ec0d5 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1600 microversion: 2.20 time: 1.797232 Oct 03 14:56:23.601189 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2537/5211] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:21 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1600 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:23.611990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:23.612493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:23.641853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:23.643483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.644164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.644957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.645655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.646125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.646564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.663698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:23.670915 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fbe9b1a0-2c1a-4d13-8f79-602163577914 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1508 microversion: 2.1 time: 0.652030 Oct 03 14:56:23.673162 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2675/5212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:23 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1508 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:23.680163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:23.685933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:23.705994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.708520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.709188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.711050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:23.714023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:23.714656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:23.905442 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ae469a3-c862-452b-8b24-697516394934 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.230824 Oct 03 14:56:23.906249 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2676/5213] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 3 14:56:23 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:56:24.570712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:24.582685 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b60be73-5052-4913-8c0b-60ca7c8d3843 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1494 microversion: 2.1 time: 0.975470 Oct 03 14:56:24.596983 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2538/5214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:23 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1494 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:24.702255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:24.703658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:24.719960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:24.720859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:24.721571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:24.722689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:24.723409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:24.724059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:24.849535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-2f192818-ed45-4b91-81c6-babf48870cd1 req-cc9bea03-1321-4dc0-9866-33ddf11246e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04994ce-f544-4364-9887-e60b13b07143", "name": "network-vif-deleted", "tag": "a2b25e07-562c-40ab-9636-a9ba529efa7d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:24.883277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2f192818-ed45-4b91-81c6-babf48870cd1 req-cc9bea03-1321-4dc0-9866-33ddf11246e2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:24.884155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2f192818-ed45-4b91-81c6-babf48870cd1 req-cc9bea03-1321-4dc0-9866-33ddf11246e2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:24.885818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2f192818-ed45-4b91-81c6-babf48870cd1 req-cc9bea03-1321-4dc0-9866-33ddf11246e2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:24.948599 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-2f192818-ed45-4b91-81c6-babf48870cd1 req-cc9bea03-1321-4dc0-9866-33ddf11246e2 service nova] Creating event network-vif-deleted:a2b25e07-562c-40ab-9636-a9ba529efa7d for instance b04994ce-f544-4364-9887-e60b13b07143 on n-h2-781139-2 Oct 03 14:56:24.966434 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-2f192818-ed45-4b91-81c6-babf48870cd1 req-cc9bea03-1321-4dc0-9866-33ddf11246e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122851 Oct 03 14:56:24.970249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2539/5215] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:25.141312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:25.154150 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb0db837-85a5-4a3e-b550-ca823e3ce1ba tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 200 len: 1466 microversion: 2.1 time: 0.456412 Oct 03 14:56:25.156459 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2677/5216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:24 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 1466 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:25.429894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-47318ce9-1412-46b7-b2e1-3ab4d4531385 req-137ade7e-2b8a-41c3-95af-a6c2d832c799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fa2c58-10bb-41ea-98b9-b1d88d631fcd", "name": "network-vif-deleted", "tag": "1b7189fd-c12e-4f0e-b050-7ba65fc46796"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:25.467536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-47318ce9-1412-46b7-b2e1-3ab4d4531385 req-137ade7e-2b8a-41c3-95af-a6c2d832c799 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:25.468577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-47318ce9-1412-46b7-b2e1-3ab4d4531385 req-137ade7e-2b8a-41c3-95af-a6c2d832c799 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:25.469792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-47318ce9-1412-46b7-b2e1-3ab4d4531385 req-137ade7e-2b8a-41c3-95af-a6c2d832c799 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:25.497613 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-47318ce9-1412-46b7-b2e1-3ab4d4531385 req-137ade7e-2b8a-41c3-95af-a6c2d832c799 service nova] Creating event network-vif-deleted:1b7189fd-c12e-4f0e-b050-7ba65fc46796 for instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd on n-h2-781139-2 Oct 03 14:56:25.504689 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-47318ce9-1412-46b7-b2e1-3ab4d4531385 req-137ade7e-2b8a-41c3-95af-a6c2d832c799 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081581 Oct 03 14:56:25.509842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2540/5217] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:25.614842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:25.616059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:25.641750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:25.645798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:25.649519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:25.655343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:25.659249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:25.675444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:25.844039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:25.857688 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ce93801-1e56-46e6-9cf6-ce5eefd85e34 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 200 len: 1286 microversion: 2.1 time: 0.248632 Oct 03 14:56:25.863906 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2678/5218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:25 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 1286 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:26.187087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:26.187839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: b04994ce-f544-4364-9887-e60b13b07143] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:26.203013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.203515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.203956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.204673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.205155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.205631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.326906 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Instance b04994ce-f544-4364-9887-e60b13b07143 could not be found. Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 HTTP/1.1 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance b04994ce-f544-4364-9887-e60b13b07143 could not be found. Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'b04994ce-f544-4364-9887-e60b13b07143'} Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04994ce-f544-4364-9887-e60b13b07143 could not be found. Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04994ce-f544-4364-9887-e60b13b07143 could not be found. Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.332144 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04994ce-f544-4364-9887-e60b13b07143 could not be found. Oct 03 14:56:26.337054 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.337925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 404 to user: Instance b04994ce-f544-4364-9887-e60b13b07143 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:26.340201 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-469a8de8-ab30-4973-8167-cf3b2a34f8dc tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143" status: 404 len: 111 microversion: 2.1 time: 0.159070 Oct 03 14:56:26.343804 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2541/5219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:26 2022] GET /compute/v2.1/servers/b04994ce-f544-4364-9887-e60b13b07143 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:26.354779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:26.356909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:26.382070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.384505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.386518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.388030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.389151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.390546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.480313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:56:26.725387 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-382324e6-de20-4501-a06c-49308e3e1ade tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "DELETE /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 204 len: 0 microversion: 2.1 time: 0.372682 Oct 03 14:56:26.726734 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2679/5220] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:56:26 2022] DELETE /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:56:26.737226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:26.738824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:26.765462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.766742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.768033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.770176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.772570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.773596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.890370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:26.894594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:26.912870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.913399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.913853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.914610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:26.915067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:26.915496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:26.979821 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd HTTP/1.1 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '16fa2c58-10bb-41ea-98b9-b1d88d631fcd'} Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:26.984435 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.989380 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:26.989380 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:26.989380 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:26.989380 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:26.989380 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:26.989380 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:56:26.989380 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:56:26.998145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:26.999619 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-677e75f5-eaa1-4608-a1d8-73a0593b8bd6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 404 len: 111 microversion: 2.1 time: 0.117878 Oct 03 14:56:27.000207 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2680/5221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:26 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:27.309717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-254317063", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fd28a296-d4d0-487d-b766-c66e0eb4645b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:27.405147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] validate_networks() for [('fd28a296-d4d0-487d-b766-c66e0eb4645b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:56:27.946351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:27.957514 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cda294ae-04b5-4444-b361-a847b7ebe0f5 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1522 microversion: 2.1 time: 1.226706 Oct 03 14:56:27.958127 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2542/5222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:26 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1522 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:28.613523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5d1801c0-d3e4-478e-871c-928013c73f45 req-5fd9fe85-2566-4d1c-98fd-e42367662840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:28.631620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d1801c0-d3e4-478e-871c-928013c73f45 req-5fd9fe85-2566-4d1c-98fd-e42367662840 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:28.633031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d1801c0-d3e4-478e-871c-928013c73f45 req-5fd9fe85-2566-4d1c-98fd-e42367662840 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:28.633744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5d1801c0-d3e4-478e-871c-928013c73f45 req-5fd9fe85-2566-4d1c-98fd-e42367662840 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:28.670578 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5d1801c0-d3e4-478e-871c-928013c73f45 req-5fd9fe85-2566-4d1c-98fd-e42367662840 service nova] Creating event network-changed:cfa9cd2b-641c-46a2-88cf-0a0614f33cdb for instance 796f59f0-d25e-440a-8a63-d6cedc50b955 on n-h2-781139-2 Oct 03 14:56:28.676853 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5d1801c0-d3e4-478e-871c-928013c73f45 req-5fd9fe85-2566-4d1c-98fd-e42367662840 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067551 Oct 03 14:56:28.677780 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2543/5223] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:28.982148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:28.982698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:29.006698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:29.013700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:29.015956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:29.019275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:29.021501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:29.025930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:29.062188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:56:29.062758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:56:29.063283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:56:29.063740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:56:29.064191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:56:29.094451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:29.095049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:29.098516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:29.105313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:29.105824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:29.108536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:29.212534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:29.226951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Getting quotas for user 3569fcf74b3b4e3d99b0dbcd5465d97d and project 3caf5c9fc7a74ec49663c58ebe29a3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:29.261316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:56:29.263652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:56:29.392378 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5fb6c9e-a81c-4631-bb5b-f2a1570c7f3c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087793 Oct 03 14:56:29.394763 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2681/5224] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:56:29.412115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a0656cc-a387-41a9-b36d-f6a3aa0928e7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:29.414371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a0656cc-a387-41a9-b36d-f6a3aa0928e7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:29.549436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a0656cc-a387-41a9-b36d-f6a3aa0928e7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:29.568432 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a0656cc-a387-41a9-b36d-f6a3aa0928e7 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1214 microversion: 2.1 time: 0.166711 Oct 03 14:56:29.569822 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2682/5225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:29 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:29.721622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:29.726350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba57cee91b1a42b6b3c8c42a5a40eba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3617808e389f442db9240aab3538e9a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:29.737655 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-604161e4-ce3a-4b6e-a8bc-d592050bfd66 tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 200 len: 1307 microversion: 2.1 time: 0.760474 Oct 03 14:56:29.741980 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2544/5226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:28 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 1307 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:30.600356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:30.601986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:30.613425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.617113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.617570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.618325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.620807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.621736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.712566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-febfdbc3-53c1-4a20-88e2-12cafc054de6 req-a1c402e6-b5f3-4879-b868-f0036b00bf71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335b701a-b1ae-4492-a11b-cf7f6a9f03cb", "name": "network-vif-deleted", "tag": "d1b940fb-7b30-4aa7-bbae-5d63b072a331"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:30.749862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-febfdbc3-53c1-4a20-88e2-12cafc054de6 req-a1c402e6-b5f3-4879-b868-f0036b00bf71 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.752696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-febfdbc3-53c1-4a20-88e2-12cafc054de6 req-a1c402e6-b5f3-4879-b868-f0036b00bf71 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.753497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-febfdbc3-53c1-4a20-88e2-12cafc054de6 req-a1c402e6-b5f3-4879-b868-f0036b00bf71 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.781590 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-febfdbc3-53c1-4a20-88e2-12cafc054de6 req-a1c402e6-b5f3-4879-b868-f0036b00bf71 service nova] Creating event network-vif-deleted:d1b940fb-7b30-4aa7-bbae-5d63b072a331 for instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb on n-h2-781139-2 Oct 03 14:56:30.804679 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-febfdbc3-53c1-4a20-88e2-12cafc054de6 req-a1c402e6-b5f3-4879-b868-f0036b00bf71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088204 Oct 03 14:56:30.805405 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2545/5227] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:30.828313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:30.842094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] [instance: 335b701a-b1ae-4492-a11b-cf7f6a9f03cb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:30.883816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.884410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.889229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.891408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:30.900294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:30.900756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:30.937353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:30.968342 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] HTTP exception thrown: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb could not be found. Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Request method failure captured: Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb HTTP/1.1 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvaH-PLXGwaLtG7P4oVHDJaHfsg7pgs0rekPCzyRdbX_9B1QR5uXWQh84WeY6Dme-UQEgiB7cZR4Pl9ne9mMeGrDASjTa_CPiF84UU3NL2mP4E25zt2Z37pAob264LGpNff2WBgio-1GYnb_MxP7W3_4HP-xvhAouPoaAT47WIHP0sE Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3617808e389f442db9240aab3538e9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3617808e389f442db9240aab3538e9a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3617808e389f442db9240aab3538e9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3617808e389f442db9240aab3538e9a3 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1325813654 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: ba57cee91b1a42b6b3c8c42a5a40eba4 Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1325813654-project Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb could not be found. Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '335b701a-b1ae-4492-a11b-cf7f6a9f03cb'} Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb could not be found. Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb could not be found. Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:30.972655 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb could not be found. Oct 03 14:56:30.977668 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:56:30.980043 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cfe6965-9c46-4b70-9370-69e3c8eaed4c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1210 microversion: 2.1 time: 0.371265 Oct 03 14:56:30.993023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2683/5228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:30 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1210 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:31.000301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] Returning 404 to user: Instance 335b701a-b1ae-4492-a11b-cf7f6a9f03cb could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:56:31.002769 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c9b1326-c513-4276-8653-83549539182d tempest-ServerRescueNegativeTestJSON-1325813654 tempest-ServerRescueNegativeTestJSON-1325813654-project] 10.222.0.20 "GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb" status: 404 len: 111 microversion: 2.1 time: 0.196013 Oct 03 14:56:31.003976 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2546/5229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:30 2022] GET /compute/v2.1/servers/335b701a-b1ae-4492-a11b-cf7f6a9f03cb => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:56:32.007949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:32.010112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:32.031209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:32.031903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:32.032319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:32.033079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:32.033731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:32.034593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:32.180792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:32.192126 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6434edd-7d5b-4eff-908e-72d00503e669 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1272 microversion: 2.1 time: 0.188308 Oct 03 14:56:32.193158 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2684/5230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:32 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:33.215637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:33.217181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:33.225526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:33.226304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:33.227097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:33.228049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:33.228720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:33.229607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:33.813164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:33.824970 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37ff8b6c-360f-49ce-a19e-b3462d59255a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1272 microversion: 2.1 time: 0.613142 Oct 03 14:56:33.840389 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2547/5231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:33 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1272 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:34.858212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:34.860344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:34.878092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:34.878909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:34.879463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:34.880771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:34.881539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:34.882305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:34.974908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:34.986677 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f30ff9f-adcc-4b34-a6e6-6f3e6b08b18f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1272 microversion: 2.1 time: 0.139884 Oct 03 14:56:34.999180 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2685/5232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:34 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:36.013374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:36.013909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:36.021404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:36.022241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:36.023423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:36.024345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:36.025043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:36.025680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:36.997123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:37.030375 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e50d6751-682c-4119-8ae3-43d0fa6a39fe tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 1.020956 Oct 03 14:56:37.030984 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2548/5233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:36 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:38.058156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:38.059020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:38.071736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:38.075109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:38.075643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:38.076464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:38.079330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:38.079916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:38.504826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:38.519193 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62e739d5-d4f0-45f9-b926-8bd530acb87c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 0.460265 Oct 03 14:56:38.522351 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2686/5234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:38 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:39.548739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:39.550975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:39.565988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:39.568369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:39.569184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:39.570574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:39.571442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:39.572148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:41.964223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:41.988107 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-225ffca9-72c8-4b69-8c0f-405889375a8a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 2.441889 Oct 03 14:56:41.990067 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2549/5235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:39 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 2449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:43.022228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:43.023205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:43.051271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:43.053124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:43.058090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:43.059802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5ea32c3d-5933-4571-a09f-29c1f228b7ad req-15ff0f6f-1559-4883-a819-3d77bbbaced1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a11c998-2c74-4358-b32c-92fbdfbce5ea", "tag": "6798f7ca-2f0e-42e5-b996-591e310c16e9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:43.066503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:43.068466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:43.069650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:43.074416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:43.075375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:43.075987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:43.101477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ea32c3d-5933-4571-a09f-29c1f228b7ad req-15ff0f6f-1559-4883-a819-3d77bbbaced1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:43.103116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ea32c3d-5933-4571-a09f-29c1f228b7ad req-15ff0f6f-1559-4883-a819-3d77bbbaced1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:43.107024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5ea32c3d-5933-4571-a09f-29c1f228b7ad req-15ff0f6f-1559-4883-a819-3d77bbbaced1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:43.141748 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5ea32c3d-5933-4571-a09f-29c1f228b7ad req-15ff0f6f-1559-4883-a819-3d77bbbaced1 service nova] Creating event network-changed:6798f7ca-2f0e-42e5-b996-591e310c16e9 for instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea on n-h1-781139-2 Oct 03 14:56:43.161634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5ea32c3d-5933-4571-a09f-29c1f228b7ad req-15ff0f6f-1559-4883-a819-3d77bbbaced1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105711 Oct 03 14:56:43.164788 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2550/5236] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:44.205158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:44.214343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb3c8982-25ab-4815-966b-67417c6ca34e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 1.204365 Oct 03 14:56:44.215381 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2687/5237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:43 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:44.264442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-436116709", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "ba6601fc-7e27-4f01-9946-12c755b1aa88"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:44.294306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:44.344274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] validate_networks() for [('ba6601fc-7e27-4f01-9946-12c755b1aa88', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:56:45.243101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:45.244360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:45.258290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.259877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.263806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:45.264748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.265436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.266057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:45.458840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:56:45.459491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:56:45.460128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:56:45.460607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:56:45.461119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:56:45.483121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.483675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.484195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:45.485139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:45.485757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:45.486343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:45.531731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Getting quotas for project bfe736ca183e4d4b8781ffb232c49a67. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:45.539508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Getting quotas for user 4fd097a3bb5f423488f27fa319f636ba and project bfe736ca183e4d4b8781ffb232c49a67. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:45.568812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:56:45.576054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:56:45.679299 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4492be0f-3097-4f04-b984-efc9b789bd92 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.419603 Oct 03 14:56:45.688850 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2551/5238] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:56:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:56:45.699047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6d3f7810-2d29-4153-adb4-33b8d546fc12 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:45.701229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6d3f7810-2d29-4153-adb4-33b8d546fc12 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:45.875295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:45.891742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e99c479a-0b66-4ade-a8e2-6be065a72d53 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 0.651692 Oct 03 14:56:45.895558 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2688/5239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:45 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:46.460067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6d3f7810-2d29-4153-adb4-33b8d546fc12 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:46.474789 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6d3f7810-2d29-4153-adb4-33b8d546fc12 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1218 microversion: 2.1 time: 0.784406 Oct 03 14:56:46.475691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2552/5240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:45 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1218 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:46.921144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:46.922256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:46.943429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:46.947240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:46.948113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:46.950664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:46.951879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:46.954472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:47.430596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:47.438636 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91726e42-21da-400e-b940-664904557e24 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 0.522637 Oct 03 14:56:47.439221 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2689/5241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:46 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:47.498725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:47.499354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:47.511281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:47.511778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:47.512217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:47.521580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:47.522084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:47.522532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:47.590540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:47.765929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:47.780344 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3bed0b17-596e-4730-aefa-1444717acd62 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1214 microversion: 2.1 time: 0.285881 Oct 03 14:56:47.790419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2553/5242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:47 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:48.467772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:48.468398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:48.491561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:48.492075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:48.492523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:48.493333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:48.493739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:48.494166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:48.811425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:48.812255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:48.834449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:48.835098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:48.835684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:48.839684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:48.840394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:48.840972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:49.017192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:49.032177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:49.047350 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5bc5e08-e7bd-42c5-a99b-d10f1f00e352 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 0.583430 Oct 03 14:56:49.056255 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f36000e-2f7a-4a9a-95b2-6909c9c7c1d2 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1276 microversion: 2.1 time: 0.250696 Oct 03 14:56:49.072839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2690/5243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:48 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:49.076943 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2554/5244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:48 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1276 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:50.071295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:50.073108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:50.081267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:50.082611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:50.097235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.099650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.100145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.101167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.101909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.103966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.104918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.105640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:50.106247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.106863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:50.107617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.109263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:50.522283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:50.537645 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-852f641b-3721-4627-aafb-d28e5985eae0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.461354 Oct 03 14:56:50.538920 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2555/5245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:50 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:50.799191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14a691ff-a598-4bbf-872b-2b823254faa4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: .version_select at 0x7fb23031b430>, body: {"keypair": {"name": "tempest-keypair-542413682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCazq4P8Up9r7FrxDniLBpcmWOdjk4QZKJ8B86wr9VYfSQIGbQTgwKPw9Hhynd71x+QseOC2ds9/jUutYNUQxAjsrEsG6d6iLaFWLZGvraQhPVp/hVEFV4vjz9cprZuHbQ=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:50.832949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-14a691ff-a598-4bbf-872b-2b823254faa4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:50.842870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-14a691ff-a598-4bbf-872b-2b823254faa4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:50.898860 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14a691ff-a598-4bbf-872b-2b823254faa4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.358479 Oct 03 14:56:50.899687 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2556/5246] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:56:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:50.920535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:50.934246 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-013bca9a-e31e-4b77-a866-fd1deed3f197 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 0.864818 Oct 03 14:56:50.936528 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2691/5247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:50 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:51.553737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7e213de3-cd43-4627-b72c-f38fced5df11 req-236c86a3-ba0f-4773-8a48-8d3f78e52a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a611d456-1cd7-4199-9f5e-0e141e08a263", "tag": "44799f54-96c4-47a1-a2d3-c269ebb39a83"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:51.566449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:51.567772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:51.582739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.583241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.583683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:51.585837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.586558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.587031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:51.603904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e213de3-cd43-4627-b72c-f38fced5df11 req-236c86a3-ba0f-4773-8a48-8d3f78e52a98 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.606514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e213de3-cd43-4627-b72c-f38fced5df11 req-236c86a3-ba0f-4773-8a48-8d3f78e52a98 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.607700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e213de3-cd43-4627-b72c-f38fced5df11 req-236c86a3-ba0f-4773-8a48-8d3f78e52a98 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:51.649981 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7e213de3-cd43-4627-b72c-f38fced5df11 req-236c86a3-ba0f-4773-8a48-8d3f78e52a98 service nova] Creating event network-changed:44799f54-96c4-47a1-a2d3-c269ebb39a83 for instance a611d456-1cd7-4199-9f5e-0e141e08a263 on n-h1-781139-2 Oct 03 14:56:51.671979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7e213de3-cd43-4627-b72c-f38fced5df11 req-236c86a3-ba0f-4773-8a48-8d3f78e52a98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123226 Oct 03 14:56:51.673323 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2557/5248] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:51.960957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:51.961976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:51.987555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:51.998135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:51.998954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:52.000251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:52.000970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:52.001638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:52.371118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:52.381572 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a14e0dfe-04d6-4587-8a2a-fab88d4bc43e tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 0.424924 Oct 03 14:56:52.387120 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2558/5249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:51 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:52.387956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:52.398228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3e8a9a14-4746-4f42-bf24-fdbbe324f51b req-ad88d79f-01fc-4015-bdfb-5dea23e2755f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a11c998-2c74-4358-b32c-92fbdfbce5ea", "name": "network-vif-plugged", "status": "completed", "tag": "6798f7ca-2f0e-42e5-b996-591e310c16e9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:52.401296 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0d6d830-73f1-4156-bf7e-843b65ab7745 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.840023 Oct 03 14:56:52.414258 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2692/5250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:51 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:52.421492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3e8a9a14-4746-4f42-bf24-fdbbe324f51b req-ad88d79f-01fc-4015-bdfb-5dea23e2755f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:52.422071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3e8a9a14-4746-4f42-bf24-fdbbe324f51b req-ad88d79f-01fc-4015-bdfb-5dea23e2755f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:52.422598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3e8a9a14-4746-4f42-bf24-fdbbe324f51b req-ad88d79f-01fc-4015-bdfb-5dea23e2755f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:52.443891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3e8a9a14-4746-4f42-bf24-fdbbe324f51b req-ad88d79f-01fc-4015-bdfb-5dea23e2755f service nova] Creating event network-vif-plugged:6798f7ca-2f0e-42e5-b996-591e310c16e9 for instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea on n-h1-781139-2 Oct 03 14:56:52.456859 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3e8a9a14-4746-4f42-bf24-fdbbe324f51b req-ad88d79f-01fc-4015-bdfb-5dea23e2755f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067852 Oct 03 14:56:52.463547 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2559/5251] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:53.002088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-558092260", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": "none"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:53.113597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:56:53.114079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:56:53.114667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:56:53.115732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:56:53.116435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:56:53.127832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:53.128472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:53.129257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:53.130286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:53.130958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:53.131631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:53.157655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Getting quotas for project 4b62bccdf1b5457fa1aecffbb3ba4442. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:53.163864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Getting quotas for user 9f22a41bc02f455eb9da25e133437d52 and project 4b62bccdf1b5457fa1aecffbb3ba4442. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:53.191986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:56:53.197059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: eae16611-74b5-4af5-a185-c406999d08b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:56:53.358002 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8966c51c-7406-47fc-aa1e-86ea5e67f51a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.531410 Oct 03 14:56:53.359105 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2693/5252] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:56:53.381613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-84c9a769-2811-4497-b2af-579e6108e380 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:53.382660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-84c9a769-2811-4497-b2af-579e6108e380 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: eae16611-74b5-4af5-a185-c406999d08b9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:53.426005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:53.426637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:53.469338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:53.470477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:53.471126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:53.472044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:53.472692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:53.473317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:53.521511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:54.069599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84c9a769-2811-4497-b2af-579e6108e380 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.083245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84c9a769-2811-4497-b2af-579e6108e380 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.088859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84c9a769-2811-4497-b2af-579e6108e380 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.095120 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-84c9a769-2811-4497-b2af-579e6108e380 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9" status: 200 len: 1277 microversion: 2.47 time: 0.725976 Oct 03 14:56:54.099087 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2560/5253] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:53 2022] GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9 => generated 1277 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:54.114737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:54.118692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:54.143922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.144438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.150113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.150113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.150610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.155239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.208428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.229944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e6d15503-8dbd-4ab4-8a7d-f65fe8c7d15b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 0.820481 Oct 03 14:56:54.234115 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2694/5254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:53 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:54.596373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:54.597263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:54.604774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:54.617731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.619519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f27fa3ac-7ee0-431e-b4e5-24d8101f820a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.514045 Oct 03 14:56:54.620912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.621556 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2561/5255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:54 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:54.635260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1453004427", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": "none"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:54.635637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.636757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.646230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.647205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.703607 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c086eaa7-2dd4-4bec-8690-fa5d98e78ced tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/ips" status: 200 len: 152 microversion: 2.20 time: 0.466792 Oct 03 14:56:54.705418 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2695/5256] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Oct 3 14:56:54 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/ips => generated 152 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:56:54.768258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:56:54.768891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:56:54.769417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:56:54.770361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:56:54.770784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:56:54.782634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.783135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.783790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.784645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:54.785228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:54.785794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:54.813641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Getting quotas for project 4b62bccdf1b5457fa1aecffbb3ba4442. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:54.821934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Getting quotas for user 9f22a41bc02f455eb9da25e133437d52 and project 4b62bccdf1b5457fa1aecffbb3ba4442. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:54.839575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:56:54.847118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:56:54.960724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-16fc7cef-297e-4e75-9a06-1873797b51f6 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.331949 Oct 03 14:56:54.975719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39070df2-5ba0-4fa9-a0c8-3fb366de1113 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:54.979438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39070df2-5ba0-4fa9-a0c8-3fb366de1113 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:54.981639 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2562/5257] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 3 14:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 14:56:55.052991 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39070df2-5ba0-4fa9-a0c8-3fb366de1113 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "PUT /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 992 microversion: 2.47 time: 0.082528 Oct 03 14:56:55.078637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-637a3551-59f8-4c4f-b47e-592e940669e0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:55.081276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-637a3551-59f8-4c4f-b47e-592e940669e0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:55.085704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2696/5258] 10.222.0.20 () {62 vars in 1297 bytes} [Mon Oct 3 14:56:54 2022] PUT /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 992 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:56:55.283932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:55.283932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:55.291564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:55.291564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:55.291564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:55.315969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:55.316478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:55.316954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:55.572221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-637a3551-59f8-4c4f-b47e-592e940669e0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:55.582436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-637a3551-59f8-4c4f-b47e-592e940669e0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:55.586610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-637a3551-59f8-4c4f-b47e-592e940669e0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:55.599682 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-637a3551-59f8-4c4f-b47e-592e940669e0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1278 microversion: 2.47 time: 0.521630 Oct 03 14:56:55.601058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2563/5259] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:55 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1278 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:55.644278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:55.644913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:55.654523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:55.656416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:55.658030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:55.659143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:55.666878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:55.667589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:56.045994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.062456 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c4770508-3e85-48cd-ac62-586eaad5dfbb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.422602 Oct 03 14:56:56.070646 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2564/5260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:55 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:56.402343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.415701 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11a4dd7c-cf95-4b0c-801a-c34815626dff tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1314 microversion: 2.1 time: 1.158036 Oct 03 14:56:56.416317 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2697/5261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:55 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:56.635156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:56.635973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:56.661481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:56.662114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:56.665634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:56.681280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:56.688475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:56.693689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:56.876094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.888887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.891118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:56.893109 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2a380c8d-7dc3-4e1f-8ed1-d778606323a0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1330 microversion: 2.47 time: 0.261589 Oct 03 14:56:56.894362 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2565/5262] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:56 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1330 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:57.016111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-351986593", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8455999-ecee-4494-a487-d4e57e751b83"}], "security_groups": [{"name": "tempest-securitygroup--1772785061"}], "key_name": "tempest-keypair-542413682", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:57.092316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:57.093456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:57.106782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.108131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.108656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.114702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.115296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.115851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.451575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] validate_networks() for [('f8455999-ecee-4494-a487-d4e57e751b83', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:56:57.499967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:57.523623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-345560e1-b6bf-45aa-b5d2-8db23206361b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.438514 Oct 03 14:56:57.524234 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2566/5263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:57 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:56:57.542072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:57.542712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:57.549337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.549690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.550129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.550843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.551293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.551721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.804651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:57.816981 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d543130a-8f33-434e-9dc7-6fa3f34eb6cf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1501 microversion: 2.1 time: 0.290743 Oct 03 14:56:57.818048 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2567/5264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:57 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:57.846622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:57.847715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:57.855600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.856197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.856730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.858287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:57.858987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:57.859524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:57.899847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lazy-loading 'flavor' on Instance uuid 3a11c998-2c74-4358-b32c-92fbdfbce5ea {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:56:58.056026 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-809757a5-9ac8-45e4-9b73-3733ecfa68f5 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "POST /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea/action" status: 202 len: 0 microversion: 2.1 time: 0.218698 Oct 03 14:56:58.057692 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2568/5265] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:56:57 2022] POST /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 14:56:58.078039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:58.079366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:58.093600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.094901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.095646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:58.097047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.097984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.098657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:58.218682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:58.244190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:58.247223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:58.251002 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e86bde08-e3bf-494c-8e68-e20810f237f1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1336 microversion: 2.47 time: 0.187432 Oct 03 14:56:58.270970 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2569/5266] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:58 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1336 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:58.287208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:58.288124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:58.342696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.348789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.349625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:58.354079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.356865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.357344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:58.649217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:58.669391 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a35db636-d1c5-4bca-a7d7-e395bb7df79a tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1509 microversion: 2.1 time: 0.396796 Oct 03 14:56:58.685038 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2570/5267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:58 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:58.687857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:58.688407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:58.703655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.703894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.704335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:58.709079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:58.709627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:58.710201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:58.745232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lazy-loading 'flavor' on Instance uuid 796f59f0-d25e-440a-8a63-d6cedc50b955 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:56:58.812062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:56:59.048080 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00086bde-c794-4b55-b274-fe29f92bb2bf tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/action" status: 202 len: 0 microversion: 2.20 time: 0.374812 Oct 03 14:56:59.048946 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2571/5268] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:56:58 2022] POST /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:56:59.062975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:59.064522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:59.082568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.083138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.084016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.084669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.086030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.086904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.266376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.277317 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-259f61d8-227b-4100-b2b3-c9cc33106f69 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.220069 Oct 03 14:56:59.278109 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2572/5269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:59 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:56:59.301106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:59.301788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:59.314643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.316086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.316500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.317634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.318115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.318654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.549231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.564069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.573614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.577881 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17a999a8-2062-4185-b509-ef9b9465e580 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.283739 Oct 03 14:56:59.578505 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2573/5270] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:59 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:59.621216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:59.621216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:59.639147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.639648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.640095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.640823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.644011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.644991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.737580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:56:59.738161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:56:59.738739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:56:59.740025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:56:59.740700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:56:59.754887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.772523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.773181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.773688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.774183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.775437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:56:59.776531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.777180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.778242 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7e85b16-8a8e-4dc7-9f45-19cf149203d0 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1336 microversion: 2.47 time: 0.191437 Oct 03 14:56:59.779434 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2574/5271] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:56:59 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1336 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:56:59.779981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.802558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e2693fab-9746-49af-9b79-f20c61d1f560 req-5248ff83-f2a5-4d34-bc91-17d522c73bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a611d456-1cd7-4199-9f5e-0e141e08a263", "name": "network-vif-plugged", "status": "completed", "tag": "44799f54-96c4-47a1-a2d3-c269ebb39a83"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:56:59.803772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:56:59.810191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:56:59.819929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e2693fab-9746-49af-9b79-f20c61d1f560 req-5248ff83-f2a5-4d34-bc91-17d522c73bb5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.821500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e2693fab-9746-49af-9b79-f20c61d1f560 req-5248ff83-f2a5-4d34-bc91-17d522c73bb5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.822625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e2693fab-9746-49af-9b79-f20c61d1f560 req-5248ff83-f2a5-4d34-bc91-17d522c73bb5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.825209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:56:59.827800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:56:59.840982 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e2693fab-9746-49af-9b79-f20c61d1f560 req-5248ff83-f2a5-4d34-bc91-17d522c73bb5 service nova] Creating event network-vif-plugged:44799f54-96c4-47a1-a2d3-c269ebb39a83 for instance a611d456-1cd7-4199-9f5e-0e141e08a263 on n-h1-781139-2 Oct 03 14:56:59.848142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e2693fab-9746-49af-9b79-f20c61d1f560 req-5248ff83-f2a5-4d34-bc91-17d522c73bb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066381 Oct 03 14:56:59.848941 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2575/5272] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:56:59.863838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:59.864852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:56:59.874645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.875672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.876432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.877881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:56:59.878680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:56:59.882026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:56:59.924803 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2fd25af1-391c-443a-b206-6e8366b580ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.914757 Oct 03 14:56:59.928398 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2698/5273] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:56:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:56:59.942991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ca3edcd-273f-46af-8b4f-80a2b5211db9 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:56:59.943975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ca3edcd-273f-46af-8b4f-80a2b5211db9 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:00.079722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ca3edcd-273f-46af-8b4f-80a2b5211db9 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:00.096905 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ca3edcd-273f-46af-8b4f-80a2b5211db9 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1240 microversion: 2.1 time: 0.159537 Oct 03 14:57:00.098599 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2699/5274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:59 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:00.221316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:00.237508 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ffd71f07-eef7-4a1f-b7f9-7cd19def99e1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1509 microversion: 2.1 time: 0.377192 Oct 03 14:57:00.241504 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2576/5275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:56:59 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:00.310802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:00.312976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:00.331434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.332857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.333407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:00.334324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.334854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.335350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:00.612177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:00.612804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:00.628138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.633542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.634159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:00.634891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.635346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.635768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:00.692177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:00.705924 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b35c7924-1b17-4ef2-b74a-dedbcd95e8d8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.403261 Oct 03 14:57:00.721476 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2700/5276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:00 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:00.806188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:00.806988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:00.825016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.830183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.830690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:00.831548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:00.832018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:00.832453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.073420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.090616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.103673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.111766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb904793-e08c-4814-b71e-afe149327d2c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.505621 Oct 03 14:57:01.113232 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2577/5277] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:00 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:01.131031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:01.136935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:01.161610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.169511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.170075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.173199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.175265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.175820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.178439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.178899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.179981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.181523 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56269b0e-9786-4a8c-abed-3711bd4e0430 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1336 microversion: 2.47 time: 0.381344 Oct 03 14:57:01.192278 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2701/5278] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:00 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1336 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:01.268424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:01.269183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:01.305120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.306759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.307242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.308017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.308508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.315598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.343149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.353055 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6c9f18a1-92bd-403c-a00a-34a9948f04df tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1292 microversion: 2.1 time: 0.235694 Oct 03 14:57:01.353853 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2578/5279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:01 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1292 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:01.741623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:01.750332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf0c59ad-981d-4433-9682-01235b076522 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1492 microversion: 2.1 time: 0.489171 Oct 03 14:57:01.761138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2702/5280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:01 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1492 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:01.773865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:01.774567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:01.795276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.799138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.800135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.801162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:01.804837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:01.808490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:01.997923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2078268510", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:02.052149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:02.135820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] validate_networks() for [('ce87d81a-66b0-4686-8402-49534adb0b63', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:57:02.318442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:02.329188 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e6aa2c9-ea91-477f-8547-a5a300673dd3 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1318 microversion: 2.1 time: 0.566635 Oct 03 14:57:02.348982 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2703/5281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:01 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:02.354445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:02.368220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:02.386546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.387454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.388318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:02.390664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.391690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.392550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:02.447306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:57:02.634437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-31a9ca5e-0238-4c9b-b976-19c9ee636b84 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 204 len: 0 microversion: 2.1 time: 0.283482 Oct 03 14:57:02.636799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2704/5282] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:02 2022] DELETE /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:57:02.644874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:02.646482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:02.657708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.658257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.658702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:02.659434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.659904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.660314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:02.887956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:02.910631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:02.913804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:02.919117 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c5e3b05-82c9-43de-8826-b0a57016d571 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.279810 Oct 03 14:57:02.936991 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2705/5283] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:02 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:02.936991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:02.936991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:02.953863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.954526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.955300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:02.956642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:02.957209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:02.957891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.112842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.122259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.123855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.125957 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd239633-1ee8-436b-b122-ef1075179741 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1357 microversion: 2.47 time: 0.202946 Oct 03 14:57:03.126533 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2706/5284] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:02 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:03.133962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:03.134839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.141528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.142241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.143002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.144027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.144696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.145368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.255305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.266111 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e14601aa-535d-4232-bd53-19c3f813056b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1298 microversion: 2.1 time: 0.138113 Oct 03 14:57:03.280676 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2707/5285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:03 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:03.289597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:03.290500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.297733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.298724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.299638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.300386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.300841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.301341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.332892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:57:03.333488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:57:03.333736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:57:03.334141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:57:03.334557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:57:03.343810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.344567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.345387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.346343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.346961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.347545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.366694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Getting quotas for project 7726834a3fd143d4b5f76ef5604b4f0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:57:03.372779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Getting quotas for user 4ba0d01f7ada40519d44797dfd342dbf and project 7726834a3fd143d4b5f76ef5604b4f0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:57:03.388290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:57:03.392142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:57:03.462063 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1bea8e52-1ee1-4009-8cee-e666364d7c7c tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.775851 Oct 03 14:57:03.465009 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2579/5286] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:57:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:57:03.471404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:03.475702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.483841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.484679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.485425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.486475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.487210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.487839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.523267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.535164 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f11a478e-df5a-4a57-b597-39e4aa655f93 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1498 microversion: 2.1 time: 0.252827 Oct 03 14:57:03.541577 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2708/5287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:03 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1498 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:03.562033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:03.562033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.580226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.581080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.581205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.581910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.582682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.589996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.609798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:57:03.610504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:57:03.611234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:57:03.612224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:57:03.612814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:57:03.745736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.759475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.759937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.760334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.761089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.761551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.767313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.786212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.800683 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6beab835-25b9-4503-9959-0b7b0c155efb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1508 microversion: 2.1 time: 0.242952 Oct 03 14:57:03.802801 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2709/5288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:03 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:03.810605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-198f782f-ed56-45f3-981e-d3c37474e788 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:03.811417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-198f782f-ed56-45f3-981e-d3c37474e788 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.886808 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b5a9c31-ea35-44b8-8c9e-6ae7b758746c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "POST /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec/action" status: 202 len: 1079 microversion: 2.47 time: 0.420397 Oct 03 14:57:03.887546 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2580/5289] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:57:03 2022] POST /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec/action => generated 1079 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 03 14:57:03.910477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:03.911506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.925977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-198f782f-ed56-45f3-981e-d3c37474e788 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:03.933390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.937672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.938091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-198f782f-ed56-45f3-981e-d3c37474e788 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1223 microversion: 2.1 time: 0.132971 Oct 03 14:57:03.938639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.940248 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2710/5290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:03 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:03.940846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.941624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.942298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.963438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:03.964021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:03.971668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.972385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.973013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:03.974634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:03.974884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:03.975479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:04.185978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.196544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.198076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.199332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b8b4c5b-8a46-4000-9aac-7cb5b137ec64 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.243177 Oct 03 14:57:04.200238 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2711/5291] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:03 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:04.294199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:04.303789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:04.311722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:04.312226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:04.312719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:04.313657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:04.314322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:04.315046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:04.415689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.430572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f943b03a-5cda-4510-8ade-8fbbdef655f3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1298 microversion: 2.1 time: 0.136217 Oct 03 14:57:04.431411 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2712/5292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:04 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:04.566627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:04.568059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:04.577022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:04.579237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:04.579703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:04.597226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:04.597226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:04.597226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:04.597226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:04.742220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.763663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.773687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.775422 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4ca0017d-5adb-4ccb-b0a1-c8c52e6908d2 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.869615 Oct 03 14:57:04.777651 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2581/5293] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:03 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:04.814675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:04.840374 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-384c93d1-2bd3-45b7-9fcd-bc6849730708 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1498 microversion: 2.1 time: 0.277857 Oct 03 14:57:04.842006 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2713/5294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:04 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1498 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:04.976397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:04.977282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:04.991974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:04.996563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:04.997389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:04.999748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:05.000248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:05.004044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:05.229996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:05.231224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:05.234875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:05.244006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:05.244497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:05.244996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:05.249507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:05.253642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:05.254580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:05.260975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:05.262772 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb935148-6227-4228-b127-5a27697a74ac tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1275 microversion: 2.1 time: 0.298755 Oct 03 14:57:05.266761 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2582/5295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:04 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1275 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:05.470994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:05.471813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:05.495927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:05.496750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:05.499857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:05.502519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:05.504193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:05.506202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:05.584056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:05.607276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:05.614257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:05.615785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fa610b9e-1004-4587-af26-896ca3740eb2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.389966 Oct 03 14:57:05.629114 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2714/5296] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:05 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:05.808419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:05.817448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:05.837377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:05.842795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:05.843757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:05.846479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:05.847359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:05.848059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:06.150380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:06.161130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:06.166896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:06.174035 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30c447ed-d71a-4f57-b3a8-93e225d98700 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.370436 Oct 03 14:57:06.174830 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2715/5297] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:05 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:06.285200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:06.309686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ad317aa-4497-4690-86f2-5d598a82f68c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.851969 Oct 03 14:57:06.313114 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2583/5298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:05 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:57:06.327366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:06.329370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:06.356191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:06.357592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:06.360828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:06.364019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:06.364700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:06.366034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:06.767440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:06.768070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:06.774940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:06.775670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:06.776548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:06.778511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:06.779124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:06.780344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:06.976106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3569fcf74b3b4e3d99b0dbcd5465d97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3caf5c9fc7a74ec49663c58ebe29a3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:06.992098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7f22536-5bc6-456e-8371-0e4d226b34d2 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 200 len: 1456 microversion: 2.1 time: 0.813872 Oct 03 14:57:06.992730 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2716/5299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:06 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 1456 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:07.023607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:07.024241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:07.031712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:07.032209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:07.032650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:07.033808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:07.034354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:07.034960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:07.280421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.289117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-089b83ec-af6b-44bc-970a-56e9160ccdca tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1323 microversion: 2.1 time: 0.973530 Oct 03 14:57:07.295363 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2584/5300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:06 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1323 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:07.300422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0f0cddd8-acc0-40f3-b954-5a7c2e862d09 req-3c9beeea-7ed2-4544-9724-c0e8898c0648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a11c998-2c74-4358-b32c-92fbdfbce5ea", "name": "network-vif-deleted", "tag": "6798f7ca-2f0e-42e5-b996-591e310c16e9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:07.325416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0f0cddd8-acc0-40f3-b954-5a7c2e862d09 req-3c9beeea-7ed2-4544-9724-c0e8898c0648 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:07.331323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0f0cddd8-acc0-40f3-b954-5a7c2e862d09 req-3c9beeea-7ed2-4544-9724-c0e8898c0648 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:07.332063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0f0cddd8-acc0-40f3-b954-5a7c2e862d09 req-3c9beeea-7ed2-4544-9724-c0e8898c0648 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:07.354295 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0f0cddd8-acc0-40f3-b954-5a7c2e862d09 req-3c9beeea-7ed2-4544-9724-c0e8898c0648 service nova] Creating event network-vif-deleted:6798f7ca-2f0e-42e5-b996-591e310c16e9 for instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea on n-h1-781139-2 Oct 03 14:57:07.359804 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0f0cddd8-acc0-40f3-b954-5a7c2e862d09 req-3c9beeea-7ed2-4544-9724-c0e8898c0648 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063000 Oct 03 14:57:07.361097 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2585/5301] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:07.369630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:07.371039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:07.380502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:07.381569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:07.382458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:07.383416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:07.383726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.384478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:07.384992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:07.395486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.414626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.417242 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a1ef746-5f02-454a-ab89-df6df58b1f24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.423487 Oct 03 14:57:07.421415 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2717/5302] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:06 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:07.441595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:07.442653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:07.456705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:07.458422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:07.459874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:07.460793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:07.461453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:07.462050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:07.643255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.656631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.658158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.662299 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43783383-a2f4-4b99-9537-c0d187be762c tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.297699 Oct 03 14:57:07.663150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2586/5303] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:07 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:07.744008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:07.755820 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6447daa6-c320-48f2-99ca-aa15c36c9164 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.332073 Oct 03 14:57:07.761833 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2718/5304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:07 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:08.016500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.017078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.025396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.026106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.026739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.029874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.030578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.031179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.056878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea HTTP/1.1 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3a11c998-2c74-4358-b32c-92fbdfbce5ea'} Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.059767 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.065258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.065258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.065258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.065258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.065258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.065258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.065258 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.068331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.073773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aae347c6-f0c7-4b13-a216-9e29ea621ebf tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 404 len: 111 microversion: 2.1 time: 0.057124 Oct 03 14:57:08.083879 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2587/5305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.089854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.091073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.101977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.103583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.105969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.109139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.110543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.113771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.145847 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea HTTP/1.1 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '3a11c998-2c74-4358-b32c-92fbdfbce5ea'} Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.151048 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.156154 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.160302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.162194 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2d65512-1452-4f70-a660-7feeeacab64f tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 404 len: 111 microversion: 2.1 time: 0.076380 Oct 03 14:57:08.164729 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2719/5306] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:08 2022] DELETE /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.172271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.173177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 3a11c998-2c74-4358-b32c-92fbdfbce5ea] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.185802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.187409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.188780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.191681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.193188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.194698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.215231 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea HTTP/1.1 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3a11c998-2c74-4358-b32c-92fbdfbce5ea'} Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.217276 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.222169 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.222169 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.222169 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.222169 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.222169 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.222169 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. Oct 03 14:57:08.222169 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.226195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 3a11c998-2c74-4358-b32c-92fbdfbce5ea could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.227292 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f16c6a32-f3e8-4162-a419-7726e2c97353 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea" status: 404 len: 111 microversion: 2.1 time: 0.059383 Oct 03 14:57:08.228393 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2588/5307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/3a11c998-2c74-4358-b32c-92fbdfbce5ea => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.238239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.239153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.248354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.248947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.249526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.250312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.250834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.251323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.268875 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd HTTP/1.1 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '16fa2c58-10bb-41ea-98b9-b1d88d631fcd'} Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.270731 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc87b345-52cd-400e-8f8f-0dc2a17f9fa6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 404 len: 111 microversion: 2.1 time: 0.039830 Oct 03 14:57:08.279368 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2720/5308] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:08 2022] DELETE /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.284519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.285336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 16fa2c58-10bb-41ea-98b9-b1d88d631fcd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.292513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.293251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.293710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.294645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.295162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.295781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.299453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:08.318312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.319349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.328458 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd HTTP/1.1 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '16fa2c58-10bb-41ea-98b9-b1d88d631fcd'} Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.331497 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.336493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.336493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.336493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.336493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.336493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.336493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. Oct 03 14:57:08.336493 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.337131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.338149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.338609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.339891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 16fa2c58-10bb-41ea-98b9-b1d88d631fcd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.341068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.341497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.341921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.354675 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c664eb71-4515-44f4-8102-90946f741f19 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd" status: 404 len: 111 microversion: 2.1 time: 0.063672 Oct 03 14:57:08.354675 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2589/5309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/16fa2c58-10bb-41ea-98b9-b1d88d631fcd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.358217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.358864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.369511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.371326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.372129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.373668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.374680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.375598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.408449 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 HTTP/1.1 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '87e6319e-de09-4df3-9695-6a571b44dc00'} Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.411140 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.415533 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.418198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.419625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-39549d09-db5d-4631-89d3-19799129ef57 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 404 len: 111 microversion: 2.1 time: 0.066202 Oct 03 14:57:08.426547 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2590/5310] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:08 2022] DELETE /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.432143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-24f30732-e42c-4b51-be07-c70a3a4cc689 req-de2366b8-a533-428a-857c-f069aaecb3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668a33-e1ac-48be-8c53-82859fb72c73", "tag": "fbbcc889-daaf-41ca-9e77-13e6ab662198"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:08.446281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24f30732-e42c-4b51-be07-c70a3a4cc689 req-de2366b8-a533-428a-857c-f069aaecb3a1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.447266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24f30732-e42c-4b51-be07-c70a3a4cc689 req-de2366b8-a533-428a-857c-f069aaecb3a1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.448276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-24f30732-e42c-4b51-be07-c70a3a4cc689 req-de2366b8-a533-428a-857c-f069aaecb3a1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.462161 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-24f30732-e42c-4b51-be07-c70a3a4cc689 req-de2366b8-a533-428a-857c-f069aaecb3a1 service nova] Creating event network-changed:fbbcc889-daaf-41ca-9e77-13e6ab662198 for instance 71668a33-e1ac-48be-8c53-82859fb72c73 on n-h2-781139-2 Oct 03 14:57:08.468014 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-24f30732-e42c-4b51-be07-c70a3a4cc689 req-de2366b8-a533-428a-857c-f069aaecb3a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039466 Oct 03 14:57:08.469243 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2591/5311] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:08.474514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.477554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 87e6319e-de09-4df3-9695-6a571b44dc00] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.484986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.486083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.486926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.488070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.488825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.489443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.515939 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 HTTP/1.1 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '87e6319e-de09-4df3-9695-6a571b44dc00'} Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.518453 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.523462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.523462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.523462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.523462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.523462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.523462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. Oct 03 14:57:08.523462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.525492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 87e6319e-de09-4df3-9695-6a571b44dc00 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.526577 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c75200d-9636-455d-a0a8-a035ac1cd2a6 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00" status: 404 len: 111 microversion: 2.1 time: 0.056087 Oct 03 14:57:08.527685 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2592/5312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/87e6319e-de09-4df3-9695-6a571b44dc00 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.532944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.533871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.546138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.546973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.547615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.548603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.549375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.549974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.694322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:08.706577 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6434b028-ac91-4542-9800-1b3415cfa337 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1323 microversion: 2.1 time: 0.392787 Oct 03 14:57:08.707353 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2721/5313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:57:08.716749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.719652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.740719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.741564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.742279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.743170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.743805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.744402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.774865 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b HTTP/1.1 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ba9f8245-5349-4f3d-bd11-83b4ac3d717b'} Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:08.780328 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:08.785589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:08.787274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:08.788159 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a189aef3-7f9e-4be5-b0b1-d0b7a53be387 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 404 len: 111 microversion: 2.1 time: 0.079532 Oct 03 14:57:08.791470 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2722/5314] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:08 2022] DELETE /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:08.813155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:08.816127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:08.831397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.833529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.834350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.835473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:08.836298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:08.836900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:08.953649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:08.967317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:08.969030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:08.970800 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a8a86dc1-b39a-47e1-ac1a-34b0bc0021d1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.178055 Oct 03 14:57:08.977992 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2723/5315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:09.004467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:09.007093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:09.028053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.031378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.032078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.035112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.035807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.036626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.116555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:09.127683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:09.129797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:09.131170 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-281a5405-7345-4b4b-88d6-fe954889768d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.602283 Oct 03 14:57:09.143557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2593/5316] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:09.153393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:09.154895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: ba9f8245-5349-4f3d-bd11-83b4ac3d717b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:09.175572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.177790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.178408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.179528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.180778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.181510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.209141 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b HTTP/1.1 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'ba9f8245-5349-4f3d-bd11-83b4ac3d717b'} Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:09.210833 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.217898 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.217898 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:09.217898 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:09.217898 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:09.217898 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:09.217898 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. Oct 03 14:57:09.217898 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.221011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance ba9f8245-5349-4f3d-bd11-83b4ac3d717b could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:09.225454 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-20ceafa5-fe92-4832-816b-9ece6ce9add1 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b" status: 404 len: 111 microversion: 2.1 time: 0.082491 Oct 03 14:57:09.226688 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2594/5317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:09 2022] GET /compute/v2.1/servers/ba9f8245-5349-4f3d-bd11-83b4ac3d717b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:09.238962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-238ee1df-7a05-41bb-93b6-a2f1246ec870 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:09.240396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-238ee1df-7a05-41bb-93b6-a2f1246ec870 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:09.251987 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-238ee1df-7a05-41bb-93b6-a2f1246ec870 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-238ee1df-7a05-41bb-93b6-a2f1246ec870 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf HTTP/1.1 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'e2ba685b-daf7-4814-8275-14c6354f5bbf'} Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:09.254424 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.259794 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.259794 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:09.259794 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:09.259794 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:09.259794 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:09.259794 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.259794 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.262179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-238ee1df-7a05-41bb-93b6-a2f1246ec870 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:09.263294 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-238ee1df-7a05-41bb-93b6-a2f1246ec870 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf" status: 404 len: 111 microversion: 2.1 time: 0.032297 Oct 03 14:57:09.264408 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2595/5318] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:09 2022] DELETE /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:09.273363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01fe4c50-2c51-4003-93a8-cbca40d35b05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:09.274633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01fe4c50-2c51-4003-93a8-cbca40d35b05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: e2ba685b-daf7-4814-8275-14c6354f5bbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:09.285722 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-01fe4c50-2c51-4003-93a8-cbca40d35b05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01fe4c50-2c51-4003-93a8-cbca40d35b05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf HTTP/1.1 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'e2ba685b-daf7-4814-8275-14c6354f5bbf'} Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:09.287882 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01fe4c50-2c51-4003-93a8-cbca40d35b05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance e2ba685b-daf7-4814-8275-14c6354f5bbf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-01fe4c50-2c51-4003-93a8-cbca40d35b05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf" status: 404 len: 111 microversion: 2.1 time: 0.021471 Oct 03 14:57:09.292501 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2596/5319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:09 2022] GET /compute/v2.1/servers/e2ba685b-daf7-4814-8275-14c6354f5bbf => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:57:09.546931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c12fdc23-90a6-4382-ba5d-bb11f79b789f req-ac19bef3-a2ca-4103-a38f-0324dffe3956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccc88d8-616d-4b2d-a989-e12540aa12bc", "tag": "6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:09.587066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c12fdc23-90a6-4382-ba5d-bb11f79b789f req-ac19bef3-a2ca-4103-a38f-0324dffe3956 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.587874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c12fdc23-90a6-4382-ba5d-bb11f79b789f req-ac19bef3-a2ca-4103-a38f-0324dffe3956 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.590127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c12fdc23-90a6-4382-ba5d-bb11f79b789f req-ac19bef3-a2ca-4103-a38f-0324dffe3956 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.617447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:09.629726 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c12fdc23-90a6-4382-ba5d-bb11f79b789f req-ac19bef3-a2ca-4103-a38f-0324dffe3956 service nova] Creating event network-changed:6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa for instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc on n-h2-781139-2 Oct 03 14:57:09.630205 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49147373-4270-4f07-b754-6d480e405096 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.645804 Oct 03 14:57:09.631777 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2724/5320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:08 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:09.638186 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c12fdc23-90a6-4382-ba5d-bb11f79b789f req-ac19bef3-a2ca-4103-a38f-0324dffe3956 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098021 Oct 03 14:57:09.639175 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2597/5321] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:57:09.732087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:09.732706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:09.744835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.746722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.747596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.748665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:09.750093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:09.753075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:09.796120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:10.009057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:10.010062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:10.028270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:10.032737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:10.032850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:10.033708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:10.036662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:10.037302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:10.039083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:10.057004 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81d1b0d0-7977-4ce0-a088-377db04c7cc7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1323 microversion: 2.1 time: 0.327604 Oct 03 14:57:10.058491 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2725/5322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:09 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:10.161489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:10.162483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:10.169151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:10.190614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:10.192002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:10.193957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:10.195621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:10.196450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:10.199641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:10.204190 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da9f9fe8-9cda-4dbd-bec9-1fd9cc7a5339 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.198838 Oct 03 14:57:10.204753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:10.205459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:10.208984 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2598/5323] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:10 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:10.440375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:10.450150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:10.452547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:10.454017 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef1ad955-115f-4593-8e03-6a07068f2f88 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.298203 Oct 03 14:57:10.455017 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2726/5324] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:10 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:10.656644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:10.657762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:10.664339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:10.665039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:10.665987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:10.667609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:10.668584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:10.669813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:11.062717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.079675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:11.081511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:11.086878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a1c1f0e-6fa8-4d66-984a-927c85805546 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.434915 Oct 03 14:57:11.089890 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2599/5325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:10 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:11.092221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:11.092946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:11.093618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:11.094350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:11.094981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:11.095710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:11.234856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:11.235680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:11.249834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:11.250342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:11.250828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:11.251593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:11.252055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:11.252487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:11.500163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.511793 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73b154f2-63a8-43b2-994c-ba408b5e3104 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1323 microversion: 2.1 time: 0.435920 Oct 03 14:57:11.512408 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2727/5326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:11 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:57:11.518134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:11.518840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:11.531749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:11.532461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:11.533495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:11.534499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:11.535114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:11.535718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:11.657125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.673115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.680151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.685178 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c37bbdf7-aa9d-4c4c-b6c1-38b411536924 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.454323 Oct 03 14:57:11.685913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2600/5327] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:11 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:11.884254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.894582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.897006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:11.899483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6610c6ed-2642-4c91-9860-75388bde753c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.385392 Oct 03 14:57:11.901230 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2728/5328] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:11 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:12.117910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:12.119192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:12.130318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:12.131223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:12.131879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:12.132987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:12.133905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:12.134623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:12.341263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:12.352553 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3162d03b-a339-4c92-8cc3-8155d603d751 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.239928 Oct 03 14:57:12.366169 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2601/5329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:12 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:12.541112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:12.542742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:12.578050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:12.580586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:12.581245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:12.582254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:12.582821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:12.583130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:12.712163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:12.713677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:12.727740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:12.729046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:12.735348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:12.737337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:12.740258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:12.741428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:13.039298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:13.051396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:13.052848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:13.055574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-054a78df-7e98-463c-ad8d-f77f43cadf38 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.347363 Oct 03 14:57:13.056158 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2602/5330] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:12 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:13.077020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:13.077905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:13.087870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:13.088896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:13.089544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:13.091923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:13.092622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:13.093251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:13.355296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:13.380673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=28 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:13.426024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:13.445261 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ec85980b-0c2d-4e4b-aa4a-3e6d6c25fb22 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1323 microversion: 2.1 time: 0.911487 Oct 03 14:57:13.449686 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2729/5331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:12 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1323 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:13.492535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:13.493491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:13.493955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:13.504847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:13.506757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:13.508137 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b52bb3a-9cb5-4012-80e3-d0133747adb4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.440708 Oct 03 14:57:13.508889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2603/5332] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:13 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:13.539701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:13.542043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:13.542623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:13.546117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:13.549563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:13.552371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:13.899521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:13.900001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:13.912324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:13.915715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:13.916185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:13.917026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:13.917705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:13.919222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:13.934730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:13.956654 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd HTTP/1.1 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1ce664a9-2425-4660-a623-ed8f73ee21dd'} Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:13.965399 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d030471-5a0e-4665-bcb7-2f7674427a0c tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 404 len: 111 microversion: 2.1 time: 0.074633 Oct 03 14:57:13.971405 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2604/5333] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:13 2022] DELETE /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:14.000488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:14.001180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 1ce664a9-2425-4660-a623-ed8f73ee21dd] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:14.025601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.028035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.029544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.031346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.036741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.037885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.082226 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd HTTP/1.1 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1ce664a9-2425-4660-a623-ed8f73ee21dd'} Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:14.085500 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.091056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.091056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:14.091056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:14.091056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:14.091056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:14.091056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. Oct 03 14:57:14.091056 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.094064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 1ce664a9-2425-4660-a623-ed8f73ee21dd could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:14.098500 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7c279cc-f12d-44df-9727-aa5955454c05 tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd" status: 404 len: 111 microversion: 2.1 time: 0.118036 Oct 03 14:57:14.099864 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2605/5334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:13 2022] GET /compute/v2.1/servers/1ce664a9-2425-4660-a623-ed8f73ee21dd => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:14.114442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:14.115254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:14.135043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:14.141389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.143143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.143862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.144953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.145658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.146329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.149498 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8024b03c-d65c-49e7-ad4c-a032f3299dc1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.690647 Oct 03 14:57:14.151442 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2730/5335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:13 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:14.162675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:14.169214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:14.190071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.193532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.194230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.195206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.202964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.203773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.248544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:14.251970 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f HTTP/1.1 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5c08890a-047d-4f3e-9c31-f0851d7e243f'} Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:14.258260 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.264492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:14.266028 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6794186c-6f3b-4159-8272-436a3d2a951b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 404 len: 111 microversion: 2.1 time: 0.111495 Oct 03 14:57:14.269938 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2731/5336] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:57:14 2022] DELETE /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:14.271500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:14.273531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:14.275241 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3633a2c-abcd-45de-811f-a7cf82ca6a52 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.171599 Oct 03 14:57:14.292967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:14.292967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] [instance: 5c08890a-047d-4f3e-9c31-f0851d7e243f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:14.293400 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2606/5337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:14 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:14.319643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.320163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.320607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.321374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.321825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.322249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.367041 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] HTTP exception thrown: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Request method failure captured: Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f HTTP/1.1 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcRRLHo7_hJMmfURGirRHOQ_wWLYhf474jIuPc2MQEoNGijVhAcuuA0AN7y2Ak_csjruu_sS8VZB5lYHbjZGMpGywD0a4fG1PiYibx5mO8G72XF2RAvXmmih_Boe53dFReUedvH3PSlyxKyixskDV0JYHlAKqptGofC_HuF12IzUV0 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3caf5c9fc7a74ec49663c58ebe29a3eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3caf5c9fc7a74ec49663c58ebe29a3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3caf5c9fc7a74ec49663c58ebe29a3eb Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-562180440 Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3569fcf74b3b4e3d99b0dbcd5465d97d Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-562180440-project Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5c08890a-047d-4f3e-9c31-f0851d7e243f'} Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:14.372574 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] Returning 404 to user: Instance 5c08890a-047d-4f3e-9c31-f0851d7e243f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:14.377954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c30d13f9-9468-405e-959f-72039a43e69b tempest-DeleteServersTestJSON-562180440 tempest-DeleteServersTestJSON-562180440-project] 10.222.0.20 "GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f" status: 404 len: 111 microversion: 2.1 time: 0.102403 Oct 03 14:57:14.388086 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2732/5338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:14 2022] GET /compute/v2.1/servers/5c08890a-047d-4f3e-9c31-f0851d7e243f => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:57:14.477640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:14.478174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:14.489051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.489953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.492731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.493871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.494500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.499247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.536290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:14.537312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:14.550056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.552617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.555287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.556104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.557576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.559511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.572658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:14.802150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:14.817214 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-86fe4226-3662-4be4-a00b-ee8ce58b5ea8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1323 microversion: 2.1 time: 0.343707 Oct 03 14:57:14.819833 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2607/5339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:14 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:14.831923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-94f0c60b-45ce-4394-9e5a-b4fb84f5cba2 req-74df78aa-95e0-47ce-a81c-2f4f4fe2d7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71668a33-e1ac-48be-8c53-82859fb72c73", "name": "network-vif-plugged", "status": "completed", "tag": "fbbcc889-daaf-41ca-9e77-13e6ab662198"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:14.859274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-94f0c60b-45ce-4394-9e5a-b4fb84f5cba2 req-74df78aa-95e0-47ce-a81c-2f4f4fe2d7bd service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:14.862316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-94f0c60b-45ce-4394-9e5a-b4fb84f5cba2 req-74df78aa-95e0-47ce-a81c-2f4f4fe2d7bd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:14.863168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-94f0c60b-45ce-4394-9e5a-b4fb84f5cba2 req-74df78aa-95e0-47ce-a81c-2f4f4fe2d7bd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:14.932698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-94f0c60b-45ce-4394-9e5a-b4fb84f5cba2 req-74df78aa-95e0-47ce-a81c-2f4f4fe2d7bd service nova] Creating event network-vif-plugged:fbbcc889-daaf-41ca-9e77-13e6ab662198 for instance 71668a33-e1ac-48be-8c53-82859fb72c73 on n-h2-781139-2 Oct 03 14:57:14.943055 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-94f0c60b-45ce-4394-9e5a-b4fb84f5cba2 req-74df78aa-95e0-47ce-a81c-2f4f4fe2d7bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121039 Oct 03 14:57:14.945637 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2608/5340] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:15.050648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:15.072131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:15.076844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:15.078380 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2dd41118-a967-41f9-9e08-2e40b6837ba9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.546965 Oct 03 14:57:15.078955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2733/5341] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:14 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:15.176002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:15.177043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:15.197872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:15.199131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:15.199793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:15.200714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:15.201377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:15.202616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:15.308592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:15.309233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:15.316109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:15.321879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:15.322532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:15.323424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:15.324051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:15.324634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:15.528815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:15.550635 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a51f5160-ddb2-4e6a-ba05-372eb29fc76e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.381403 Oct 03 14:57:15.565310 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2609/5342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:15 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:15.608446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:15.621681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:15.627747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:15.629589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d132c8a-66d3-4750-8485-c4a25b3dcf94 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.328099 Oct 03 14:57:15.630670 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2734/5343] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:15 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:15.843179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:15.844183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:15.854611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:15.857838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:15.858535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:15.860667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:15.861884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:15.863113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:16.112201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:16.127890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:16.134744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:16.136205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:16.137411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:16.138692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:16.143355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:16.144757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:16.481641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:16.502043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:16.506689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:16.513227 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5e34be7-0a62-4f74-8236-a756e315393e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1745 microversion: 2.20 time: 0.406599 Oct 03 14:57:16.513886 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2735/5344] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:16 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1745 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:16.575940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:16.576572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:16.592972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:16.593411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:16.600310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:16.601141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:16.602346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:16.603513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:16.915405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:16.926794 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ad69c2e-9877-4d72-8acd-fd6bbdc5c724 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1323 microversion: 2.1 time: 1.088081 Oct 03 14:57:16.935279 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2610/5345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:15 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1323 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:16.941291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:16.943618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:16.955265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:16.961939 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18d6b276-1fcb-41b1-a212-aac8865908a1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.389876 Oct 03 14:57:16.962574 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2736/5346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:16 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:57:16.972381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:16.973840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:16.975233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:16.977190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:16.978623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:16.984085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.037488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-108c5727-c999-4cfc-a4fa-f4a1a5c5f6e1 req-a55f8bbf-f372-4706-ba15-7f1601c01af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccc88d8-616d-4b2d-a989-e12540aa12bc", "name": "network-vif-plugged", "status": "completed", "tag": "6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:17.058369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-108c5727-c999-4cfc-a4fa-f4a1a5c5f6e1 req-a55f8bbf-f372-4706-ba15-7f1601c01af6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.059178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-108c5727-c999-4cfc-a4fa-f4a1a5c5f6e1 req-a55f8bbf-f372-4706-ba15-7f1601c01af6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.059865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-108c5727-c999-4cfc-a4fa-f4a1a5c5f6e1 req-a55f8bbf-f372-4706-ba15-7f1601c01af6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.077534 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-108c5727-c999-4cfc-a4fa-f4a1a5c5f6e1 req-a55f8bbf-f372-4706-ba15-7f1601c01af6 service nova] Creating event network-vif-plugged:6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa for instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc on n-h2-781139-2 Oct 03 14:57:17.087001 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-108c5727-c999-4cfc-a4fa-f4a1a5c5f6e1 req-a55f8bbf-f372-4706-ba15-7f1601c01af6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058380 Oct 03 14:57:17.088191 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2737/5347] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 03 14:57:17.190329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:17.205518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:17.207444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:17.211890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52671123-ec64-4e1a-b11b-4fee6262bc07 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.275058 Oct 03 14:57:17.213065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2611/5348] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:16 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:17.540697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:17.541433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:17.552219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.552885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.553636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.554598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.555280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.556556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.923889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:17.934595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:17.943526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:17.945177 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a6492d5-e337-4d89-852c-581113cd7eb8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.408964 Oct 03 14:57:17.948309 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2738/5349] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:17 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:17.975891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:17.977095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:17.987156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:17.987811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:17.993247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.994002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:17.996456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:17.997765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.999235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:17.999911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.000503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.002755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.003470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.004401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:18.005064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.005653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.335144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:18.350563 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d18eed21-fc5c-4302-9fcc-e934b9338a75 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1366 microversion: 2.1 time: 0.365827 Oct 03 14:57:18.351475 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2739/5350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:17 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:18.361036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:18.362046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:18.372840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:18.373616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.374263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.381089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:18.382280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.383257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.484263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:18.503833 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98c28fb0-8bd1-4533-9131-2a0c89607fa8 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1518 microversion: 2.1 time: 0.532165 Oct 03 14:57:18.505090 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2612/5351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:17 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1518 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:18.531287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:18.534210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:18.546186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:18.550322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.551058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.553763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:18.555113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.557059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.562130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:18.625399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:18.626505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lazy-loading 'flavor' on Instance uuid 71668a33-e1ac-48be-8c53-82859fb72c73 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:57:18.634658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:18.636144 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2acac707-a8c3-4cf0-903c-f0784d113fb4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.283499 Oct 03 14:57:18.638452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:18.652339 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2740/5352] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:18 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:18.794188 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e296f494-980a-4968-953c-19275a881bd3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action" status: 200 len: 32 microversion: 2.1 time: 0.266837 Oct 03 14:57:18.796104 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2613/5353] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:57:18 2022] POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:57:18.806698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:18.808239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:18.829714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:18.830649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.836540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.839213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:18.839901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:18.841863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:18.977578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:18.978324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:19.024419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:19.025041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:19.026776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:19.027720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:19.029343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:19.029793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.196782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.211593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.222759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.224112 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-84179fd5-3ccd-4f32-ad94-901bd98d1187 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 1.251988 Oct 03 14:57:20.229411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2614/5354] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:18 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:20.242322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e1b7694d-a389-4def-bca2-f102c4a20eb2 req-4a7c1ecc-b65f-4f26-8b69-22efebc29c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "name": "network-vif-plugged", "status": "completed", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:20.292773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e1b7694d-a389-4def-bca2-f102c4a20eb2 req-4a7c1ecc-b65f-4f26-8b69-22efebc29c15 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:20.294176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e1b7694d-a389-4def-bca2-f102c4a20eb2 req-4a7c1ecc-b65f-4f26-8b69-22efebc29c15 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:20.298104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.307366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1452c9da-cdfb-4bf3-89bd-263356873545 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 1.506657 Oct 03 14:57:20.308262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e1b7694d-a389-4def-bca2-f102c4a20eb2 req-4a7c1ecc-b65f-4f26-8b69-22efebc29c15 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.321174 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2741/5355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:18 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:20.333987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:20.349575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:20.366426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e1b7694d-a389-4def-bca2-f102c4a20eb2 req-4a7c1ecc-b65f-4f26-8b69-22efebc29c15 service nova] Creating event network-vif-plugged:cfa9cd2b-641c-46a2-88cf-0a0614f33cdb for instance 796f59f0-d25e-440a-8a63-d6cedc50b955 on n-h2-781139-2 Oct 03 14:57:20.386364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:20.386805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:20.387240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.387958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:20.388407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:20.388829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.398552 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e1b7694d-a389-4def-bca2-f102c4a20eb2 req-4a7c1ecc-b65f-4f26-8b69-22efebc29c15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156641 Oct 03 14:57:20.398552 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2615/5356] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:20.418783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:20.419504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:20.447385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:20.447871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:20.448327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.449031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:20.449479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:20.456233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:20.889081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.901294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.915576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.917545 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b46bd83-a073-422a-9ffe-b9bd4fec40fd tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.514828 Oct 03 14:57:20.923780 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2616/5357] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:20 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:20.974615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:20.984373 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6546ddf3-3ca6-4176-89e5-3d1bed6e597b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1556 microversion: 2.1 time: 0.661708 Oct 03 14:57:20.990222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2742/5358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:20 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1556 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:21.019381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:21.020287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:21.034928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.035427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.036126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.036658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.046757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.047479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.256057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:21.257165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:21.268743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.278084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.279483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.281668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.283212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.286429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.458015 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fdeb16d4-d312-47c8-abe9-0d389304d5bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.448802 Oct 03 14:57:21.465638 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2617/5359] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:57:21 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-interface => generated 284 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:21.474405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:21.485704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:21.510490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.510900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.511347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.513464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.513921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.514347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.600717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:21.618688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:21.623222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:21.625710 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-582631b1-b95b-4dc4-8852-afce2033d719 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.373176 Oct 03 14:57:21.642131 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2743/5360] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:21 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:21.950114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:21.956087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:21.970886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.971383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.971822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:21.972652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:21.974960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:21.975468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:22.272229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.284661 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66aef37c-3210-4460-af9f-58e52e38e4aa tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.817243 Oct 03 14:57:22.286678 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2618/5361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:21 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:22.341597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.359906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.362038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.363262 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9c21484-c346-45d3-b9a3-149dbf0bb0e5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.417146 Oct 03 14:57:22.364160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2744/5362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:21 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:22.658148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:22.658974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:22.670810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:22.671656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:22.672269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:22.675630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:22.676280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:22.676892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:22.979197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.988549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.994583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:22.997452 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-acea9017-f5e7-4bb9-8a10-ea80e2088c2b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.344333 Oct 03 14:57:23.002052 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2619/5363] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:22 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:23.313629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:23.314626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:23.330890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:23.335429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:23.336004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:23.337807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:23.340616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:23.342360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:23.396238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:23.397187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:23.400654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:23.421083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:23.424781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:23.425762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:23.426694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:23.427314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:23.429155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:23.721856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:23.741488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:23.749488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:23.757521 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f1db476d-1b60-4cf9-ba43-d0b142be89c4 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.366832 Oct 03 14:57:23.806358 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2620/5364] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:23 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:23.869811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:23.879501 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc59b530-7e6c-47a8-8a4c-1bb9432f9033 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.570041 Oct 03 14:57:23.880111 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2745/5365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:23 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:24.033408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:24.035890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:24.054066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.055280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.056848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:24.059111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.059833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.060955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:24.720441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:24.734981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:24.736547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:24.737768 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c326b33c-2106-404d-b2df-1f23ad06376f tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.709489 Oct 03 14:57:24.738376 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2621/5366] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:24 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:24.796138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:24.796746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:24.806248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.811938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.812687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:24.818856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.819501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.820116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:24.906141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:24.906779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:24.914669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.915082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.915513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:24.922391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:24.929159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:24.930184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:25.030373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:25.045448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:25.047139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:25.048908 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-245b9c21-6693-4b37-9cb7-abd8714b1f00 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.256658 Oct 03 14:57:25.065907 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2746/5367] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:24 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:25.496687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:25.517908 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5604b93-0d80-46af-9c96-004e4d1a10db tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.616094 Oct 03 14:57:25.520749 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2622/5368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:24 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:57:25.767005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:25.767627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:25.776772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:25.777318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:25.779839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:25.783213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:25.784966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:25.787545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:26.081641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:26.083218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:26.102554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:26.104894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:26.106192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:26.112492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:26.116340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:26.117895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:26.292775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:26.308367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:26.316328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:26.317952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:26.319198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fcf4e2f-2b2e-46fc-964f-b1f7ab350407 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.557749 Oct 03 14:57:26.325262 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2747/5369] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:25 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:26.330439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d5fa8e81-0cbc-43f3-af60-e3e3fd18a200 req-6608cc5c-8d8f-457b-922b-78a27a6156af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccc88d8-616d-4b2d-a989-e12540aa12bc", "tag": "6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:26.348236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:26.355533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:26.362522 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d75bd1a-5bba-4ed4-b995-570ef4cfdbc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.288823 Oct 03 14:57:26.364289 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2623/5370] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:26 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:26.378290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d5fa8e81-0cbc-43f3-af60-e3e3fd18a200 req-6608cc5c-8d8f-457b-922b-78a27a6156af service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:26.378801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d5fa8e81-0cbc-43f3-af60-e3e3fd18a200 req-6608cc5c-8d8f-457b-922b-78a27a6156af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:26.379247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d5fa8e81-0cbc-43f3-af60-e3e3fd18a200 req-6608cc5c-8d8f-457b-922b-78a27a6156af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:26.417987 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d5fa8e81-0cbc-43f3-af60-e3e3fd18a200 req-6608cc5c-8d8f-457b-922b-78a27a6156af service nova] Creating event network-changed:6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa for instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc on n-h2-781139-2 Oct 03 14:57:26.443500 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d5fa8e81-0cbc-43f3-af60-e3e3fd18a200 req-6608cc5c-8d8f-457b-922b-78a27a6156af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116673 Oct 03 14:57:26.444653 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2748/5371] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:26.546563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:26.548108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:26.565069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:26.566147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:26.566786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:26.567711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:26.568468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:26.569110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:27.236996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.247844 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5412cc9e-7f5a-4573-9d50-6618bf063cdc tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.705472 Oct 03 14:57:27.257708 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2624/5372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:26 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:27.350090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:27.350954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:27.367268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:27.367763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:27.368205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:27.368954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:27.369399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:27.369824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:27.399792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:27.400424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:27.422301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:27.422981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:27.429270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:27.430053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:27.430542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:27.430977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:27.620896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.634269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.638563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.642557 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1eab9331-80a5-492e-881d-b9d32aa47cc8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.248486 Oct 03 14:57:27.654373 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2625/5373] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:27 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:27.858943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.883530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.889501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:27.896910 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de2c2b5f-b2fe-40d2-8a8c-7fdaaf1a31ff tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.551002 Oct 03 14:57:27.899025 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2749/5374] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:27 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:28.279675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:28.284861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:28.305677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.310192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.312678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.313590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.319909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.320471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.683828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:28.684445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:28.697301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.697814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.698243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.698943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.702892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.704283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.868513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:28.887556 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66146b8f-7da3-4175-84d5-153a2f5d8eec tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.610956 Oct 03 14:57:28.892174 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2626/5375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:28 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:28.930644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:28.931448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:28.940319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.944109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.944786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.945655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:28.947584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:28.948111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:28.979502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:28.993928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:28.995835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:29.002177 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2929cb6-77e7-4732-a930-4acf074ce93a tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.317394 Oct 03 14:57:29.004026 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2750/5376] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:28 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:29.250736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:29.273042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:29.307815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:29.318310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0b6634ca-aae4-4da1-8010-8281bd69cf00 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.392763 Oct 03 14:57:29.318875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2627/5377] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:28 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:29.912384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:29.913010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:29.929916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:29.930405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:29.933940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:29.934696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:29.935152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:29.935622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:29.938865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:30.033990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:30.034917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:30.049884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:30.050677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:30.051491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:30.052401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:30.066146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:30.067627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:30.252967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.298469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.315859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.345634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ca86323f-48ba-4a29-9fbb-7d8bf8255993 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1366 microversion: 2.47 time: 0.314201 Oct 03 14:57:30.366346 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2628/5378] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:30 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:30.375377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:30.376342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:30.383474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:30.384230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:30.384883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:30.385834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:30.386721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:30.387372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:30.414184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:30.464128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.476709 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b74e11f2-04d4-4744-885b-571fccc5cf8a tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.568289 Oct 03 14:57:30.486863 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2751/5379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:29 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:30.637695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.653907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.655967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:30.669891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fce2b44-50f4-416f-bfae-0ecc1ff30610 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.301881 Oct 03 14:57:30.672206 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2629/5380] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:30 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:31.380580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:31.382144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:31.396489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.400950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.401721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:31.402707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.404640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.405541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:31.510172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:31.512423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:31.536164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.539067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.543109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:31.544164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.544854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.546705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:31.622397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:31.637777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:31.645734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:31.653914 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7aec08f-e764-43d0-bbc2-afe6a0e41393 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1372 microversion: 2.47 time: 0.275810 Oct 03 14:57:31.674065 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2752/5381] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:31 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:31.718265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:31.725339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:31.753648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.777602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.778237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:31.782267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:31.783076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:31.783929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:32.096969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:32.123045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:32.131374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:32.133162 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d804be0-4f6f-40b9-a88b-03ae1bb012fe tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.427271 Oct 03 14:57:32.139067 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2753/5382] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:31 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:32.218258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:32.248655 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e22dbe53-0183-4a50-bf00-b8d3209b803b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.741549 Oct 03 14:57:32.276502 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2630/5383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:31 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:32.705257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:32.706899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:32.765590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:32.769072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:32.771662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:32.779258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:32.788435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:32.790632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.166870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:33.167511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:33.177052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.177446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.177875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.192191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.192741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.193235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.689737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.699498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.705986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.711848 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a314af58-5d63-48cd-949c-1bc91a70e3d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.548865 Oct 03 14:57:33.725257 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2631/5384] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:33 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:33.735758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:33.735758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:33.748050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.748551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.749025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.749747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:33.750196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:33.750682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:33.932213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.947287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.949160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:33.950933 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6166ec68-c239-404c-baf3-4908dbb8e774 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1372 microversion: 2.47 time: 1.266545 Oct 03 14:57:33.952066 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2754/5385] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:32 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1372 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:34.747373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:34.748084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:34.766581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:34.769203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:34.771884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:34.774348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:34.776366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:34.779243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:35.123478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.139099 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-011ab725-e8ce-4a1d-a29a-133d988b28d2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 1.420938 Oct 03 14:57:35.142662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2632/5386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:33 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:35.148024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:35.148858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:35.182985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:35.187295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:35.188340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:35.189390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:35.190114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:35.191017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:35.341855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.359728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.363540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.368352 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e878583d-7049-4024-a269-df7956348243 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1372 microversion: 2.47 time: 0.224339 Oct 03 14:57:35.371077 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2633/5387] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:35 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:35.868549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.905558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.916157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:35.926041 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-703817d6-6dad-416a-9744-b64fd3a376d2 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 1.186270 Oct 03 14:57:35.935507 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2755/5388] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:34 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:36.170164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:36.172210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:36.199263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.199771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.200211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.207749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.208613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.214508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.406758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:36.407815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:36.410241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=84 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:36.427729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.428229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.428662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.429411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.429861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.430426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.591569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:36.616674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:36.629680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:36.651054 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1387d5e1-7035-4eaa-a052-8aabb8cc42c7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1357 microversion: 2.47 time: 0.231647 Oct 03 14:57:36.655866 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2756/5389] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:36 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:36.685163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:36.697161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:36.701029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Searching by: {'deleted': False, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442'} {{(pid=128869) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 14:57:36.715113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.715600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.716032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.716754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.719972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.720653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.878610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:36.901294 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e6ec785-2323-4cd9-9118-ba003765a96f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.732540 Oct 03 14:57:36.934535 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2634/5390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:36 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:36.962873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:36.966580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:36.976656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.983729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.984406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:36.985455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:36.986076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:36.987130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.053453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.multi_cell_list [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128869) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 14:57:37.197727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:37.210523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.211020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.211469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.241726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:37.245584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:37.341216 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59827e75-301a-4958-b6de-41826e65e6a5 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.660352 Oct 03 14:57:37.342796 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2757/5391] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 3 14:57:36 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:37.367441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:37.376202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:37.379583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:37.393588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:37.396436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.396436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.396958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.397666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.398118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.398538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.401884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:37.403129 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52ec546d-63c3-43b1-836b-54796576ead8 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.444206 Oct 03 14:57:37.412948 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2635/5392] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:36 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:37.440840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:57:37.616563 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2df01714-a8ae-41ed-b629-1e9cf8858b81 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 204 len: 0 microversion: 2.47 time: 0.245677 Oct 03 14:57:37.618148 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2758/5393] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:57:37 2022] DELETE /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:57:37.627698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:37.628441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:37.641925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.644461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.645139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.648408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.649828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.650473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.931881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:37.932836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:37.977761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.979091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.982390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:37.985598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:37.987391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:37.991035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:38.353189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.364242 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-168dd55a-d173-4f9e-b980-62cfb3890e34 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.437394 Oct 03 14:57:38.382988 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2759/5394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:37 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:38.441815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:38.442998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:38.456015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:38.459066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:38.462204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:38.463926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:38.465454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:38.466169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:38.558495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.585555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.592556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.595965 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d9eae10c-2059-45e1-a647-781499c5abc1 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1363 microversion: 2.47 time: 0.971851 Oct 03 14:57:38.611113 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2636/5395] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:37 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1363 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:38.734202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.744700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.746565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:38.747979 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b41fc3b6-4000-4ddf-b470-0701ec29441e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.312213 Oct 03 14:57:38.749232 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2760/5396] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:38 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:39.247036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45a4bdb4-51f8-4586-99d2-9d9661e2aaab", "device": "/dev/sdb"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:39.250181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:39.272017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:39.273167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:39.273841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:39.274840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:39.275400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:39.275926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:39.401001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:39.404910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:39.437690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:39.443893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:39.445182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:39.448098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:39.448664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:39.452290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:39.698485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:39.711904 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-327e2664-4b05-47b2-bb1a-a1a6e97b0c8b tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 0.320545 Oct 03 14:57:39.753439 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2761/5397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:39 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:39.784900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:39.785567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:39.803859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:39.809564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:39.810317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:39.811297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:39.812194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:39.813386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:39.995242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:40.005583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:40.007253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:40.016857 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a95e2432-8362-4fcd-9458-ad6bf6a0e6e7 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1363 microversion: 2.47 time: 0.254001 Oct 03 14:57:40.018094 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2762/5398] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:39 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:40.023549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:40.025789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:40.044401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:40.045447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:40.046310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:40.047174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:40.047751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:40.048282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:40.349060 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58356484-939b-4a39-8c6c-7454774b7aad tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "POST /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.107452 Oct 03 14:57:40.350342 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2637/5399] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:57:39 2022] POST /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263/os-volume_attachments => generated 194 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:40.400389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:40.425374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:40.429266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:40.432222 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9903e721-c4d7-41bf-bc10-fa42c1004ba7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.412203 Oct 03 14:57:40.433071 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2763/5400] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:40 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:40.753967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:40.754867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:40.778070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:40.779346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:40.780023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:40.780988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:40.781679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:40.782302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:41.053294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:41.053930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:41.104022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:41.104592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:41.112384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:41.113558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:41.116895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:41.117897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:41.207114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:41.210811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:41.211263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:41.211737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lazy-loading 'fault' on Instance uuid 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:57:41.336523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:41.357014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:41.363196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:41.369714 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8c863e7-ce00-4660-8f04-9d0156c18ba3 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 200 len: 1368 microversion: 2.47 time: 0.323379 Oct 03 14:57:41.382994 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2764/5401] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:41 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:41.461344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:41.462031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:41.477940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:41.480322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:41.481616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:41.482643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:41.483255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:41.483833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:41.517785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:41.754521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:41.772577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:41.775567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:41.788008 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fbaf76ef-e45a-4bbe-ae6b-6c5838865a04 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.331644 Oct 03 14:57:41.790397 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2765/5402] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:41 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:42.053517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:42.085445 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-382734f4-3677-4ee9-bbcf-afcb9db3cdb2 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1524 microversion: 2.1 time: 1.335691 Oct 03 14:57:42.086513 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2638/5403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:40 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1524 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:42.403343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:42.403985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:42.430835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.431506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.431956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.436037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.437827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.438933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.557130 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] HTTP exception thrown: Instance 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec could not be found. Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Request method failure captured: Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec HTTP/1.1 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvg0xOvahef8zViYbs55XI_-fUySYs7wM_RmeND9BZ7wNPlou-a5w3U2HxCad5k8QcrSydAYLn8_cg5ytUxjgN_FFPtp_ijhtEAqtDXBoTGzekUQhhuyEMQdkR2YGy84SUaTQ-lxU9eTUzpEzDEjQog7q0lpdnMkmmznorGwkgJFwls Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.47 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 4b62bccdf1b5457fa1aecffbb3ba4442 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerShowV247Test-659846061 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b62bccdf1b5457fa1aecffbb3ba4442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b62bccdf1b5457fa1aecffbb3ba4442", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b62bccdf1b5457fa1aecffbb3ba4442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b62bccdf1b5457fa1aecffbb3ba4442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerShowV247Test-659846061 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 4b62bccdf1b5457fa1aecffbb3ba4442 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerShowV247Test-659846061 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerShowV247Test-659846061-project Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9f22a41bc02f455eb9da25e133437d52 Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerShowV247Test-659846061-project Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec could not be found. Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '96d7c95c-c952-4e23-b91a-abcdc4fdd2ec'} Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec could not be found. Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec could not be found. Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:42.565978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:42.571525 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:42.571525 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:42.571525 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:42.571525 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:42.571525 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:42.571525 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec could not be found. Oct 03 14:57:42.571525 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:42.572842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Returning 404 to user: Instance 96d7c95c-c952-4e23-b91a-abcdc4fdd2ec could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:42.583176 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d03f138b-f156-4638-be3c-8f5160d8b984 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec" status: 404 len: 111 microversion: 2.47 time: 0.186619 Oct 03 14:57:42.587927 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2766/5404] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:42 2022] GET /compute/v2.1/servers/96d7c95c-c952-4e23-b91a-abcdc4fdd2ec => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:57:42.597423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:42.597929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: eae16611-74b5-4af5-a185-c406999d08b9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:42.624978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.629521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.632702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.633637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.637478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.637940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.771142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: eae16611-74b5-4af5-a185-c406999d08b9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:57:42.830649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:42.831275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:42.872193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.873086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.877223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.878880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.882642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.883373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.960623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-997565ac-3d13-45ea-aa1c-b50f3bafac98 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9" status: 204 len: 0 microversion: 2.47 time: 0.368014 Oct 03 14:57:42.969831 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2639/5405] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:57:42 2022] DELETE /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:57:42.980177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:42.981866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: eae16611-74b5-4af5-a185-c406999d08b9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:42.992852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.993664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.994291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:42.996678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:42.997797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:42.998389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.283094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:43.298654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:43.300894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:43.302998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-de56ecfe-888a-40d1-b2bb-4327970f88c7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.487621 Oct 03 14:57:43.304084 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2767/5406] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:42 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:43.437337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:43.470293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:43.478319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:43.480703 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5b2d2c39-e5a1-4808-b840-0a4bb6706280 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9" status: 200 len: 1362 microversion: 2.47 time: 0.508250 Oct 03 14:57:43.483347 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2640/5407] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:42 2022] GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9 => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:43.527728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:43.528785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:43.542700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:43.543681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:43.544659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.547412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:43.548438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:43.549306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:43.625872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-192602421", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:43.752123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] validate_networks() for [('7268de7c-f19f-4160-aa55-7c106c38d82f', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:57:44.049038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:44.057873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bcbc13ee-b7cf-4429-a8f6-950850dbb7a5 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1504 microversion: 2.1 time: 0.562126 Oct 03 14:57:44.061540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2641/5408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:43 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:44.089516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f76fd7fc-5f91-4279-b3ba-3738f93c8922 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'create', calling method: .version_select at 0x7fb2306971f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-932229691", "description": "tempest-description-2025232971"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:44.499278 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f76fd7fc-5f91-4279-b3ba-3738f93c8922 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.413703 Oct 03 14:57:44.500458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2642/5409] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 3 14:57:44 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:57:44.514495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:44.515315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:44.539235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:44.540250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:44.541964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:44.542789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:44.554448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:44.555047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:44.826644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:44.841841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:44.847788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:44.849496 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4abc3365-62ea-497b-8859-ecb567194b59 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1740 microversion: 2.20 time: 0.339648 Oct 03 14:57:44.851404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2643/5410] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:44 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:44.857376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-932229691"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:44.865375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:44.878430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:44.881529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:44.882264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:44.886257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:44.887038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:44.887711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:44.898121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:45.195967 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.network.security_group_api [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Adding security group 1095cdbd-f787-48f4-bef7-fb054b2b9881 to port fbbcc889-daaf-41ca-9e77-13e6ab662198 Oct 03 14:57:45.225692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:57:45.226734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:57:45.227436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:57:45.228126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:57:45.228899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:57:45.243370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.246260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.246984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:45.248001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.248708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.249396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:45.276410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Getting quotas for project 592cd90df88f49d1957f2c624475bc5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:57:45.285990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Getting quotas for user 1594a3b392ec41aba2db7be639531f15 and project 592cd90df88f49d1957f2c624475bc5c. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:57:45.304291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:57:45.307269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:57:45.375364 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4128d027-94d5-40cf-9341-f09f42ba43d8 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069362 Oct 03 14:57:45.377286 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2768/5411] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:57:45.383993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:45.384904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: eae16611-74b5-4af5-a185-c406999d08b9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:45.394713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.395607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.397840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:45.399625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.400324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.401298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:45.497592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:45.516671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:45.531921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f22a41bc02f455eb9da25e133437d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b62bccdf1b5457fa1aecffbb3ba4442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:45.534591 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2edb6761-52ac-4fb0-9fbe-a4d7ee973ce8 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9" status: 200 len: 1362 microversion: 2.47 time: 0.156036 Oct 03 14:57:45.547601 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2769/5412] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:45 2022] GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:45.558366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b13e71b-fb27-44aa-aff5-81b30d12676a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:45.559094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b13e71b-fb27-44aa-aff5-81b30d12676a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:45.659551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b13e71b-fb27-44aa-aff5-81b30d12676a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:45.672340 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b13e71b-fb27-44aa-aff5-81b30d12676a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1223 microversion: 2.1 time: 0.123514 Oct 03 14:57:45.673466 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2770/5413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:45 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:45.885102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:45.885863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:45.921453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.923154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.923833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:45.924820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:45.925588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:45.929149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:46.462468 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25ce0014-1410-40ed-a1cb-777564d2b69f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action" status: 202 len: 0 microversion: 2.1 time: 1.608757 Oct 03 14:57:46.463887 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2644/5414] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:57:44 2022] POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:57:46.474697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-932229691"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:46.475750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:46.501724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:46.504947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:46.505820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:46.510339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:46.512267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:46.513386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.073668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:47.087663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:47.095929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:47.098967 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3db52c37-9e1d-4f74-8d7c-450560a6eb32 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1722 microversion: 2.20 time: 1.216977 Oct 03 14:57:47.101443 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2771/5415] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:45 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1722 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:47.130856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8bdfb00d-140c-4d88-8bdd-2ec8ff0f02f1 req-b4180ecc-adbc-4537-bb25-7bdfbf6875c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668a33-e1ac-48be-8c53-82859fb72c73", "tag": "fbbcc889-daaf-41ca-9e77-13e6ab662198"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:47.147111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8bdfb00d-140c-4d88-8bdd-2ec8ff0f02f1 req-b4180ecc-adbc-4537-bb25-7bdfbf6875c7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:47.147900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8bdfb00d-140c-4d88-8bdd-2ec8ff0f02f1 req-b4180ecc-adbc-4537-bb25-7bdfbf6875c7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:47.148503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8bdfb00d-140c-4d88-8bdd-2ec8ff0f02f1 req-b4180ecc-adbc-4537-bb25-7bdfbf6875c7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.163849 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8bdfb00d-140c-4d88-8bdd-2ec8ff0f02f1 req-b4180ecc-adbc-4537-bb25-7bdfbf6875c7 service nova] Creating event network-changed:fbbcc889-daaf-41ca-9e77-13e6ab662198 for instance 71668a33-e1ac-48be-8c53-82859fb72c73 on n-h2-781139-2 Oct 03 14:57:47.171419 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8bdfb00d-140c-4d88-8bdd-2ec8ff0f02f1 req-b4180ecc-adbc-4537-bb25-7bdfbf6875c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067267 Oct 03 14:57:47.173112 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2772/5416] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:47.194565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:47.196559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] [instance: eae16611-74b5-4af5-a185-c406999d08b9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:47.216391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:47.216872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:47.217531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.218399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:47.219071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:47.219665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.246141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] HTTP exception thrown: Instance eae16611-74b5-4af5-a185-c406999d08b9 could not be found. Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Request method failure captured: Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9 HTTP/1.1 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvg0xOvahef8zViYbs55XI_-fUySYs7wM_RmeND9BZ7wNPlou-a5w3U2HxCad5k8QcrSydAYLn8_cg5ytUxjgN_FFPtp_ijhtEAqtDXBoTGzekUQhhuyEMQdkR2YGy84SUaTQ-lxU9eTUzpEzDEjQog7q0lpdnMkmmznorGwkgJFwls Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.47 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 4b62bccdf1b5457fa1aecffbb3ba4442 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerShowV247Test-659846061 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b62bccdf1b5457fa1aecffbb3ba4442"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b62bccdf1b5457fa1aecffbb3ba4442", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b62bccdf1b5457fa1aecffbb3ba4442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b62bccdf1b5457fa1aecffbb3ba4442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerShowV247Test-659846061 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 4b62bccdf1b5457fa1aecffbb3ba4442 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerShowV247Test-659846061 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerShowV247Test-659846061-project Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9f22a41bc02f455eb9da25e133437d52 Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerShowV247Test-659846061-project Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance eae16611-74b5-4af5-a185-c406999d08b9 could not be found. Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'eae16611-74b5-4af5-a185-c406999d08b9'} Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae16611-74b5-4af5-a185-c406999d08b9 could not be found. Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae16611-74b5-4af5-a185-c406999d08b9 could not be found. Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:57:47.259141 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.264351 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:57:47.264351 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:57:47.264351 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:57:47.264351 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:57:47.264351 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:57:47.264351 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae16611-74b5-4af5-a185-c406999d08b9 could not be found. Oct 03 14:57:47.264351 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:57:47.266193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] Returning 404 to user: Instance eae16611-74b5-4af5-a185-c406999d08b9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:57:47.267478 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72b81330-d432-4fa8-a0fa-3262af5a53d9 tempest-ServerShowV247Test-659846061 tempest-ServerShowV247Test-659846061-project] 10.222.0.20 "GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9" status: 404 len: 111 microversion: 2.47 time: 0.093075 Oct 03 14:57:47.268204 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2773/5417] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:47 2022] GET /compute/v2.1/servers/eae16611-74b5-4af5-a185-c406999d08b9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:57:47.297362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:47.299988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:47.336621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:47.339722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:47.342795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.348296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:47.351817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:47.354992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:47.605746 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.network.security_group_api [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Removing security group 1095cdbd-f787-48f4-bef7-fb054b2b9881 from port fbbcc889-daaf-41ca-9e77-13e6ab662198 Oct 03 14:57:47.759732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:47.769823 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1ac4fcb-96d0-440f-b3b2-c86a7972c36f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1275 microversion: 2.1 time: 0.500390 Oct 03 14:57:47.781941 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2774/5418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:47 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1275 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:48.131446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:48.132033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:48.145443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.150158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.150705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:48.151421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.154089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.154585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:48.876474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:48.906366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:48.908708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:48.916995 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8782ca28-f3ef-489c-b9dd-b7518e22303b tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1722 microversion: 2.20 time: 0.783374 Oct 03 14:57:48.933176 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2775/5419] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:48 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1722 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:48.940819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:48.941715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:48.966002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.973494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.974142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:48.975061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:48.975748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:48.979698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:49.040259 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eceb575a-241d-4c6d-8cfb-33b4a60eb0e3 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action" status: 202 len: 0 microversion: 2.1 time: 2.571698 Oct 03 14:57:49.042310 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2645/5420] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:57:46 2022] POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action => generated 0 bytes in 2574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:57:49.051612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec10e720-c55b-42b1-88d6-dca1f64bb16f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'create', calling method: .version_select at 0x7fb22b55a820>, body: {"pool": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:49.229504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:49.241489 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-977e1581-3a26-4df8-a825-04804f337b11 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1281 microversion: 2.1 time: 0.306831 Oct 03 14:57:49.252988 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2776/5421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:48 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1281 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:49.283442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ee0b9d04-b311-4dea-94e4-d39c16f649d6 req-79054260-a58e-4682-967f-3acd523f042f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668a33-e1ac-48be-8c53-82859fb72c73", "tag": "fbbcc889-daaf-41ca-9e77-13e6ab662198"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:49.318893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ee0b9d04-b311-4dea-94e4-d39c16f649d6 req-79054260-a58e-4682-967f-3acd523f042f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:49.319364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ee0b9d04-b311-4dea-94e4-d39c16f649d6 req-79054260-a58e-4682-967f-3acd523f042f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:49.319828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ee0b9d04-b311-4dea-94e4-d39c16f649d6 req-79054260-a58e-4682-967f-3acd523f042f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:49.348966 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ee0b9d04-b311-4dea-94e4-d39c16f649d6 req-79054260-a58e-4682-967f-3acd523f042f service nova] Creating event network-changed:fbbcc889-daaf-41ca-9e77-13e6ab662198 for instance 71668a33-e1ac-48be-8c53-82859fb72c73 on n-h2-781139-2 Oct 03 14:57:49.362935 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ee0b9d04-b311-4dea-94e4-d39c16f649d6 req-79054260-a58e-4682-967f-3acd523f042f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083531 Oct 03 14:57:49.363792 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2777/5422] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:49.948608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:49.949622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:49.970423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:49.971925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:49.973119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:49.974525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:49.975541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:49.976880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:50.673854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:50.683626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:50.688720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:50.694174 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ca3c970-1109-47e2-b6bd-871f2cade136 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1722 microversion: 2.20 time: 0.750562 Oct 03 14:57:50.710051 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2778/5423] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:49 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1722 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:50.729583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:50.734597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:50.750760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:50.751532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:50.754375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:50.755642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:50.759328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:50.760161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:52.284284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:52.302605 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6a55042-cc93-4793-9627-2d2c302fa2ee tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1323 microversion: 2.1 time: 1.586676 Oct 03 14:57:52.305446 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2779/5424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:50 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1323 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:52.328252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f73c4951-115e-4540-900a-37e4536571aa req-74786db3-9899-4b45-88dd-cf942b11af58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "name": "network-vif-unplugged", "status": "completed", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:52.356201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f73c4951-115e-4540-900a-37e4536571aa req-74786db3-9899-4b45-88dd-cf942b11af58 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:52.356704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f73c4951-115e-4540-900a-37e4536571aa req-74786db3-9899-4b45-88dd-cf942b11af58 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:52.365416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f73c4951-115e-4540-900a-37e4536571aa req-74786db3-9899-4b45-88dd-cf942b11af58 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:52.417708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.compute.server_external_events [req-f73c4951-115e-4540-900a-37e4536571aa req-74786db3-9899-4b45-88dd-cf942b11af58 service nova] Unable to find a host for instance 796f59f0-d25e-440a-8a63-d6cedc50b955. Dropping event network-vif-unplugged {{(pid=128869) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 14:57:52.425080 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f73c4951-115e-4540-900a-37e4536571aa req-74786db3-9899-4b45-88dd-cf942b11af58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.114761 Oct 03 14:57:52.426664 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2780/5425] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 120 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 14:57:52.435316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:52.438353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:52.475590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:52.479258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:52.479755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:52.483698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:52.488122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:52.489534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:53.239433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:53.257075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:53.259123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:53.264627 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2f05f45-de72-4b5f-aa62-d31ce123b034 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1665 microversion: 2.20 time: 0.836900 Oct 03 14:57:53.278128 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2781/5426] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:52 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1665 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:53.298601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76cbda7d-8852-43dd-9d2b-1b14c8845d70"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:53.302431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:53.310052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:53.310947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:53.311555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:53.312827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:53.313890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:53.314504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:53.871192 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-478469df-9456-4145-92e1-1afa90717860 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.578961 Oct 03 14:57:53.874527 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2782/5427] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 3 14:57:53 2022] POST /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-volume_attachments => generated 188 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 14:57:53.889078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:53.892644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:53.917609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:53.927882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:53.930483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:53.931504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:53.932189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:53.933199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.564678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:54.581200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f35a25f8-99ac-4b3d-bc2e-ecc6e0c254e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1323 microversion: 2.1 time: 0.704349 Oct 03 14:57:54.617388 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2783/5428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:53 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1323 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:54.628964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3edabeb7-a6b1-43e1-bbfe-57ffb95324d9 req-9188a8c1-dfc5-4673-9b38-e9b2f1f4a69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab3bd64-e0cf-44a6-b10c-5e50a18858d5", "tag": "f65c9ebc-2f23-4c55-9768-3f7ec92e552d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:54.633773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec10e720-c55b-42b1-88d6-dca1f64bb16f tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.586596 Oct 03 14:57:54.634759 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2646/5429] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 3 14:57:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:57:54.639801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:54.640292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:54.644875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:54.661370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:54.662898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:54.664114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.666543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:54.667342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:54.667956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.676408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3edabeb7-a6b1-43e1-bbfe-57ffb95324d9 req-9188a8c1-dfc5-4673-9b38-e9b2f1f4a69c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:54.677224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3edabeb7-a6b1-43e1-bbfe-57ffb95324d9 req-9188a8c1-dfc5-4673-9b38-e9b2f1f4a69c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:54.679473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3edabeb7-a6b1-43e1-bbfe-57ffb95324d9 req-9188a8c1-dfc5-4673-9b38-e9b2f1f4a69c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.731281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:54.737356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3edabeb7-a6b1-43e1-bbfe-57ffb95324d9 req-9188a8c1-dfc5-4673-9b38-e9b2f1f4a69c service nova] Creating event network-changed:f65c9ebc-2f23-4c55-9768-3f7ec92e552d for instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 on n-h1-781139-2 Oct 03 14:57:54.758575 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3edabeb7-a6b1-43e1-bbfe-57ffb95324d9 req-9188a8c1-dfc5-4673-9b38-e9b2f1f4a69c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136818 Oct 03 14:57:54.760747 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2784/5430] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:54.779948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.203"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:54.807930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:54.819078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:54.819843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:54.820530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.821748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:54.822436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:54.823088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:54.873379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "refresh_cache-71668a33-e1ac-48be-8c53-82859fb72c73" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:57:54.874023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquired lock "refresh_cache-71668a33-e1ac-48be-8c53-82859fb72c73" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:57:55.172655 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dbd10e28-b67a-48e4-a90e-86edbeca8a67 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-volume_attachments/76cbda7d-8852-43dd-9d2b-1b14c8845d70" status: 202 len: 0 microversion: 2.20 time: 0.536635 Oct 03 14:57:55.193944 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2647/5431] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 3 14:57:54 2022] DELETE /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-volume_attachments/76cbda7d-8852-43dd-9d2b-1b14c8845d70 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:57:55.264785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:55.304731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:55.307313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:55.333528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:55.334389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:55.335272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:55.336152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:55.336750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:55.339056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:55.416258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128868) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 14:57:55.539377 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c82e07a6-55d1-4a60-bb76-109f0a050e53 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "POST /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/action" status: 202 len: 0 microversion: 2.20 time: 0.239497 Oct 03 14:57:55.543699 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2648/5432] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 3 14:57:55 2022] POST /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:57:55.552077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:55.553971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:55.566731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:55.567677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:55.568383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:55.575376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:55.578730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:55.579585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:55.666290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:57:55.834129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:55.846619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:55.848603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:55.851077 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ddb7eab-e4e8-4e70-a213-8575c6ae7372 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1673 microversion: 2.20 time: 0.305440 Oct 03 14:57:55.851833 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2649/5433] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:55 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1673 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:55.865079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:55.866059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:55.885206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:55.886648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:55.892686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:55.894302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:55.895262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:55.898283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:56.185679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:56.195871 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29aaa395-b9aa-4032-9de9-725e79c35038 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1323 microversion: 2.1 time: 0.342551 Oct 03 14:57:56.196980 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2650/5434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:55 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:56.880071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:56.880768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:56.900241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:56.900796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:56.901280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:56.902022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:56.902470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:56.902893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:57.288818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:57.309922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:57.312391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:57.314159 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f7a4b2a-e5cd-4072-b1b2-8eb61de92de9 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1673 microversion: 2.20 time: 0.438403 Oct 03 14:57:57.315350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2651/5435] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:56 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1673 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:57:57.320541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:57.321595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:57.329223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:57.330499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:57.331240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:57.332909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:57.333624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:57.334503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:57.432301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:57:58.250003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:58.265887 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4301408-4722-4bdd-b732-fb0f839e8f00 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1323 microversion: 2.1 time: 0.947766 Oct 03 14:57:58.268098 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2652/5436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:57 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1323 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:57:58.286431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-36926780-e319-4f99-9f06-67332915df5a req-434ed089-cad9-4e4f-9a8a-e59802dd1dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668a33-e1ac-48be-8c53-82859fb72c73", "tag": "fbbcc889-daaf-41ca-9e77-13e6ab662198"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:58.309022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-36926780-e319-4f99-9f06-67332915df5a req-434ed089-cad9-4e4f-9a8a-e59802dd1dba service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:58.309748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-36926780-e319-4f99-9f06-67332915df5a req-434ed089-cad9-4e4f-9a8a-e59802dd1dba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:58.311173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-36926780-e319-4f99-9f06-67332915df5a req-434ed089-cad9-4e4f-9a8a-e59802dd1dba service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:58.337614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-36926780-e319-4f99-9f06-67332915df5a req-434ed089-cad9-4e4f-9a8a-e59802dd1dba service nova] Creating event network-changed:fbbcc889-daaf-41ca-9e77-13e6ab662198 for instance 71668a33-e1ac-48be-8c53-82859fb72c73 on n-h2-781139-2 Oct 03 14:57:58.345963 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-36926780-e319-4f99-9f06-67332915df5a req-434ed089-cad9-4e4f-9a8a-e59802dd1dba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074565 Oct 03 14:57:58.346520 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2653/5437] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:58.353502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:58.355397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:58.365025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:58.365821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:58.367117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:58.368109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:58.368728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:58.369410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:58.911354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Updating instance_info_cache with network_info: [{"id": "fbbcc889-daaf-41ca-9e77-13e6ab662198", "address": "fa:16:3e:34:46:3d", "network": {"id": "ce87d81a-66b0-4686-8402-49534adb0b63", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1524932903-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7726834a3fd143d4b5f76ef5604b4f0d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfbbcc889-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:57:58.914009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:58.929415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:58.932160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Releasing lock "refresh_cache-71668a33-e1ac-48be-8c53-82859fb72c73" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:57:58.933079 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29a78276-672d-45e2-bfe7-e7479c7494f7 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action" status: 202 len: 0 microversion: 2.1 time: 4.168226 Oct 03 14:57:58.934017 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2785/5438] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:57:54 2022] POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action => generated 0 bytes in 4171 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:57:58.943164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.203"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:57:58.944790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:58.948748 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6886a39-c8aa-48d0-be9c-bf28650571d7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.599231 Oct 03 14:57:58.969084 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2654/5439] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:57:58 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:57:59.248240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:59.249040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:59.257899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.259105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.259546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.260274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.260732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.261210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.316579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cf638aa8-eda5-4ed7-a81c-57884aa4419b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/ips" status: 200 len: 149 microversion: 2.1 time: 0.072688 Oct 03 14:57:59.329849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:59.336685 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2655/5440] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:57:59 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/ips => generated 149 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:57:59.343455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:57:59.345382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:57:59.354107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.354619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.355060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.355781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.356363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.356643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.370577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.371086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.371523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.379816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:57:59.381005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:57:59.381649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:57:59.978021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:57:59.990153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9210c2ff-2478-4163-ae14-46161ba9333a tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1323 microversion: 2.1 time: 0.650978 Oct 03 14:57:59.991283 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2656/5441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:57:59 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1323 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:00.014446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:00.016172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:00.042675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:00.045524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:00.046246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:00.048831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:00.051044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:00.052678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:00.293614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "refresh_cache-71668a33-e1ac-48be-8c53-82859fb72c73" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 14:58:00.294183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquired lock "refresh_cache-71668a33-e1ac-48be-8c53-82859fb72c73" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 14:58:01.284285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:01.306362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:01.310832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:01.314098 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-23eb979c-7f50-4952-a44e-a73170f713ee tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 1.307297 Oct 03 14:58:01.318570 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2657/5442] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:00 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:01.330617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:01.331637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:01.388988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:01.389519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:01.389975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:01.390831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:01.391275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:01.391710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:02.173717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Building network info cache for instance {{(pid=128869) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 03 14:58:02.439585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:02.454029 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5877a0ad-524e-475a-a494-29546ce789c9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1323 microversion: 2.1 time: 1.130518 Oct 03 14:58:02.454618 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2658/5443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:01 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1323 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:02.469567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-62ba7f5d-dc80-43a8-9144-2800f1b304cc req-5634bb38-d0a7-4261-8e75-7886a1aa1922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab3bd64-e0cf-44a6-b10c-5e50a18858d5", "name": "network-vif-plugged", "status": "completed", "tag": "f65c9ebc-2f23-4c55-9768-3f7ec92e552d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:02.487392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-62ba7f5d-dc80-43a8-9144-2800f1b304cc req-5634bb38-d0a7-4261-8e75-7886a1aa1922 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:02.493646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-62ba7f5d-dc80-43a8-9144-2800f1b304cc req-5634bb38-d0a7-4261-8e75-7886a1aa1922 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:02.494340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-62ba7f5d-dc80-43a8-9144-2800f1b304cc req-5634bb38-d0a7-4261-8e75-7886a1aa1922 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:02.536349 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-62ba7f5d-dc80-43a8-9144-2800f1b304cc req-5634bb38-d0a7-4261-8e75-7886a1aa1922 service nova] Creating event network-vif-plugged:f65c9ebc-2f23-4c55-9768-3f7ec92e552d for instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 on n-h1-781139-2 Oct 03 14:58:02.553350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-62ba7f5d-dc80-43a8-9144-2800f1b304cc req-5634bb38-d0a7-4261-8e75-7886a1aa1922 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097154 Oct 03 14:58:02.554152 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2659/5444] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:02.574445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-589da8a0-0658-41a6-81d1-7b3fdac41f28 req-685e5aa8-edbc-4ec5-8d8e-bdc92d43f415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71668a33-e1ac-48be-8c53-82859fb72c73", "tag": "fbbcc889-daaf-41ca-9e77-13e6ab662198"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:02.601787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-589da8a0-0658-41a6-81d1-7b3fdac41f28 req-685e5aa8-edbc-4ec5-8d8e-bdc92d43f415 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:02.605330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-589da8a0-0658-41a6-81d1-7b3fdac41f28 req-685e5aa8-edbc-4ec5-8d8e-bdc92d43f415 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:02.605825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-589da8a0-0658-41a6-81d1-7b3fdac41f28 req-685e5aa8-edbc-4ec5-8d8e-bdc92d43f415 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:02.653624 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-589da8a0-0658-41a6-81d1-7b3fdac41f28 req-685e5aa8-edbc-4ec5-8d8e-bdc92d43f415 service nova] Creating event network-changed:fbbcc889-daaf-41ca-9e77-13e6ab662198 for instance 71668a33-e1ac-48be-8c53-82859fb72c73 on n-h2-781139-2 Oct 03 14:58:02.697302 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-589da8a0-0658-41a6-81d1-7b3fdac41f28 req-685e5aa8-edbc-4ec5-8d8e-bdc92d43f415 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139120 Oct 03 14:58:02.698436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2660/5445] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:02.714087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:02.716311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:02.730787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:02.733551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:02.736412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:02.737475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:02.740907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:02.741689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:02.750240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:03.122299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:03.131976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:03.134166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:03.135587 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1abb2f21-f22a-4d00-835a-b23ccbd9fd29 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.432159 Oct 03 14:58:03.136349 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2661/5446] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:02 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:03.381691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Updating instance_info_cache with network_info: [{"id": "fbbcc889-daaf-41ca-9e77-13e6ab662198", "address": "fa:16:3e:34:46:3d", "network": {"id": "ce87d81a-66b0-4686-8402-49534adb0b63", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1524932903-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "7726834a3fd143d4b5f76ef5604b4f0d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfbbcc889-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128869) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 03 14:58:03.423214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Releasing lock "refresh_cache-71668a33-e1ac-48be-8c53-82859fb72c73" {{(pid=128869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 14:58:03.424448 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19943c9c-7e6b-4ed4-8342-4afd729f2752 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action" status: 202 len: 0 microversion: 2.1 time: 4.486158 Oct 03 14:58:03.425654 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2786/5447] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:57:58 2022] POST /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73/action => generated 0 bytes in 4488 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 03 14:58:03.434377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-219391c8-23d6-4af0-968d-133a44bd5757 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '.version_select at 0x7fb22b536820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:03.502868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d3b5d9c2-83d4-49c4-afa7-ee0c50be510c req-6e7404a9-20ef-46ef-bfaa-f38dcad47ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:03.561335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d3b5d9c2-83d4-49c4-afa7-ee0c50be510c req-6e7404a9-20ef-46ef-bfaa-f38dcad47ae0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:03.568011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d3b5d9c2-83d4-49c4-afa7-ee0c50be510c req-6e7404a9-20ef-46ef-bfaa-f38dcad47ae0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:03.570115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d3b5d9c2-83d4-49c4-afa7-ee0c50be510c req-6e7404a9-20ef-46ef-bfaa-f38dcad47ae0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:03.593396 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d3b5d9c2-83d4-49c4-afa7-ee0c50be510c req-6e7404a9-20ef-46ef-bfaa-f38dcad47ae0 service nova] Creating event network-changed:cfa9cd2b-641c-46a2-88cf-0a0614f33cdb for instance 796f59f0-d25e-440a-8a63-d6cedc50b955 on n-h1-781139-2 Oct 03 14:58:03.602690 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d3b5d9c2-83d4-49c4-afa7-ee0c50be510c req-6e7404a9-20ef-46ef-bfaa-f38dcad47ae0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132413 Oct 03 14:58:03.604080 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2787/5448] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:03.614353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:03.615760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:03.629251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:03.630120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:03.630778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:03.632408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:03.633248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:03.633943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:03.896629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:03.907737 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1bf36506-cae0-493d-857f-268f555d61be tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1323 microversion: 2.1 time: 0.300884 Oct 03 14:58:03.911637 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2788/5449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:03 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:03.919990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dbf7ae0-5a19-48a0-be19-c699015c5b35"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:03.945890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:03.965320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:03.965815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:03.966256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:03.966972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:03.971604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:03.972453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:04.633066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cce9eb7c-051a-47d5-8bf9-8dc9fffd4f4e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717312 Oct 03 14:58:04.647333 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2789/5450] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:58:03 2022] POST /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:04.663378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:04.672059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:04.690045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:04.701724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:04.702443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:04.704498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:04.707723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:04.708830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:05.172103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:05.187262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:05.197551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:05.199188 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d671b1f8-c49d-4e08-96cf-e62d443e7b70 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.548295 Oct 03 14:58:05.199934 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2790/5451] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:04 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:05.221232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:05.222125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:05.231114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:05.236495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:05.237355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:05.238272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:05.240500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:05.241172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:05.550492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:05.562226 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95068452-2acc-4bdf-8545-ce3d9a91c944 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1519 microversion: 2.1 time: 0.360719 Oct 03 14:58:05.576244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2791/5452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:05 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1519 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:05.887048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a978676-eee0-4b2a-b98a-dc481c39b984 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-703168732", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a978676-eee0-4b2a-b98a-dc481c39b984 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 242 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-703168732", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-703168732', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '7268de7c-f19f-4160-aa55-7c106c38d82f'}]}}} Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:05.895735 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:05.901522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.904611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a978676-eee0-4b2a-b98a-dc481c39b984 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:05.909899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a978676-eee0-4b2a-b98a-dc481c39b984 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.028599 Oct 03 14:58:05.912345 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2792/5453] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:05 2022] POST /compute/v2.1/servers => generated 175 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:58:05.935597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e3a7835-09b1-4ebc-b798-948f67a6f3bb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:05.936678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e3a7835-09b1-4ebc-b798-948f67a6f3bb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: e4f97fa0-dd17-4c0d-ba65-b805210df68a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:05.953626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1e3a7835-09b1-4ebc-b798-948f67a6f3bb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] HTTP exception thrown: Instance e4f97fa0-dd17-4c0d-ba65-b805210df68a could not be found. Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e3a7835-09b1-4ebc-b798-948f67a6f3bb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e4f97fa0-dd17-4c0d-ba65-b805210df68a/metadata HTTP/1.1 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e4f97fa0-dd17-4c0d-ba65-b805210df68a could not be found. Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': 'e4f97fa0-dd17-4c0d-ba65-b805210df68a'} Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f97fa0-dd17-4c0d-ba65-b805210df68a could not be found. Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f97fa0-dd17-4c0d-ba65-b805210df68a could not be found. Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:05.965852 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:05.971061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:05.971061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:05.971061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f97fa0-dd17-4c0d-ba65-b805210df68a could not be found. Oct 03 14:58:05.971061 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:05.971061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e3a7835-09b1-4ebc-b798-948f67a6f3bb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 404 to user: Instance e4f97fa0-dd17-4c0d-ba65-b805210df68a could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:05.971061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e3a7835-09b1-4ebc-b798-948f67a6f3bb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/e4f97fa0-dd17-4c0d-ba65-b805210df68a/metadata" status: 404 len: 111 microversion: 2.1 time: 0.039345 Oct 03 14:58:05.971061 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2793/5454] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:58:05 2022] GET /compute/v2.1/servers/e4f97fa0-dd17-4c0d-ba65-b805210df68a/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:58:06.121253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b821ce05-3ed1-4fa6-a17a-01e924ec05e4 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1027090267", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b821ce05-3ed1-4fa6-a17a-01e924ec05e4 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 499 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1027090267", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1027090267', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7268de7c-f19f-4160-aa55-7c106c38d82f'}]}}} Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:58:06.126233 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.129747 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.132447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b821ce05-3ed1-4fa6-a17a-01e924ec05e4 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:06.132447 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b821ce05-3ed1-4fa6-a17a-01e924ec05e4 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.015241 Oct 03 14:58:06.132447 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2794/5455] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:06 2022] POST /compute/v2.1/servers => generated 687 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:58:06.234174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:06.235222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:06.243501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:06.254450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.255660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.258074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.262127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.263708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.266919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.529400 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-219391c8-23d6-4af0-968d-133a44bd5757 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/182ba535-a8ec-4c4b-9e3b-27afeb381e56" status: 202 len: 0 microversion: 2.1 time: 3.099541 Oct 03 14:58:06.530284 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2662/5456] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 3 14:58:03 2022] DELETE /compute/v2.1/os-floating-ips/182ba535-a8ec-4c4b-9e3b-27afeb381e56 => generated 0 bytes in 3101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:06.537242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db971e1e-d260-497e-92f7-e3e0279427cc tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-181847714", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db971e1e-d260-497e-92f7-e3e0279427cc tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 499 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-181847714", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-181847714', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7268de7c-f19f-4160-aa55-7c106c38d82f'}]}}} Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:58:06.550183 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.560700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db971e1e-d260-497e-92f7-e3e0279427cc tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:06.568723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db971e1e-d260-497e-92f7-e3e0279427cc tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.026522 Oct 03 14:58:06.568723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2663/5457] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:06 2022] POST /compute/v2.1/servers => generated 689 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:58:06.590162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53ea687a-482d-4ebb-a3c3-5754d9530ede tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '.version_select at 0x7fb22b536040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:06.634464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:06.643383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:06.644894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:06.646154 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f1cf878-f057-4382-bb75-fc30b3ee4a93 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.416300 Oct 03 14:58:06.646724 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2795/5458] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:06 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:06.701777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f546a40a-76ad-4f69-a8e8-52282895291b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-369848960", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f546a40a-76ad-4f69-a8e8-52282895291b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 753 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-369848960", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-369848960', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7268de7c-f19f-4160-aa55-7c106c38d82f'}]}}} Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:58:06.706555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:58:06.709976 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:58:06.712979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.712979 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.717691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f546a40a-76ad-4f69-a8e8-52282895291b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:06.719925 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f546a40a-76ad-4f69-a8e8-52282895291b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022476 Oct 03 14:58:06.729727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2796/5459] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:06 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 03 14:58:06.809043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34d5608f-7cca-4b01-985d-9029bab9d03b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1105680090", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34d5608f-7cca-4b01-985d-9029bab9d03b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 1266 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1105680090", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7268de7c-f19f-4160-aa55-7c106c38d82f"}]}} Oct 03 14:58:06.817926 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1105680090', 'imageRef': 'b9a0038d-acfa-4c25-a7f1-6598cf246eca', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7268de7c-f19f-4160-aa55-7c106c38d82f'}]}}} Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.820724 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:58:06.822892 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:58:06.834115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 03 14:58:06.834115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.834115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34d5608f-7cca-4b01-985d-9029bab9d03b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:06.834115 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34d5608f-7cca-4b01-985d-9029bab9d03b tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023184 Oct 03 14:58:06.834115 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2797/5460] 10.222.0.20 () {60 vars in 1148 bytes} [Mon Oct 3 14:58:06 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 03 14:58:06.847033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19d2809b-dabc-4660-9283-9ba7a3b41a83 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:06.853685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19d2809b-dabc-4660-9283-9ba7a3b41a83 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: ee670a75-a999-440c-825e-ae508f5b0206] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:06.866677 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-19d2809b-dabc-4660-9283-9ba7a3b41a83 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] HTTP exception thrown: Instance ee670a75-a999-440c-825e-ae508f5b0206 could not be found. Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19d2809b-dabc-4660-9283-9ba7a3b41a83 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/ee670a75-a999-440c-825e-ae508f5b0206/metadata/test2 HTTP/1.1 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance ee670a75-a999-440c-825e-ae508f5b0206 could not be found. Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': 'ee670a75-a999-440c-825e-ae508f5b0206', 'id': 'test2'} Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee670a75-a999-440c-825e-ae508f5b0206 could not be found. Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee670a75-a999-440c-825e-ae508f5b0206 could not be found. Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:06.870977 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:06.875562 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:06.875562 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:06.875562 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee670a75-a999-440c-825e-ae508f5b0206 could not be found. Oct 03 14:58:06.875562 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:58:06.877804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19d2809b-dabc-4660-9283-9ba7a3b41a83 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 404 to user: Instance ee670a75-a999-440c-825e-ae508f5b0206 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:06.885355 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19d2809b-dabc-4660-9283-9ba7a3b41a83 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/ee670a75-a999-440c-825e-ae508f5b0206/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.049308 Oct 03 14:58:06.895007 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2798/5461] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 3 14:58:06 2022] GET /compute/v2.1/servers/ee670a75-a999-440c-825e-ae508f5b0206/metadata/test2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:58:06.901294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:06.904225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:06.922708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.923649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.924341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.925367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:06.926061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:06.926702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:06.992422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:58:07.216725 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7537e95b-2dd7-4fc5-815c-5afc091a472f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 204 len: 0 microversion: 2.1 time: 0.319079 Oct 03 14:58:07.220525 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2799/5462] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:58:06 2022] DELETE /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:58:07.238888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:07.244280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:07.272254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.273167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.274329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:07.276737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.277390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.277831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:07.709539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:07.718297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c221e8f-3631-40f6-bd21-10f5b2083577 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1525 microversion: 2.1 time: 0.496102 Oct 03 14:58:07.737947 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2800/5463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:07 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1525 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:07.749481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:07.751733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:07.772816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.773294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.773718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:07.774438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:07.774885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:07.775301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.016473 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53ea687a-482d-4ebb-a3c3-5754d9530ede tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1095cdbd-f787-48f4-bef7-fb054b2b9881" status: 202 len: 0 microversion: 2.1 time: 1.450307 Oct 03 14:58:08.020041 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2664/5464] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 14:58:06 2022] DELETE /compute/v2.1/os-security-groups/1095cdbd-f787-48f4-bef7-fb054b2b9881 => generated 0 bytes in 1453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:08.024993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:08.025495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:08.038583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.039084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.039528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.040250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.042497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.042947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.054878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:08.100013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:58:08.107511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:08.110739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:08.112992 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-205fd67d-4a57-4e32-97d2-1899c91f03aa tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.373657 Oct 03 14:58:08.114843 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2801/5465] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:07 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:08.292377 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-22f014b7-9b60-4bd4-adab-0a6b2425f927 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 204 len: 0 microversion: 2.1 time: 0.270864 Oct 03 14:58:08.293445 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2665/5466] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:58:08 2022] DELETE /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:58:08.319090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:08.321400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:08.362909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.370228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.370764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.371544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.376750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.377343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.750521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:08.752376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:08.759569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:08.772078 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92c2f637-84ab-4bb1-999c-1b81c64dc8bd tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1510 microversion: 2.1 time: 0.470342 Oct 03 14:58:08.773086 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2802/5467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:08 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:08.810488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.812522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.813623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:08.814792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:08.818581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:08.819271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.153129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:09.153943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:09.186879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.190426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.190999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.194533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.197673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.198224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.238464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:09.551905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:09.565345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:09.568388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:09.570458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39992d57-abd4-4dd8-b0f9-12ca03407504 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.429629 Oct 03 14:58:09.572066 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2803/5468] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:09 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:09.622921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:09.650435 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-30083970-7173-4502-8e6b-cd7572df3cfb tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1525 microversion: 2.1 time: 0.905889 Oct 03 14:58:09.673561 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2666/5469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:08 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1525 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:09.800226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:09.801444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:09.820025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.822467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.827069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:09.831608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:09.832506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:09.839466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:10.346381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:10.387408 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a2430144-bc54-402a-8249-5a8f09656cbb tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1510 microversion: 2.1 time: 0.592161 Oct 03 14:58:10.390337 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2804/5470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:09 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1510 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:10.604151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:10.605231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:10.627038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:10.633819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:10.634619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:10.636249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:10.638607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:10.651078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:10.693575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:10.694679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:10.725709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:10.742551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:10.743613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:10.745745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:10.757041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:10.758631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.498852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:11.514056 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f715172-fb37-48ac-b19a-6f072df40507 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1525 microversion: 2.1 time: 0.829422 Oct 03 14:58:11.516839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2805/5471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:10 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1525 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:11.549872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:11.552241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:11.580061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.580610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.585336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.586480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:11.589521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:11.590151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:11.929233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:11.964155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:11.966388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:11.968833 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d3d207fc-aa48-46f4-acbd-871def987d13 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 1.369150 Oct 03 14:58:11.971878 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2667/5472] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:10 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:11.982475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b4ba8df7-b6a7-411b-9f06-774bd7f784eb req-4e763d72-cf45-43c9-8859-bb4ea174d6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab3bd64-e0cf-44a6-b10c-5e50a18858d5", "name": "network-vif-unplugged", "status": "completed", "tag": "f65c9ebc-2f23-4c55-9768-3f7ec92e552d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:12.031955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b4ba8df7-b6a7-411b-9f06-774bd7f784eb req-4e763d72-cf45-43c9-8859-bb4ea174d6a0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.033978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b4ba8df7-b6a7-411b-9f06-774bd7f784eb req-4e763d72-cf45-43c9-8859-bb4ea174d6a0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.035415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b4ba8df7-b6a7-411b-9f06-774bd7f784eb req-4e763d72-cf45-43c9-8859-bb4ea174d6a0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.092748 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b4ba8df7-b6a7-411b-9f06-774bd7f784eb req-4e763d72-cf45-43c9-8859-bb4ea174d6a0 service nova] Creating event network-vif-unplugged:f65c9ebc-2f23-4c55-9768-3f7ec92e552d for instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 on n-h1-781139-2 Oct 03 14:58:12.123090 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b4ba8df7-b6a7-411b-9f06-774bd7f784eb req-4e763d72-cf45-43c9-8859-bb4ea174d6a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144717 Oct 03 14:58:12.124058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2668/5473] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:12.324755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:12.349197 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99b6d83c-2187-4145-8dca-edac3144990d tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1510 microversion: 2.1 time: 0.815778 Oct 03 14:58:12.356736 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2806/5474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:11 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1510 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:12.554180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:12.556795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:12.605567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.612736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.615639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.627800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:12.646543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:12.649680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:12.955590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0c2a24b4-63b3-40ad-b6ce-141e374f3cc5 req-ccd777a6-6e8f-4830-a7b0-a3c3a5de2a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71668a33-e1ac-48be-8c53-82859fb72c73", "name": "network-vif-deleted", "tag": "fbbcc889-daaf-41ca-9e77-13e6ab662198"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:13.039913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c2a24b4-63b3-40ad-b6ce-141e374f3cc5 req-ccd777a6-6e8f-4830-a7b0-a3c3a5de2a4d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.057938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c2a24b4-63b3-40ad-b6ce-141e374f3cc5 req-ccd777a6-6e8f-4830-a7b0-a3c3a5de2a4d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.059509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c2a24b4-63b3-40ad-b6ce-141e374f3cc5 req-ccd777a6-6e8f-4830-a7b0-a3c3a5de2a4d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.097718 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0c2a24b4-63b3-40ad-b6ce-141e374f3cc5 req-ccd777a6-6e8f-4830-a7b0-a3c3a5de2a4d service nova] Creating event network-vif-deleted:fbbcc889-daaf-41ca-9e77-13e6ab662198 for instance 71668a33-e1ac-48be-8c53-82859fb72c73 on n-h2-781139-2 Oct 03 14:58:13.112232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:13.131120 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99a3e7ed-792f-443a-be62-5cb30d5b0309 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1483 microversion: 2.1 time: 0.591051 Oct 03 14:58:13.133412 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0c2a24b4-63b3-40ad-b6ce-141e374f3cc5 req-ccd777a6-6e8f-4830-a7b0-a3c3a5de2a4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179169 Oct 03 14:58:13.136069 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2807/5475] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:58:13.152634 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2669/5476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:12 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1483 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:13.173056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:13.175267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:13.198880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.199376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.199814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.207750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.211782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.212252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.380053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:13.381515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:13.403104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.405651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.407353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.412706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.413871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.418769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.688263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:13.690628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:13.691257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:13.694934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lazy-loading 'fault' on Instance uuid 71668a33-e1ac-48be-8c53-82859fb72c73 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:13.901078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ba0d01f7ada40519d44797dfd342dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7726834a3fd143d4b5f76ef5604b4f0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:13.911766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50e9e318-15a3-4b05-83d1-4e5dad8824d4 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 200 len: 1313 microversion: 2.1 time: 0.538753 Oct 03 14:58:13.935035 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2670/5477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:13 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:13.942935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:13.951676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e0aaccb8-c811-4b35-90fd-b14b0ffda084 req-0e16229a-7491-4b3d-8f9f-0fc263316e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab3bd64-e0cf-44a6-b10c-5e50a18858d5", "name": "network-vif-deleted", "tag": "f65c9ebc-2f23-4c55-9768-3f7ec92e552d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:13.970836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:13.977936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:13.983377 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-79d02f17-4f91-4944-8c06-09c286d35185 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.841917 Oct 03 14:58:13.989627 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2808/5478] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:13 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:14.037386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e0aaccb8-c811-4b35-90fd-b14b0ffda084 req-0e16229a-7491-4b3d-8f9f-0fc263316e1a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.037879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e0aaccb8-c811-4b35-90fd-b14b0ffda084 req-0e16229a-7491-4b3d-8f9f-0fc263316e1a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.055345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e0aaccb8-c811-4b35-90fd-b14b0ffda084 req-0e16229a-7491-4b3d-8f9f-0fc263316e1a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:14.104751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e0aaccb8-c811-4b35-90fd-b14b0ffda084 req-0e16229a-7491-4b3d-8f9f-0fc263316e1a service nova] Creating event network-vif-deleted:f65c9ebc-2f23-4c55-9768-3f7ec92e552d for instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 on n-h1-781139-2 Oct 03 14:58:14.140718 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e0aaccb8-c811-4b35-90fd-b14b0ffda084 req-0e16229a-7491-4b3d-8f9f-0fc263316e1a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199784 Oct 03 14:58:14.144041 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2671/5479] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:14.159969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:14.161109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:14.181865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.188066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.188718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:14.190052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.190490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.191238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:14.376388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.376886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.377360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:14.377829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lazy-loading 'fault' on Instance uuid 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:14.569899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1594a3b392ec41aba2db7be639531f15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592cd90df88f49d1957f2c624475bc5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:14.585723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfb31acc-8401-4b02-bf87-6465094e166f tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 200 len: 1313 microversion: 2.1 time: 0.431250 Oct 03 14:58:14.591860 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2809/5480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:14 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:14.944744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:14.949132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] [instance: 71668a33-e1ac-48be-8c53-82859fb72c73] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:14.974627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.976247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.977636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:14.981349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:14.982064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:14.985801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:15.017744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:15.019397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:15.035965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:15.038903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:15.042191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:15.045394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:15.047607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:15.050183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:15.051094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] HTTP exception thrown: Instance 71668a33-e1ac-48be-8c53-82859fb72c73 could not be found. Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Request method failure captured: Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 HTTP/1.1 Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvg84I82lZx-owG-2Wxhx_xJFEj_hDRclb5OnYoeRMYjEgiJvUvdYMrVnFx3JtXx6xYr72S6QIgcaXDmOgimAUlbTrco3SmWfEm4X6ZNyW3x4s0rTuR5i4ffcF3moGYxkMF_tc11hgE-MBr8y3_lyiXaG58tsawc42HeKkHehmT_DhM Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7726834a3fd143d4b5f76ef5604b4f0d Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1488248123 Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7726834a3fd143d4b5f76ef5604b4f0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7726834a3fd143d4b5f76ef5604b4f0d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7726834a3fd143d4b5f76ef5604b4f0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7726834a3fd143d4b5f76ef5604b4f0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1488248123 Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7726834a3fd143d4b5f76ef5604b4f0d Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1488248123 Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerRescueTestJSONUnderV235-1488248123-project Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 4ba0d01f7ada40519d44797dfd342dbf Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1488248123-project Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 71668a33-e1ac-48be-8c53-82859fb72c73 could not be found. Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '71668a33-e1ac-48be-8c53-82859fb72c73'} Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71668a33-e1ac-48be-8c53-82859fb72c73 could not be found. Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71668a33-e1ac-48be-8c53-82859fb72c73 could not be found. Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.059191 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71668a33-e1ac-48be-8c53-82859fb72c73 could not be found. Oct 03 14:58:15.064993 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.068126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] Returning 404 to user: Instance 71668a33-e1ac-48be-8c53-82859fb72c73 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:15.070632 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d3d9df7-c8c9-4ff2-888c-f536e7a27f07 tempest-ServerRescueTestJSONUnderV235-1488248123 tempest-ServerRescueTestJSONUnderV235-1488248123-project] 10.222.0.20 "GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73" status: 404 len: 111 microversion: 2.1 time: 0.131369 Oct 03 14:58:15.074474 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2672/5481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:14 2022] GET /compute/v2.1/servers/71668a33-e1ac-48be-8c53-82859fb72c73 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:58:15.615504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:15.616912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] [instance: 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:15.630165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:15.640169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:15.643917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:15.645960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:15.648752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:15.649404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:15.710831 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] HTTP exception thrown: Instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 could not be found. Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Request method failure captured: Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 HTTP/1.1 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvhm1naVJjZ1DEh6pA5VRgoR8AtZTtoCj6ZDy6oTf5L1B-XsgI0NhZY43sOXwZ3AlXzhvzTpd9yZDD3BuaRu7BjpNlo3oejIwIj1nm9mvSyTE2Xk-91CQh87VsW2UXb1CBPSAaSjSUuDdNll1czAhd3E5g6JBWqIqLyT5zHFvQQ_ji4 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_592cd90df88f49d1957f2c624475bc5c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/592cd90df88f49d1957f2c624475bc5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 592cd90df88f49d1957f2c624475bc5c Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1560073733 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 1594a3b392ec41aba2db7be639531f15 Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1560073733-project Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 could not be found. Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3ab3bd64-e0cf-44a6-b10c-5e50a18858d5'} Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 could not be found. Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 could not be found. Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.717046 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 could not be found. Oct 03 14:58:15.721591 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:15.728085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] Returning 404 to user: Instance 3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:15.729856 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c81a7c74-c5e2-4410-b9c9-823ef28f52e9 tempest-ServerMetadataNegativeTestJSON-1560073733 tempest-ServerMetadataNegativeTestJSON-1560073733-project] 10.222.0.20 "GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5" status: 404 len: 111 microversion: 2.1 time: 0.118305 Oct 03 14:58:15.737887 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2673/5482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:15 2022] GET /compute/v2.1/servers/3ab3bd64-e0cf-44a6-b10c-5e50a18858d5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:58:17.227591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:17.241834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:17.261573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:17.266737 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6655b846-2ec4-43c9-80e0-0851d2091de4 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 2.251740 Oct 03 14:58:17.269186 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2810/5483] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:15 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:18.309484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:18.310124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:18.349202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:18.352843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:18.363376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:18.364640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:18.370428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:18.380963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:19.899268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:19.913274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:19.914946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:19.916198 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03055c3c-083a-4021-80f8-5610e276761d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 1.620494 Oct 03 14:58:19.928117 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2674/5484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:18 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:20.961674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:20.962377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:20.991841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.992557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.993215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:20.994103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:20.995081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:20.996654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:21.771728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:21.818298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:21.823131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:21.829346 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d0d7f53-ed29-4ec6-a9ce-ac64c3bb2474 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.872702 Oct 03 14:58:21.848966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2811/5485] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:20 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:22.879919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:22.880615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:22.899531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.900106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.900575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:22.901348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:22.901808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:22.902242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:24.837796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.851846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.853553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:24.855098 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2bf61af3-b30e-49c6-ab6b-b32b4fc9207e tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 1.979388 Oct 03 14:58:24.855976 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2675/5486] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:22 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:25.883386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:25.884664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:25.902640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.902967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.903784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:25.904655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:25.906049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:25.907289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:26.883902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:26.904021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:26.906014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:26.910341 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e73881d5-25df-4cf8-be91-467767e5e433 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 1.032643 Oct 03 14:58:26.917742 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2812/5487] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:25 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:27.656685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-103aa082-4a04-46e4-8190-23e23f6a2bf6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: .version_select at 0x7fb23031b3a0>, body: {"keypair": {"name": "tempest-keypair-1289339001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2QlCXFG4yEx+loOPfnhWGUtE7kYg44e0SzTYJA2+UPJBZ6HtV5WtFl95m6yuC6nrfHgMAg8LkaEQ7idvOAY48VVItNy+ZG7Nke9gKOlcOHZMlSopZu0tc+oogzAaDnMA=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:27.667738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:27.708115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-103aa082-4a04-46e4-8190-23e23f6a2bf6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:58:27.721437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-103aa082-4a04-46e4-8190-23e23f6a2bf6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:58:27.761427 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-103aa082-4a04-46e4-8190-23e23f6a2bf6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112816 Oct 03 14:58:27.762041 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2676/5488] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 14:58:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:27.947829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:27.948829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:27.957705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.957705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.958105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:27.958828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:27.959287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:27.959715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:28.405487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:28.415168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:28.417653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:28.419130 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a1518d4-4a52-4725-9c67-f6d6850e35cc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.475357 Oct 03 14:58:28.420286 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2813/5489] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:27 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:28.620602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:28.621144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:28.636004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:28.639373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:28.642467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:28.645725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:28.647898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:28.650429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:28.827899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lazy-loading 'services' on Instance uuid a611d456-1cd7-4199-9f5e-0e141e08a263 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:28.987797 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3364a58c-b6e0-4cd3-a21e-52aab86b5246 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263/os-volume_attachments/45a4bdb4-51f8-4586-99d2-9d9661e2aaab" status: 202 len: 0 microversion: 2.1 time: 0.371574 Oct 03 14:58:28.991507 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2677/5490] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 14:58:28 2022] DELETE /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263/os-volume_attachments/45a4bdb4-51f8-4586-99d2-9d9661e2aaab => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:58:29.449535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:29.450113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:29.469435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:29.471613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:29.472363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:29.475513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:29.476573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:29.478855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:30.374054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:30.399042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:30.403473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:30.408598 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5aff2d47-5cf7-4db8-80c8-608565b79375 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.965067 Oct 03 14:58:30.415193 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2814/5491] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:29 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:31.298734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-375174961", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8455999-ecee-4494-a487-d4e57e751b83"}], "security_groups": [{"name": "tempest-securitygroup--312166082"}], "key_name": "tempest-keypair-1289339001", "user_data": "}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:31.463397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:31.464040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:31.527093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:31.532411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:31.533162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:31.534162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:31.536337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:31.536980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:31.646775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] validate_networks() for [('f8455999-ecee-4494-a487-d4e57e751b83', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:58:32.643085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:58:32.643698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:58:32.644110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:58:32.644524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:58:32.644961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:58:32.661919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:32.662417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:32.662854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:32.663589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:32.664038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:32.668452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:32.697730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:32.714914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:32.720428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:58:32.721539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:32.725977 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1ebd711-54e5-4f66-b810-11cf8bc15d01 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 1.284224 Oct 03 14:58:32.727613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:58:32.728544 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2815/5492] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:31 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:32.746922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:58:32.750499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:58:32.840243 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9ef1d03-f5cd-4351-bb53-6b1eea622674 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.548763 Oct 03 14:58:32.841764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2678/5493] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:58:32.863780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96167cf4-2709-4286-af68-ca3f1c0edb8a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:32.866547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96167cf4-2709-4286-af68-ca3f1c0edb8a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:32.998093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96167cf4-2709-4286-af68-ca3f1c0edb8a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:33.010931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96167cf4-2709-4286-af68-ca3f1c0edb8a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1241 microversion: 2.1 time: 0.161707 Oct 03 14:58:33.013826 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2816/5494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:32 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:33.770716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:33.771381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:33.799519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:33.800800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:33.801729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:33.802656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:33.804692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:33.806729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:33.814686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:34.039969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da19ad58-cb3f-4326-b8ce-aea7f7fa24fb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:34.041148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-da19ad58-cb3f-4326-b8ce-aea7f7fa24fb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:34.154813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-da19ad58-cb3f-4326-b8ce-aea7f7fa24fb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:34.167099 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da19ad58-cb3f-4326-b8ce-aea7f7fa24fb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1241 microversion: 2.1 time: 0.131749 Oct 03 14:58:34.168005 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2817/5495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:34 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:34.470442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:34.483551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:34.485146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:34.488299 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-754b52f6-b8d6-492e-bc50-50197fe9fcc1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.721853 Oct 03 14:58:34.491862 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2679/5496] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:33 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:35.205175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:35.232807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:35.270235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:35.274309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:35.276188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:35.281220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:35.283841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:35.284786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:35.523720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:35.524525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:35.543097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:35.545860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:35.546418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:35.547237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:35.549844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:35.550468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:35.753624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:35.769481 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6262d72b-98b4-4293-9da0-e31701ce505f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1293 microversion: 2.1 time: 0.574937 Oct 03 14:58:35.785359 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2818/5497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:35 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1293 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:35.990813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:36.011490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:36.013196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:36.014524 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3728f90b-135f-49c6-8987-c445f0bcbecc tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.499479 Oct 03 14:58:36.015201 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2680/5498] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:35 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:36.780720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-248bc7dc-769f-481a-9e8f-b05aa411f630 req-b7910480-ace4-4aea-9966-cd3c0c6f134d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "name": "network-vif-plugged", "status": "completed", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:36.803438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:36.804830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:36.823253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:36.824043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:36.824713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:36.825725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:36.826459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:36.827135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:36.844971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:36.851585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-248bc7dc-769f-481a-9e8f-b05aa411f630 req-b7910480-ace4-4aea-9966-cd3c0c6f134d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:36.853501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-248bc7dc-769f-481a-9e8f-b05aa411f630 req-b7910480-ace4-4aea-9966-cd3c0c6f134d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:36.855604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-248bc7dc-769f-481a-9e8f-b05aa411f630 req-b7910480-ace4-4aea-9966-cd3c0c6f134d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:36.893381 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-248bc7dc-769f-481a-9e8f-b05aa411f630 req-b7910480-ace4-4aea-9966-cd3c0c6f134d service nova] Creating event network-vif-plugged:cfa9cd2b-641c-46a2-88cf-0a0614f33cdb for instance 796f59f0-d25e-440a-8a63-d6cedc50b955 on n-h1-781139-2 Oct 03 14:58:36.907225 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-248bc7dc-769f-481a-9e8f-b05aa411f630 req-b7910480-ace4-4aea-9966-cd3c0c6f134d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131792 Oct 03 14:58:36.909365 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2819/5499] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:37.050203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:37.055560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:37.080824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:37.081521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:37.082204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:37.084473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:37.086156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:37.086794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:37.751552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:37.762282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:37.766611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:37.770903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4aef192f-947c-422e-9b83-9157c7102d7d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.730886 Oct 03 14:58:37.773645 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2820/5500] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:37 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:38.122717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:38.134481 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4bf355f-a39a-49d9-96f1-468ce5cf2248 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 1.339992 Oct 03 14:58:38.141089 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2681/5501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:36 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:38.801334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:38.805447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:38.831165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:38.834992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:38.843921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:38.845095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:38.846000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:38.846597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:39.170026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:39.171494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:39.188091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:39.195132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:39.195848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:39.198389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:39.205672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:39.213166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:39.213794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:39.218310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:39.233530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:39.237389 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46df5a8b-9786-4c07-8ae2-ac2f739d360c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.437774 Oct 03 14:58:39.238036 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2821/5502] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:38 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:40.267910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:40.269534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:40.283877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:40.285156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:40.285648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:40.287759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:40.289036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:40.291488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:40.305290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=94 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:40.747091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:40.761320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:40.775105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:40.787700 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3fed1fb-16ad-4943-af85-8d5532fcedf7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1731 microversion: 2.20 time: 0.524893 Oct 03 14:58:40.794147 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2822/5503] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:40 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1731 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 14:58:40.886051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:40.886547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:40.893927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:40.894701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:40.895317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:40.896222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:40.896849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:40.897464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:40.929794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:58:41.082165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:41.090417 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-477070f1-2c42-4c61-afed-5497543876ec tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 1.924813 Oct 03 14:58:41.099911 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2682/5504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:39 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:41.108527 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d0b31e6-8fbe-4a7c-a733-ecad49d9b9e4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 204 len: 0 microversion: 2.1 time: 0.224694 Oct 03 14:58:41.109622 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2823/5505] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:58:40 2022] DELETE /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 14:58:41.118230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:41.118538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:41.142989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.143502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.143955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:41.144678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.145158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.145600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:41.590854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:41.608946 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7b1260c-8dfb-46a0-9ff1-67b8ef66492a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1514 microversion: 2.1 time: 0.492264 Oct 03 14:58:41.612648 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2683/5506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:41 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1514 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:41.828610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:41.829346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:41.839521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.840025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.847245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:41.849129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.851685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.852260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:41.860378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3a166a4b-395c-46b0-8b1f-4a817e4c8090 req-a45cd888-3698-46f5-a374-5f8d1ad955be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147e2c8d-3333-4c10-9130-3139e3313608", "tag": "838c4b59-3633-4b72-bbac-508dc55d21a8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:41.881931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3a166a4b-395c-46b0-8b1f-4a817e4c8090 req-a45cd888-3698-46f5-a374-5f8d1ad955be service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:41.883065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3a166a4b-395c-46b0-8b1f-4a817e4c8090 req-a45cd888-3698-46f5-a374-5f8d1ad955be service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:41.884386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3a166a4b-395c-46b0-8b1f-4a817e4c8090 req-a45cd888-3698-46f5-a374-5f8d1ad955be service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:41.911698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3a166a4b-395c-46b0-8b1f-4a817e4c8090 req-a45cd888-3698-46f5-a374-5f8d1ad955be service nova] Creating event network-changed:838c4b59-3633-4b72-bbac-508dc55d21a8 for instance 147e2c8d-3333-4c10-9130-3139e3313608 on n-h1-781139-2 Oct 03 14:58:41.928365 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3a166a4b-395c-46b0-8b1f-4a817e4c8090 req-a45cd888-3698-46f5-a374-5f8d1ad955be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074279 Oct 03 14:58:41.932115 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2684/5507] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:58:42.121311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:42.122712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:42.140720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:42.142552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:42.144773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:42.150612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:42.151478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:42.153110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:42.241562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:42.266838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:42.269531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:42.273719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e21c7f4c-9029-439b-a5d0-795ba765772c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1718 microversion: 2.20 time: 0.449712 Oct 03 14:58:42.289986 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2824/5508] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:58:41 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1718 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:58:42.647242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:42.650064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:42.673099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:42.673987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:42.674679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:42.675672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:42.676347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:42.677041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:42.691391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:42.740611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:42.869449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:42.886925 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-75bd5eda-2a88-4437-b411-9f9801e08d08 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 0.771255 Oct 03 14:58:42.887645 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2685/5509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:42 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:43.022804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:43.037494 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e47e4fa3-8eef-41d8-8caf-47735c97184e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1514 microversion: 2.1 time: 0.399174 Oct 03 14:58:43.039556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2825/5510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:42 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1514 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:43.930773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:43.932738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:43.950258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:43.951166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:43.951957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:43.952967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:43.953621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:43.954243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:44.065943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:44.067339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:44.079634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:44.080481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:44.082605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:44.083699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:44.088131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:44.088956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:44.163857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:44.377127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:44.391533 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3487d36e-bcfa-4714-9abc-d59a0795fc76 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1514 microversion: 2.1 time: 0.329465 Oct 03 14:58:44.407631 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2826/5511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:44 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:44.608219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0ea7d440-8608-4da8-81cc-f52084e8b5d5 req-8f292c8f-2eee-4fc2-b6e5-e18bed6420a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a611d456-1cd7-4199-9f5e-0e141e08a263", "name": "network-vif-deleted", "tag": "44799f54-96c4-47a1-a2d3-c269ebb39a83"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:44.653949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0ea7d440-8608-4da8-81cc-f52084e8b5d5 req-8f292c8f-2eee-4fc2-b6e5-e18bed6420a8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:44.654572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0ea7d440-8608-4da8-81cc-f52084e8b5d5 req-8f292c8f-2eee-4fc2-b6e5-e18bed6420a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:44.655177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0ea7d440-8608-4da8-81cc-f52084e8b5d5 req-8f292c8f-2eee-4fc2-b6e5-e18bed6420a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:44.690936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:44.704533 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9aafdd1e-d2b0-4e53-b5f1-5fd5ef0d75ef tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 0.789476 Oct 03 14:58:44.708327 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2686/5512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:43 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:44.732572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0ea7d440-8608-4da8-81cc-f52084e8b5d5 req-8f292c8f-2eee-4fc2-b6e5-e18bed6420a8 service nova] Creating event network-vif-deleted:44799f54-96c4-47a1-a2d3-c269ebb39a83 for instance a611d456-1cd7-4199-9f5e-0e141e08a263 on n-h1-781139-2 Oct 03 14:58:44.747009 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0ea7d440-8608-4da8-81cc-f52084e8b5d5 req-8f292c8f-2eee-4fc2-b6e5-e18bed6420a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140353 Oct 03 14:58:44.747269 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2827/5513] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:58:45.420136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:45.421350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:45.443193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.447794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.448642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.449799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.450509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.460154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.542105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.545300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.546108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.548991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lazy-loading 'fault' on Instance uuid a611d456-1cd7-4199-9f5e-0e141e08a263 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:58:45.656904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:45.665257 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7cac2da-45bb-47ac-8011-a3e08b777340 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 200 len: 1308 microversion: 2.1 time: 0.249424 Oct 03 14:58:45.687863 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2687/5514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:45 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:45.735617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:45.737280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:45.752079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.755026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.755886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:45.759746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:45.760494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:45.763556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.335254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:46.350422 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88da11ee-c2c7-470b-99d0-0420ab017c86 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 0.618903 Oct 03 14:58:46.351868 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2828/5515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:45 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:46.694526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:46.696019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: a611d456-1cd7-4199-9f5e-0e141e08a263] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:46.709006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:46.709925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:46.712415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.715413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:46.716166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:46.717840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:46.766007 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] HTTP exception thrown: Instance a611d456-1cd7-4199-9f5e-0e141e08a263 could not be found. Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Request method failure captured: Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 HTTP/1.1 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvfBxS94XjTrOZfRxUCWyy3Daz84yweaVBh9gBlkxRIs1ADW1e08CFsRbVG8Pt-piNjKV4kBhcNPQ9nTNhHsPUrwp-CJdtZ34SThGteX_0traxgI7ogAOCxw2XM5IHXw9Ij63kkOjEqvmO8QgzT-HN9k_3sw0rBPy9nf8fWkC-iatGY Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: bfe736ca183e4d4b8781ffb232c49a67 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1376114293 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe736ca183e4d4b8781ffb232c49a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe736ca183e4d4b8781ffb232c49a67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe736ca183e4d4b8781ffb232c49a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe736ca183e4d4b8781ffb232c49a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesSnapshotTestJSON-1376114293 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: bfe736ca183e4d4b8781ffb232c49a67 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1376114293 Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesSnapshotTestJSON-1376114293-project Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 4fd097a3bb5f423488f27fa319f636ba Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesSnapshotTestJSON-1376114293-project Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance a611d456-1cd7-4199-9f5e-0e141e08a263 could not be found. Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'a611d456-1cd7-4199-9f5e-0e141e08a263'} Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a611d456-1cd7-4199-9f5e-0e141e08a263 could not be found. Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a611d456-1cd7-4199-9f5e-0e141e08a263 could not be found. Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:58:46.767879 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:46.773766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:58:46.773766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:58:46.773766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:58:46.773766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:58:46.773766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:58:46.773766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a611d456-1cd7-4199-9f5e-0e141e08a263 could not be found. Oct 03 14:58:46.773766 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:58:46.775468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Returning 404 to user: Instance a611d456-1cd7-4199-9f5e-0e141e08a263 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:58:46.777627 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f9e6057c-dd6e-4dbb-a482-4939f90e726a tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263" status: 404 len: 111 microversion: 2.1 time: 0.087544 Oct 03 14:58:46.784498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2688/5516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:46 2022] GET /compute/v2.1/servers/a611d456-1cd7-4199-9f5e-0e141e08a263 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:58:47.377502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:47.379216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:47.388151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:47.389445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:47.390118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:47.391111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:47.391793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:47.393040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:48.561418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:48.582295 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-951a8ce1-2210-42a7-b6fd-bfa9a3e361ed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 1.209398 Oct 03 14:58:48.584084 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2829/5517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:47 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:49.611067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:49.611684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:49.630530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:49.632239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:49.633181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:49.636306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:49.637303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:49.638923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:50.318810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:50.335177 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7c74d84f-97dd-4af4-9c9f-527b91124ce6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 0.730818 Oct 03 14:58:50.340582 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2689/5518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:49 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:50.749790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1579037270", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:50.759916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] validate_networks() for [('b9aa55a0-cd2f-4c43-9485-fbd6773ab0db', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:58:51.370624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:51.372819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:51.391991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:51.392505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:51.396115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:51.399979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:51.401872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:51.402376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:52.182563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:52.226362 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-93a9accc-408c-4e42-8418-145bcd9ec370 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 0.863765 Oct 03 14:58:52.227872 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2690/5519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:51 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:53.187830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:58:53.189438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:58:53.190154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:58:53.190741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:58:53.191535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:58:53.214721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:53.215677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:53.216867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:53.217999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:53.218865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:53.224844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:53.251977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:53.252498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:53.261866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Getting quotas for project 3f8de0a15a7b4a38876759625866f1d9. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:58:53.268149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:53.268651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:53.269127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:53.269374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Getting quotas for user 2d4287949baa4046b00749b4c46067be and project 3f8de0a15a7b4a38876759625866f1d9. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:58:53.269855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:53.270318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:53.270748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:53.286632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:58:53.290591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:58:53.376876 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acc18d3b-4ba1-402d-ac86-ea9301229461 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.279239 Oct 03 14:58:53.382027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2830/5520] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 14:58:53.422716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a1fb907-8923-43d5-96e0-9cb37f4e9871 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:53.425860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a1fb907-8923-43d5-96e0-9cb37f4e9871 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:53.728758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a1fb907-8923-43d5-96e0-9cb37f4e9871 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:53.736962 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a1fb907-8923-43d5-96e0-9cb37f4e9871 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1214 microversion: 2.1 time: 0.351423 Oct 03 14:58:53.741187 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2831/5521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:53 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:54.774845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:54.775999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:54.810755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:54.834491 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1435231f-94ab-4628-b50b-c81919c062d2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 1.586624 Oct 03 14:58:54.835694 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2691/5522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:53 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:54.838167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:54.841068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:54.842221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:54.847065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:54.850033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:54.852362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:55.412142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:55.424558 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75de5836-9f20-4c61-badd-9f8d20cb2688 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1218 microversion: 2.1 time: 0.662036 Oct 03 14:58:55.431062 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2832/5523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:54 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1218 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:55.880711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:55.886732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:55.963482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:55.969900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:55.999989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:56.001566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:56.007141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:56.008524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:56.320186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7ac61b90-3daf-42eb-808f-765741d1b2bc req-fd2cfcf3-3a0f-4270-8786-a5be190e6d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e2c8d-3333-4c10-9130-3139e3313608", "name": "network-vif-plugged", "status": "completed", "tag": "838c4b59-3633-4b72-bbac-508dc55d21a8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:56.357047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7ac61b90-3daf-42eb-808f-765741d1b2bc req-fd2cfcf3-3a0f-4270-8786-a5be190e6d83 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:56.357639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7ac61b90-3daf-42eb-808f-765741d1b2bc req-fd2cfcf3-3a0f-4270-8786-a5be190e6d83 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:56.363490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7ac61b90-3daf-42eb-808f-765741d1b2bc req-fd2cfcf3-3a0f-4270-8786-a5be190e6d83 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:56.412549 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7ac61b90-3daf-42eb-808f-765741d1b2bc req-fd2cfcf3-3a0f-4270-8786-a5be190e6d83 service nova] Creating event network-vif-plugged:838c4b59-3633-4b72-bbac-508dc55d21a8 for instance 147e2c8d-3333-4c10-9130-3139e3313608 on n-h1-781139-2 Oct 03 14:58:56.424030 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7ac61b90-3daf-42eb-808f-765741d1b2bc req-fd2cfcf3-3a0f-4270-8786-a5be190e6d83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.049910 Oct 03 14:58:56.436338 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2692/5524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:58:56.458043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:56.458763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:56.474296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:56.474787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:56.475228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:56.484775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:56.500653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:56.501590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:56.730379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:56.746855 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7be67908-e5c9-41b2-9fa8-9e78f1564692 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1272 microversion: 2.1 time: 0.293062 Oct 03 14:58:56.747500 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2693/5525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:56 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:56.762456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:56.800957 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c0d245c4-d8fc-4af3-ab51-3b20c3f58918 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 0.919695 Oct 03 14:58:56.821437 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2833/5526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:55 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:57.169216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-386027862", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "47db8c04-6fa5-4812-9d3b-4a4bae727d6f"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:58:57.305127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] validate_networks() for [('47db8c04-6fa5-4812-9d3b-4a4bae727d6f', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:58:57.774201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:57.774201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:57.786185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:57.786690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:57.787129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:57.790482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:57.790967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:57.792970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.411664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:58.423854 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-918a7eec-bc23-4ffc-8d8c-35adece0dcf8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 0.654410 Oct 03 14:58:58.425268 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2834/5527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:57 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:58:58.431028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:58.432537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:58.439664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.440567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.441211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.443544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.444684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.445316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.924441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:58:58.925000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:58:58.925478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:58:58.925901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:58:58.926323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:58:58.928654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:58:58.946901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.949952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.950685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:58.954838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:58.955571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:58.956202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:59.013530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Getting quotas for project 21be13d3eee24f8c938dc298276c8b7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:58:59.022161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Getting quotas for user 32ef6613b3dd49cc81074cb05cccb7a8 and project 21be13d3eee24f8c938dc298276c8b7f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:58:59.056201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:58:59.065964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:58:59.190727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:58:59.207799 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f4139e8-8f7e-41b2-b9d8-011fab995140 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1366 microversion: 2.1 time: 0.781071 Oct 03 14:58:59.213263 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2835/5528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:58 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1366 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:58:59.261839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ffa4003-fd07-41be-b354-eba1baf292f8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.511332 Oct 03 14:58:59.263247 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2694/5529] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:58:59.283497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d62dc5a-bb35-4f31-a401-3987fa8cc465 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:59.286789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d62dc5a-bb35-4f31-a401-3987fa8cc465 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:59.509763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:58:59.512031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:58:59.531497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:59.532329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:59.533458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:58:59.537814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:58:59.538563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:58:59.539219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:00.033379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:00.043019 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3681cea2-d6ef-46e8-a345-4bd7a798d82b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 0.572697 Oct 03 14:59:00.048110 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2695/5530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:59 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:00.136470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d62dc5a-bb35-4f31-a401-3987fa8cc465 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:00.151248 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d62dc5a-bb35-4f31-a401-3987fa8cc465 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1227 microversion: 2.1 time: 0.879742 Oct 03 14:59:00.151887 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2836/5531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:58:59 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1227 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:00.239070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:00.240174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:00.258717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:00.259298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:00.259745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:00.271261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:00.271764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:00.274077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:00.585722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:00.594426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2d89d169-e9ee-4129-a17b-6d8fe4830490 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1556 microversion: 2.1 time: 0.359668 Oct 03 14:59:00.595027 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2696/5532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:00 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1556 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:00.621824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:00.623580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:00.632211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:00.633218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:00.634429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:00.635876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:00.636589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:00.637489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:00.993035 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db3f128e-bb7c-4e77-b71d-6917d32fb55c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.376155 Oct 03 14:59:00.994729 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2837/5533] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 14:59:00 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:01.074881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:01.076268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:01.085631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.086349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.087010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.088375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.089086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.089765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.179099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:01.180286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:01.214750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.224946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.227613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.228612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:01.233146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:01.234465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:01.659550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:01.673405 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ad98df4-2916-4da3-98c2-ee9703c8534d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1223 microversion: 2.1 time: 0.501891 Oct 03 14:59:01.681997 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2838/5534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:01 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1223 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:01.691014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2106736532", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "ba6601fc-7e27-4f01-9946-12c755b1aa88"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:01.788227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] validate_networks() for [('ba6601fc-7e27-4f01-9946-12c755b1aa88', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:59:01.939405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:01.952506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c1543af6-155b-4c00-9aa5-216894d45b20 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 0.886276 Oct 03 14:59:01.968397 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2697/5535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:01 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:02.708515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:02.709252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:02.726503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.728621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.729246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.730036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:02.732482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:02.736246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:02.747160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:03.100301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:03.117591 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9daad1d7-05da-4703-8b60-86b813c01857 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1285 microversion: 2.1 time: 0.413390 Oct 03 14:59:03.118244 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2698/5536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:02 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1285 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:03.137984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:03.138859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:03.176729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:03.176729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:03.176729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:03.176729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:03.176729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:03.176729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:03.245200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:04.376903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:04.390102 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-486c2880-814e-42bc-b93f-c59be8078ead tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 1.270218 Oct 03 14:59:04.390726 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2699/5537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:03 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:04.611744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:59:04.613434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:59:04.614110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:59:04.614908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:59:04.615236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:59:04.644468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:04.645322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:04.651180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.654759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:04.657362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:04.658471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.740910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Getting quotas for project bfe736ca183e4d4b8781ffb232c49a67. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:59:04.748741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Getting quotas for user 4fd097a3bb5f423488f27fa319f636ba and project bfe736ca183e4d4b8781ffb232c49a67. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:59:04.797529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:59:04.799976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:59:04.804556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-af1d49fc-7eef-40f8-b0ca-0781b9a629ec req-1534eb0e-0104-4474-9274-f8c1d22d5217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4aa48c-6241-42ec-8d48-852fd00b64e3", "tag": "fd05eeca-e1ac-47ab-81b4-f4b10768505d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:04.875669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-af1d49fc-7eef-40f8-b0ca-0781b9a629ec req-1534eb0e-0104-4474-9274-f8c1d22d5217 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:04.878550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-af1d49fc-7eef-40f8-b0ca-0781b9a629ec req-1534eb0e-0104-4474-9274-f8c1d22d5217 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:04.879294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-af1d49fc-7eef-40f8-b0ca-0781b9a629ec req-1534eb0e-0104-4474-9274-f8c1d22d5217 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.913577 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea5bffdc-22e4-46aa-a704-1ce011681dd4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.230280 Oct 03 14:59:04.914915 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2839/5538] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:59:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:59:04.920020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:04.921284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:04.928157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:04.928880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:04.929608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.930585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:04.931258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:04.931992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:04.944505 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-af1d49fc-7eef-40f8-b0ca-0781b9a629ec req-1534eb0e-0104-4474-9274-f8c1d22d5217 service nova] Creating event network-changed:fd05eeca-e1ac-47ab-81b4-f4b10768505d for instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 on n-h2-781139-2 Oct 03 14:59:04.980236 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-af1d49fc-7eef-40f8-b0ca-0781b9a629ec req-1534eb0e-0104-4474-9274-f8c1d22d5217 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.570371 Oct 03 14:59:04.981902 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2700/5539] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:04.991555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-306e3a84-5f73-47af-9e6a-f59d79fb102b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:05.021281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-306e3a84-5f73-47af-9e6a-f59d79fb102b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:05.161213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-306e3a84-5f73-47af-9e6a-f59d79fb102b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:05.177132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-306e3a84-5f73-47af-9e6a-f59d79fb102b tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1219 microversion: 2.1 time: 0.189662 Oct 03 14:59:05.179111 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2701/5540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:04 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:05.375781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7343808f-a6a5-40aa-bfa8-fff17d5c772b req-ed73fef5-3940-4abc-beb5-a154d05fa2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147e2c8d-3333-4c10-9130-3139e3313608", "tag": "838c4b59-3633-4b72-bbac-508dc55d21a8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:05.432344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7343808f-a6a5-40aa-bfa8-fff17d5c772b req-ed73fef5-3940-4abc-beb5-a154d05fa2b6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.433569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7343808f-a6a5-40aa-bfa8-fff17d5c772b req-ed73fef5-3940-4abc-beb5-a154d05fa2b6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.436520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7343808f-a6a5-40aa-bfa8-fff17d5c772b req-ed73fef5-3940-4abc-beb5-a154d05fa2b6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.483150 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7343808f-a6a5-40aa-bfa8-fff17d5c772b req-ed73fef5-3940-4abc-beb5-a154d05fa2b6 service nova] Creating event network-changed:838c4b59-3633-4b72-bbac-508dc55d21a8 for instance 147e2c8d-3333-4c10-9130-3139e3313608 on n-h1-781139-2 Oct 03 14:59:05.510231 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7343808f-a6a5-40aa-bfa8-fff17d5c772b req-ed73fef5-3940-4abc-beb5-a154d05fa2b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137393 Oct 03 14:59:05.512337 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2702/5541] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:59:05.534407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:05.537825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:05.570631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.574487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.575983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.581019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:05.582339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:05.585234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:05.899523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:05.916203 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35d57509-9e03-4c6b-9083-bcfb3acb0c2c tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.999847 Oct 03 14:59:05.917139 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2840/5542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:04 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:06.059994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:06.070013 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-02487c4d-fe88-4d2a-a222-2377eb29c87c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 0.553626 Oct 03 14:59:06.071461 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2703/5543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:05 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:06.203180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:06.204199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:06.217127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.226409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.226986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:06.230206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.231710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.232437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:06.300631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:06.566384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:06.596584 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7245420b-b8ed-4ea0-ac20-134a8196dbc8 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1223 microversion: 2.1 time: 0.398237 Oct 03 14:59:06.607110 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2841/5544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:06 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1223 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:06.945495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:06.947126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:06.961672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.962372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.963574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:06.966723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:06.967885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:06.968603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:07.098884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:07.099505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:07.103206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:07.117275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:07.118220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:07.119231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:07.120949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:07.123035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:07.124885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:07.550762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:07.559247 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4865202-8f32-4600-b748-a0a88f003904 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.619086 Oct 03 14:59:07.566481 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2704/5545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:06 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:07.622331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:07.623034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:07.631705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:07.632208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:07.632682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:07.633387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:07.633840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:07.634265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:07.892006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:07.908018 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e4c36593-6bf4-4ba4-95d7-efc50e4806cb tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1277 microversion: 2.1 time: 0.290939 Oct 03 14:59:07.926715 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2705/5546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:07 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:07.932518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f83ea561-843c-452a-8150-460258622330 req-98d949aa-7d9d-4b47-afe8-4ddd60b98f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4", "tag": "fce44bdf-10f7-4784-8bcc-8b34a9bdbf12"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:07.960383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f83ea561-843c-452a-8150-460258622330 req-98d949aa-7d9d-4b47-afe8-4ddd60b98f77 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:07.962661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f83ea561-843c-452a-8150-460258622330 req-98d949aa-7d9d-4b47-afe8-4ddd60b98f77 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:07.963686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f83ea561-843c-452a-8150-460258622330 req-98d949aa-7d9d-4b47-afe8-4ddd60b98f77 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:08.027625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f83ea561-843c-452a-8150-460258622330 req-98d949aa-7d9d-4b47-afe8-4ddd60b98f77 service nova] Creating event network-changed:fce44bdf-10f7-4784-8bcc-8b34a9bdbf12 for instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 on n-h1-781139-2 Oct 03 14:59:08.045519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f83ea561-843c-452a-8150-460258622330 req-98d949aa-7d9d-4b47-afe8-4ddd60b98f77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114925 Oct 03 14:59:08.046756 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2706/5547] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:08.218664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:08.236132 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-364979b7-446f-407b-92ff-11b0b94f233c tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 1.141068 Oct 03 14:59:08.242612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2842/5548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:07 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:08.593780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:08.594968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:08.612113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:08.614249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:08.615264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:08.618289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:08.620487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:08.622128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:08.932749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:08.933719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:08.946910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:08.951575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:08.957246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:08.962744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:08.965820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:08.967403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:08.973960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:09.603987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:09.614903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-470dd40a-5406-42f1-ad9f-5d686781ef3e tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1277 microversion: 2.1 time: 0.686786 Oct 03 14:59:09.617690 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2843/5549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:08 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1277 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:09.637893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:09.646763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:09.666271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:09.677809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:09.679481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:09.680156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:09.681869 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6d05ce63-ac55-4696-b328-82eb013150c7 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 1.093004 Oct 03 14:59:09.683371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:09.685864 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2707/5550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:08 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:09.686241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:09.686889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:09.918951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:09.937736 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d83ee510-654d-40a9-a43f-e00f30bfde04 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 0.315650 Oct 03 14:59:09.941955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2844/5551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:09 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:10.483283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6271fa4e-1c35-491f-a4d3-5932523c8c2a req-305d869d-8af2-4e7d-a1d9-026efd5f7b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aa48c-6241-42ec-8d48-852fd00b64e3", "name": "network-vif-plugged", "status": "completed", "tag": "fd05eeca-e1ac-47ab-81b4-f4b10768505d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:10.503772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6271fa4e-1c35-491f-a4d3-5932523c8c2a req-305d869d-8af2-4e7d-a1d9-026efd5f7b22 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.504404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6271fa4e-1c35-491f-a4d3-5932523c8c2a req-305d869d-8af2-4e7d-a1d9-026efd5f7b22 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.504855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6271fa4e-1c35-491f-a4d3-5932523c8c2a req-305d869d-8af2-4e7d-a1d9-026efd5f7b22 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.521000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6271fa4e-1c35-491f-a4d3-5932523c8c2a req-305d869d-8af2-4e7d-a1d9-026efd5f7b22 service nova] Creating event network-vif-plugged:fd05eeca-e1ac-47ab-81b4-f4b10768505d for instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 on n-h2-781139-2 Oct 03 14:59:10.527630 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6271fa4e-1c35-491f-a4d3-5932523c8c2a req-305d869d-8af2-4e7d-a1d9-026efd5f7b22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050595 Oct 03 14:59:10.528374 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2708/5552] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:10.643024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:10.644440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:10.657421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.657989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.658516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.659577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.660908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.661353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.712855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:10.713784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:10.731650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.732257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.733397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.735229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.736898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.737635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.907425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:10.920968 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff84b2e9-7e66-4a9b-99bd-41e076367fce tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1319 microversion: 2.1 time: 0.284869 Oct 03 14:59:10.921990 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2845/5553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:10 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:10.972634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:10.973552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:10.982560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.983246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.984183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:10.985321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:10.985921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:10.986537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:11.107535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:11.124231 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b6e02c1-ceff-4d36-9266-c15c1ffbe12d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.416471 Oct 03 14:59:11.131222 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2709/5554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:10 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:11.272960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:11.282191 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3af22f70-8724-4b92-bfa7-7c35e8b40338 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1314 microversion: 2.1 time: 0.315322 Oct 03 14:59:11.286073 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2846/5555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:10 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:11.945248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:11.946631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:11.960098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:11.961995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:11.963110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:11.966321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:11.967141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:11.968527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.151181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:12.151953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:12.164214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:12.166084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:12.168121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.171043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:12.172384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:12.174391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.585508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:12.596102 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7fbe6c2c-2fbd-47bf-9b09-eb26f2486870 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.448734 Oct 03 14:59:12.599338 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2847/5556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:12 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:12.612742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:12.613760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:12.630064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:12.632203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:12.633477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.634343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:12.634905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:12.635435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.815801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:12.828595 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7aef368d-71c0-4a6c-990b-745b428ee91d tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1319 microversion: 2.1 time: 0.888206 Oct 03 14:59:12.830921 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2710/5557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:11 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1319 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:12.836365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1f13224f-d0ff-4da2-92c0-be8f302a67b8 req-e1262d21-e8b3-411d-994d-b70e22b75dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d143879-8d49-4eaf-a3f6-7d47fbe402d4", "tag": "5fc0406d-0041-42b2-80d3-733ddec9b4f0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:12.849834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1f13224f-d0ff-4da2-92c0-be8f302a67b8 req-e1262d21-e8b3-411d-994d-b70e22b75dc7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:12.850319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1f13224f-d0ff-4da2-92c0-be8f302a67b8 req-e1262d21-e8b3-411d-994d-b70e22b75dc7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:12.852085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1f13224f-d0ff-4da2-92c0-be8f302a67b8 req-e1262d21-e8b3-411d-994d-b70e22b75dc7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:12.906378 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1f13224f-d0ff-4da2-92c0-be8f302a67b8 req-e1262d21-e8b3-411d-994d-b70e22b75dc7 service nova] Creating event network-changed:5fc0406d-0041-42b2-80d3-733ddec9b4f0 for instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 on n-h2-781139-2 Oct 03 14:59:12.916698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1f13224f-d0ff-4da2-92c0-be8f302a67b8 req-e1262d21-e8b3-411d-994d-b70e22b75dc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083770 Oct 03 14:59:12.920141 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2711/5558] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:12.998489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:13.007516 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e392d413-196c-466e-89f4-ba0aba2adaf4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1500 microversion: 2.1 time: 0.406868 Oct 03 14:59:13.010161 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2848/5559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:12 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1500 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:13.044649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:13.047129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:13.065957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.067726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.069338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:13.070367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.071004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.073970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:13.116034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lazy-loading 'flavor' on Instance uuid 6a4aa48c-6241-42ec-8d48-852fd00b64e3 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:59:13.331260 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-756322bd-0715-4c1b-afb9-281962b9b389 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "POST /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3/action" status: 200 len: 32 microversion: 2.1 time: 0.293731 Oct 03 14:59:13.332432 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2712/5560] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 14:59:13 2022] POST /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3/action => generated 32 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 14:59:13.347696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:13.349096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:13.385714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.389215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.390451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:13.391471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.392139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.393008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:13.627946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:13.628678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:13.663204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.671561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.672388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:13.675626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:13.676214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:13.677245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:14.078902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:14.091683 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-236cf0d9-8e42-409a-bfc7-e2880d78e333 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.469699 Oct 03 14:59:14.097011 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2713/5561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:13 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:14.102139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:14.110371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:14.132453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:14.138109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:14.140093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:14.141516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:14.146050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:14.151946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:14.348404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:14.365371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f43dbd2-7a81-40dd-bbdd-c2928d76de77 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 1.024421 Oct 03 14:59:14.367991 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2849/5562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:13 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:14.417625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:14.449335 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61c48110-87c9-459b-94c1-dc3e90371eae tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1319 microversion: 2.1 time: 0.350881 Oct 03 14:59:14.450018 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2714/5563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:14 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:15.115945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:15.116639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:15.127688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:15.132429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=16 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:15.139587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.142163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.142676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.143637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.153917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.155241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.395711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:15.397016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:15.400701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:15.427990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.428725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.430807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.431703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.432305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.435079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.547276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:15.557303 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-679255ab-8ff0-40a0-965c-c043d496bb04 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.445464 Oct 03 14:59:15.561427 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2850/5564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:15 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:15.572795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:15.573765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:15.591481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.593813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.594437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:15.596510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:15.598132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:15.598713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:16.163870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:16.203861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96ac95ac-ab22-4b41-8def-30dbc4106be4 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1319 microversion: 2.1 time: 0.640872 Oct 03 14:59:16.206556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2851/5565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:15 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:16.362000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:16.375052 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b66eff7c-ea0d-42a9-a87e-675f61b3cd1a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.984210 Oct 03 14:59:16.376721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2715/5566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:15 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:16.585767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:16.587203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:16.608242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:16.609543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:16.610342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:16.611281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:16.611948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:16.612577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:16.721467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e2a38dcf-9b4d-462d-8cef-d41c201537cd req-d93cdd63-396e-4896-9154-fe375100c69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4", "name": "network-vif-plugged", "status": "completed", "tag": "fce44bdf-10f7-4784-8bcc-8b34a9bdbf12"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:16.741506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e2a38dcf-9b4d-462d-8cef-d41c201537cd req-d93cdd63-396e-4896-9154-fe375100c69d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:16.742433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e2a38dcf-9b4d-462d-8cef-d41c201537cd req-d93cdd63-396e-4896-9154-fe375100c69d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:16.743076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e2a38dcf-9b4d-462d-8cef-d41c201537cd req-d93cdd63-396e-4896-9154-fe375100c69d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:16.768906 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e2a38dcf-9b4d-462d-8cef-d41c201537cd req-d93cdd63-396e-4896-9154-fe375100c69d service nova] Creating event network-vif-plugged:fce44bdf-10f7-4784-8bcc-8b34a9bdbf12 for instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 on n-h1-781139-2 Oct 03 14:59:16.782649 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e2a38dcf-9b4d-462d-8cef-d41c201537cd req-d93cdd63-396e-4896-9154-fe375100c69d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062599 Oct 03 14:59:16.783770 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2716/5567] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:16.799081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:16.811164 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5851dc42-cf20-466f-b431-2c69238f44cd tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.229249 Oct 03 14:59:16.812454 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2852/5568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:16 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:17.230476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:17.232162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:17.240108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.240864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.241936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:17.242994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.244030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.244789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:17.397921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:17.398546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:17.406452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.406784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.407224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:17.408276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.409259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.409897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:17.484247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:17.486785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:17.494408 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3439f325-cc3b-4c95-ac5b-a5144f2f671c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1319 microversion: 2.1 time: 0.269131 Oct 03 14:59:17.495003 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2717/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:17 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:17.674327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:17.682620 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4a277f4-69b0-494a-8574-b266e6324488 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.288613 Oct 03 14:59:17.683205 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2853/5570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:17 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:17.838957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:17.840150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:17.850218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.851159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.851798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:17.852725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:17.853482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:17.854260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.169215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:18.187623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7979b89-e8de-495a-bb47-98f6c01c98e9 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1327 microversion: 2.1 time: 0.352634 Oct 03 14:59:18.189582 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2718/5571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:17 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1327 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:18.518140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:18.518927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:18.529357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.531464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.533331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.535278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.536033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.536642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.707926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:18.708825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:18.717316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.717875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.718380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.719282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.719975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.720559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.860152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:18.889491 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac05d884-b9c2-416f-aae9-31e51c128622 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1319 microversion: 2.1 time: 0.374457 Oct 03 14:59:18.892587 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2854/5572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:18 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:18.898818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-054760f7-498e-4d97-8d5d-c8698b9dc9b8 req-76f4e597-ae02-4f4e-b375-ed12993df498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d143879-8d49-4eaf-a3f6-7d47fbe402d4", "name": "network-vif-plugged", "status": "completed", "tag": "5fc0406d-0041-42b2-80d3-733ddec9b4f0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:18.914094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-054760f7-498e-4d97-8d5d-c8698b9dc9b8 req-76f4e597-ae02-4f4e-b375-ed12993df498 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:18.915486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-054760f7-498e-4d97-8d5d-c8698b9dc9b8 req-76f4e597-ae02-4f4e-b375-ed12993df498 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:18.915919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-054760f7-498e-4d97-8d5d-c8698b9dc9b8 req-76f4e597-ae02-4f4e-b375-ed12993df498 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:18.935531 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-054760f7-498e-4d97-8d5d-c8698b9dc9b8 req-76f4e597-ae02-4f4e-b375-ed12993df498 service nova] Creating event network-vif-plugged:5fc0406d-0041-42b2-80d3-733ddec9b4f0 for instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 on n-h2-781139-2 Oct 03 14:59:18.941904 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-054760f7-498e-4d97-8d5d-c8698b9dc9b8 req-76f4e597-ae02-4f4e-b375-ed12993df498 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047595 Oct 03 14:59:18.942664 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2855/5573] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:19.006647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:19.017870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d3b80d5-968d-4be4-b57d-aca8d8562d02 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.314942 Oct 03 14:59:19.018385 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2719/5574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:18 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:19.214593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:19.215373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:19.227868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:19.228369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:19.229318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:19.230184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:19.230943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:19.233710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:19.637785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:19.647959 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3f19958-68b1-4012-857d-cf8f99f6f786 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1527 microversion: 2.1 time: 0.439277 Oct 03 14:59:19.650591 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2856/5575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:19 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1527 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:19.676447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:19.679053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:19.688122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:19.688974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:19.689591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:19.690667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:19.692563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:19.693259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:19.915495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:19.916814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:19.929223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:19.930007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:19.930829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:19.937023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:19.937744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:19.938361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.093464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:20.107720 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b295f298-3ae0-4577-9758-65c982266cc0 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1527 microversion: 2.1 time: 0.435102 Oct 03 14:59:20.122933 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2720/5576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:19 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1527 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:20.144127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:20.145231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:20.159395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.159864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.160307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.161091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.166569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.167105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.258995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:20.268784 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d49aa335-450e-4e3c-89bb-9232a99412c6 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1319 microversion: 2.1 time: 0.358284 Oct 03 14:59:20.280954 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2857/5577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:19 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:20.539391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:20.549702 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ebd534da-f485-4cd5-ab56-d1fa4cb7bdb0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.412765 Oct 03 14:59:20.550505 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2721/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:20 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:20.739802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:20.740714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:20.755868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.756621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.757280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.758185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.758881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.759531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.780696 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] HTTP exception thrown: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Request method failure captured: Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 HTTP/1.1 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOviv9lhTpt0LLPPeHhCSKQbHP8MbKqPDqp2mQiw50HV6zt8LV1qoGg7ZmejpVpUkkiiqWG3Dib9AMinPTuiQx4j-EptVBCpoo967AK6176khhvoIGe7BgrLtVFDtTjnLHaD_nkRxFOj6V5sI8w0MP-LCKfU-gD9xGinSXD2LEx8LzfI Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8b3f222f5fa9492c8f6d3b75b480a2ad Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1651502738 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b3f222f5fa9492c8f6d3b75b480a2ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b3f222f5fa9492c8f6d3b75b480a2ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3f222f5fa9492c8f6d3b75b480a2ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3f222f5fa9492c8f6d3b75b480a2ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1651502738 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8b3f222f5fa9492c8f6d3b75b480a2ad Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1651502738 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1651502738-project Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9f7fdc005f9645cb982227a6e6179a53 Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1651502738-project Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4'} Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:20.789280 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:20.792490 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:20.796071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Returning 404 to user: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:20.797119 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29670620-a3c9-4959-8e9b-9336763a5823 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 404 len: 111 microversion: 2.1 time: 0.520823 Oct 03 14:59:20.798833 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2858/5579] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:59:20 2022] DELETE /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 111 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:20.809240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:20.810160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:20.817834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.818644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.819312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:20.820489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:20.821180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:20.821824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.038563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:21.047738 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-074c5e3d-474e-4142-95cb-b9f1b89956a6 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1527 microversion: 2.1 time: 0.244432 Oct 03 14:59:21.048611 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2722/5580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:20 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1527 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:21.070621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Action: 'update', calling method: >, body: {"server": {"name": "6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4_new"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:21.073248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:21.080267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.080759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.081387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.082291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.083363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.083938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.100355 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] HTTP exception thrown: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Request method failure captured: Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: request: PUT /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 HTTP/1.1 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 64 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOviv9lhTpt0LLPPeHhCSKQbHP8MbKqPDqp2mQiw50HV6zt8LV1qoGg7ZmejpVpUkkiiqWG3Dib9AMinPTuiQx4j-EptVBCpoo967AK6176khhvoIGe7BgrLtVFDtTjnLHaD_nkRxFOj6V5sI8w0MP-LCKfU-gD9xGinSXD2LEx8LzfI Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 8b3f222f5fa9492c8f6d3b75b480a2ad Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1651502738 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b3f222f5fa9492c8f6d3b75b480a2ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b3f222f5fa9492c8f6d3b75b480a2ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3f222f5fa9492c8f6d3b75b480a2ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b3f222f5fa9492c8f6d3b75b480a2ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1651502738 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 8b3f222f5fa9492c8f6d3b75b480a2ad Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1651502738 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1651502738-project Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 9f7fdc005f9645cb982227a6e6179a53 Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1651502738-project Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: {"server": {"name": "6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4_new"}} Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4', 'body': {'server': {'name': '6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4_new'}}} Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 14:59:21.102253 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] Returning 404 to user: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:21.105555 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2ab59a9-9ba6-4bfb-9929-e9eec2a69ad0 tempest-ServersNegativeTestMultiTenantJSON-1651502738 tempest-ServersNegativeTestMultiTenantJSON-1651502738-project] 10.222.0.20 "PUT /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 404 len: 111 microversion: 2.1 time: 0.037576 Oct 03 14:59:21.113058 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2859/5581] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 14:59:21 2022] PUT /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:21.115011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:21.116133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:21.123678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.124255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.124760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.125565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.126086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.126576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.179062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:59:21.297713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:21.298396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:21.310866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.311361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.314464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.315257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.315725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.316184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.327910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:21.388235 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-01c21165-fef1-42cf-a1a5-1a119a2cf943 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 204 len: 0 microversion: 2.1 time: 0.276959 Oct 03 14:59:21.389362 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2723/5582] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 14:59:21 2022] DELETE /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 14:59:21.408487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:21.412402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:21.434324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.434906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.435485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.436302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.437052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.437942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.640343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:21.651400 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07fb04c3-7434-4faf-be5b-e9ea7dc45df8 tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1533 microversion: 2.1 time: 0.256336 Oct 03 14:59:21.665803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2724/5583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:21 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1533 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:21.678409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:21.679525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:21.693997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.694493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.694931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:21.695638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:21.696090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:21.696518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:22.105137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:22.117316 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64443185-a2d4-4579-95f2-10b233b5c669 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1508 microversion: 2.1 time: 0.827907 Oct 03 14:59:22.119334 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2860/5584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:21 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1508 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:22.148121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "078eb624-918e-423f-a90e-26f7b0072165", "device": "/dev/sdb"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:22.152188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:22.174468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:22.175055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:22.175813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:22.176693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:22.177273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:22.177796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:22.428030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:22.443958 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-757b5480-73fd-43eb-aa89-dfc43931e15f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.776533 Oct 03 14:59:22.444810 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2725/5585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:21 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:22.678839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:22.679805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:22.691143 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48b7401f-4923-48c4-829d-afc5ece27f18 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "POST /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542327 Oct 03 14:59:22.692250 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2861/5586] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 14:59:22 2022] POST /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:59:22.694145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:22.695645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:22.696276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:22.697595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:22.698491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:22.703093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:23.055695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:23.066386 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b3dc3c8f-2d67-481e-bcfc-12467f2c35bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1533 microversion: 2.1 time: 0.393001 Oct 03 14:59:23.070627 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2726/5587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:22 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1533 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:23.472673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:23.473561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:23.495131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:23.496429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:23.498993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:23.504256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:23.505270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:23.510214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:24.348999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:24.365561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccdefbb1-79d2-43cb-beb3-4f37636542e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.897049 Oct 03 14:59:24.367870 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2862/5588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:23 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:24.378848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:24.379679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:24.401276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:24.403287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:24.404305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:24.408066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:24.408883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:24.410862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:24.490441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:24.491058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:24.491360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:24.491818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lazy-loading 'fault' on Instance uuid 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:59:24.546998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-298a458e-fdf2-4c4e-8668-02bdd3d2e38a req-774d8cbc-16b0-4ddc-8898-61a126141973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4", "name": "network-vif-deleted", "tag": "fce44bdf-10f7-4784-8bcc-8b34a9bdbf12"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:24.559729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32ef6613b3dd49cc81074cb05cccb7a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21be13d3eee24f8c938dc298276c8b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:24.582616 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db79b08a-4b1a-4a04-b3fb-82e9fa0cd42d tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 200 len: 1317 microversion: 2.1 time: 0.213006 Oct 03 14:59:24.583417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-298a458e-fdf2-4c4e-8668-02bdd3d2e38a req-774d8cbc-16b0-4ddc-8898-61a126141973 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:24.585462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-298a458e-fdf2-4c4e-8668-02bdd3d2e38a req-774d8cbc-16b0-4ddc-8898-61a126141973 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:24.588886 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2863/5589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:24 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:24.589147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-298a458e-fdf2-4c4e-8668-02bdd3d2e38a req-774d8cbc-16b0-4ddc-8898-61a126141973 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:24.609037 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-298a458e-fdf2-4c4e-8668-02bdd3d2e38a req-774d8cbc-16b0-4ddc-8898-61a126141973 service nova] Creating event network-vif-deleted:fce44bdf-10f7-4784-8bcc-8b34a9bdbf12 for instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 on n-h1-781139-2 Oct 03 14:59:24.615598 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-298a458e-fdf2-4c4e-8668-02bdd3d2e38a req-774d8cbc-16b0-4ddc-8898-61a126141973 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.554673 Oct 03 14:59:24.616520 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2727/5590] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:59:25.394751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:25.395464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:25.404221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:25.405044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:25.405749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:25.406854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:25.407510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:25.408614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:25.612681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:25.613729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] [instance: 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:25.629372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:25.630075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:25.630659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:25.631599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:25.632325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:25.632897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:25.648442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] HTTP exception thrown: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Request method failure captured: Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 HTTP/1.1 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvif5sfKvaH_vmGuD9UNvDZ7rTrrsZ6ZyXCpZivVU31JrKKdq3hfaGYzBHa69xWaSEtnfxmQoCJ0PvkOSR7uZNShY-rtiaeA4O7tMwWpvujgwnyPoyuLGfU6cG70LTDQtiv5u3Rt6AwH9iC1pwE0Ak_jR1VcQlQO0xBiM6CsZDq0Nqo Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 21be13d3eee24f8c938dc298276c8b7f Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1178561442 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/21be13d3eee24f8c938dc298276c8b7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_21be13d3eee24f8c938dc298276c8b7f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21be13d3eee24f8c938dc298276c8b7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/21be13d3eee24f8c938dc298276c8b7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1178561442 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 21be13d3eee24f8c938dc298276c8b7f Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1178561442 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1178561442-project Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 32ef6613b3dd49cc81074cb05cccb7a8 Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1178561442-project Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4'} Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:25.650396 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. Oct 03 14:59:25.653612 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:25.656000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] Returning 404 to user: Instance 6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:25.657089 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12eb21f5-f2c5-4898-9cba-e5eaa46de6bc tempest-ServersNegativeTestMultiTenantJSON-1178561442 tempest-ServersNegativeTestMultiTenantJSON-1178561442-project] 10.222.0.20 "GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4" status: 404 len: 111 microversion: 2.1 time: 0.049905 Oct 03 14:59:25.657856 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2728/5591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:25 2022] GET /compute/v2.1/servers/6d3ee7ff-b63a-4fad-b44f-1d55400eb6a4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 14:59:25.696996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:25.712643 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e83ef071-7a19-4387-9971-4baaf0743328 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.322193 Oct 03 14:59:25.713395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2864/5592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:25 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:26.741594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:26.742840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:26.750400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:26.751144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:26.751807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:26.752697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:26.753355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:26.754002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:27.014500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:27.032463 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-16c27e64-48b2-443e-88d1-df325064d2dc tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.294727 Oct 03 14:59:27.034405 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2729/5593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:26 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:28.059586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:28.060140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:28.073589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:28.074907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:28.075674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:28.076587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:28.077261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:28.077865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:28.512709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:28.524464 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55cd4b04-a571-4d22-92d1-9103983e4b36 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.470823 Oct 03 14:59:28.525493 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2865/5594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:28 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:29.550414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:29.551640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:29.560470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:29.562717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:29.563396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:29.564120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:29.565109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:29.565955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:29.566706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:29.779634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:29.789130 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-81a568a5-941d-4fef-9707-e6a138977d95 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.244238 Oct 03 14:59:29.795493 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2730/5595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:29 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:30.836489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:30.837113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:30.855828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:30.858903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:30.859449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:30.860393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:30.860851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:30.873767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:31.340708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:31.349900 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-966dfa9a-0b3e-4aa7-8aef-d7b8fd7bd1b4 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.530016 Oct 03 14:59:31.353254 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2866/5596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:30 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:32.379978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:32.383359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:32.395455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:32.396338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:32.397134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:32.398182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:32.398785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:32.399464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:32.820180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:32.830373 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f179243f-c829-4979-b9bc-80b79cf05851 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.460663 Oct 03 14:59:32.834289 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2731/5597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:32 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:33.858286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:33.859553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:33.866980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:33.867801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:33.868798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:33.869848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:33.870321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:33.871031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:34.161203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:34.188877 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b6221819-a343-49d4-9af2-6e1a2fcdee0e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.334223 Oct 03 14:59:34.197358 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2867/5598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:33 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:35.213971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:35.215082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:35.225938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:35.227097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:35.227751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:35.228976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:35.229641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:35.230936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:35.658808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:35.672642 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3241beb-8db6-4ff3-9812-7b6ad503dcb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.461957 Oct 03 14:59:35.677199 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2732/5599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:35 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:36.695686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:36.696308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:36.730259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:36.731996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:36.735004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:36.735944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:36.737517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:36.738106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:37.142024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:37.154012 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f426209-fce4-4b39-a473-fcd2c6c61b3e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.462174 Oct 03 14:59:37.154839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2868/5600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:36 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:37.882625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:37.886258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:37.896910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:37.899042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:37.900943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:37.902609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:37.904222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:37.904817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:37.982306 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb8ab20d-769a-4978-bbde-83f739ce5bde tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.100412 Oct 03 14:59:37.992231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2733/5601] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 3 14:59:37 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:38.115644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:38.116271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:38.129927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=56 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:38.146911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:38.147609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:38.148060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:38.148794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:38.158216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:38.158216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:38.179353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:38.179995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:38.199164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:38.200359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:38.200824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:38.209474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:38.210488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:38.211134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:38.275436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 14:59:38.309520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:38.550749 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-92851f87-f624-4798-9770-08f43034a367 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 204 len: 0 microversion: 2.20 time: 0.439904 Oct 03 14:59:38.551346 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2869/5602] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:59:38 2022] DELETE /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:59:38.582528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:38.584223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:38.612492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:38.613501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:38.614512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:38.615443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:38.619494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:38.622771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:39.046969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:39.055869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:39.057366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:39.058632 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35da3b74-7ce2-432d-a89c-21ca6ae8ebf1 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.502370 Oct 03 14:59:39.066043 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2870/5603] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:59:38 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:59:39.412250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:39.423539 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8e353fe6-264c-475b-a34f-0ad2c24bb9bb tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 1.248740 Oct 03 14:59:39.424247 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2734/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:38 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:40.093422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:40.094364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:40.103822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.104463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.105370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:40.106241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.106806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.108030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:40.345884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:40.357147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:40.362547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:40.369037 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f34a3ee2-365e-4ae2-9af8-de7ea20ff438 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.278313 Oct 03 14:59:40.371635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2871/5605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:59:40 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:59:40.448090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:40.449087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:40.462289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.463007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.463500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:40.464190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:40.465187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:40.465881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:40.972811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:41.000614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe6f88a6-39e0-4c77-8eb9-903340f05e57 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.556337 Oct 03 14:59:41.002041 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2735/5606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:40 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:41.400015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:41.400626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:41.413957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:41.414565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:41.415013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:41.415814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:41.416286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:41.416697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:41.785940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:41.804443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:41.806101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:41.807341 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55c192ec-23d2-4463-b890-1f7bbdb61d82 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1724 microversion: 2.20 time: 0.413478 Oct 03 14:59:41.819620 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2872/5607] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:59:41 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:59:42.027120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:42.027884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:42.047974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:42.048585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:42.051113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:42.053682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:42.055740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:42.058160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:42.839714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:42.841014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:42.855020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:42.861814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:42.864508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:42.865672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:42.867134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:42.868967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:42.909723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:43.049114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:43.061549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:43.064345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb80c02a281e4132aa50bb4de496525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82632b5ccf0a49cb83a76bac46f80c97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:43.066374 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad11ae01-14f7-4ac7-9459-f92b426585e7 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 200 len: 1656 microversion: 2.20 time: 0.231840 Oct 03 14:59:43.078470 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2873/5608] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:59:42 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 1656 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 14:59:43.242813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4ed85b4f-c4b0-4a6c-9d36-c3cb05a52d33 req-43e1d60d-f046-44df-a358-919e931748c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796f59f0-d25e-440a-8a63-d6cedc50b955", "name": "network-vif-deleted", "tag": "cfa9cd2b-641c-46a2-88cf-0a0614f33cdb"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:43.275362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4ed85b4f-c4b0-4a6c-9d36-c3cb05a52d33 req-43e1d60d-f046-44df-a358-919e931748c1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:43.277219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4ed85b4f-c4b0-4a6c-9d36-c3cb05a52d33 req-43e1d60d-f046-44df-a358-919e931748c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:43.278266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4ed85b4f-c4b0-4a6c-9d36-c3cb05a52d33 req-43e1d60d-f046-44df-a358-919e931748c1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:43.326629 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4ed85b4f-c4b0-4a6c-9d36-c3cb05a52d33 req-43e1d60d-f046-44df-a358-919e931748c1 service nova] Creating event network-vif-deleted:cfa9cd2b-641c-46a2-88cf-0a0614f33cdb for instance 796f59f0-d25e-440a-8a63-d6cedc50b955 on n-h1-781139-2 Oct 03 14:59:43.336373 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4ed85b4f-c4b0-4a6c-9d36-c3cb05a52d33 req-43e1d60d-f046-44df-a358-919e931748c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099921 Oct 03 14:59:43.341383 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2874/5609] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 14:59:43.358980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:43.392118 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-903697c8-8829-4a42-ad18-dc8003c73ee2 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 1.370071 Oct 03 14:59:43.413411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2736/5610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:42 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:44.100960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:44.101968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:44.119614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:44.122188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:44.123852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:44.126491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:44.128075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:44.129272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:44.189715 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] HTTP exception thrown: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Request method failure captured: Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 HTTP/1.1 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcFDdBYOCJuLVLlX6uB4UD0BUo5pKuKml-W2ySioby_wLB4m1Ois7kSMbxEM1tT5vam8scRC7-BXc_WfRQlmWvecOcv6cQkPByzAKKJHeXhy0PkegjGDIY9-1V2Tds-ZVuGfkcubzMxZrdY9QZLXlRimLEwRJb57ixoNsJtJJby-mc Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82632b5ccf0a49cb83a76bac46f80c97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb80c02a281e4132aa50bb4de496525c Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '796f59f0-d25e-440a-8a63-d6cedc50b955'} Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.191423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.194872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Returning 404 to user: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:44.197404 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55e81f0c-5949-4914-b502-66e13526554c tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 404 len: 111 microversion: 2.20 time: 0.101892 Oct 03 14:59:44.201047 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2875/5611] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:59:44 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:59:44.212537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c1a8887-a7e9-42de-9169-ce634a088930 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '.version_select at 0x7fb22b7b90d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:44.250833 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c1a8887-a7e9-42de-9169-ce634a088930 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-561435831" status: 204 len: 0 microversion: 2.20 time: 0.042249 Oct 03 14:59:44.251401 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2876/5612] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 3 14:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-561435831 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 14:59:44.424183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:44.425002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:44.443973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:44.444476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:44.444941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:44.445669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:44.467242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:44.468706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:44.540306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-369a402d-0133-440d-b1d3-8401a0b05f13 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Action: 'create', calling method: .version_select at 0x7fb230197c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-388026838", "metadata": {"Type": "work"}}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-369a402d-0133-440d-b1d3-8401a0b05f13 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Request method failure captured: Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 121 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvjfKLxawVaHugff2DZwRWnxgPqDz6rqL2lVXJJxtzlAYJErH5BBxVsr-XBKtzbR5pHQe4Fy8isd3tOy5u6I2Idydh9jY_7g9ba17Ub6lw8eeqDr5g7csxnRo4Osuf5HA38UHeP5Ssb7yTembB5vQDE6qzB3ijpD0fOwdRNIlKE-_w8 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b970c7906a71470aa1fd0891efdfb7a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3d2c69bd21054a9bb718316dfa714be7 Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-388026838", "metadata": {"Type": "work"}}} Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-388026838', 'metadata': {'Type': 'work'}}}} Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '#$%' Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:59:44.548810 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 14:59:44.552528 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.570343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-369a402d-0133-440d-b1d3-8401a0b05f13 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:44.575576 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-369a402d-0133-440d-b1d3-8401a0b05f13 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.402950 Oct 03 14:59:44.577264 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2737/5613] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 3 14:59:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 407 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:59:44.592894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6202e280-2f97-480c-a718-20a7e724f4ae tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Action: 'create', calling method: .version_select at 0x7fb2300e9e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1786391705", "metadata": {"Type": "work"}}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6202e280-2f97-480c-a718-20a7e724f4ae tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Request method failure captured: Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 120 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvjfKLxawVaHugff2DZwRWnxgPqDz6rqL2lVXJJxtzlAYJErH5BBxVsr-XBKtzbR5pHQe4Fy8isd3tOy5u6I2Idydh9jY_7g9ba17Ub6lw8eeqDr5g7csxnRo4Osuf5HA38UHeP5Ssb7yTembB5vQDE6qzB3ijpD0fOwdRNIlKE-_w8 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b970c7906a71470aa1fd0891efdfb7a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3d2c69bd21054a9bb718316dfa714be7 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1786391705", "metadata": {"Type": "work"}}} Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1786391705', 'metadata': {'Type': 'work'}}}} Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '0' Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:59:44.606463 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 14:59:44.611346 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.614664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6202e280-2f97-480c-a718-20a7e724f4ae tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:44.616989 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6202e280-2f97-480c-a718-20a7e724f4ae tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034727 Oct 03 14:59:44.621167 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2738/5614] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 3 14:59:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:59:44.650164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e399993-6f25-4acf-a0e3-caa6ff6fddd0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Action: 'create', calling method: .version_select at 0x7fb2300e6940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-938378920", "metadata": {"Type": "work"}}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e399993-6f25-4acf-a0e3-caa6ff6fddd0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Request method failure captured: Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 118 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvjfKLxawVaHugff2DZwRWnxgPqDz6rqL2lVXJJxtzlAYJErH5BBxVsr-XBKtzbR5pHQe4Fy8isd3tOy5u6I2Idydh9jY_7g9ba17Ub6lw8eeqDr5g7csxnRo4Osuf5HA38UHeP5Ssb7yTembB5vQDE6qzB3ijpD0fOwdRNIlKE-_w8 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b970c7906a71470aa1fd0891efdfb7a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3d2c69bd21054a9bb718316dfa714be7 Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-938378920", "metadata": {"Type": "work"}}} Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-938378920', 'metadata': {'Type': 'work'}}}} Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise error Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi '' Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 14:59:44.697745 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.702751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e399993-6f25-4acf-a0e3-caa6ff6fddd0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:44.704723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e399993-6f25-4acf-a0e3-caa6ff6fddd0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.070405 Oct 03 14:59:44.706106 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2739/5615] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 3 14:59:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:59:44.726777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-896a3b1f-f895-4a03-a737-96bf134999f2 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Calling method '.version_select at 0x7fb2302d5a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:44.791978 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-896a3b1f-f895-4a03-a737-96bf134999f2 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] HTTP exception thrown: Volume tempest-invalid-203710611 could not be found. Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-896a3b1f-f895-4a03-a737-96bf134999f2 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Request method failure captured: Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-203710611 HTTP/1.1 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvjfKLxawVaHugff2DZwRWnxgPqDz6rqL2lVXJJxtzlAYJErH5BBxVsr-XBKtzbR5pHQe4Fy8isd3tOy5u6I2Idydh9jY_7g9ba17Ub6lw8eeqDr5g7csxnRo4Osuf5HA38UHeP5Ssb7yTembB5vQDE6qzB3ijpD0fOwdRNIlKE-_w8 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b970c7906a71470aa1fd0891efdfb7a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3d2c69bd21054a9bb718316dfa714be7 Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: exception: Volume tempest-invalid-203710611 could not be found. Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'tempest-invalid-203710611'} Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-203710611 could not be found. (HTTP 404) (Request-ID: req-56846a30-c8af-4cf8-b2c6-3cd717b98617) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:59:44.795228 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-203710611 could not be found. Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-203710611 could not be found. Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-203710611 could not be found. Oct 03 14:59:44.799702 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.804364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-896a3b1f-f895-4a03-a737-96bf134999f2 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Returning 404 to user: Volume tempest-invalid-203710611 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:44.805479 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-896a3b1f-f895-4a03-a737-96bf134999f2 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-203710611" status: 404 len: 98 microversion: 2.1 time: 0.093315 Oct 03 14:59:44.806659 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2740/5616] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Oct 3 14:59:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-203710611 => generated 98 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 14:59:44.816393 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e764f72-4e81-4e37-a405-2d8eee4e676b tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004264 Oct 03 14:59:44.821534 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2741/5617] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 3 14:59:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 03 14:59:44.832711 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3d229d97-df90-4f43-8f2a-2125e0fdb449 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007267 Oct 03 14:59:44.833742 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2742/5618] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 3 14:59:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 14:59:44.847370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c97cfcc-f239-4b12-8ab3-34dcd87452b0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Calling method '.version_select at 0x7fb230197c10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:44.895479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:44.909323 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df43d4df-8916-41ea-a2c5-337832b2f090 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1506 microversion: 2.1 time: 0.489279 Oct 03 14:59:44.928972 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2877/5619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:44 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 14:59:44.946357 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0c97cfcc-f239-4b12-8ab3-34dcd87452b0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] HTTP exception thrown: Volume 375d6d45-b8e7-478a-a43b-dc74395fa187 could not be found. Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c97cfcc-f239-4b12-8ab3-34dcd87452b0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Request method failure captured: Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/os-volumes/375d6d45-b8e7-478a-a43b-dc74395fa187 HTTP/1.1 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvjfKLxawVaHugff2DZwRWnxgPqDz6rqL2lVXJJxtzlAYJErH5BBxVsr-XBKtzbR5pHQe4Fy8isd3tOy5u6I2Idydh9jY_7g9ba17Ub6lw8eeqDr5g7csxnRo4Osuf5HA38UHeP5Ssb7yTembB5vQDE6qzB3ijpD0fOwdRNIlKE-_w8 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b970c7906a71470aa1fd0891efdfb7a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3d2c69bd21054a9bb718316dfa714be7 Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: exception: Volume 375d6d45-b8e7-478a-a43b-dc74395fa187 could not be found. Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '375d6d45-b8e7-478a-a43b-dc74395fa187'} Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 375d6d45-b8e7-478a-a43b-dc74395fa187 could not be found. (HTTP 404) (Request-ID: req-2edf3485-80ac-487c-a18a-bdae997fb182) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:59:44.949296 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 375d6d45-b8e7-478a-a43b-dc74395fa187 could not be found. Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 375d6d45-b8e7-478a-a43b-dc74395fa187 could not be found. Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 375d6d45-b8e7-478a-a43b-dc74395fa187 could not be found. Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c97cfcc-f239-4b12-8ab3-34dcd87452b0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Returning 404 to user: Volume 375d6d45-b8e7-478a-a43b-dc74395fa187 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:44.955184 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0c97cfcc-f239-4b12-8ab3-34dcd87452b0 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/375d6d45-b8e7-478a-a43b-dc74395fa187" status: 404 len: 109 microversion: 2.1 time: 0.115627 Oct 03 14:59:44.958762 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2743/5620] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 14:59:44 2022] DELETE /compute/v2.1/os-volumes/375d6d45-b8e7-478a-a43b-dc74395fa187 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:44.966952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9841efa2-60cc-442e-a48f-0a4d1ebbff75 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Calling method '.version_select at 0x7fb22b6489d0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:45.028100 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9841efa2-60cc-442e-a48f-0a4d1ebbff75 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] HTTP exception thrown: Volume ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 could not be found. Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9841efa2-60cc-442e-a48f-0a4d1ebbff75 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Request method failure captured: Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/os-volumes/ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 HTTP/1.1 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvjfKLxawVaHugff2DZwRWnxgPqDz6rqL2lVXJJxtzlAYJErH5BBxVsr-XBKtzbR5pHQe4Fy8isd3tOy5u6I2Idydh9jY_7g9ba17Ub6lw8eeqDr5g7csxnRo4Osuf5HA38UHeP5Ssb7yTembB5vQDE6qzB3ijpD0fOwdRNIlKE-_w8 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b970c7906a71470aa1fd0891efdfb7a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b970c7906a71470aa1fd0891efdfb7a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b970c7906a71470aa1fd0891efdfb7a6 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesNegativeTest-1284803071 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3d2c69bd21054a9bb718316dfa714be7 Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesNegativeTest-1284803071-project Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: method: Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: exception: Volume ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 could not be found. Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ed5c7f6e-a781-42ce-98b5-2e427acf3fe2'} Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 could not be found. (HTTP 404) (Request-ID: req-b9f4beb9-04a6-405a-98b5-29ab62604d10) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 14:59:45.030428 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 could not be found. Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 could not be found. Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 could not be found. Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9841efa2-60cc-442e-a48f-0a4d1ebbff75 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] Returning 404 to user: Volume ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9841efa2-60cc-442e-a48f-0a4d1ebbff75 tempest-VolumesNegativeTest-1284803071 tempest-VolumesNegativeTest-1284803071-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ed5c7f6e-a781-42ce-98b5-2e427acf3fe2" status: 404 len: 109 microversion: 2.1 time: 0.070347 Oct 03 14:59:45.035692 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2878/5621] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 14:59:44 2022] GET /compute/v2.1/os-volumes/ed5c7f6e-a781-42ce-98b5-2e427acf3fe2 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 14:59:45.939907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:45.940560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:45.979191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:45.979846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:45.980372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:45.981162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:45.981625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:45.982050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:46.589403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:46.598585 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54103f90-2f7e-411b-a0da-2330c060044a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1486 microversion: 2.1 time: 0.663824 Oct 03 14:59:46.607296 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2744/5622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:45 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1486 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:46.792503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-412306626", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:46.908529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] validate_networks() for [('b9aa55a0-cd2f-4c43-9485-fbd6773ab0db', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 14:59:47.916341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 14:59:47.917506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 14:59:47.918330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 14:59:47.919135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 14:59:47.919960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 14:59:47.940621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:47.941429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:47.945492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:47.946515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:47.947135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:47.947756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:47.989863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Getting quotas for project 3f8de0a15a7b4a38876759625866f1d9. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 14:59:48.003479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Getting quotas for user 2d4287949baa4046b00749b4c46067be and project 3f8de0a15a7b4a38876759625866f1d9. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 14:59:48.038560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 14:59:48.041200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 14:59:48.165365 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8068d04c-ff58-4d66-986a-bb8565259861 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.381097 Oct 03 14:59:48.166025 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2879/5623] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 14:59:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 14:59:48.178149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f19862d-3a2d-4b83-bcaf-b9024effed3f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:48.178641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4f19862d-3a2d-4b83-bcaf-b9024effed3f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:48.428742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4f19862d-3a2d-4b83-bcaf-b9024effed3f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:48.437864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f19862d-3a2d-4b83-bcaf-b9024effed3f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1213 microversion: 2.1 time: 0.264004 Oct 03 14:59:48.438478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2745/5624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:48 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1213 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:49.470273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:49.470968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:49.486819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:49.487327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:49.487770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:49.488501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:49.488975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:49.489410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:49.708835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:49.723970 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7930942-7adb-4ee1-bf2d-48f2af91dd65 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1209 microversion: 2.1 time: 0.258461 Oct 03 14:59:49.725737 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2880/5625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:49 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1209 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:50.756538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:50.758006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:50.779898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:50.781016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:50.781645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:50.783199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:50.784619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:50.786898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:51.256393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:51.270324 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c9ba5c2-aafd-4d64-8962-609b4dd9d767 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1271 microversion: 2.1 time: 0.520261 Oct 03 14:59:51.276669 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2746/5626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:50 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1271 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:52.303754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:52.304451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:52.319069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:52.319564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:52.320000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:52.326445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:52.334004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:52.334734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:52.818965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:52.828493 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1efe9741-c61c-40f1-8320-8a3da7b2037b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1271 microversion: 2.1 time: 0.528995 Oct 03 14:59:52.840985 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2881/5627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:52 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1271 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:53.857698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:53.859576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:53.888278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:53.895410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:53.897592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:53.901166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:53.901929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:53.903478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.180894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:55.182039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:55.201604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.202567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.203651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.206277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.208995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.210110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.232847 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] HTTP exception thrown: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Request method failure captured: Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 HTTP/1.1 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcFDdBYOCJuLVLlX6uB4UD0BUo5pKuKml-W2ySioby_wLB4m1Ois7kSMbxEM1tT5vam8scRC7-BXc_WfRQlmWvecOcv6cQkPByzAKKJHeXhy0PkegjGDIY9-1V2Tds-ZVuGfkcubzMxZrdY9QZLXlRimLEwRJb57ixoNsJtJJby-mc Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82632b5ccf0a49cb83a76bac46f80c97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb80c02a281e4132aa50bb4de496525c Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '796f59f0-d25e-440a-8a63-d6cedc50b955'} Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:55.235922 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.239451 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.241150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Returning 404 to user: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:55.242245 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cf2bfc6-17a7-4722-a58d-a50d046db3cd tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 404 len: 111 microversion: 2.20 time: 0.066187 Oct 03 14:59:55.246835 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2882/5628] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 14:59:55 2022] DELETE /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 03 14:59:55.252054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:55.253113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: 796f59f0-d25e-440a-8a63-d6cedc50b955] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:55.260497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.261322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.261913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.262913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:55.263516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:55.264165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:55.283925 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] HTTP exception thrown: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Request method failure captured: Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 HTTP/1.1 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcFDdBYOCJuLVLlX6uB4UD0BUo5pKuKml-W2ySioby_wLB4m1Ois7kSMbxEM1tT5vam8scRC7-BXc_WfRQlmWvecOcv6cQkPByzAKKJHeXhy0PkegjGDIY9-1V2Tds-ZVuGfkcubzMxZrdY9QZLXlRimLEwRJb57ixoNsJtJJby-mc Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82632b5ccf0a49cb83a76bac46f80c97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb80c02a281e4132aa50bb4de496525c Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '796f59f0-d25e-440a-8a63-d6cedc50b955'} Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.285720 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. Oct 03 14:59:55.289897 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 14:59:55.291273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Returning 404 to user: Instance 796f59f0-d25e-440a-8a63-d6cedc50b955 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 14:59:55.292505 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b07789fe-e37a-470b-b674-ac59980b637d tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955" status: 404 len: 111 microversion: 2.20 time: 0.044470 Oct 03 14:59:55.293250 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2883/5629] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 14:59:55 2022] GET /compute/v2.1/servers/796f59f0-d25e-440a-8a63-d6cedc50b955 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 14:59:56.575331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:56.591224 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-971a88ca-8d68-4921-9396-50f783bf7c78 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 2.738309 Oct 03 14:59:56.592040 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2747/5630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:53 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:57.622369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:57.623162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:57.646591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:57.654214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:57.662211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:57.663599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:57.666699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:57.669982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:57.968717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:58.031793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:58.062778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 14:59:58.078019 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-388c84d9-9e85-4d33-9b9d-2581d0dd079f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 0.460170 Oct 03 14:59:58.078642 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2884/5631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:57 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 14:59:58.433931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:58.435037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:58.444606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:59:58.451309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:58.454644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:58.456435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:58.457392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:58.459929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:58.462504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:58.658824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lazy-loading 'services' on Instance uuid 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 14:59:58.839922 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a1494d01-3d1c-4af1-b2d1-bc4d0962e132 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4/os-volume_attachments/078eb624-918e-423f-a90e-26f7b0072165" status: 202 len: 0 microversion: 2.1 time: 0.408869 Oct 03 14:59:58.841185 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2748/5632] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 14:59:58 2022] DELETE /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4/os-volume_attachments/078eb624-918e-423f-a90e-26f7b0072165 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 14:59:58.880204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9e2ce48a-3743-4f1e-b00a-d3b39f9b503c req-7d436e1d-4724-4b36-aed3-165da8569b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d", "tag": "74998e11-e041-4321-9ea2-0f3007528f94"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 14:59:58.932591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e2ce48a-3743-4f1e-b00a-d3b39f9b503c req-7d436e1d-4724-4b36-aed3-165da8569b74 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:58.935933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e2ce48a-3743-4f1e-b00a-d3b39f9b503c req-7d436e1d-4724-4b36-aed3-165da8569b74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:58.936591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9e2ce48a-3743-4f1e-b00a-d3b39f9b503c req-7d436e1d-4724-4b36-aed3-165da8569b74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:58.971275 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9e2ce48a-3743-4f1e-b00a-d3b39f9b503c req-7d436e1d-4724-4b36-aed3-165da8569b74 service nova] Creating event network-changed:74998e11-e041-4321-9ea2-0f3007528f94 for instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d on n-h1-781139-2 Oct 03 14:59:58.998948 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9e2ce48a-3743-4f1e-b00a-d3b39f9b503c req-7d436e1d-4724-4b36-aed3-165da8569b74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119084 Oct 03 14:59:58.999949 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2885/5633] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 14:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 14:59:59.105585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 14:59:59.106732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 14:59:59.118519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:59.120447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:59.122160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 14:59:59.126217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 14:59:59.126893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 14:59:59.127474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:00.087567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:00.108041 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-214d3333-a0bd-4843-a3d1-c2b1d7e7f1c3 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 1.011336 Oct 03 15:00:00.111982 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2749/5634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 14:59:59 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:01.144747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:01.145602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:01.164067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.165048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.166594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:01.169751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:01.173019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:01.173449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:02.290237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:02.304646 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7dce60e6-acb8-4f4e-8723-3f197fae0bef tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 1.166047 Oct 03 15:00:02.308685 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2886/5635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:01 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:03.335276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:03.336539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:03.354812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=28 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:03.363028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.363620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.367581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.368719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.377215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.380518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.877282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:03.878930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:03.887801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.889124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.889892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.890844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.891518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.892155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.922010 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] HTTP exception thrown: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Request method failure captured: Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 HTTP/1.1 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcFDdBYOCJuLVLlX6uB4UD0BUo5pKuKml-W2ySioby_wLB4m1Ois7kSMbxEM1tT5vam8scRC7-BXc_WfRQlmWvecOcv6cQkPByzAKKJHeXhy0PkegjGDIY9-1V2Tds-ZVuGfkcubzMxZrdY9QZLXlRimLEwRJb57ixoNsJtJJby-mc Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82632b5ccf0a49cb83a76bac46f80c97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb80c02a281e4132aa50bb4de496525c Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b9ea3c31-c873-4937-b6cc-ebd75656c505'} Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:00:03.928523 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.932043 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.934850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Returning 404 to user: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:03.936050 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e69501a-34d3-47a1-a466-c260224512f6 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 404 len: 111 microversion: 2.20 time: 0.063501 Oct 03 15:00:03.940429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2887/5636] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 3 15:00:03 2022] DELETE /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:00:03.947371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:03.948708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] [instance: b9ea3c31-c873-4937-b6cc-ebd75656c505] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:03.957680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.958394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.959058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.960021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:03.960701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:03.961578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:03.989589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] HTTP exception thrown: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Request method failure captured: Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 HTTP/1.1 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvcFDdBYOCJuLVLlX6uB4UD0BUo5pKuKml-W2ySioby_wLB4m1Ois7kSMbxEM1tT5vam8scRC7-BXc_WfRQlmWvecOcv6cQkPByzAKKJHeXhy0PkegjGDIY9-1V2Tds-ZVuGfkcubzMxZrdY9QZLXlRimLEwRJb57ixoNsJtJJby-mc Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_82632b5ccf0a49cb83a76bac46f80c97", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/82632b5ccf0a49cb83a76bac46f80c97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 82632b5ccf0a49cb83a76bac46f80c97 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1984033216 Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: cb80c02a281e4132aa50bb4de496525c Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1984033216-project Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b9ea3c31-c873-4937-b6cc-ebd75656c505'} Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.994563 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. Oct 03 15:00:03.998649 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:03.999870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] Returning 404 to user: Instance b9ea3c31-c873-4937-b6cc-ebd75656c505 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:04.000864 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-899a8a52-87fb-4549-88d9-5ca21c2a1b24 tempest-AttachVolumeShelveTestJSON-1984033216 tempest-AttachVolumeShelveTestJSON-1984033216-project] 10.222.0.20 "GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505" status: 404 len: 111 microversion: 2.20 time: 0.059082 Oct 03 15:00:04.015271 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2888/5637] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 3 15:00:03 2022] GET /compute/v2.1/servers/b9ea3c31-c873-4937-b6cc-ebd75656c505 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:00:04.393924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:04.407817 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-556d6a5f-8006-42ae-894d-c5b817a451e5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 1.079688 Oct 03 15:00:04.409789 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2750/5638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:03 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:05.433581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:05.434203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:05.452774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:05.454307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:05.455763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:05.471594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:05.472111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:05.472622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:06.207607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:06.255842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4034743-697c-45f7-85b7-ae4f3a1d4fa8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 0.825609 Oct 03 15:00:06.278786 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2889/5639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:05 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:07.051430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:07.052021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:07.072338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.075615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.076529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.077547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.080125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.080702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.169480 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7797198a-89a2-4765-9489-585a653547c6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608/ips" status: 200 len: 150 microversion: 2.1 time: 0.121859 Oct 03 15:00:07.174144 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2751/5640] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 15:00:07 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608/ips => generated 150 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:07.186528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5dbf7ae0-5a19-48a0-be19-c699015c5b35"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:07.189085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:07.215072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.219056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.221350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.224151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.225530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.229912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.286146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:07.287931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:07.300033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.306790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.307837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.310028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.312665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.314595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.639775 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Invalid volume: volume 5dbf7ae0-5a19-48a0-be19-c699015c5b35 is already attached to instances: 6ccc88d8-616d-4b2d-a989-e12540aa12bc Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608/os-volume_attachments HTTP/1.1 Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 74 Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: {"volumeAttachment": {"volumeId": "5dbf7ae0-5a19-48a0-be19-c699015c5b35"}} Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid volume: volume 5dbf7ae0-5a19-48a0-be19-c699015c5b35 is already attached to instances: 6ccc88d8-616d-4b2d-a989-e12540aa12bc Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': '147e2c8d-3333-4c10-9130-3139e3313608', 'body': {'volumeAttachment': {'volumeId': '5dbf7ae0-5a19-48a0-be19-c699015c5b35'}}} Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5dbf7ae0-5a19-48a0-be19-c699015c5b35 is already attached to instances: 6ccc88d8-616d-4b2d-a989-e12540aa12bc Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:00:07.643837 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5dbf7ae0-5a19-48a0-be19-c699015c5b35 is already attached to instances: 6ccc88d8-616d-4b2d-a989-e12540aa12bc Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5dbf7ae0-5a19-48a0-be19-c699015c5b35 is already attached to instances: 6ccc88d8-616d-4b2d-a989-e12540aa12bc Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 400 to user: Invalid volume: volume 5dbf7ae0-5a19-48a0-be19-c699015c5b35 is already attached to instances: 6ccc88d8-616d-4b2d-a989-e12540aa12bc {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:07.647963 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89ba3727-3b01-42c9-8004-925b607aaf4b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.464402 Oct 03 15:00:07.656774 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2890/5641] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:00:07 2022] POST /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608/os-volume_attachments => generated 174 bytes in 476 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:00:07.663950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:07.671301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:07.683971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.688049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.689611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.690385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:07.690957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:07.694153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:07.763131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:00:07.932089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:07.952404 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-310056bd-7bb6-4154-b9fc-999c2920210a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 0.670753 Oct 03 15:00:07.954199 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2752/5642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:07 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:07.983340 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a5879f0-8577-46e0-b67f-417f5fccda1c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 204 len: 0 microversion: 2.1 time: 0.324235 Oct 03 15:00:07.984064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2891/5643] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:00:07 2022] DELETE /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:00:07.994867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:07.996464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:08.008334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:08.011172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:08.012722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:08.017966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:08.020615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:08.022629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:08.979153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:08.980790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:09.024817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:09.027147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:09.027737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:09.028219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:09.031526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:09.032058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:09.032516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:09.359685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:09.363027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:09.397136 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ca6a802-081e-47ef-8e4f-c1fb9df0f3c5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1681 microversion: 2.1 time: 1.407935 Oct 03 15:00:09.400482 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2753/5644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:07 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1681 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:09.828286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-75cf27db-6bba-4d45-9dc0-513bb59bfe4a req-4333bf39-f99a-44f9-b688-14cfd4137a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d", "name": "network-vif-plugged", "status": "completed", "tag": "74998e11-e041-4321-9ea2-0f3007528f94"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:09.842344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-75cf27db-6bba-4d45-9dc0-513bb59bfe4a req-4333bf39-f99a-44f9-b688-14cfd4137a8e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:09.843033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-75cf27db-6bba-4d45-9dc0-513bb59bfe4a req-4333bf39-f99a-44f9-b688-14cfd4137a8e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:09.843633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-75cf27db-6bba-4d45-9dc0-513bb59bfe4a req-4333bf39-f99a-44f9-b688-14cfd4137a8e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:09.856790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-75cf27db-6bba-4d45-9dc0-513bb59bfe4a req-4333bf39-f99a-44f9-b688-14cfd4137a8e service nova] Creating event network-vif-plugged:74998e11-e041-4321-9ea2-0f3007528f94 for instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d on n-h1-781139-2 Oct 03 15:00:09.865254 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-75cf27db-6bba-4d45-9dc0-513bb59bfe4a req-4333bf39-f99a-44f9-b688-14cfd4137a8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039971 Oct 03 15:00:09.869753 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2754/5645] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:00:10.410972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:10.426436 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05a55474-4f9a-4b10-9d1e-e9ba59b47257 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 1.451650 Oct 03 15:00:10.428268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:10.428980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:10.435196 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2892/5646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:08 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:10.448000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:10.448504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:10.449028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:10.461949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:10.462466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:10.462919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:10.951311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:10.952947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:10.967535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:10.968284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:10.968991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:10.970093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:10.970753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:10.971516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:11.067248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:00:11.343611 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17060627-4401-4218-a011-d1b1bce656ea tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 204 len: 0 microversion: 2.1 time: 0.396380 Oct 03 15:00:11.344422 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2893/5647] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:00:10 2022] DELETE /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:00:11.353031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:11.360278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:11.378535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:11.379188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:11.379777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:11.380668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:11.381291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:11.381868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:11.388107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:11.661591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:11.674091 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-93b79ec7-e04d-4d68-9fd0-87f97f469d2f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1681 microversion: 2.1 time: 1.252195 Oct 03 15:00:11.680145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2755/5648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:10 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1681 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:11.701664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:11.703161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:11.743341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:11.751176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:11.756429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:11.757263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:11.757743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:11.758181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:12.042783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:12.062089 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18d3b4ff-405a-4d81-a268-e6db457e6ac0 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1514 microversion: 2.1 time: 0.713108 Oct 03 15:00:12.062747 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2894/5649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:11 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1514 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:12.715799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:12.723022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:12.750707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:12.751704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:12.770025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:12.771323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:12.777893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:12.779616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:13.213042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:13.223002 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d874458-9fde-4ee0-8086-a841b0df80d6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1681 microversion: 2.1 time: 0.520186 Oct 03 15:00:13.223595 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2895/5650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:12 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1681 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:13.231134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:13.244181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:13.272607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:13.275651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:13.276367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:13.277315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:13.278322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:13.278908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:13.354280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:13.366257 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3aa1b245-ca2d-4cec-971b-bbd9f0f554fe tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1313 microversion: 2.1 time: 1.684589 Oct 03 15:00:13.372509 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2756/5651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:11 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1313 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:13.419418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f7464fc9-7ad5-48b8-8660-7ad516e8cba9 req-6dd74e71-4ea0-4c7d-8897-a054455323b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e2c8d-3333-4c10-9130-3139e3313608", "name": "network-vif-unplugged", "status": "completed", "tag": "838c4b59-3633-4b72-bbac-508dc55d21a8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:13.461677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f7464fc9-7ad5-48b8-8660-7ad516e8cba9 req-6dd74e71-4ea0-4c7d-8897-a054455323b2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:13.462115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f7464fc9-7ad5-48b8-8660-7ad516e8cba9 req-6dd74e71-4ea0-4c7d-8897-a054455323b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:13.485043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f7464fc9-7ad5-48b8-8660-7ad516e8cba9 req-6dd74e71-4ea0-4c7d-8897-a054455323b2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:13.516355 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f7464fc9-7ad5-48b8-8660-7ad516e8cba9 req-6dd74e71-4ea0-4c7d-8897-a054455323b2 service nova] Creating event network-vif-unplugged:838c4b59-3633-4b72-bbac-508dc55d21a8 for instance 147e2c8d-3333-4c10-9130-3139e3313608 on n-h1-781139-2 Oct 03 15:00:13.534952 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f7464fc9-7ad5-48b8-8660-7ad516e8cba9 req-6dd74e71-4ea0-4c7d-8897-a054455323b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136481 Oct 03 15:00:13.542658 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2757/5652] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:13.798078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:13.815474 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36d27228-6878-44c7-bd88-8020fc0b56fe tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1514 microversion: 2.1 time: 0.590775 Oct 03 15:00:13.819373 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2896/5653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:13 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1514 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:14.268475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:14.269511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:14.283423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:14.285830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:14.286471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:14.288242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:14.290551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:14.291256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:14.403595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:14.404590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:14.434253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:14.443455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:14.446571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:14.452447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:14.460427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:14.465392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.210513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:15.222220 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9f21a10-82f4-4bf3-93e9-222cf3870bab tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1499 microversion: 2.1 time: 0.826153 Oct 03 15:00:15.223556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2897/5654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:14 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1499 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:15.229657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:15.231147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:15.246425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.247263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.247893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.248839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.249530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.250187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.283606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:15.294485 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f2541d3-0604-43d0-9324-84a802eaa45d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1681 microversion: 2.1 time: 1.031178 Oct 03 15:00:15.296269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2758/5655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:14 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1681 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:15.315527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:15.322907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:15.336693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.338964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.339742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.341704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.345013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.346558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.396387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lazy-loading 'flavor' on Instance uuid 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:00:15.564279 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05f87af8-aa10-4e32-a791-003ca27178a1 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "POST /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d/action" status: 200 len: 32 microversion: 2.1 time: 0.262048 Oct 03 15:00:15.565371 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2759/5656] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:00:15 2022] POST /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:00:15.580090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:15.581361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:15.611257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.616514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.617195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.619013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:15.623498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:15.624142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:15.874095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:15.890146 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eda94e85-d17f-4c58-bde9-19bc8b179cfc tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1514 microversion: 2.1 time: 0.658644 Oct 03 15:00:15.897154 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2898/5657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:15 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1514 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:16.322929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:16.324110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:16.336713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:16.337501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:16.338595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:16.340889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:16.344191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:16.344766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:16.553968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:16.567053 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-007db892-b7c1-4c03-807b-7764dc40ed64 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1614 microversion: 2.1 time: 0.249848 Oct 03 15:00:16.571833 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2899/5658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:16 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1614 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:16.926304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:16.926304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:16.960528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:16.966310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:16.967104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:16.969850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:16.974316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:16.975021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:17.238711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:17.260672 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0894530-ba00-4961-b48f-69234a156c04 tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1472 microversion: 2.1 time: 0.343177 Oct 03 15:00:17.270854 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2900/5659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:16 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:17.593895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:17.595799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:17.608456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:17.613194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:17.613870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:17.616213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:17.619310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:17.621888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:17.807555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:17.833077 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57dc9cdb-feb9-4b50-a7b9-c848a100aa00 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1614 microversion: 2.1 time: 0.245486 Oct 03 15:00:17.841389 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2901/5660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:17 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1614 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:18.453131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:18.477077 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b3b1cf9a-120d-42bf-abdf-e8fe4c71a384 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 2.901417 Oct 03 15:00:18.480135 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2760/5661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:15 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:18.496090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:18.511118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34f0cfce-e55a-4784-ad78-d7a3c88f4676 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Action: 'create', calling method: .version_select at 0x7fb22be1ca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-874021174", "metadata": {"Type": "work"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:18.516711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:18.536062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:18.536662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:18.537329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:18.538420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:18.539261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:18.540041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:18.697905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd097a3bb5f423488f27fa319f636ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe736ca183e4d4b8781ffb232c49a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:18.713779 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17aff332-bd22-4278-91e4-7eeccb1266dd tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 200 len: 1304 microversion: 2.1 time: 0.229195 Oct 03 15:00:18.716737 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2761/5662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:18 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:18.724648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-bdb93344-05fe-42f6-a693-4c1416872be7 req-a37b37bd-d3be-4f7c-8b61-8c6f950fe4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d143879-8d49-4eaf-a3f6-7d47fbe402d4", "name": "network-vif-deleted", "tag": "5fc0406d-0041-42b2-80d3-733ddec9b4f0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:18.750670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bdb93344-05fe-42f6-a693-4c1416872be7 req-a37b37bd-d3be-4f7c-8b61-8c6f950fe4cd service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:18.753462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bdb93344-05fe-42f6-a693-4c1416872be7 req-a37b37bd-d3be-4f7c-8b61-8c6f950fe4cd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:18.753924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bdb93344-05fe-42f6-a693-4c1416872be7 req-a37b37bd-d3be-4f7c-8b61-8c6f950fe4cd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:18.783163 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-bdb93344-05fe-42f6-a693-4c1416872be7 req-a37b37bd-d3be-4f7c-8b61-8c6f950fe4cd service nova] Creating event network-vif-deleted:5fc0406d-0041-42b2-80d3-733ddec9b4f0 for instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 on n-h2-781139-2 Oct 03 15:00:18.789820 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-bdb93344-05fe-42f6-a693-4c1416872be7 req-a37b37bd-d3be-4f7c-8b61-8c6f950fe4cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071855 Oct 03 15:00:18.791608 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2762/5663] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:18.856492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:18.857214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:18.873207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:18.873716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:18.874160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:18.874880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:18.875334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:18.875756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:19.084192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:19.123429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7954da3f-2706-44f2-8c77-80165b75c017 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1614 microversion: 2.1 time: 0.271307 Oct 03 15:00:19.125732 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2763/5664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:18 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1614 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:19.506772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:19.508811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:19.519509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:19.524066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:19.525337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:19.527145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:19.528723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:19.530473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:19.561406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34f0cfce-e55a-4784-ad78-d7a3c88f4676 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.306361 Oct 03 15:00:19.562357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2902/5665] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 3 15:00:18 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1308 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 15:00:19.581256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41b42ba4-1b01-4c4b-99c6-6cf5f616b29a tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb22b5e0ca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:19.706270 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41b42ba4-1b01-4c4b-99c6-6cf5f616b29a tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 352 microversion: 2.1 time: 0.133916 Oct 03 15:00:19.707680 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2903/5666] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:19 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:19.742281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:19.744213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] [instance: 1d143879-8d49-4eaf-a3f6-7d47fbe402d4] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:19.755942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:19.757029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:19.758951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:19.760559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:19.762089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:19.764091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:19.802414 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] HTTP exception thrown: Instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 could not be found. Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Request method failure captured: Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 HTTP/1.1 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvfBxS94XjTrOZfRxUCWyy3Daz84yweaVBh9gBlkxRIs1ADW1e08CFsRbVG8Pt-piNjKV4kBhcNPQ9nTNhHsPUrwp-CJdtZ34SThGteX_0traxgI7ogAOCxw2XM5IHXw9Ij63kkOjEqvmO8QgzT-HN9k_3sw0rBPy9nf8fWkC-iatGY Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: bfe736ca183e4d4b8781ffb232c49a67 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1376114293 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfe736ca183e4d4b8781ffb232c49a67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfe736ca183e4d4b8781ffb232c49a67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe736ca183e4d4b8781ffb232c49a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfe736ca183e4d4b8781ffb232c49a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesSnapshotTestJSON-1376114293 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: bfe736ca183e4d4b8781ffb232c49a67 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1376114293 Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesSnapshotTestJSON-1376114293-project Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 4fd097a3bb5f423488f27fa319f636ba Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesSnapshotTestJSON-1376114293-project Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 could not be found. Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1d143879-8d49-4eaf-a3f6-7d47fbe402d4'} Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 could not be found. Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 could not be found. Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:19.806056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:19.810322 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:19.810322 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:19.810322 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:19.810322 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:19.810322 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:19.810322 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 could not be found. Oct 03 15:00:19.810322 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:19.811395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:19.813805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] Returning 404 to user: Instance 1d143879-8d49-4eaf-a3f6-7d47fbe402d4 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:19.816237 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53db24ac-f90f-4564-9975-4044312f907c tempest-VolumesSnapshotTestJSON-1376114293 tempest-VolumesSnapshotTestJSON-1376114293-project] 10.222.0.20 "GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4" status: 404 len: 111 microversion: 2.1 time: 0.078680 Oct 03 15:00:19.818342 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2904/5667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:19 2022] GET /compute/v2.1/servers/1d143879-8d49-4eaf-a3f6-7d47fbe402d4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:00:19.860177 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-688de37e-2f46-43d8-af3e-98546a7b4494 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.357897 Oct 03 15:00:19.862563 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2764/5668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:19 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:20.149703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:20.150766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:20.163583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:20.169689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:20.171737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:20.172408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:20.172876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:20.173333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:20.283441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:20.286515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:20.289957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:20.290572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lazy-loading 'fault' on Instance uuid 147e2c8d-3333-4c10-9130-3139e3313608 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:00:20.658944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:20.688463 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5acd0518-1dba-49ec-88f4-3d88229dc93d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 200 len: 1331 microversion: 2.1 time: 0.542658 Oct 03 15:00:20.692181 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2905/5669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:20 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 1331 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:20.722609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a58ae01a-acb0-41d7-9bbc-736dfade0846 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb230197ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:20.854598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c562ffc0-83a1-4e46-8fab-95cf07abc0ce req-336a061c-d7c9-4e99-9c6f-74c017e8e1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e2c8d-3333-4c10-9130-3139e3313608", "name": "network-vif-deleted", "tag": "838c4b59-3633-4b72-bbac-508dc55d21a8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:20.879982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c562ffc0-83a1-4e46-8fab-95cf07abc0ce req-336a061c-d7c9-4e99-9c6f-74c017e8e1eb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:20.880470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c562ffc0-83a1-4e46-8fab-95cf07abc0ce req-336a061c-d7c9-4e99-9c6f-74c017e8e1eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:20.880904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c562ffc0-83a1-4e46-8fab-95cf07abc0ce req-336a061c-d7c9-4e99-9c6f-74c017e8e1eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:20.887330 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a58ae01a-acb0-41d7-9bbc-736dfade0846 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 352 microversion: 2.1 time: 0.168849 Oct 03 15:00:20.887936 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2765/5670] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:20 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 352 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:00:20.894325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:20.897124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:20.909550 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c562ffc0-83a1-4e46-8fab-95cf07abc0ce req-336a061c-d7c9-4e99-9c6f-74c017e8e1eb service nova] Creating event network-vif-deleted:838c4b59-3633-4b72-bbac-508dc55d21a8 for instance 147e2c8d-3333-4c10-9130-3139e3313608 on n-h1-781139-2 Oct 03 15:00:20.915818 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c562ffc0-83a1-4e46-8fab-95cf07abc0ce req-336a061c-d7c9-4e99-9c6f-74c017e8e1eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065176 Oct 03 15:00:20.917218 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2906/5671] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:20.926175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:20.928466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:20.929165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:20.930769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:20.934848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:20.935621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:21.389306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:21.403189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aba88319-114f-4576-82d7-591a2cafb55f tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.514179 Oct 03 15:00:21.412426 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2766/5672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:20 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:21.720465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:21.721360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:21.747796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:21.751503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:21.758855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:21.761976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:21.765884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:21.767461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:21.839818 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 HTTP/1.1 Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '147e2c8d-3333-4c10-9130-3139e3313608'} Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:21.841872 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:21.845405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:21.845405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:21.845405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:21.845405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:21.845405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:21.845405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:00:21.845405 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:21.847703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:21.848870 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cbf3d4e8-5d7e-4ce4-ba90-326c60ab38da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 404 len: 111 microversion: 2.1 time: 0.135394 Oct 03 15:00:21.850039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2907/5673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:21 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:00:21.860414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c1344a16-7acf-427a-88f5-a5363348052b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '.version_select at 0x7fb230898c10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:21.904410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2699673-89ce-4661-a700-24e392585716 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb22bc93550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:21.906690 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c1344a16-7acf-427a-88f5-a5363348052b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289339001" status: 202 len: 0 microversion: 2.1 time: 0.052260 Oct 03 15:00:21.907290 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2767/5674] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 15:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289339001 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:00:22.049061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2699673-89ce-4661-a700-24e392585716 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 353 microversion: 2.1 time: 0.150083 Oct 03 15:00:22.049745 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2908/5675] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:21 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:00:22.063979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d0791421-0026-4ede-b0e4-29264590aaae tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb234add790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:22.200412 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d0791421-0026-4ede-b0e4-29264590aaae tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 353 microversion: 2.1 time: 0.141448 Oct 03 15:00:22.209411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2768/5676] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:22 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:22.223514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d495897-7315-4344-b26a-4149f5e92dcb tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb22bd96790>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:22.338523 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d495897-7315-4344-b26a-4149f5e92dcb tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 202 len: 0 microversion: 2.1 time: 0.126150 Oct 03 15:00:22.341747 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2909/5677] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 15:00:22 2022] DELETE /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:00:22.355585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e9123352-e217-4cbc-b575-67882873f443 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb2302d5dc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:22.438864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:22.439666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:22.448434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:22.448950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:22.449386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:22.450116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:22.450568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:22.451067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:22.482901 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e9123352-e217-4cbc-b575-67882873f443 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 352 microversion: 2.1 time: 0.131680 Oct 03 15:00:22.483528 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2769/5678] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:22 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:23.302808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:23.315715 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-010b12dd-f6bf-4b90-9504-2550ad510954 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.877975 Oct 03 15:00:23.329579 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2910/5679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:22 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:23.499729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80e93681-53b7-4ab9-9c50-4a724d455540 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb2300613a0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:23.588284 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80e93681-53b7-4ab9-9c50-4a724d455540 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 352 microversion: 2.1 time: 0.093278 Oct 03 15:00:23.588892 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2770/5680] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:23 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:24.091513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:24.092022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:24.108838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:24.109370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:24.109817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:24.126216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:24.126581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:24.127032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:24.345769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:24.346534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:24.358661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:24.359481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:24.364320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:24.365177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:24.366023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:24.366714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:24.733700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lazy-loading 'services' on Instance uuid 6ccc88d8-616d-4b2d-a989-e12540aa12bc {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:00:25.007732 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b106d554-778b-4aa7-be2a-570fe2064ef1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments/5dbf7ae0-5a19-48a0-be19-c699015c5b35" status: 202 len: 0 microversion: 2.1 time: 0.920214 Oct 03 15:00:25.012122 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2911/5681] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:00:24 2022] DELETE /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments/5dbf7ae0-5a19-48a0-be19-c699015c5b35 => generated 0 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:00:25.032901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64290ee9-9912-453f-926a-074b7204c3d9 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb22be1d700>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:25.249315 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64290ee9-9912-453f-926a-074b7204c3d9 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 352 microversion: 2.1 time: 0.235763 Oct 03 15:00:25.256645 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2912/5682] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:25 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 352 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:25.262590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:25.278303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:25.304378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:25.305088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:25.308766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:25.309874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:25.310771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:25.311202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:25.360533 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93601d51-417d-49bd-bf83-3fcdf45e5fb3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102329 Oct 03 15:00:25.361395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2913/5683] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:25 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:25.372780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:25.383394 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-101ac257-0157-4074-ac38-be60a21f1cb9 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 1.042169 Oct 03 15:00:25.387631 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2771/5684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:24 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:26.266043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3afb8ccd-a7fa-4abb-88dd-3fcf6d459580 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb22bb913a0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:26.386179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:26.393168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:26.430885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:26.434590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:26.436658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:26.437476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:26.437960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:26.438398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:26.471447 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3afb8ccd-a7fa-4abb-88dd-3fcf6d459580 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 200 len: 352 microversion: 2.1 time: 0.209761 Oct 03 15:00:26.472352 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2914/5685] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:26 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 352 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:26.483455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:26.484002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:26.515305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:26.515836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:26.524234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:26.531139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:26.532011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:26.533451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:26.626653 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-982003e8-9696-4521-90ae-bf02a791ef28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.255920 Oct 03 15:00:26.627292 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2772/5686] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:26 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:00:27.092960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:27.112892 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34f214a3-b3b1-47a8-affd-59e0e266716e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.636477 Oct 03 15:00:27.116461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2915/5687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:26 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:27.486846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c036a91b-e6ec-4686-a2c0-c4d45f51b461 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Calling method '.version_select at 0x7fb230968a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:27.560757 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c036a91b-e6ec-4686-a2c0-c4d45f51b461 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] HTTP exception thrown: Volume a659a985-fac1-4bc2-ada9-8158662f49f6 could not be found. Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c036a91b-e6ec-4686-a2c0-c4d45f51b461 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Request method failure captured: Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 HTTP/1.1 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvkC4QxT_vr2oKYJXk2uFihJr5ol64b-ygFWbaBufeUWrrj_cwfo8VtF0M3_UehPygvZz4_AX3I0ca3h0CxVUmGWH-zG7VT5aSRjkQ3kS8PTbyKYaIqdaOerUgrMsVpXGb9k3T6XfNZdWq-kDg7AjyMKeeDS4Rdt9qDkC4ThXCxm3rI Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 9372ed1d3fd34da68b576fb4af2daa69 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesGetTestJSON-2098593409 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9372ed1d3fd34da68b576fb4af2daa69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9372ed1d3fd34da68b576fb4af2daa69", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9372ed1d3fd34da68b576fb4af2daa69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9372ed1d3fd34da68b576fb4af2daa69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesGetTestJSON-2098593409 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 9372ed1d3fd34da68b576fb4af2daa69 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesGetTestJSON-2098593409 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesGetTestJSON-2098593409-project Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b7d288b400314d7989c71061d63cc520 Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesGetTestJSON-2098593409-project Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: method: Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: exception: Volume a659a985-fac1-4bc2-ada9-8158662f49f6 could not be found. Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'a659a985-fac1-4bc2-ada9-8158662f49f6'} Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a659a985-fac1-4bc2-ada9-8158662f49f6 could not be found. (HTTP 404) (Request-ID: req-77900f2e-ece0-4945-b067-8b90fc3245ce) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 15:00:27.563371 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a659a985-fac1-4bc2-ada9-8158662f49f6 could not be found. Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a659a985-fac1-4bc2-ada9-8158662f49f6 could not be found. Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a659a985-fac1-4bc2-ada9-8158662f49f6 could not be found. Oct 03 15:00:27.568279 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:27.573387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c036a91b-e6ec-4686-a2c0-c4d45f51b461 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] Returning 404 to user: Volume a659a985-fac1-4bc2-ada9-8158662f49f6 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:27.575171 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c036a91b-e6ec-4686-a2c0-c4d45f51b461 tempest-VolumesGetTestJSON-2098593409 tempest-VolumesGetTestJSON-2098593409-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6" status: 404 len: 109 microversion: 2.1 time: 0.092532 Oct 03 15:00:27.576369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2773/5688] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:00:27 2022] GET /compute/v2.1/os-volumes/a659a985-fac1-4bc2-ada9-8158662f49f6 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:00:27.641573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:27.646398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:27.665862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:27.666978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:27.667708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:27.670104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:27.670799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:27.671888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:27.837936 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ade0b56-25c4-4187-8f1f-85a95b85ce26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200902 Oct 03 15:00:27.841773 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2916/5689] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:27 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:28.147546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:28.148527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:28.163742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:28.165804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:28.167713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:28.168651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:28.172871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:28.173501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:28.856504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:28.859039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:28.869984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:28.876276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:28.877128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:28.877914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:28.878801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:28.879480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:28.880277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:28.881681 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-88339980-a2f0-4ac9-ba67-be5d9e6a2caa tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.741772 Oct 03 15:00:28.886349 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2774/5690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:28 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:28.956091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:28.964022 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fae9ace7-abcd-44dd-8a7a-4f1c28667657 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111925 Oct 03 15:00:28.970090 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2917/5691] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:28 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:00:29.916008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:29.917823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:29.928779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:29.929642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:29.931808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:29.934148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:29.935038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:29.935665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:29.978486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:29.984721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:30.030527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:30.031440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:30.032872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:30.037297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:30.039339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:30.039748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:30.178482 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e4de60e-c45f-4456-bbb2-b3c5759b32cc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204672 Oct 03 15:00:30.184570 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2918/5692] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:29 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:30.370040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:30.383805 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6b9710d0-658b-4e3a-897a-cf679dd74961 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.480955 Oct 03 15:00:30.402568 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2775/5693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:29 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:31.204802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:31.208297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:31.226803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:31.227931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:31.229208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:31.231961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:31.232983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:31.235375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:31.310664 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf12c606-9242-4e95-8fdd-978c8a0f7630 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122777 Oct 03 15:00:31.314544 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2919/5694] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:31 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:31.410194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:31.411376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:31.422921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:31.430567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:31.431033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:31.431905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:31.432312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:31.432733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:31.487627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:32.124804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:32.137996 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b514133c-52c9-4b3d-a0c5-757a41461b8a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.731866 Oct 03 15:00:32.158605 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2776/5695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:31 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:32.326739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:32.329280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:32.346974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:32.350909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:32.354815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:32.358737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:32.362418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:32.365045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:32.509793 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f31b8ca0-477c-4dbc-95e1-acc9a896119b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187576 Oct 03 15:00:32.510413 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2920/5696] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:32 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:33.163926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:33.164547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:33.174211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:33.178454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:33.179424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:33.182139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:33.183260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:33.185562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:33.522653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:33.526037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:33.554024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:33.554830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:33.555483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:33.557907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:33.559338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:33.559999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:33.668983 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9b4417b-2445-4cfa-9264-b9442fb0da27 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149252 Oct 03 15:00:33.677960 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2921/5697] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:33 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:33.704038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:33.716564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f36dfef9-8077-4407-b522-2795b510c45e tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.552770 Oct 03 15:00:33.717601 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2777/5698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:33 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:34.681532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:34.688150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:34.711843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:34.713995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:34.716380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:34.719459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:34.720097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:34.720701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:34.757465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:34.758747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:34.764156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:34.802447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:34.805697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:34.810335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:34.811342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:34.813565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:34.817242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:34.855208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4403802-beab-4bf3-ae0c-eee7bb5ca832 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174392 Oct 03 15:00:34.855872 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2922/5699] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:34 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:35.262408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:35.275986 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f11ee471-1db2-4acd-83b4-51fd495cfe1b tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.523955 Oct 03 15:00:35.279229 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2778/5700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:34 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:35.877809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:35.881472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:35.905880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:35.911437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:35.911949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:35.912708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:35.917618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:35.918109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:36.031398 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e1f1c0f-a70e-432e-80f9-87f505962d9d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161214 Oct 03 15:00:36.036519 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2923/5701] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:35 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:36.305919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:36.307077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:36.319179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:36.320216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:36.320711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:36.321537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:36.328348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:36.332110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:37.046756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:37.050305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:37.067712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:37.068217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:37.074861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:37.076084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:37.083332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:37.107483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:37.213143 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-112c8237-9c93-40d5-80ec-83304f767176 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172713 Oct 03 15:00:37.215807 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2924/5702] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:37 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:37.536231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:37.545217 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8a5af9b2-283d-41a2-a843-c34899bf43e0 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 1.244542 Oct 03 15:00:37.545811 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2779/5703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:36 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:38.231396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:38.234638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:38.297738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:38.301017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:38.304361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:38.306676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:38.310303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:38.311057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:38.434766 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8aa5517e-f402-4b5a-b335-d41bd6be4444 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.206480 Oct 03 15:00:38.436088 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2925/5704] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:00:38 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc/os-volume_attachments => generated 25 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:00:38.576215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:38.576848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:38.596581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:38.597367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:38.603469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:38.608288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:38.609012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:38.609701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:38.610741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:38.611543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:38.612162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:38.613782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:38.613987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:38.614604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:38.618028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:38.620853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:38.712057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:00:38.958407 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f4d5205-8ac9-4b75-9dbb-50a19a1cd41c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 204 len: 0 microversion: 2.1 time: 0.364738 Oct 03 15:00:38.959968 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2926/5705] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:00:38 2022] DELETE /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:00:38.991443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:38.996461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:39.019788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:39.020300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:39.020740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:39.023139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:39.030965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:39.033508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:39.063536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:39.072896 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b88a053-2049-4bfc-bf5e-1173440f159d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.506076 Oct 03 15:00:39.073527 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2780/5706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:38 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:39.570537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:39.583499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ce834d2-f70e-4e13-a3e5-7a3727314b8d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1680 microversion: 2.1 time: 0.617630 Oct 03 15:00:39.594629 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2927/5707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:38 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1680 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:40.108368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:40.111369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:40.136423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:40.145859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:40.146489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:40.148548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:40.151916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:40.155397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:40.609305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:40.609305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:40.610913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:40.624712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:40.630694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:40.639069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:40.640094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:40.640777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:40.641447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:41.347396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:41.369788 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-815ce9f7-bc70-4bf7-9bfc-65d26cb0fd11 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 1.265379 Oct 03 15:00:41.386022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2781/5708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:40 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:42.151994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:42.163178 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-046d9c63-95ff-48fe-b7b2-f60672b91859 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1680 microversion: 2.1 time: 1.559851 Oct 03 15:00:42.164646 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2928/5709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:40 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1680 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:42.409958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:42.412312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:42.430205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:42.434508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:42.435357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:42.436498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:42.440497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:42.441362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:43.188354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:43.189116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:43.206314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:43.212051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:43.221489 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e0e274f-ebf5-4510-b939-ec830cd31280 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.827360 Oct 03 15:00:43.222147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:43.222879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:43.223875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:43.225717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:43.227295 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2782/5710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:42 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:43.244960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:43.449937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:43.463139 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6537b7e6-3494-4e72-b8b4-3dea80f97c82 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1612 microversion: 2.1 time: 0.277317 Oct 03 15:00:43.477136 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2929/5711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:43 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1612 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:43.702880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6cb90328-1ef4-4148-b886-6db3407ae299 req-d2e17c3f-0d89-4f73-8245-5e80083a0376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccc88d8-616d-4b2d-a989-e12540aa12bc", "name": "network-vif-deleted", "tag": "6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:43.718347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cb90328-1ef4-4148-b886-6db3407ae299 req-d2e17c3f-0d89-4f73-8245-5e80083a0376 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:43.719179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cb90328-1ef4-4148-b886-6db3407ae299 req-d2e17c3f-0d89-4f73-8245-5e80083a0376 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:43.720187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cb90328-1ef4-4148-b886-6db3407ae299 req-d2e17c3f-0d89-4f73-8245-5e80083a0376 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:43.736656 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6cb90328-1ef4-4148-b886-6db3407ae299 req-d2e17c3f-0d89-4f73-8245-5e80083a0376 service nova] Creating event network-vif-deleted:6b503086-0baf-4e9c-8bf1-2bbc1cb7fafa for instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc on n-h2-781139-2 Oct 03 15:00:43.745826 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6cb90328-1ef4-4148-b886-6db3407ae299 req-d2e17c3f-0d89-4f73-8245-5e80083a0376 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046942 Oct 03 15:00:43.753022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2783/5712] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:00:44.255927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:44.256550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:44.267692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.268183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.269443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.274759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.275464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.276223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.487934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:44.488654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:44.503096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.503593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.507268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.509884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.511524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.514274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.649996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.655127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.655962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.658742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lazy-loading 'fault' on Instance uuid 6ccc88d8-616d-4b2d-a989-e12540aa12bc {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:00:44.673425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:44.688980 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48fb1cd2-00ae-4f37-a63b-28ec9feee4ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1485 microversion: 2.1 time: 0.434596 Oct 03 15:00:44.705704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2930/5713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:44 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1485 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:44.717333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:44.719043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:44.730939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.745689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.746618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.747604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.748130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.749835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.878962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:44.896286 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48913c2c-0117-4e63-b0a6-56c49e9575d7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "POST /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d/action" status: 202 len: 0 microversion: 2.1 time: 0.182927 Oct 03 15:00:44.898649 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2931/5714] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:00:44 2022] POST /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:00:44.913299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:44.914422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:44.928429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.933043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.933838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:44.934807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:44.935478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:44.936117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:45.335780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:45.346582 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dcb016e-eb84-442a-8ea9-1a8f950d388a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1493 microversion: 2.1 time: 0.434934 Oct 03 15:00:45.347821 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2932/5715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:44 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1493 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:45.399513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:45.419139 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f1c38218-9046-4f20-a4dd-7e3e5ba3fd26 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 200 len: 1330 microversion: 2.1 time: 0.928876 Oct 03 15:00:45.419803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2784/5716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:44 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 1330 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:46.376793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:46.377468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:46.388444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.388954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.389400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.409797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.410521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.413348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.447050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:46.447764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:46.466322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.468981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.469496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.471158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:46.471637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:46.473525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:46.521307 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc HTTP/1.1 Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6ccc88d8-616d-4b2d-a989-e12540aa12bc'} Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:46.528856 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:46.532726 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:46.532726 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:46.532726 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:46.532726 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:46.532726 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:46.532726 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:00:46.532726 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:00:46.537344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:46.539829 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eca69fe5-421f-4627-996c-09602c9ca1fa tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 404 len: 111 microversion: 2.1 time: 0.098509 Oct 03 15:00:46.545131 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2785/5717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:46 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:00:46.562508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-128276fb-9505-4675-abe9-cee4806c9bc3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '.version_select at 0x7fb234b375e0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:46.622490 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-128276fb-9505-4675-abe9-cee4806c9bc3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-542413682" status: 202 len: 0 microversion: 2.1 time: 0.072700 Oct 03 15:00:46.623098 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2786/5718] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 15:00:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-542413682 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:00:46.768449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:46.779405 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d398b4ca-9570-423f-a5b0-2a4e762abde7 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1493 microversion: 2.1 time: 0.406488 Oct 03 15:00:46.801237 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2933/5719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:46 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1493 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:47.807542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:47.809070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:47.821283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:47.832660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:47.832660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:47.832660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:47.832660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:47.832660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:48.590174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:48.620853 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90534271-6b53-44a0-9bba-149ac9e5dc80 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1493 microversion: 2.1 time: 0.818189 Oct 03 15:00:48.622276 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2787/5720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:47 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1493 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:48.947227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-da97de02-4e6e-4d08-a828-a1a5a2468568 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: .version_select at 0x7fb230203700>, body: {"keypair": {"name": "tempest-keypair-121735486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9gtf5Xpg8RnUzgA4zlGxtrQ2CKILRZI4yyBE88GvXoy9SLzvrVYafK/LRpv+zZkvvrwX/y4A0wyAF+F7bFpcf+SjbW+veOJfROeC2XbrQ10ZIw79FTO2LZESFbDP4gng=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:48.967826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-da97de02-4e6e-4d08-a828-a1a5a2468568 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:00:48.977382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-da97de02-4e6e-4d08-a828-a1a5a2468568 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:00:49.037634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-da97de02-4e6e-4d08-a828-a1a5a2468568 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094479 Oct 03 15:00:49.057199 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2934/5721] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:00:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:49.666096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:49.668673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:49.695338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:49.696322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:49.698515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:49.700413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:49.701199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:49.703156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:50.147237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:50.158700 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-78b6e679-86fd-4dde-b2c7-f63e6e5e0271 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1493 microversion: 2.1 time: 0.511095 Oct 03 15:00:50.162396 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2788/5722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:49 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1493 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:51.196553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:51.198129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:51.215801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:51.217967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:51.222207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:51.223277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:51.228263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:51.230568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:52.115961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:52.127844 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-18c1c9c3-edd8-454c-8608-787d8f7857ea tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1499 microversion: 2.1 time: 0.943830 Oct 03 15:00:52.131360 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2935/5723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:51 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1499 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:52.172772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:52.174072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:52.187264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:52.189544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:52.190088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:52.192496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:52.193162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:52.193727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:52.250253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:00:52.481661 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9442190f-c5d9-4db3-8f24-00db6134c33d tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 204 len: 0 microversion: 2.1 time: 0.313737 Oct 03 15:00:52.482293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2789/5724] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:00:52 2022] DELETE /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:00:52.491560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:52.493438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:52.509016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:52.516538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:52.517252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:52.519661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:52.520357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:52.522566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:53.804637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:53.819931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eaedb041-45aa-4d07-b914-bd4b36ac2879 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 1.333012 Oct 03 15:00:53.821240 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2936/5725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:52 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:54.482259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1101158192", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8455999-ecee-4494-a487-d4e57e751b83"}], "security_groups": [{"name": "tempest-securitygroup--1342734419"}], "key_name": "tempest-keypair-121735486", "user_data": "}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:54.846233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:54.846879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:54.859399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:54.859907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:54.860414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:54.869395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:54.869951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:54.870439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:55.123252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] validate_networks() for [('f8455999-ecee-4494-a487-d4e57e751b83', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:00:55.166417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:55.175247 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c048b806-410f-4b03-9213-c5f2978d23b8 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.332972 Oct 03 15:00:55.195986 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2937/5726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:54 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:00:56.203082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:56.204221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:56.215580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.216145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.216598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.217488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.217996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.218539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.549471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:56.566416 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9982c661-2298-48da-aa9b-75028b8e1873 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1505 microversion: 2.1 time: 0.365972 Oct 03 15:00:56.569377 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2938/5727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:56 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:56.720330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:00:56.720829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:00:56.721278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:00:56.721698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:00:56.722125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:00:56.749121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.749650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.750098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.750900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:56.753818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:56.755054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:56.829153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:00:56.844455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:00:56.900424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:00:56.910464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:00:56.991215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-de91832f-3d24-453e-ac2c-37fda27ba169 req-37b61e85-7e7b-45f6-ad2e-30cf1f61eec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d", "name": "network-vif-deleted", "tag": "74998e11-e041-4321-9ea2-0f3007528f94"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:00:57.051313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-de91832f-3d24-453e-ac2c-37fda27ba169 req-37b61e85-7e7b-45f6-ad2e-30cf1f61eec4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.052280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-de91832f-3d24-453e-ac2c-37fda27ba169 req-37b61e85-7e7b-45f6-ad2e-30cf1f61eec4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.053623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-de91832f-3d24-453e-ac2c-37fda27ba169 req-37b61e85-7e7b-45f6-ad2e-30cf1f61eec4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:57.106356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7925c1fa-0484-4ab5-bab2-fd7cbf2ef392 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.629077 Oct 03 15:00:57.109608 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2790/5728] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:00:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:00:57.121109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98845af7-8b46-4c8f-88bc-84c24d5f0972 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:57.125595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-98845af7-8b46-4c8f-88bc-84c24d5f0972 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:57.136125 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-de91832f-3d24-453e-ac2c-37fda27ba169 req-37b61e85-7e7b-45f6-ad2e-30cf1f61eec4 service nova] Creating event network-vif-deleted:74998e11-e041-4321-9ea2-0f3007528f94 for instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d on n-h1-781139-2 Oct 03 15:00:57.162695 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-de91832f-3d24-453e-ac2c-37fda27ba169 req-37b61e85-7e7b-45f6-ad2e-30cf1f61eec4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189085 Oct 03 15:00:57.169890 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2939/5729] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:00:57.240813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98845af7-8b46-4c8f-88bc-84c24d5f0972 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:57.274043 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98845af7-8b46-4c8f-88bc-84c24d5f0972 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1241 microversion: 2.1 time: 0.157573 Oct 03 15:00:57.275798 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2791/5730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:57 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1241 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:57.595058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:57.596643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:57.614554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.617564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.619387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:57.621438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.622146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.624302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:57.778320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:57.784707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:57.785177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:57.789704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lazy-loading 'fault' on Instance uuid 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:00:58.061734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:58.070611 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03c4e948-1acb-4d17-8f57-dcbf6b4476f5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 200 len: 1303 microversion: 2.1 time: 0.480906 Oct 03 15:00:58.071271 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2940/5731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:57 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 1303 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:58.323664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:58.339603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:58.376127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:58.386043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:58.386753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:58.387684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:58.388158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:58.388591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:58.564793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:58.585263 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45fda643-9b6d-470c-b9b4-96e947b65d1e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1245 microversion: 2.1 time: 0.288893 Oct 03 15:00:58.588206 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2792/5732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:58 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1245 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:00:59.099356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:59.100620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:59.112535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:59.118052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.118928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.139191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.143117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.146380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.149335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.229496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] HTTP exception thrown: Instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d could not be found. Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Request method failure captured: Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d HTTP/1.1 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOviptJJliwCzD6-J2ggRTKFTtv1P4kAVgwiC3DOOKyOWAM5bBgPe0exmeDYrMYET_RLokeJsP5UUuEHB3ZOhIzlPCTX9g4Ahx_qLGkcVKpb2rmKXYlXTWahn67GG2YDK1NzJ__N4ty4tUAr3ohDGJyNDfsDW2DgCQVlBeVq0E0c2gFo Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3f8de0a15a7b4a38876759625866f1d9 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerRescueTestJSON-1624857473 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f8de0a15a7b4a38876759625866f1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f8de0a15a7b4a38876759625866f1d9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f8de0a15a7b4a38876759625866f1d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f8de0a15a7b4a38876759625866f1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerRescueTestJSON-1624857473 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3f8de0a15a7b4a38876759625866f1d9 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerRescueTestJSON-1624857473 Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerRescueTestJSON-1624857473-project Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2d4287949baa4046b00749b4c46067be Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerRescueTestJSON-1624857473-project Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d could not be found. Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d'} Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d could not be found. Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d could not be found. Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:00:59.235145 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:59.239624 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:00:59.239624 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:00:59.239624 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:00:59.239624 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:00:59.239624 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:00:59.239624 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d could not be found. Oct 03 15:00:59.239624 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:00:59.240830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Returning 404 to user: Instance 5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:00:59.242794 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0214792-846c-4c04-9705-47ea0bdd2210 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d" status: 404 len: 111 microversion: 2.1 time: 0.147701 Oct 03 15:00:59.249914 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2941/5733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:59 2022] GET /compute/v2.1/servers/5bb0c49f-0c4b-4b2c-8a6e-67c0e2d61a9d => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:00:59.257144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:59.257539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:59.273563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.275893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.276507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.278719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.281001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.284875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.404003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:00:59.620419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:59.621333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:59.628360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.645216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:00:59.645715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.647088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.653482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.657950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.669027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.774136 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e610b155-b39e-45ae-afba-7d6df539c9ff tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 204 len: 0 microversion: 2.1 time: 0.518599 Oct 03 15:00:59.777578 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2793/5734] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:00:59 2022] DELETE /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:00:59.791130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:00:59.792155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:00:59.813905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.815875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.818450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.821777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:00:59.823721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:00:59.824411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:00:59.893521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:00:59.903130 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ba0c6e4-bc6e-4a10-aba2-764d9e7bd0f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1311 microversion: 2.1 time: 0.295909 Oct 03 15:00:59.928444 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2942/5735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:59 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1311 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:00.756127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:00.782999 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4a8194f-e987-4fb3-b4d8-7b8d7e5cd3a5 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1492 microversion: 2.1 time: 0.988096 Oct 03 15:01:00.796952 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2794/5736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:00:59 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1492 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:00.944143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:00.945902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:00.958511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:00.981908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:00.982721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:00.983722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:00.984414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:00.985127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:01.123379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:01.137896 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-137fa419-398a-4d6f-863e-a8315786b2dc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1299 microversion: 2.1 time: 0.213939 Oct 03 15:01:01.149526 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2943/5737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:00 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1299 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:01.815359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:01.816643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:01.828230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:01.830389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:01.840033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:01.841483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:01.842587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:01.850346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:02.166487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:02.167267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:02.189370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:02.192499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:02.194472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:02.197826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:02.198377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:02.198823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:02.924492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:02.936734 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-118304f2-ad37-48ef-bb69-1f34052f996a tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1492 microversion: 2.1 time: 1.125461 Oct 03 15:01:02.937622 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2795/5738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:01 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1492 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:03.067771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:03.087991 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85fcbbfa-d595-43b4-9f58-3906a56517f2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.927351 Oct 03 15:01:03.095675 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2944/5739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:02 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:03.706171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a6a9f342-7f57-4a3e-ae37-d3ae8ef6bed7 req-0598538e-656c-489a-91c1-4c25cf892e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aa48c-6241-42ec-8d48-852fd00b64e3", "name": "network-vif-deleted", "tag": "fd05eeca-e1ac-47ab-81b4-f4b10768505d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:03.754849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a6a9f342-7f57-4a3e-ae37-d3ae8ef6bed7 req-0598538e-656c-489a-91c1-4c25cf892e58 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:03.756229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a6a9f342-7f57-4a3e-ae37-d3ae8ef6bed7 req-0598538e-656c-489a-91c1-4c25cf892e58 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:03.759461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a6a9f342-7f57-4a3e-ae37-d3ae8ef6bed7 req-0598538e-656c-489a-91c1-4c25cf892e58 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:03.797518 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a6a9f342-7f57-4a3e-ae37-d3ae8ef6bed7 req-0598538e-656c-489a-91c1-4c25cf892e58 service nova] Creating event network-vif-deleted:fd05eeca-e1ac-47ab-81b4-f4b10768505d for instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 on n-h2-781139-2 Oct 03 15:01:03.821921 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a6a9f342-7f57-4a3e-ae37-d3ae8ef6bed7 req-0598538e-656c-489a-91c1-4c25cf892e58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115962 Oct 03 15:01:03.821921 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2796/5740] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:03.966894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:03.967503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:03.978109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:03.978606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:03.981517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:03.982450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:03.983112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:03.986715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:04.058225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:04.060070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:04.060542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:04.061033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lazy-loading 'fault' on Instance uuid 6a4aa48c-6241-42ec-8d48-852fd00b64e3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:01:04.116645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:04.117583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:04.144351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:04.147018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:04.148762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:04.150786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:04.153331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:04.155611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:04.155732 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2a6aef9-99cc-48cd-8e77-12c2fcba4646 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1304 microversion: 2.1 time: 0.194625 Oct 03 15:01:04.157163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:04.164961 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2945/5741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:03 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:04.827269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:04.848980 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7bb5593-f2ba-4073-b651-dc672d0fc3da tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.738022 Oct 03 15:01:04.854327 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2797/5742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:04 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:05.179341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:05.181221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:05.191090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.195732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.198750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.207634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.208436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.209436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.314191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.322694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.323487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.324219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lazy-loading 'fault' on Instance uuid 6a4aa48c-6241-42ec-8d48-852fd00b64e3 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:01:05.447243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d4287949baa4046b00749b4c46067be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8de0a15a7b4a38876759625866f1d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:05.463065 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b64e0f43-c771-4c88-bb2f-eca1a2d81329 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 200 len: 1304 microversion: 2.1 time: 0.287673 Oct 03 15:01:05.465581 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2946/5743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:05 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 1304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:05.613208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ffef7f60-81fa-4cee-a228-91e4ec0cb8a3 req-960be323-5316-4ca4-8c2e-da82bdf1e6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343dcbf0-a74e-4293-8fe7-873c3fb31ed3", "tag": "82c0c7b2-3785-4055-8cc6-c3e9a30e16cc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:05.641882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:05.644726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ffef7f60-81fa-4cee-a228-91e4ec0cb8a3 req-960be323-5316-4ca4-8c2e-da82bdf1e6b7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.647859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ffef7f60-81fa-4cee-a228-91e4ec0cb8a3 req-960be323-5316-4ca4-8c2e-da82bdf1e6b7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.654146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ffef7f60-81fa-4cee-a228-91e4ec0cb8a3 req-960be323-5316-4ca4-8c2e-da82bdf1e6b7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.708483 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ffef7f60-81fa-4cee-a228-91e4ec0cb8a3 req-960be323-5316-4ca4-8c2e-da82bdf1e6b7 service nova] Creating event network-changed:82c0c7b2-3785-4055-8cc6-c3e9a30e16cc for instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 on n-h1-781139-2 Oct 03 15:01:05.729534 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ffef7f60-81fa-4cee-a228-91e4ec0cb8a3 req-960be323-5316-4ca4-8c2e-da82bdf1e6b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119453 Oct 03 15:01:05.733032 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2798/5744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:01:05.873769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:05.874408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:05.891623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.893204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.893904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:05.896958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:05.899062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:05.902053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:06.245250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:06.257060 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc11f7a2-4b5c-4ede-82f7-2dbb8db2b708 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.388346 Oct 03 15:01:06.258511 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2947/5745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:05 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:06.487444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:06.488511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] [instance: 6a4aa48c-6241-42ec-8d48-852fd00b64e3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:06.502491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:06.507837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:06.508527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:06.510196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:06.512541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:06.513196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:06.562693 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] HTTP exception thrown: Instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 could not be found. Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Request method failure captured: Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 HTTP/1.1 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOviptJJliwCzD6-J2ggRTKFTtv1P4kAVgwiC3DOOKyOWAM5bBgPe0exmeDYrMYET_RLokeJsP5UUuEHB3ZOhIzlPCTX9g4Ahx_qLGkcVKpb2rmKXYlXTWahn67GG2YDK1NzJ__N4ty4tUAr3ohDGJyNDfsDW2DgCQVlBeVq0E0c2gFo Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3f8de0a15a7b4a38876759625866f1d9 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerRescueTestJSON-1624857473 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f8de0a15a7b4a38876759625866f1d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f8de0a15a7b4a38876759625866f1d9", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f8de0a15a7b4a38876759625866f1d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f8de0a15a7b4a38876759625866f1d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerRescueTestJSON-1624857473 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3f8de0a15a7b4a38876759625866f1d9 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerRescueTestJSON-1624857473 Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerRescueTestJSON-1624857473-project Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2d4287949baa4046b00749b4c46067be Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerRescueTestJSON-1624857473-project Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 could not be found. Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6a4aa48c-6241-42ec-8d48-852fd00b64e3'} Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 could not be found. Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 could not be found. Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:01:06.565849 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 could not be found. Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:06.570358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] Returning 404 to user: Instance 6a4aa48c-6241-42ec-8d48-852fd00b64e3 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:01:06.572550 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94369883-e2b0-4d7d-96d2-79f47fb60265 tempest-ServerRescueTestJSON-1624857473 tempest-ServerRescueTestJSON-1624857473-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3" status: 404 len: 111 microversion: 2.1 time: 0.087166 Oct 03 15:01:06.573647 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2799/5746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:06 2022] GET /compute/v2.1/servers/6a4aa48c-6241-42ec-8d48-852fd00b64e3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:01:07.286999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:07.289615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:07.310876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:07.311764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:07.315802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:07.317705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:07.318837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:07.318837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:08.163628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:08.190842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcea6720-ea45-4a18-81ce-97784be3859c tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.911006 Oct 03 15:01:08.192032 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2948/5747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:07 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:09.218019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:09.219229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:09.244173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:09.291060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:09.303510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:09.304222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:09.307870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:09.308765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:09.311772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:09.314495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:10.469192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:10.488655 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-132b78d2-e4ca-4df4-ba62-d6c5c06112b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 1.276283 Oct 03 15:01:10.489318 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2800/5748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:09 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:11.517460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:11.518259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:11.535612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:11.546674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.548413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.550073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:11.553975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:11.556384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:11.559441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:12.020039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:12.027334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:12.048963 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b415c213-1db1-4881-a2a7-fb5909f70952 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.521360 Oct 03 15:01:12.048963 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2949/5749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:11 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:13.069782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:13.070478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:13.125075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:13.127170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:13.139860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:13.145924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:13.149052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:13.151572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:13.824907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:13.834528 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-64727bb4-5de6-49e2-8641-a8f8a36c5e76 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.770673 Oct 03 15:01:13.837264 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2801/5750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:13 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:14.862256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:14.863905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:14.881749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:14.882340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:14.882897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:14.884575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:14.885300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:14.885785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:15.298855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:15.311548 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb2cb4fb-3088-4b5a-a779-1e9975915129 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.452998 Oct 03 15:01:15.325635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2950/5751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:14 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:15.384038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a4da3a32-c164-484a-af4d-eeae673b8a6b req-52241290-9097-44f4-b7ad-1fd9bc9020ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343dcbf0-a74e-4293-8fe7-873c3fb31ed3", "name": "network-vif-plugged", "status": "completed", "tag": "82c0c7b2-3785-4055-8cc6-c3e9a30e16cc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:15.436854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a4da3a32-c164-484a-af4d-eeae673b8a6b req-52241290-9097-44f4-b7ad-1fd9bc9020ae service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:15.437531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a4da3a32-c164-484a-af4d-eeae673b8a6b req-52241290-9097-44f4-b7ad-1fd9bc9020ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:15.442354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a4da3a32-c164-484a-af4d-eeae673b8a6b req-52241290-9097-44f4-b7ad-1fd9bc9020ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:15.495526 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a4da3a32-c164-484a-af4d-eeae673b8a6b req-52241290-9097-44f4-b7ad-1fd9bc9020ae service nova] Creating event network-vif-plugged:82c0c7b2-3785-4055-8cc6-c3e9a30e16cc for instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 on n-h1-781139-2 Oct 03 15:01:15.510145 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a4da3a32-c164-484a-af4d-eeae673b8a6b req-52241290-9097-44f4-b7ad-1fd9bc9020ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129761 Oct 03 15:01:15.513388 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2802/5752] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:16.339912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:16.340540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:16.352788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:16.357472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:16.357941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:16.358760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:16.359175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:16.359598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:16.852119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:16.861641 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc82d255-031a-4aa4-9d18-22ab5d320632 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1367 microversion: 2.1 time: 0.526586 Oct 03 15:01:16.862886 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2951/5753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:16 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:17.886237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:17.886979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:17.901066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:17.901857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:17.902485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:17.903400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:17.904046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:17.904647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:18.120524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:18.130747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-605889c1-1564-4809-8640-c5b44fca00b4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1558 microversion: 2.1 time: 0.248918 Oct 03 15:01:18.133505 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2803/5754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:17 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1558 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:18.160629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:18.161247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:18.174502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:18.176434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:18.177453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:18.179095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:18.182531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:18.197883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:18.400296 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.244619 Oct 03 15:01:18.401473 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2952/5755] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:01:18 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-interface => generated 285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:20.525630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a2bbca15-f709-4f73-b17d-b75f6db66a33 req-f00cee1a-58ca-4f13-857f-f8cd073841ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343dcbf0-a74e-4293-8fe7-873c3fb31ed3", "tag": "82c0c7b2-3785-4055-8cc6-c3e9a30e16cc"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:20.555671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a2bbca15-f709-4f73-b17d-b75f6db66a33 req-f00cee1a-58ca-4f13-857f-f8cd073841ef service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:20.556319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a2bbca15-f709-4f73-b17d-b75f6db66a33 req-f00cee1a-58ca-4f13-857f-f8cd073841ef service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:20.556774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a2bbca15-f709-4f73-b17d-b75f6db66a33 req-f00cee1a-58ca-4f13-857f-f8cd073841ef service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:20.601399 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a2bbca15-f709-4f73-b17d-b75f6db66a33 req-f00cee1a-58ca-4f13-857f-f8cd073841ef service nova] Creating event network-changed:82c0c7b2-3785-4055-8cc6-c3e9a30e16cc for instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 on n-h1-781139-2 Oct 03 15:01:20.610132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a2bbca15-f709-4f73-b17d-b75f6db66a33 req-f00cee1a-58ca-4f13-857f-f8cd073841ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092806 Oct 03 15:01:20.611344 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2804/5756] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:20.794297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:20.796786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fa5525a-7ed7-487e-8ecb-913d6a8663ca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002961 Oct 03 15:01:20.797794 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2953/5757] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 3 15:01:20 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 03 15:01:26.431885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-917092491", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "3080837f-a6e7-48e1-b060-6bff62e887e3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:26.528798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] validate_networks() for [('3080837f-a6e7-48e1-b060-6bff62e887e3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:01:27.491896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:01:27.493761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:01:27.494322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:01:27.494750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:01:27.495181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:01:27.530287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:27.531328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:27.531929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:27.532852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:27.533507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:27.541751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:27.581017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Getting quotas for project b5e7b4c80fa447699f5c838f8b101f67. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:01:27.588987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Getting quotas for user 838ce76590fc4b05b375eee9a283ef8b and project b5e7b4c80fa447699f5c838f8b101f67. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:01:27.605474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:01:27.608599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:01:27.693043 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b679364e-a6b5-4f23-bc84-c928f85c1aaf tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.266060 Oct 03 15:01:27.694218 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2805/5758] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:01:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:01:27.707373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-deac79bb-de3b-42bb-9ce3-67392434727d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:27.710338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-deac79bb-de3b-42bb-9ce3-67392434727d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:27.872005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-deac79bb-de3b-42bb-9ce3-67392434727d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:27.882346 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-deac79bb-de3b-42bb-9ce3-67392434727d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1213 microversion: 2.1 time: 0.180771 Oct 03 15:01:27.884128 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2954/5759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:27 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:28.908204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:28.908852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:28.917924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=17 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:28.924219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:28.926639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:28.927093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:28.927825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:28.928294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:28.929939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:28.996829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39ebf7c1-108b-476c-94e8-7bb36910949d tempest-ComputeTenantNetworksTest-559548144 tempest-ComputeTenantNetworksTest-559548144-project] Calling method '.version_select at 0x7fb2306cd1f0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:29.068876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:29.083300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abceaef1-1ebd-4405-bc8b-615afa1fd502 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1209 microversion: 2.1 time: 0.179372 Oct 03 15:01:29.084756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2955/5760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:28 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1209 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:01:29.186794 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-39ebf7c1-108b-476c-94e8-7bb36910949d tempest-ComputeTenantNetworksTest-559548144 tempest-ComputeTenantNetworksTest-559548144-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.505465 Oct 03 15:01:29.187490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2806/5761] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 15:01:28 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:29.198727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-906cc470-bcc6-4e10-884a-16b5f2475f67 tempest-ComputeTenantNetworksTest-559548144 tempest-ComputeTenantNetworksTest-559548144-project] Calling method '.version_select at 0x7fb2301c75e0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:29.301785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-906cc470-bcc6-4e10-884a-16b5f2475f67 tempest-ComputeTenantNetworksTest-559548144 tempest-ComputeTenantNetworksTest-559548144-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/b0372b02-9fe2-4ced-8e21-c50dd68b9acd" status: 200 len: 140 microversion: 2.1 time: 0.105898 Oct 03 15:01:29.302624 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2956/5762] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 15:01:29 2022] GET /compute/v2.1/os-tenant-networks/b0372b02-9fe2-4ced-8e21-c50dd68b9acd => generated 140 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:30.123355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:30.124895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:30.151436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:30.154244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:30.156992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:30.161411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:30.163018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:30.164021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:30.206982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:30.299379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:30.310856 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a99c892-4243-4629-8077-ec5fb0f82a1f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1271 microversion: 2.1 time: 0.203757 Oct 03 15:01:30.314974 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2807/5763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:30 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:31.338396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:31.340214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:31.354072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:31.355052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:31.355755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:31.357849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:31.361175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:31.362037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:31.750915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:31.759214 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac572bb8-aa8e-40db-a919-e3f3da67ecdd tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.425397 Oct 03 15:01:31.760007 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2957/5764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:31 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:32.407228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-92513c30-93b9-4a6c-acd7-5199a5e8c7bf req-1be4a1db-30ea-4318-9fc1-03ced4154094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cffdff01-05f1-4ebe-add6-9d715678ba1e", "tag": "888088e2-ff36-430c-b464-da9d83e0186b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:32.430341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-92513c30-93b9-4a6c-acd7-5199a5e8c7bf req-1be4a1db-30ea-4318-9fc1-03ced4154094 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.430876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-92513c30-93b9-4a6c-acd7-5199a5e8c7bf req-1be4a1db-30ea-4318-9fc1-03ced4154094 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.431351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-92513c30-93b9-4a6c-acd7-5199a5e8c7bf req-1be4a1db-30ea-4318-9fc1-03ced4154094 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.470749 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-92513c30-93b9-4a6c-acd7-5199a5e8c7bf req-1be4a1db-30ea-4318-9fc1-03ced4154094 service nova] Creating event network-changed:888088e2-ff36-430c-b464-da9d83e0186b for instance cffdff01-05f1-4ebe-add6-9d715678ba1e on n-h2-781139-2 Oct 03 15:01:32.489438 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-92513c30-93b9-4a6c-acd7-5199a5e8c7bf req-1be4a1db-30ea-4318-9fc1-03ced4154094 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088761 Oct 03 15:01:32.490171 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2808/5765] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:32.806166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:32.807676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:32.818560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.819727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.821131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:32.822268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:32.823075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:32.823765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:33.284258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:33.304634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a660b72f-11be-4f0e-ae96-c91e2c687fe4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.518070 Oct 03 15:01:33.308769 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2958/5766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:32 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:34.336823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:34.337989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:34.362228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:34.367043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:34.368179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:34.369127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:34.369742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:34.370348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:34.667680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:34.677782 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f4cd170-efdc-4a04-8f4f-345f32eb7372 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.349459 Oct 03 15:01:34.678688 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2809/5767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:34 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:35.700767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:35.702130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:35.728805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.730847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.733657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:35.737619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:35.745456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:35.748412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:36.367093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:36.379818 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2d57fab-e387-40ad-8003-36da5b138107 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.682895 Oct 03 15:01:36.395134 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2959/5768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:35 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1313 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:37.405559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:37.406229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:37.417779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:37.421809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:37.422289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:37.423040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:37.423513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:37.423943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:37.566449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:37.599360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:38.163238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d45b1630-320b-4b33-8110-b222b6b84aea req-a12d9337-36fd-4df3-ba2b-4daacd076bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cffdff01-05f1-4ebe-add6-9d715678ba1e", "name": "network-vif-plugged", "status": "completed", "tag": "888088e2-ff36-430c-b464-da9d83e0186b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:38.221740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:38.230833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d45b1630-320b-4b33-8110-b222b6b84aea req-a12d9337-36fd-4df3-ba2b-4daacd076bc2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:38.238166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d45b1630-320b-4b33-8110-b222b6b84aea req-a12d9337-36fd-4df3-ba2b-4daacd076bc2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:38.239113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d45b1630-320b-4b33-8110-b222b6b84aea req-a12d9337-36fd-4df3-ba2b-4daacd076bc2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:38.308313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d45b1630-320b-4b33-8110-b222b6b84aea req-a12d9337-36fd-4df3-ba2b-4daacd076bc2 service nova] Creating event network-vif-plugged:888088e2-ff36-430c-b464-da9d83e0186b for instance cffdff01-05f1-4ebe-add6-9d715678ba1e on n-h2-781139-2 Oct 03 15:01:38.365657 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d45b1630-320b-4b33-8110-b222b6b84aea req-a12d9337-36fd-4df3-ba2b-4daacd076bc2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204720 Oct 03 15:01:38.372114 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2960/5769] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:38.388796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:38.443985 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05243e57-723a-4e5a-8e10-53e34fddd22f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1313 microversion: 2.1 time: 1.035622 Oct 03 15:01:38.448511 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2810/5770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:37 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1313 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:39.477547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:39.479127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:39.504634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:39.505756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:39.506745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:39.509373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:39.510207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:39.512358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:39.975837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:40.031497 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bfc275a-1197-4212-ba19-c819c17825b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.555401 Oct 03 15:01:40.033165 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2961/5771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:39 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:41.057587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:41.059100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:41.063530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:41.070991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:41.072056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:41.072802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:41.073879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:41.074607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:41.075841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:41.696833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:41.713258 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0943ef24-54bc-4e5a-a703-7ac73a34a20d tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1497 microversion: 2.1 time: 0.659228 Oct 03 15:01:41.733828 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2811/5772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:41 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1497 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:42.827552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:42.829797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:42.834179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=24 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:42.844564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:42.849793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:42.851031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:42.857573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:42.859169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:42.859759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:42.937204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:01:43.184503 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7019ebde-f048-4bf1-81ec-e59f421c33d1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 204 len: 0 microversion: 2.1 time: 0.372624 Oct 03 15:01:43.189267 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2962/5773] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:01:42 2022] DELETE /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:01:43.203883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:43.203883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:43.217889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:43.218545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:43.221324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:43.222245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:43.223490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:43.226205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:43.798301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:43.809591 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4de3e532-98d3-4fdf-ae34-88c25fe0586b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1503 microversion: 2.1 time: 0.618828 Oct 03 15:01:43.810201 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2812/5774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:43 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1503 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:44.838376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:44.839307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:44.857131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:44.858563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:44.860293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:44.862840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:44.863482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:44.868836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:45.473971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:45.483289 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7166c2ac-5af6-4990-a84c-fa7a363f5ef9 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1503 microversion: 2.1 time: 0.652037 Oct 03 15:01:45.500380 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2963/5775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:44 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1503 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:46.204441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50493493-21ff-4125-a2e4-d5eafd8406e5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'create', calling method: .version_select at 0x7fb23030a820>, body: {"keypair": {"name": "tempest-keypair-995865680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNy/mreeJkpyor2Ux6v/PR/zk2jFi8nKlP21mBPop0qsqvIFKkDJ1yM0cFeeeR/BgJArHnLAHeEVL/I0hsSuImVsvdDuqJfnds9ZIAFAJXd9zyhIF7q0L9Ei5yri9UYSOQ=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:46.233960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-50493493-21ff-4125-a2e4-d5eafd8406e5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for project fdf7775cd80545c18da6599765b0e690. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:01:46.243526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-50493493-21ff-4125-a2e4-d5eafd8406e5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for user 7d21903a3b0047b6ba5a19908d3b99c5 and project fdf7775cd80545c18da6599765b0e690. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:01:46.286488 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50493493-21ff-4125-a2e4-d5eafd8406e5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256094 Oct 03 15:01:46.287922 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2813/5776] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:01:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:46.521649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:46.524173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:46.540216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:46.541165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:46.541861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:46.543376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:46.544001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:46.545839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:46.797147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:46.814036 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13f11905-9992-4139-b3e4-44f01ff749b1 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1461 microversion: 2.1 time: 0.299707 Oct 03 15:01:46.843641 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2964/5777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:46 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1461 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:47.118614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ad49fb05-328c-48a6-a7f9-1b79331494c1 req-5563b50a-c86f-41ba-8b8e-53aac51e28a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cffdff01-05f1-4ebe-add6-9d715678ba1e", "name": "network-vif-deleted", "tag": "888088e2-ff36-430c-b464-da9d83e0186b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:47.180044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad49fb05-328c-48a6-a7f9-1b79331494c1 req-5563b50a-c86f-41ba-8b8e-53aac51e28a9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:47.180859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad49fb05-328c-48a6-a7f9-1b79331494c1 req-5563b50a-c86f-41ba-8b8e-53aac51e28a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:47.188311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ad49fb05-328c-48a6-a7f9-1b79331494c1 req-5563b50a-c86f-41ba-8b8e-53aac51e28a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:47.230100 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ad49fb05-328c-48a6-a7f9-1b79331494c1 req-5563b50a-c86f-41ba-8b8e-53aac51e28a9 service nova] Creating event network-vif-deleted:888088e2-ff36-430c-b464-da9d83e0186b for instance cffdff01-05f1-4ebe-add6-9d715678ba1e on n-h2-781139-2 Oct 03 15:01:47.243758 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ad49fb05-328c-48a6-a7f9-1b79331494c1 req-5563b50a-c86f-41ba-8b8e-53aac51e28a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133155 Oct 03 15:01:47.250685 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2814/5778] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:47.848953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:47.850386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:47.868233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:47.870299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:47.870764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:47.872521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:47.874031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:47.879235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:47.992107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:48.016234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:48.017478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:48.017918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lazy-loading 'fault' on Instance uuid cffdff01-05f1-4ebe-add6-9d715678ba1e {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:01:48.259042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:48.268044 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-80372585-4002-41b2-bac1-d593c113021f tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 200 len: 1303 microversion: 2.1 time: 0.424131 Oct 03 15:01:48.277990 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2965/5779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:47 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 1303 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:49.303153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:49.304848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: cffdff01-05f1-4ebe-add6-9d715678ba1e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:49.317160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:49.328147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:49.335704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:49.338545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:49.342774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:49.343578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:49.388342 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] HTTP exception thrown: Instance cffdff01-05f1-4ebe-add6-9d715678ba1e could not be found. Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Request method failure captured: Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e HTTP/1.1 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvlC3VdITMupd1iKJNVROKZonpArR7sUVWewk5guSntOO20FWDxy2Usuk8QdDj-kPFgfSEd3TaKYvW9c4ATuv25As0D4efsxgKWv75YgVmGV5R-PijjNx9XztF982EheiFhVqHq6j4_0EKUm8fN_Kw83bQtE39GXEaYMDZSAmuAyFdo Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: b5e7b4c80fa447699f5c838f8b101f67 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesActionsTest-1698573733 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b5e7b4c80fa447699f5c838f8b101f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b5e7b4c80fa447699f5c838f8b101f67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5e7b4c80fa447699f5c838f8b101f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5e7b4c80fa447699f5c838f8b101f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesActionsTest-1698573733 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: b5e7b4c80fa447699f5c838f8b101f67 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesActionsTest-1698573733 Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesActionsTest-1698573733-project Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 838ce76590fc4b05b375eee9a283ef8b Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesActionsTest-1698573733-project Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance cffdff01-05f1-4ebe-add6-9d715678ba1e could not be found. Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'cffdff01-05f1-4ebe-add6-9d715678ba1e'} Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cffdff01-05f1-4ebe-add6-9d715678ba1e could not be found. Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cffdff01-05f1-4ebe-add6-9d715678ba1e could not be found. Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:01:49.394267 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:49.399401 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:01:49.399401 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:01:49.399401 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:01:49.399401 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:01:49.399401 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:01:49.399401 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cffdff01-05f1-4ebe-add6-9d715678ba1e could not be found. Oct 03 15:01:49.399401 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:01:49.405757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Returning 404 to user: Instance cffdff01-05f1-4ebe-add6-9d715678ba1e could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:01:49.406956 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d9f54f22-c806-4bd2-9a0e-8b726f853e34 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e" status: 404 len: 111 microversion: 2.1 time: 0.109522 Oct 03 15:01:49.421803 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2815/5780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:49 2022] GET /compute/v2.1/servers/cffdff01-05f1-4ebe-add6-9d715678ba1e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:01:49.583325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-101107929", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "3080837f-a6e7-48e1-b060-6bff62e887e3"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:49.698029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] validate_networks() for [('3080837f-a6e7-48e1-b060-6bff62e887e3', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:01:50.838910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:01:50.839518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:01:50.839863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:01:50.840455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:01:50.841021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:01:50.860023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:50.863290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:50.864174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:50.868356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:50.869634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:50.872111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:50.937271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Getting quotas for project b5e7b4c80fa447699f5c838f8b101f67. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:01:50.948357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Getting quotas for user 838ce76590fc4b05b375eee9a283ef8b and project b5e7b4c80fa447699f5c838f8b101f67. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:01:50.974792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:01:50.984511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:01:51.134952 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b52f239-0510-4ab8-b99e-1dadc4400979 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555466 Oct 03 15:01:51.135623 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2966/5781] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:01:51.152655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-64e9f841-6c42-48a8-a874-16f1398646c6 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:51.154497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-64e9f841-6c42-48a8-a874-16f1398646c6 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:51.250785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1439758483", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3bd0bdc-483f-45cf-a590-2aa5e727aca0"}], "security_groups": [{"name": "tempest-securitygroup--1557490148"}], "key_name": "tempest-keypair-995865680", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:51.419780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-64e9f841-6c42-48a8-a874-16f1398646c6 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:51.458412 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-64e9f841-6c42-48a8-a874-16f1398646c6 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1213 microversion: 2.1 time: 0.313714 Oct 03 15:01:51.480183 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2816/5782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:51 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1213 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:51.765626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] validate_networks() for [('d3bd0bdc-483f-45cf-a590-2aa5e727aca0', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:01:52.505911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:52.507289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:52.530897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:52.531818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:52.532278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:52.536306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:52.536796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:52.537269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:52.797690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:52.820555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:01:52.822626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:01:52.824480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:01:52.825079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:01:52.826054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:01:52.841864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f749880c-0adb-4bcb-ab24-29ffe1dc16e4 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1209 microversion: 2.1 time: 0.356413 Oct 03 15:01:52.844147 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2817/5783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:52 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1209 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:52.847841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:52.848475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:52.849117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:52.849858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:52.850751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:52.851188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:52.899966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for project fdf7775cd80545c18da6599765b0e690. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:01:52.916788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for user 7d21903a3b0047b6ba5a19908d3b99c5 and project fdf7775cd80545c18da6599765b0e690. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:01:52.949449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:01:52.952331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:01:53.074488 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db44781b-dc17-40b2-b53d-5d85fda95440 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.827985 Oct 03 15:01:53.075160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2967/5784] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:01:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:01:53.086768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c338bea-48d4-460a-8782-92512e132114 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:53.087395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1c338bea-48d4-460a-8782-92512e132114 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:53.244723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1c338bea-48d4-460a-8782-92512e132114 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:53.253001 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c338bea-48d4-460a-8782-92512e132114 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1237 microversion: 2.1 time: 0.170111 Oct 03 15:01:53.254186 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2818/5785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:53 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1237 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:53.870194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:53.870833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:53.878362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:53.879158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:53.879753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:53.880683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:53.881486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:53.882068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:53.977727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:54.002199 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46943b02-7215-4cac-aa12-a8613d2d2c87 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1271 microversion: 2.1 time: 0.137743 Oct 03 15:01:54.002824 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2968/5786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:53 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:54.276877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:54.277812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:54.296407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:54.296847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:54.298867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:54.299638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:54.300120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:54.300555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:54.429778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:54.441220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd2a5f15-5b63-4fd5-915c-93849c591548 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1289 microversion: 2.1 time: 0.168379 Oct 03 15:01:54.442062 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2819/5787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:54 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1289 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:55.025694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:55.026910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:55.044126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.045184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.047553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.049997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.050481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.050916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.363327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:55.377318 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-134d60d0-a453-49fb-85f1-ae29f7ecff1e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1313 microversion: 2.1 time: 0.355648 Oct 03 15:01:55.398509 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2969/5788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:55 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:01:55.466996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:55.468982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:55.478997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.480648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.482369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.484807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:55.485465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:55.486833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:55.635436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:55.650629 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4380ebf4-48e0-4a09-b66e-918708e01c76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1295 microversion: 2.1 time: 0.187955 Oct 03 15:01:55.653543 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2820/5789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:55 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1295 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:56.139928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-77e9955f-80cd-4708-b85d-d0ac0f1f278d req-79968b2b-9ff1-42db-bac4-9d417d82331b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148e84b6-d1ef-46d7-a353-cfc090b9dd7f", "tag": "a9d263d5-16ce-47c5-beed-07ddbb414788"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:56.184337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77e9955f-80cd-4708-b85d-d0ac0f1f278d req-79968b2b-9ff1-42db-bac4-9d417d82331b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:56.185146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77e9955f-80cd-4708-b85d-d0ac0f1f278d req-79968b2b-9ff1-42db-bac4-9d417d82331b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:56.185996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77e9955f-80cd-4708-b85d-d0ac0f1f278d req-79968b2b-9ff1-42db-bac4-9d417d82331b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:56.244833 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-77e9955f-80cd-4708-b85d-d0ac0f1f278d req-79968b2b-9ff1-42db-bac4-9d417d82331b service nova] Creating event network-changed:a9d263d5-16ce-47c5-beed-07ddbb414788 for instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f on n-h2-781139-2 Oct 03 15:01:56.253720 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-77e9955f-80cd-4708-b85d-d0ac0f1f278d req-79968b2b-9ff1-42db-bac4-9d417d82331b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118322 Oct 03 15:01:56.255945 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2970/5790] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:56.400644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:56.402051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:56.418145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:56.418627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:56.419798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:56.420645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:56.424025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:56.424482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:56.676543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:56.677294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:56.689688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:56.690192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:56.690639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:56.693228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:56.694202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:56.694649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:56.957072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:56.979645 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0912f39-97f5-4fa2-b6d0-5b21da9d5541 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1363 microversion: 2.1 time: 0.297164 Oct 03 15:01:56.986663 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2971/5791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:56 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:57.291828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:57.306133 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd2420d7-862e-467f-acbe-deed0e080791 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1313 microversion: 2.1 time: 0.908050 Oct 03 15:01:57.309633 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2821/5792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:56 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:57.861898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1992329c-b62d-4400-a4cf-bb7bf4f7c861 req-11bd4bb3-a719-4bea-a45a-9e64156e734b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e655a610-872b-49b4-9d79-39debb37d219", "tag": "7fdee40e-2f28-468a-b7e8-9f23e8bb0984"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:01:57.886564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1992329c-b62d-4400-a4cf-bb7bf4f7c861 req-11bd4bb3-a719-4bea-a45a-9e64156e734b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:57.887051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1992329c-b62d-4400-a4cf-bb7bf4f7c861 req-11bd4bb3-a719-4bea-a45a-9e64156e734b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:57.887481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1992329c-b62d-4400-a4cf-bb7bf4f7c861 req-11bd4bb3-a719-4bea-a45a-9e64156e734b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:57.917388 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1992329c-b62d-4400-a4cf-bb7bf4f7c861 req-11bd4bb3-a719-4bea-a45a-9e64156e734b service nova] Creating event network-changed:7fdee40e-2f28-468a-b7e8-9f23e8bb0984 for instance e655a610-872b-49b4-9d79-39debb37d219 on n-h2-781139-2 Oct 03 15:01:57.935639 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1992329c-b62d-4400-a4cf-bb7bf4f7c861 req-11bd4bb3-a719-4bea-a45a-9e64156e734b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078787 Oct 03 15:01:57.936279 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2972/5793] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:01:58.011578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:58.012483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:58.038534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:58.041541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:58.042190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:58.043181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:58.046787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:58.047241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:58.340337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:58.341432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:58.361650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:58.362390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:58.365183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:58.368435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:58.369479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:58.371583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:58.413968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:58.432961 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-28e1a514-b9af-45d2-bf15-c9dc266d2628 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1363 microversion: 2.1 time: 0.421551 Oct 03 15:01:58.433499 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2822/5794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:58 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1363 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:58.693058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:58.697486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:01:58.703510 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-913b8bfc-d357-45c5-a478-0d35ac33b1fe tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1313 microversion: 2.1 time: 0.375077 Oct 03 15:01:58.704374 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2973/5795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:58 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:01:59.460367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:59.461591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:59.471713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:59.472549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:59.473244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:59.475448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:59.476206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:59.477082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:59.728772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:01:59.729506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:01:59.749146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:59.753677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:59.754134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:59.755470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:01:59.756580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:01:59.757828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:01:59.916657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:01:59.939284 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-faafe800-43c9-499c-8105-ac67e5470039 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1363 microversion: 2.1 time: 0.484710 Oct 03 15:01:59.941252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2823/5796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:59 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1363 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:00.285806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:00.314161 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b4266d1-0859-4b20-aad5-a87ddb854152 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1313 microversion: 2.1 time: 0.585606 Oct 03 15:02:00.315468 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2974/5797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:01:59 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:02:00.966611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:00.968021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:00.986256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:00.987104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:00.992054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:00.994167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:00.996025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:00.998089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:01.006092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=72 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:01.344681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:01.345372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:01.366828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:01.367323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:01.374887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:01.375816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:01.378671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:01.379003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:01.391257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:01.400191 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-870d4370-3a67-4fe1-8710-4960b01ae3db tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1363 microversion: 2.1 time: 0.438601 Oct 03 15:02:01.409428 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2824/5798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:00 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:01.742994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:01.768464 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-011d1f23-367d-4d0a-b2ba-e72c4c032a4e tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1313 microversion: 2.1 time: 0.431101 Oct 03 15:02:01.769766 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2975/5799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:01 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:01.943480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6ff98dfb-2a71-408d-b958-3bc532df2ec3 req-0a431320-e49a-4a70-9079-5399d02a85b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148e84b6-d1ef-46d7-a353-cfc090b9dd7f", "name": "network-vif-plugged", "status": "completed", "tag": "a9d263d5-16ce-47c5-beed-07ddbb414788"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:01.971153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6ff98dfb-2a71-408d-b958-3bc532df2ec3 req-0a431320-e49a-4a70-9079-5399d02a85b7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:01.971767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6ff98dfb-2a71-408d-b958-3bc532df2ec3 req-0a431320-e49a-4a70-9079-5399d02a85b7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:01.972050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6ff98dfb-2a71-408d-b958-3bc532df2ec3 req-0a431320-e49a-4a70-9079-5399d02a85b7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:02.017951 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6ff98dfb-2a71-408d-b958-3bc532df2ec3 req-0a431320-e49a-4a70-9079-5399d02a85b7 service nova] Creating event network-vif-plugged:a9d263d5-16ce-47c5-beed-07ddbb414788 for instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f on n-h2-781139-2 Oct 03 15:02:02.037502 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6ff98dfb-2a71-408d-b958-3bc532df2ec3 req-0a431320-e49a-4a70-9079-5399d02a85b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098928 Oct 03 15:02:02.044099 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2825/5800] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:02.424181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:02.424804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:02.438592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:02.441016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:02.441971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:02.445364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:02.446065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:02.448837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:02.674567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:02.689475 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3ff2807-ec9a-4b3f-aa8b-6cd9ebc9ec0c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1363 microversion: 2.1 time: 0.269706 Oct 03 15:02:02.703188 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2976/5801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:02 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:02.796330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:02.797058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:02.815920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:02.817832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:02.819020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:02.821576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:02.823410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:02.824016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:03.125221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:03.142075 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-090a2844-5899-4c67-a15c-94c1163f6a70 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1313 microversion: 2.1 time: 0.350713 Oct 03 15:02:03.147564 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2826/5802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:02 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:03.720382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:03.721973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:03.724507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:03.725875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:03.734917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:03.736018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:03.736691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:03.738015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:03.738556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:03.739062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.060888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:04.072087 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3a7a0c4b-6a28-4ca2-84d6-d9f30cc3f887 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1363 microversion: 2.1 time: 0.358857 Oct 03 15:02:04.072692 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2977/5803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:03 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:04.096057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-47e976df-05ba-4bc4-a2cb-7c60fba0a4f2 req-06eabe72-39e5-416f-8997-8afa0bd6d32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e655a610-872b-49b4-9d79-39debb37d219", "name": "network-vif-plugged", "status": "completed", "tag": "7fdee40e-2f28-468a-b7e8-9f23e8bb0984"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:04.106918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:04.111354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-47e976df-05ba-4bc4-a2cb-7c60fba0a4f2 req-06eabe72-39e5-416f-8997-8afa0bd6d32f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.111974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-47e976df-05ba-4bc4-a2cb-7c60fba0a4f2 req-06eabe72-39e5-416f-8997-8afa0bd6d32f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.112804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-47e976df-05ba-4bc4-a2cb-7c60fba0a4f2 req-06eabe72-39e5-416f-8997-8afa0bd6d32f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.136083 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-47e976df-05ba-4bc4-a2cb-7c60fba0a4f2 req-06eabe72-39e5-416f-8997-8afa0bd6d32f service nova] Creating event network-vif-plugged:7fdee40e-2f28-468a-b7e8-9f23e8bb0984 for instance e655a610-872b-49b4-9d79-39debb37d219 on n-h2-781139-2 Oct 03 15:02:04.143759 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-47e976df-05ba-4bc4-a2cb-7c60fba0a4f2 req-06eabe72-39e5-416f-8997-8afa0bd6d32f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053894 Oct 03 15:02:04.147105 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2827/5804] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:04.169746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:04.170700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:04.192895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.201888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.202482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.204129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:04.205830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:04.206846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:04.535645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:04.547712 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0a091aa-dae0-4489-a84d-4d89a9110d74 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1497 microversion: 2.1 time: 0.383462 Oct 03 15:02:04.548672 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2978/5805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:04 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1497 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:05.098631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:05.100293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:05.122325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.123322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.125025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.126135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.128325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.130938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.460401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:05.460904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:05.474276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.475227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.475855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.476907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.489437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.492664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.494878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:05.518045 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-60c78f01-170f-45da-abaf-d55c17d8cc3f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1363 microversion: 2.1 time: 0.425710 Oct 03 15:02:05.520721 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2828/5806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:05 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1363 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:05.551750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:02:05.724488 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35b14eaa-594d-4414-b021-692253a37d57 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 204 len: 0 microversion: 2.1 time: 0.267893 Oct 03 15:02:05.728209 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2979/5807] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:02:05 2022] DELETE /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:02:05.745635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:05.746591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:05.777419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.778240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.779879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:05.783231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:05.784363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:05.786564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:06.141460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:06.155933 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ede608e9-1711-4df0-a27f-5d7e57869fef tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1503 microversion: 2.1 time: 0.423109 Oct 03 15:02:06.156568 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2829/5808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:05 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:06.549623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:06.550441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:06.564542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:06.565718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:06.566811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:06.575434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:06.577636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:06.579467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.181341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:07.182114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:07.194996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.202565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.203107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.207454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.212752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.213329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.330659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:07.345833 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48be292d-1506-4120-a0a7-d3913f87bc11 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1548 microversion: 2.1 time: 0.801358 Oct 03 15:02:07.354803 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2980/5809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:06 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1548 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:07.370574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:07.371305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:07.379524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.380285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.381322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.382217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:07.382838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:07.383418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:07.598155 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49dcd7f4-3497-4ec2-bdc6-627dc3f63c54 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232019 Oct 03 15:02:07.599892 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2981/5810] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:02:07 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:02:07.721170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:07.734383 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb1e1bd0-b45c-478a-99e3-e51b1ff42b2b tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1503 microversion: 2.1 time: 0.555411 Oct 03 15:02:07.736761 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2830/5811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:07 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1503 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:02:08.314118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-97150925-3b40-4622-816f-850c193f4f9b req-e06f827d-0389-4cc4-a11f-d1a0c1b29f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148e84b6-d1ef-46d7-a353-cfc090b9dd7f", "name": "network-vif-deleted", "tag": "a9d263d5-16ce-47c5-beed-07ddbb414788"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:08.368230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-97150925-3b40-4622-816f-850c193f4f9b req-e06f827d-0389-4cc4-a11f-d1a0c1b29f95 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:08.368724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-97150925-3b40-4622-816f-850c193f4f9b req-e06f827d-0389-4cc4-a11f-d1a0c1b29f95 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:08.369187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-97150925-3b40-4622-816f-850c193f4f9b req-e06f827d-0389-4cc4-a11f-d1a0c1b29f95 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:08.441616 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-97150925-3b40-4622-816f-850c193f4f9b req-e06f827d-0389-4cc4-a11f-d1a0c1b29f95 service nova] Creating event network-vif-deleted:a9d263d5-16ce-47c5-beed-07ddbb414788 for instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f on n-h2-781139-2 Oct 03 15:02:08.454797 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-97150925-3b40-4622-816f-850c193f4f9b req-e06f827d-0389-4cc4-a11f-d1a0c1b29f95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144464 Oct 03 15:02:08.466962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2982/5812] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:08.762023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:08.762643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:08.774177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:08.774671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:08.775118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:08.775825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:08.776278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:08.776699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:08.854702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:08.857941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:08.858591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:08.861567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lazy-loading 'fault' on Instance uuid 148e84b6-d1ef-46d7-a353-cfc090b9dd7f {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:02:09.142197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838ce76590fc4b05b375eee9a283ef8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e7b4c80fa447699f5c838f8b101f67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:02:09.153584 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8058b3a7-a509-4cdb-82cd-b9fab6b7a617 tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 200 len: 1303 microversion: 2.1 time: 0.394774 Oct 03 15:02:09.155816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2831/5813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:08 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 1303 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:02:10.183634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:10.184386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] [instance: 148e84b6-d1ef-46d7-a353-cfc090b9dd7f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:10.200750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:10.203734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:10.204345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:10.205262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:10.207105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:10.209527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:10.245526 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] HTTP exception thrown: Instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f could not be found. Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Request method failure captured: Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f HTTP/1.1 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvlC3VdITMupd1iKJNVROKZonpArR7sUVWewk5guSntOO20FWDxy2Usuk8QdDj-kPFgfSEd3TaKYvW9c4ATuv25As0D4efsxgKWv75YgVmGV5R-PijjNx9XztF982EheiFhVqHq6j4_0EKUm8fN_Kw83bQtE39GXEaYMDZSAmuAyFdo Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: b5e7b4c80fa447699f5c838f8b101f67 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-VolumesActionsTest-1698573733 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b5e7b4c80fa447699f5c838f8b101f67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b5e7b4c80fa447699f5c838f8b101f67", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5e7b4c80fa447699f5c838f8b101f67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b5e7b4c80fa447699f5c838f8b101f67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-VolumesActionsTest-1698573733 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: b5e7b4c80fa447699f5c838f8b101f67 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-VolumesActionsTest-1698573733 Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-VolumesActionsTest-1698573733-project Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 838ce76590fc4b05b375eee9a283ef8b Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-VolumesActionsTest-1698573733-project Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f could not be found. Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '148e84b6-d1ef-46d7-a353-cfc090b9dd7f'} Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f could not be found. Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f could not be found. Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:10.252085 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f could not be found. Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:10.258978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] Returning 404 to user: Instance 148e84b6-d1ef-46d7-a353-cfc090b9dd7f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:10.260651 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a22a11d-5b98-4a95-9cce-867963deacca tempest-VolumesActionsTest-1698573733 tempest-VolumesActionsTest-1698573733-project] 10.222.0.20 "GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f" status: 404 len: 111 microversion: 2.1 time: 0.084246 Oct 03 15:02:10.261895 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2983/5814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:02:10 2022] GET /compute/v2.1/servers/148e84b6-d1ef-46d7-a353-cfc090b9dd7f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:02:11.848332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f4cfb6a6-cd50-4bb2-8128-b6a9c989df04 req-60780826-9978-4fc7-9d72-7e8b36a51060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e655a610-872b-49b4-9d79-39debb37d219", "tag": "7fdee40e-2f28-468a-b7e8-9f23e8bb0984"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:11.876046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:11.886751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f4cfb6a6-cd50-4bb2-8128-b6a9c989df04 req-60780826-9978-4fc7-9d72-7e8b36a51060 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:11.894339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f4cfb6a6-cd50-4bb2-8128-b6a9c989df04 req-60780826-9978-4fc7-9d72-7e8b36a51060 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:11.909115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f4cfb6a6-cd50-4bb2-8128-b6a9c989df04 req-60780826-9978-4fc7-9d72-7e8b36a51060 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:11.935753 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f4cfb6a6-cd50-4bb2-8128-b6a9c989df04 req-60780826-9978-4fc7-9d72-7e8b36a51060 service nova] Creating event network-changed:7fdee40e-2f28-468a-b7e8-9f23e8bb0984 for instance e655a610-872b-49b4-9d79-39debb37d219 on n-h2-781139-2 Oct 03 15:02:11.958425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f4cfb6a6-cd50-4bb2-8128-b6a9c989df04 req-60780826-9978-4fc7-9d72-7e8b36a51060 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110205 Oct 03 15:02:11.961330 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2832/5815] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:22.917480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:22.919479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:23.201976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:23.202603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:23.224284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:23.226526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:23.227186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:23.227926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:23.230451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:23.231205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:23.300787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7a861d6-130d-47fd-b017-afeb4ea04ee6 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/ips" status: 200 len: 151 microversion: 2.1 time: 0.392836 Oct 03 15:02:23.308123 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2984/5816] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 15:02:22 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/ips => generated 151 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:26.455514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44f7fcba-fe29-4645-a04f-9c3799ac40fe"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:26.458333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:26.476226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=43 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:26.485951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:26.499436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.500114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.503801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:26.508542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:26.511170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:26.514299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:27.384201 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aff6dbfe-8c1d-412a-a1c6-fb3b3a81d412 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.931856 Oct 03 15:02:27.388587 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2833/5817] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:02:26 2022] POST /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:33.208849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:33.297878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:33.555487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Calling method '.version_select at 0x7fb2309dfee0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:33.557715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:33.558089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:33.558876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:33.641066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:33.641568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:33.646019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:33.704880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:33.707949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:33.716622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:33.754022 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-085302d5-e865-43b8-8128-56c0940d1f0d tempest-PortsAdminExtendedAttrsTestJSON-2091476037 tempest-PortsAdminExtendedAttrsTestJSON-2091476037-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.080695 Oct 03 15:02:33.770684 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2985/5818] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 15:02:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:40.687407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:40.688147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:41.307122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-10acccea-dfb0-4789-b875-607db711d475 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: .version_select at 0x7fb234aac4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-418102029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMDHwBdHV/qYns+iEIc0tkW4xZsOfKym/6r2ln1Nogf/jekwUDdz91+Akvc6XcgK64Uk3lHbUDY2hS5E/Wotx160sxl+gw0296EDbOQNl9XyeFEx5v7wOPEJpEbcsnhjg=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:41.389714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-10acccea-dfb0-4789-b875-607db711d475 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:02:41.409483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-10acccea-dfb0-4789-b875-607db711d475 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:02:41.488478 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-10acccea-dfb0-4789-b875-607db711d475 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.803745 Oct 03 15:02:41.489110 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2834/5819] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:02:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:42.530841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:42.532361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:42.547780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:42.550885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:42.555300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:42.559141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:42.561878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:42.562553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:42.653741 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70919659-9405-4be1-9260-3a2b87890b4b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/ips" status: 200 len: 145 microversion: 2.1 time: 0.127593 Oct 03 15:02:42.656909 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2986/5820] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 15:02:42 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/ips => generated 145 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:46.605113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4d1a579-adda-4c60-a7eb-bc068cf3b05b"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:46.607797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:46.628627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:46.639289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:46.640212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:46.644509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:46.645405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:46.648605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:47.288622 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e871fa42-8044-44d6-8045-9258aa133b19 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688120 Oct 03 15:02:47.305798 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2835/5821] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:02:46 2022] POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:48.404287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44f7fcba-fe29-4645-a04f-9c3799ac40fe"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:02:48.410878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:48.417570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:48.418069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:48.418513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:48.419377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:48.419917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:48.420351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:48.565244 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Invalid volume: volume 44f7fcba-fe29-4645-a04f-9c3799ac40fe is already attached to instances: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments HTTP/1.1 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 74 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: {"volumeAttachment": {"volumeId": "44f7fcba-fe29-4645-a04f-9c3799ac40fe"}} Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid volume: volume 44f7fcba-fe29-4645-a04f-9c3799ac40fe is already attached to instances: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': '343dcbf0-a74e-4293-8fe7-873c3fb31ed3', 'body': {'volumeAttachment': {'volumeId': '44f7fcba-fe29-4645-a04f-9c3799ac40fe'}}} Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 44f7fcba-fe29-4645-a04f-9c3799ac40fe is already attached to instances: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:02:48.567221 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 44f7fcba-fe29-4645-a04f-9c3799ac40fe is already attached to instances: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 44f7fcba-fe29-4645-a04f-9c3799ac40fe is already attached to instances: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 Oct 03 15:02:48.573787 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:02:48.581816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 400 to user: Invalid volume: volume 44f7fcba-fe29-4645-a04f-9c3799ac40fe is already attached to instances: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:02:48.583983 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f033a3cd-db29-4e53-b59b-77b6ebf89333 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.183833 Oct 03 15:02:48.592655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2987/5822] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:02:48 2022] POST /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 174 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:02:48.835459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:48.841157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:48.860306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:48.866183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:48.866996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:48.868446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:48.869340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:48.869997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:49.080357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lazy-loading 'services' on Instance uuid 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:02:49.353750 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-08e5a30c-0804-4e45-a5e0-c79eaa910aba tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments/44f7fcba-fe29-4645-a04f-9c3799ac40fe" status: 202 len: 0 microversion: 2.1 time: 0.525406 Oct 03 15:02:49.355706 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2836/5823] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:02:48 2022] DELETE /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments/44f7fcba-fe29-4645-a04f-9c3799ac40fe => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:02:49.364235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:49.367889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:49.400510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:49.403038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:49.406652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:49.408441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:49.414775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:49.415544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:49.583105 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e36f806d-0b7f-4b8a-acd7-b61a8afa5638 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222978 Oct 03 15:02:49.584223 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2988/5824] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:49 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:50.609260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:50.612335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:50.667726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:50.668354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:50.668819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:50.669606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:50.679312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:50.680025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:50.894435 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3794e06f-338e-4690-a7c1-10c5597be1f8 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.297276 Oct 03 15:02:50.895778 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2837/5825] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:50 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:51.909480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:51.914107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:51.947778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:51.949874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:51.950533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:51.954068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:51.957680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:51.959696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:52.089624 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d7ec1b0-43fb-4843-a721-83ebb8673183 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185565 Oct 03 15:02:52.094569 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2989/5826] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:51 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:53.104157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:53.106950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:53.122007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:02:53.125044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:53.143068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:53.143879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:53.145826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:53.146492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:53.147112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:53.242132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0cf43725-057f-4590-8add-282e96142c46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141981 Oct 03 15:02:53.248886 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2838/5827] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:53 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:54.254838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:54.258671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:54.280172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:54.280887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:54.281528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:54.283146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:54.284123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:54.288817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:54.337049 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b356fd0-1bdd-449a-8249-afa402057f14 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086717 Oct 03 15:02:54.338400 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2990/5828] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:54 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:02:55.350664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:55.353589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:55.389220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:55.390176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:55.390807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:55.392409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:55.396817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:55.397476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:55.473316 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b0618b2-71a0-4ab4-980b-ceaac4e71b87 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127173 Oct 03 15:02:55.478581 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2839/5829] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:55 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:56.491808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:56.494661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:56.510583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:56.517843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:56.518835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:56.520522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:56.521327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:56.523447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:56.623059 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0c4e25e-038c-42f3-be2b-9a21e4e81408 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137068 Oct 03 15:02:56.631041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2991/5830] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:56 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:57.642068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:57.645268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:57.666680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:57.667198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:57.667639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:57.668366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:57.668826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:57.685112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:57.812229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0c2f8f17-00d0-4bc7-9dce-7b150011a947 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173939 Oct 03 15:02:57.822689 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2840/5831] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:57 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:58.828616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:58.834340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:58.877763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:58.878528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:58.880209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:58.881592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:58.882241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:02:58.882855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:02:58.955766 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-889cf353-95dc-4a44-95b8-44abef636ff7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131952 Oct 03 15:02:58.962438 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2992/5832] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:58 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:02:59.971178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:02:59.976729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:02:59.997393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:02:59.998239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:00.003068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:00.010507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:00.011562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:00.012271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:00.147528 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3bdd0139-e8b7-48fe-81c9-f872dcd8dad3 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181310 Oct 03 15:03:00.165384 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2841/5833] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:02:59 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:01.170088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:01.177167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:01.213396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:01.215933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:01.221445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:01.225215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:01.225914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:01.226539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:01.357291 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca7de063-ff71-49ef-b650-e77b6d763d8b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199080 Oct 03 15:03:01.368812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2993/5834] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:03:01 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:02.371443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:02.373996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:02.395747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:02.396246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:02.396693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:02.397447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:02.397904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:02.398335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:02.531599 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-51ccc2a3-0ff5-48c9-b7ac-70d4b2f497e0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164933 Oct 03 15:03:02.532470 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2842/5835] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:03:02 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:02.619374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1427037878", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "ca9a3fe9-c20f-4442-894a-ea0b29577bca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-418102029", "security_groups": [{"name": "tempest-secgroup-smoke-368891916"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:03.293424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] validate_networks() for [('ca9a3fe9-c20f-4442-894a-ea0b29577bca', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:03:03.624057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:03.636226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:03.640773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:03.674133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:03.683733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:03.688096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:03.692183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:03.694059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:03.695123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:03.813398 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-45ce875b-4dbf-4bc6-9ed2-437d3ad4571f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182067 Oct 03 15:03:03.814458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2843/5836] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:03:03 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:04.534740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:03:04.535774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:03:04.536515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:03:04.537048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:03:04.537400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:03:04.560707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:04.561235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:04.561674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:04.562415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:04.562873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:04.563310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:04.583156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=53 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:04.605725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:03:04.616042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:03:04.653977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:03:04.656307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:03:04.755201 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a0a691b-176c-4dd0-8d61-f0bdfe796edd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.140316 Oct 03 15:03:04.765307 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2994/5837] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:03:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 2151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:03:04.767351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-26b36904-76a6-4a8f-9397-a223cd0d821c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:04.767974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-26b36904-76a6-4a8f-9397-a223cd0d821c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:04.827060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:04.829940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:04.856010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:04.856734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:04.857394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:04.862330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:04.863371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:04.864057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:04.968857 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1108a058-c71b-4818-8ee4-5cbf208b5929 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146287 Oct 03 15:03:04.976032 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2995/5838] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:03:04 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:03:05.338363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-26b36904-76a6-4a8f-9397-a223cd0d821c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:05.357580 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-26b36904-76a6-4a8f-9397-a223cd0d821c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1266 microversion: 2.1 time: 0.582945 Oct 03 15:03:05.358592 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2844/5839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:04 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1266 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:05.986976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:05.989590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:06.026701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:06.031148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:06.034045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:06.035114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:06.045957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:06.047430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:06.197999 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6053db24-9e46-44df-aa05-a747e87937fc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.218545 Oct 03 15:03:06.220043 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2996/5840] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:03:05 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3/os-volume_attachments => generated 25 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:03:06.389275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:06.389918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:06.418077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:06.418891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:06.420863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:06.424069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:06.425577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:06.427521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:06.817218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:06.831589 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c26f2dd0-c919-4a94-af19-fbff5d6e145c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1318 microversion: 2.1 time: 0.448129 Oct 03 15:03:06.851683 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2845/5841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:06 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:07.388873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:07.390004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:07.400917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:07.401904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:07.402510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:07.403549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:07.404157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:07.404755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:07.496054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:03:07.730158 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73538ae3-ee4e-4c8d-b52b-f78082d2de1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 204 len: 0 microversion: 2.1 time: 0.344845 Oct 03 15:03:07.734355 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2997/5842] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:03:07 2022] DELETE /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:03:07.741705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:07.742334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:07.757167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:07.757863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:07.758498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:07.761700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:07.762453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:07.763750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:07.865233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:07.868019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:07.879872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:07.884121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:07.887154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:07.888239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:07.889721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:07.891084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:08.338791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:08.351394 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-786b5802-788a-4c1b-936a-3b1610ed1b25 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1324 microversion: 2.1 time: 0.496725 Oct 03 15:03:08.359846 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2998/5843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:07 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:08.601402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:08.611623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06a8bb49-51d6-40cc-afbc-b5820a736b28 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1683 microversion: 2.1 time: 0.875969 Oct 03 15:03:08.620020 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2846/5844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:07 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1683 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:09.380880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:09.381766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:09.394045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:09.395927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:09.399552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:09.400834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:09.401571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:09.402569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:09.644480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:09.645807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:09.657244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:09.663250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:09.663937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:09.666334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:09.667005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:09.669787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:09.787789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:09.818523 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-775261e0-eb7f-465b-91b4-160744055b7a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1324 microversion: 2.1 time: 0.441387 Oct 03 15:03:09.832945 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 2999/5845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:09 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:10.771672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:10.789890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:10.794008 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33194a78-cafb-4898-9295-ddb34f76138e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1683 microversion: 2.1 time: 1.154778 Oct 03 15:03:10.796544 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2847/5846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:09 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1683 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:10.850152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:10.850782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:10.864365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:10.873212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:10.873917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:10.874733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:10.875212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:10.875642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:11.309572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:11.332705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8382d06-3fe6-4273-9462-1b335ce9bcbb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.492313 Oct 03 15:03:11.334066 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3000/5847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:10 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:11.820700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:11.822006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:11.825062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:11.846237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:11.851416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:11.853557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:11.854327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:11.854791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:11.855211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:12.361292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:12.363214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:12.381465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:12.382057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:12.382507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:12.386847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:12.387666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:12.393077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:12.830184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:12.841140 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7213bbf4-bca1-489e-bfcf-543bc92bb56e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.483644 Oct 03 15:03:12.847525 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3001/5848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:12 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:13.870250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:13.871547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:13.886804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:13.889641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:13.890317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:13.893050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:13.908073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:13.909139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:13.996261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:14.009216 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35f4a36f-1ba1-4cda-a64b-193968dcf288 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1683 microversion: 2.1 time: 2.190112 Oct 03 15:03:14.016558 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2848/5849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:11 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1683 bytes in 2195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:14.359438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:14.377071 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16113fab-5424-4573-9691-8c821448f366 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.505119 Oct 03 15:03:14.378401 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3002/5850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:13 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:15.037367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:15.038594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:15.053823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:15.054690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:15.055836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:15.057475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:15.059442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:15.061200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:15.325681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:15.335464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7979cb18-cda3-44eb-9e80-8a6a5737efc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 200 len: 1615 microversion: 2.1 time: 0.305015 Oct 03 15:03:15.351883 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2849/5851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:15 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 1615 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:15.354118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-77a9ea79-0758-4309-a0e5-a2a1e4342e51 req-69f3104b-a056-4522-abe1-033515f243ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343dcbf0-a74e-4293-8fe7-873c3fb31ed3", "name": "network-vif-deleted", "tag": "82c0c7b2-3785-4055-8cc6-c3e9a30e16cc"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:15.402234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:15.403151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:15.412879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:15.413909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:15.419950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:15.422660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:15.423325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:15.424659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:15.425641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:15.426249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:15.426373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77a9ea79-0758-4309-a0e5-a2a1e4342e51 req-69f3104b-a056-4522-abe1-033515f243ca service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:15.426987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:15.432810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77a9ea79-0758-4309-a0e5-a2a1e4342e51 req-69f3104b-a056-4522-abe1-033515f243ca service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:15.446173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77a9ea79-0758-4309-a0e5-a2a1e4342e51 req-69f3104b-a056-4522-abe1-033515f243ca service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:15.512817 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-77a9ea79-0758-4309-a0e5-a2a1e4342e51 req-69f3104b-a056-4522-abe1-033515f243ca service nova] Creating event network-vif-deleted:82c0c7b2-3785-4055-8cc6-c3e9a30e16cc for instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 on n-h1-781139-2 Oct 03 15:03:15.535788 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-77a9ea79-0758-4309-a0e5-a2a1e4342e51 req-69f3104b-a056-4522-abe1-033515f243ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189057 Oct 03 15:03:15.538447 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3003/5852] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:16.127767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:16.135840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc897027-89cf-49e3-9289-9491d259a742 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:16.139674 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53a8ec29-2604-413d-ac58-aa6bf86ed3c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.732218 Oct 03 15:03:16.141325 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2850/5853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:15 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:16.159032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc897027-89cf-49e3-9289-9491d259a742 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:16.160193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc897027-89cf-49e3-9289-9491d259a742 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:16.160834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc897027-89cf-49e3-9289-9491d259a742 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:16.191813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc897027-89cf-49e3-9289-9491d259a742 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Going to try to stop instance {{(pid=128869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 15:03:16.305881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc897027-89cf-49e3-9289-9491d259a742 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action" status: 202 len: 0 microversion: 2.1 time: 0.174915 Oct 03 15:03:16.315768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:16.316787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:16.319436 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3004/5854] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:03:16 2022] POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:03:16.327478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:16.329757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:16.332440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:16.337964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:16.338747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:16.339382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:16.365939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:16.366750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:16.382335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:16.384590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:16.385601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:16.390325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:16.391345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:16.393140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:16.453625 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 HTTP/1.1 Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '343dcbf0-a74e-4293-8fe7-873c3fb31ed3'} Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:03:16.461053 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:03:16.466250 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:03:16.466250 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:03:16.466250 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:03:16.466250 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:03:16.466250 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:03:16.466250 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:03:16.466250 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:03:16.469608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:03:16.472724 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4aca4379-fdac-41dd-b0bb-26a400feb9b1 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 404 len: 111 microversion: 2.1 time: 0.111038 Oct 03 15:03:16.474959 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3005/5855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:16 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:03:16.496056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbfc9381-8913-4151-9520-07065c18eaed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '.version_select at 0x7fb230b13e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:16.560776 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbfc9381-8913-4151-9520-07065c18eaed tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-121735486" status: 202 len: 0 microversion: 2.1 time: 0.079268 Oct 03 15:03:16.560776 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3006/5856] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 15:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-121735486 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:03:16.946280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:16.963338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ae6612a-6012-4e21-a31d-e519430bd1aa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.652368 Oct 03 15:03:16.967187 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2851/5857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:16 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:17.165801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:17.166504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:17.176220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:17.176720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:17.177185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:17.181060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:17.181720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:17.184297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:17.617871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-48ed9bbe-cfe8-4e1b-a1c6-394e9787441f req-1383bf35-a4de-42f5-90a0-5d3b1ab050ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:17.642945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-48ed9bbe-cfe8-4e1b-a1c6-394e9787441f req-1383bf35-a4de-42f5-90a0-5d3b1ab050ae service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:17.645421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-48ed9bbe-cfe8-4e1b-a1c6-394e9787441f req-1383bf35-a4de-42f5-90a0-5d3b1ab050ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:17.645990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-48ed9bbe-cfe8-4e1b-a1c6-394e9787441f req-1383bf35-a4de-42f5-90a0-5d3b1ab050ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:17.677115 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-48ed9bbe-cfe8-4e1b-a1c6-394e9787441f req-1383bf35-a4de-42f5-90a0-5d3b1ab050ae service nova] Creating event network-changed:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h2-781139-2 Oct 03 15:03:17.694093 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-48ed9bbe-cfe8-4e1b-a1c6-394e9787441f req-1383bf35-a4de-42f5-90a0-5d3b1ab050ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077023 Oct 03 15:03:17.695379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2852/5858] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:17.926609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:17.946607 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63509be0-88b2-496b-9ca6-2350d190fb1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.784852 Oct 03 15:03:17.947635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3007/5859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:17 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:17.996631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:17.998089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:18.011805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:18.012769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:18.013604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:18.015740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:18.016731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:18.017399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:18.344513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3febc68-1469-493b-adba-826681e05c90 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: .version_select at 0x7fb22b745f70>, body: {"keypair": {"name": "tempest-keypair-690291359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLrRGq1IHRIOCJPHNZUirzcDB+iOX+dTTK8p3jCuspNcRYpx7sUY6jmNNzgBYkxlLB8+6CWhQroxWCGS4VgexCOJzCn08JBIJnEU1U8cYER4SCtFl/YfZAmmzrPU5O29A=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:18.442451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c3febc68-1469-493b-adba-826681e05c90 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:03:18.465710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c3febc68-1469-493b-adba-826681e05c90 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:03:18.529258 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3febc68-1469-493b-adba-826681e05c90 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190322 Oct 03 15:03:18.530099 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3008/5860] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:03:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:18.534636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:18.544338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80f9a8c1-776e-4e85-8c05-0fc3faf66e41 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.555912 Oct 03 15:03:18.568293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2853/5861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:17 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:18.987859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:18.988482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:18.996384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:19.001690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:19.002382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:19.003835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:19.004318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:19.004751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:19.576767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:19.578128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:19.596008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:19.598257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:19.602023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:19.604369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:19.607935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:19.610643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:19.730206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:19.740854 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2685f570-44b5-4476-b723-fb4f46c04cd6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.756975 Oct 03 15:03:19.750087 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3009/5862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:18 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:20.071561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:20.100142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70fd1fdf-7f0e-478b-b0b7-7e93bd7dbec6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.524950 Oct 03 15:03:20.101360 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2854/5863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:19 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:20.788876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:20.791098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:20.807748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:20.811776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:20.812489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:20.813495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:20.814170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:20.814843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:21.124417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:21.125046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:21.129001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:21.139782 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a93b37b2-9724-4d8a-847a-7898f9e28dd4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.364978 Oct 03 15:03:21.140400 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3010/5864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:20 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:21.159253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:21.160077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:21.160698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:21.161812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:21.162800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:21.163393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:21.302313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-537338239", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:21.432484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:03:22.044693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:03:22.047192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:03:22.047889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:03:22.049003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:03:22.049973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:03:22.061478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:22.062267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:22.062986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:22.063914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:22.064557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:22.065257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:22.093116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Getting quotas for project 1a5a64f239ff4e6786dbea364bb59d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:03:22.100361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Getting quotas for user 96529b60c8db4875a975aa0db5fdcf57 and project 1a5a64f239ff4e6786dbea364bb59d2c. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:03:22.129140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:03:22.131991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:03:22.183171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:22.197644 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50a816c5-d075-4efc-8596-aae07d11eefb tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 1.077221 Oct 03 15:03:22.201761 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2855/5865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:21 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:22.209801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-54decf27-0201-4aff-8a24-d2309f09e690 req-9e7e2295-121b-4705-800b-22c0c859033a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "name": "network-vif-plugged", "status": "completed", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:22.214239 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0835a520-dca2-4b10-8f39-5a6ccd68da2f tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910628 Oct 03 15:03:22.214946 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3011/5866] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:03:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:03:22.224824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:22.225732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:22.241547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-54decf27-0201-4aff-8a24-d2309f09e690 req-9e7e2295-121b-4705-800b-22c0c859033a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:22.259792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:22.262582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:22.264629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:22.268495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:22.269703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-54decf27-0201-4aff-8a24-d2309f09e690 req-9e7e2295-121b-4705-800b-22c0c859033a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:22.274960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:22.275440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:22.275628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-54decf27-0201-4aff-8a24-d2309f09e690 req-9e7e2295-121b-4705-800b-22c0c859033a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:22.312477 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-54decf27-0201-4aff-8a24-d2309f09e690 req-9e7e2295-121b-4705-800b-22c0c859033a service nova] Creating event network-vif-plugged:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h2-781139-2 Oct 03 15:03:22.330095 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-54decf27-0201-4aff-8a24-d2309f09e690 req-9e7e2295-121b-4705-800b-22c0c859033a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126734 Oct 03 15:03:22.331646 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2856/5867] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:22.346212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe8a4d03-cbfe-404b-a5bc-1d2c12e10e1c tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:22.347399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe8a4d03-cbfe-404b-a5bc-1d2c12e10e1c tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:22.542571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fe8a4d03-cbfe-404b-a5bc-1d2c12e10e1c tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:22.561868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe8a4d03-cbfe-404b-a5bc-1d2c12e10e1c tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1213 microversion: 2.1 time: 0.226841 Oct 03 15:03:22.562991 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2857/5868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:22 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1213 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:22.590897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:22.594289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:22.604633 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-daba924a-bb0e-42e7-8c3a-03c87843979a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1391 microversion: 2.1 time: 0.388444 Oct 03 15:03:22.605432 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3012/5869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:22 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1391 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:23.243104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:23.244407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:23.263211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.263755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.267957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.268818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.269335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.271036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.508037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-754722271", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8455999-ecee-4494-a487-d4e57e751b83"}], "security_groups": [{"name": "tempest-securitygroup--888231405"}], "key_name": "tempest-keypair-690291359", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:23.735665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] validate_networks() for [('f8455999-ecee-4494-a487-d4e57e751b83', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:03:23.827124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:23.840834 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2db13439-0bae-45e2-9ce2-8bd6530ece22 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.614419 Oct 03 15:03:23.845586 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2858/5870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:23 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:23.861525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:23.863125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:23.886045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.886753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.887290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:23.888130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:23.888711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:23.889400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:24.108952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:24.119209 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-41e07b3f-da72-4f09-b632-33de3ac863d5 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1265 microversion: 2.1 time: 0.271665 Oct 03 15:03:24.119816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2859/5871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:23 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:24.147819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:24.149877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:24.185386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:24.189740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:24.192294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:24.193096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:24.193553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:24.193992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:24.869015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:24.887137 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17fd17f2-5fa8-4dfe-bba8-f85a8de24349 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1562 microversion: 2.1 time: 0.761178 Oct 03 15:03:24.888150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2860/5872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:24 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1562 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:24.915845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:24.919168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:24.929587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:24.930461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:24.931118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:24.932053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:24.932724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:24.933437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.287316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:03:25.288369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:03:25.288855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:03:25.289313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:03:25.289730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:03:25.308955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.309876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.310479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.311296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.311754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.312194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.334231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:03:25.339818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Getting quotas for user d4048c225333488babee42b8bbe86bfe and project 74c93601b06e4575980d5d65c27bebad. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:03:25.351611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:25.363185 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05909354-0547-4809-9308-24a5cf72b217 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.471270 Oct 03 15:03:25.366288 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2861/5873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:24 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:25.370554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:03:25.372821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:03:25.383143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:25.383879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:25.390927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.393950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.395601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.398434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.399534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.401904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.453176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:25.513163 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34b2cfa3-d802-47d7-b7e8-698dab57106a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.010300 Oct 03 15:03:25.514198 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3013/5874] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:03:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:03:25.519049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:25.519663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:25.527734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.528289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.528729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.529515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:25.530044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:25.530613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:25.641615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:25.652208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-025ee0e0-fcad-41ed-a68f-8ee98f8b5f28 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1271 microversion: 2.1 time: 0.136850 Oct 03 15:03:25.657507 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3014/5875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:25 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:25.671586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f8c71542-e4da-4a50-a7f4-ec75e6305f60 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:25.671937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f8c71542-e4da-4a50-a7f4-ec75e6305f60 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:25.836382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f8c71542-e4da-4a50-a7f4-ec75e6305f60 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:25.845793 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f8c71542-e4da-4a50-a7f4-ec75e6305f60 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1240 microversion: 2.1 time: 0.186213 Oct 03 15:03:25.850073 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3015/5876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:25 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1240 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:26.029791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:26.047171 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7c5c28f-3007-4a50-bc26-ffb0e8e698ab tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1562 microversion: 2.1 time: 0.679696 Oct 03 15:03:26.047785 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2862/5877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:25 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1562 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:26.387566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:26.388281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:26.399717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:26.400661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:26.402691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:26.405024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:26.406491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:26.408682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:26.676990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:26.678542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:26.693191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:26.694177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:26.694894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:26.696803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:26.697478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:26.698220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:26.988253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:27.051162 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d40f6605-0054-488d-a009-1238b1d45a31 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.667896 Oct 03 15:03:27.063573 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3016/5878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:26 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:27.074631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:27.074631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:27.084435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:27.085541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:27.086080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:27.089253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:27.090055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:27.090761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:27.221270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:27.238737 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caf3a9f8-dc74-4306-9966-0daa602a1e0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1292 microversion: 2.1 time: 0.183455 Oct 03 15:03:27.244563 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3017/5879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:27 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1292 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:27.453519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:27.467155 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33ccf09c-1c72-47ab-bb61-22bc524a7672 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1271 microversion: 2.1 time: 0.794937 Oct 03 15:03:27.499128 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2863/5880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:26 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1271 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:28.083262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:28.083861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:28.098515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:28.098922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:28.099423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:28.100165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:28.100820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:28.101277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:28.268285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:28.268968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:28.280894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:28.289612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:28.290324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:28.291261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:28.291884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:28.292495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:28.420623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:28.442229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0697d86c-2389-4c25-91be-17c7b38875bc tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1298 microversion: 2.1 time: 0.177779 Oct 03 15:03:28.443170 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2864/5881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:28 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:28.493963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:28.495436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:28.518047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:28.518047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:28.518613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:28.519339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:28.519798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:28.520229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:28.590121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:28.607065 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9cf60426-631c-4d5b-9d14-bd64684cdab6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.527631 Oct 03 15:03:28.613474 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3018/5882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:28 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:29.472507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:29.474280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:29.492687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:29.493502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:29.494129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:29.495212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:29.495965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:29.496596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:29.498377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:29.507881 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14d514ad-a0d2-44e5-a3d9-d3ae1c04f190 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 1.019701 Oct 03 15:03:29.508496 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2865/5883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:28 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:29.631535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:29.633678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:29.634457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:29.646169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:29.646482 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf94a132-e099-44c6-a5f1-4fd450953e1b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1298 microversion: 2.1 time: 0.180047 Oct 03 15:03:29.646923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:29.647376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:29.648089 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3019/5884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:29 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:29.661304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:29.661855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:29.662306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:30.281893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:30.286054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:30.305676 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed596e72-33f6-4e9b-ac71-a52edb37b2d7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.675765 Oct 03 15:03:30.314194 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2866/5885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:29 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:30.536244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:30.536841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:30.557371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:30.558291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:30.558915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:30.560244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:30.561166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:30.561772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:30.677809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:30.679204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:30.693902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:30.694838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:30.695952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:30.696938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:30.697771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:30.698496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:30.854928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:30.891458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-253e74da-4f53-437e-af17-ba089f8fb3d1 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.359956 Oct 03 15:03:30.892970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3020/5886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:30 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:31.165333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:31.189016 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9a54a9ef-8a27-4889-9504-3f7733b918a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1298 microversion: 2.1 time: 0.506090 Oct 03 15:03:31.206080 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2867/5887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:30 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1298 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:31.337502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:31.338123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:31.374486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.375049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.375508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.376272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.376736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.377199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.918421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:31.919041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:31.935781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.936275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.936918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:31.937818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:31.938430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:31.939035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:32.002415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:32.012824 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b7c6caaa-4d13-4296-aa9c-926a6372acaa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1723 microversion: 2.1 time: 0.679367 Oct 03 15:03:32.019694 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3021/5888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:31 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1723 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:32.212961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:32.213876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:32.222198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:32.222894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:32.223701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:32.224590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:32.225240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:32.225868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:32.430215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:32.441554 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bab011cb-a300-44b1-9532-d79c75839a4a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1298 microversion: 2.1 time: 0.233445 Oct 03 15:03:32.442365 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3022/5889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:32 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1298 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:32.553144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:32.597322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:32.632198 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83e6b0ab-52d5-490f-89c6-35813ad63757 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.717417 Oct 03 15:03:32.634688 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2868/5890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:31 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:32.845411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b6d75945-ab7c-4d8e-aefc-48af0109f5c8 req-c08a77f0-0f59-482a-a51e-417de89e4970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5", "tag": "73943ebd-aa16-493e-8d27-a1ba6d7134c9"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:32.900564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b6d75945-ab7c-4d8e-aefc-48af0109f5c8 req-c08a77f0-0f59-482a-a51e-417de89e4970 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:32.903849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b6d75945-ab7c-4d8e-aefc-48af0109f5c8 req-c08a77f0-0f59-482a-a51e-417de89e4970 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:32.905395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b6d75945-ab7c-4d8e-aefc-48af0109f5c8 req-c08a77f0-0f59-482a-a51e-417de89e4970 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:32.958772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b6d75945-ab7c-4d8e-aefc-48af0109f5c8 req-c08a77f0-0f59-482a-a51e-417de89e4970 service nova] Creating event network-changed:73943ebd-aa16-493e-8d27-a1ba6d7134c9 for instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 on n-h1-781139-2 Oct 03 15:03:32.975951 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b6d75945-ab7c-4d8e-aefc-48af0109f5c8 req-c08a77f0-0f59-482a-a51e-417de89e4970 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139676 Oct 03 15:03:32.989278 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3023/5891] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:33.044138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:33.045951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:33.062751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.063683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.064312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.065558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.066260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.067674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.466495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:33.467819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:33.475475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.476361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.476999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.478113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.478722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.479314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.667373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:33.677715 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-204d5a6e-faab-45ea-bdce-ce87870c8e71 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.215317 Oct 03 15:03:33.678230 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3024/5892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:33 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:33.688590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:33.693517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:33.707006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.707758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.708341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.709311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:33.709940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:33.710722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:33.895483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:33.907200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0f39483-f1b7-44b7-ad19-64962f507a46 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.226445 Oct 03 15:03:33.920146 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3025/5893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:33 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:34.137808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:34.149651 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5226da36-51b3-48b2-8548-a87b2fa22675 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1700 microversion: 2.1 time: 1.109611 Oct 03 15:03:34.150252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2869/5894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:33 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1700 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:34.173429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1937e21a-c015-4d76-aacd-bb2bced65e15 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:34.181261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1937e21a-c015-4d76-aacd-bb2bced65e15 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:34.181717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1937e21a-c015-4d76-aacd-bb2bced65e15 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:34.182181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1937e21a-c015-4d76-aacd-bb2bced65e15 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:34.207317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1937e21a-c015-4d76-aacd-bb2bced65e15 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Going to try to start instance {{(pid=128869) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 15:03:34.272790 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1937e21a-c015-4d76-aacd-bb2bced65e15 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action" status: 202 len: 0 microversion: 2.1 time: 0.103578 Oct 03 15:03:34.274182 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3026/5895] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:03:34 2022] POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:03:34.291660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:34.293546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:34.311833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:34.313704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:34.315114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:34.316384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:34.317216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:34.318118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:34.700450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:34.701205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:34.729129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:34.731251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:34.732063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:34.735454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:34.736093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:34.743939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:34.952523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:34.980977 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2cd9b2b-d75a-4819-8222-fad752eb8b8f tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1709 microversion: 2.1 time: 0.697859 Oct 03 15:03:34.981999 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2870/5896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:34 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1709 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:35.007138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:35.017470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:35.030775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.031830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.033084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.035294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.037184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.037822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.325072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:35.649448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:35.660984 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-838f30b8-2572-434b-9cc3-c502502b996e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.964754 Oct 03 15:03:35.661661 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3027/5897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:34 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:35.682830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:35.683455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:35.702088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.702692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.703007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.706811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:35.711368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:35.713249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:35.840866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=18 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:36.231774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:36.244357 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33174235-1aae-49cf-83e5-4bf9955bb5bd tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 1.259137 Oct 03 15:03:36.253800 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2871/5898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:34 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:36.268159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a851ec80-9aea-4928-adf9-489b59ef5072 req-abb85786-9d85-4a81-96c1-2d6fef802f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:36.308846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a851ec80-9aea-4928-adf9-489b59ef5072 req-abb85786-9d85-4a81-96c1-2d6fef802f0c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:36.310995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a851ec80-9aea-4928-adf9-489b59ef5072 req-abb85786-9d85-4a81-96c1-2d6fef802f0c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:36.311432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a851ec80-9aea-4928-adf9-489b59ef5072 req-abb85786-9d85-4a81-96c1-2d6fef802f0c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:36.349347 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a851ec80-9aea-4928-adf9-489b59ef5072 req-abb85786-9d85-4a81-96c1-2d6fef802f0c service nova] Creating event network-changed:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h2-781139-2 Oct 03 15:03:36.356336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a851ec80-9aea-4928-adf9-489b59ef5072 req-abb85786-9d85-4a81-96c1-2d6fef802f0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100406 Oct 03 15:03:36.357512 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2872/5899] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:36.364157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:36.365659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:36.374400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:36.375422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:36.376085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:36.377041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:36.379859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:36.381406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:36.415455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:36.430633 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64cb4611-7ccc-48e4-b7d5-9a29a7edec87 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1562 microversion: 2.1 time: 0.767151 Oct 03 15:03:36.432580 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3028/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:35 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1562 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:36.689350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:36.690329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:36.704368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:36.705612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:36.706482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:36.707388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:36.707995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:36.708612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:37.399649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:37.410599 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-767cab22-6395-4df0-9867-32c3e949cdb6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1709 microversion: 2.1 time: 1.050897 Oct 03 15:03:37.413150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2873/5901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:36 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1709 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:37.425331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:37.430884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:37.430884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:37.440320 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74774e83-81b2-485e-8c8d-be942882c8f4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.756541 Oct 03 15:03:37.448009 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3029/5902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:36 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:37.452124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:37.452824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:37.453457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:37.456749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:37.457611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:37.458203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:37.888511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:37.899873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-307ede60-0428-4801-aa19-357312900912 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.485529 Oct 03 15:03:37.902836 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2874/5903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:37 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:38.390264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-980449cc-1225-4d58-be97-70ca3d86ebed req-9986ae7c-7692-4d8c-8c11-04885004c015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe90175-4da8-43b3-aa10-4b19ca890877", "tag": "2d564a74-8d4e-49ec-8c11-d2677dc23759"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:38.414346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-980449cc-1225-4d58-be97-70ca3d86ebed req-9986ae7c-7692-4d8c-8c11-04885004c015 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:38.414832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-980449cc-1225-4d58-be97-70ca3d86ebed req-9986ae7c-7692-4d8c-8c11-04885004c015 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:38.415267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-980449cc-1225-4d58-be97-70ca3d86ebed req-9986ae7c-7692-4d8c-8c11-04885004c015 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:38.438348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:38.438348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:38.454041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:38.454544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:38.454985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:38.462550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:38.463744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-980449cc-1225-4d58-be97-70ca3d86ebed req-9986ae7c-7692-4d8c-8c11-04885004c015 service nova] Creating event network-changed:2d564a74-8d4e-49ec-8c11-d2677dc23759 for instance ffe90175-4da8-43b3-aa10-4b19ca890877 on n-h1-781139-2 Oct 03 15:03:38.464480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:38.465206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:38.482270 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-980449cc-1225-4d58-be97-70ca3d86ebed req-9986ae7c-7692-4d8c-8c11-04885004c015 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095837 Oct 03 15:03:38.483505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3030/5904] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:38.497744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:38.498995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:38.514029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:38.518159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:38.518790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:38.520376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:38.522800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:38.523173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:38.551639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:38.805130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:38.819616 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53e8aecd-be84-478f-b9ce-9b14707c2bc6 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1713 microversion: 2.1 time: 0.385756 Oct 03 15:03:38.821338 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2875/5905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:38 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1713 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:38.823582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:38.856519 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0900af5-78dc-4289-8744-650ab944d23b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.371541 Oct 03 15:03:38.857803 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3031/5906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:38 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:38.928696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:38.929500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:38.973699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:38.983289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:38.983952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:38.984736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:38.985254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:38.985692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:39.608099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:39.617377 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98b1eb8d-b4f7-4d68-a92f-f3812202ae00 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.695318 Oct 03 15:03:39.622533 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2876/5907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:38 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:39.897124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:39.897756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:39.910213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:39.910986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:39.911868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:39.914873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:39.915735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:39.916345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:40.191600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:40.229958 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-910af87c-82ba-4e80-a708-f1366cda81d0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.341777 Oct 03 15:03:40.230570 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3032/5908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:39 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:40.652083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:40.655936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:40.673618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:40.675531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:40.676317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:40.677979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:40.678784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:40.679623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:41.253229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:41.255098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:41.269975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:41.270987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:41.272362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:41.276501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:41.277187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:41.278340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:41.474306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:41.482514 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1f3b369b-9340-49c5-89b9-3927c9553835 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.838785 Oct 03 15:03:41.483569 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2877/5909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:40 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:41.606056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:41.617904 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d386c32d-c549-48b8-85ca-5f30db759e88 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.368867 Oct 03 15:03:41.618767 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3033/5910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:41 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:42.510235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:42.510962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:42.516661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=62 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:42.529497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:42.530819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:42.533187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:42.534248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:42.537986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:42.539853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:42.658969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:42.664771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:42.701462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:42.701973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:42.702432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:42.706495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:42.707277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:42.710559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:42.831925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:42.840868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-194f114b-7938-4106-9c88-25f142c57943 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.336396 Oct 03 15:03:42.860369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2878/5911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:42 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:43.179631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:43.196731 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b1b0d35-aeac-4091-8eaa-194a92391b05 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.556278 Oct 03 15:03:43.201713 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3034/5912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:42 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:43.883312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:43.884513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:43.892629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:43.893824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:43.895113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:43.898304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:43.899012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:43.903159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:44.217518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:44.227357 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e340530b-be43-494f-8da5-58d25b3ccee3 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.364358 Oct 03 15:03:44.241913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:44.242690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:44.249687 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2879/5913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:43 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:44.252977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:44.253855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:44.255932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:44.259629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:44.260294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:44.261447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:44.293490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-30bdd37b-6cf1-41a6-92d4-023c244852e5 req-2a731ab8-9bb4-4a6a-a181-dbbed6271ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5", "name": "network-vif-plugged", "status": "completed", "tag": "73943ebd-aa16-493e-8d27-a1ba6d7134c9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:44.330411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-30bdd37b-6cf1-41a6-92d4-023c244852e5 req-2a731ab8-9bb4-4a6a-a181-dbbed6271ad1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:44.332916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-30bdd37b-6cf1-41a6-92d4-023c244852e5 req-2a731ab8-9bb4-4a6a-a181-dbbed6271ad1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:44.335913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-30bdd37b-6cf1-41a6-92d4-023c244852e5 req-2a731ab8-9bb4-4a6a-a181-dbbed6271ad1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:44.370059 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-30bdd37b-6cf1-41a6-92d4-023c244852e5 req-2a731ab8-9bb4-4a6a-a181-dbbed6271ad1 service nova] Creating event network-vif-plugged:73943ebd-aa16-493e-8d27-a1ba6d7134c9 for instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 on n-h1-781139-2 Oct 03 15:03:44.383747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-30bdd37b-6cf1-41a6-92d4-023c244852e5 req-2a731ab8-9bb4-4a6a-a181-dbbed6271ad1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097398 Oct 03 15:03:44.384614 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2880/5914] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:03:44.718024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:44.737680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff36dc2c-4495-48b1-b00f-f3bf50129186 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.509275 Oct 03 15:03:44.738822 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3035/5915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:44 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:03:45.255585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:45.256287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:45.281777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:45.282300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:45.282754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:45.289876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:45.290410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:45.290866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:45.673416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:45.681630 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e8a3da5-6683-496b-b03a-cca296187272 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1313 microversion: 2.1 time: 0.431263 Oct 03 15:03:45.688039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2881/5916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:45 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:45.764783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:45.766929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:45.781549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:45.785179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:45.786033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:45.787552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:45.788458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:45.789147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:46.253516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:46.267290 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65a8f1ac-8395-499c-aad1-6703e198a53f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.508189 Oct 03 15:03:46.268041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3036/5917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:45 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:46.704095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:46.704776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:46.718026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:46.718520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:46.721872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:46.722836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:46.723464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:46.726116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:47.049925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:47.067698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b6eb45c7-1029-42a9-bb9f-9a7f01bfdd04 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1463 microversion: 2.1 time: 0.358689 Oct 03 15:03:47.068381 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2882/5918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:46 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1463 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:47.096530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "216fc8a6-d9da-495a-a296-b04f78643b95", "device": "/dev/sdb"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:47.099176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:47.125775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:47.126659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:47.127849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:47.129627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:47.131721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:47.132944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:47.293909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:47.294807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:47.313926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:47.331776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:47.332890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:47.343788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:47.344318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:47.344775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:47.757505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:47.774754 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b9b89b32-6b52-4d03-8929-4aa96a027553 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.482796 Oct 03 15:03:47.778509 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2883/5919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:47 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:47.869572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0f49768-bffa-418b-9102-943563b2ec83 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "POST /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777800 Oct 03 15:03:47.876277 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3037/5920] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:03:47 2022] POST /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:47.989861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:47.989861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:48.005738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:48.005738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:48.005738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:48.007073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:48.008021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:48.010146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:48.126948 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ce3dd4f-f81f-4767-bce9-0d64078a48e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action" status: 200 len: 24561 microversion: 2.1 time: 0.152722 Oct 03 15:03:48.127750 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2884/5921] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:03:47 2022] POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action => generated 24561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:03:48.806965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:48.808525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:48.823026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:48.823798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:48.824747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:48.825924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:48.826727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:48.827378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:49.214662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:49.249418 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8bc53366-4000-42f6-8bde-63b99d2425ee tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.431277 Oct 03 15:03:49.253297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3038/5922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:48 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:50.149301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-124ef743-0be4-405b-880b-711ee10211ed req-6166d72e-afa8-438d-a8e5-8be47a9e7032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe90175-4da8-43b3-aa10-4b19ca890877", "name": "network-vif-plugged", "status": "completed", "tag": "2d564a74-8d4e-49ec-8c11-d2677dc23759"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:50.176182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-124ef743-0be4-405b-880b-711ee10211ed req-6166d72e-afa8-438d-a8e5-8be47a9e7032 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:50.178703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-124ef743-0be4-405b-880b-711ee10211ed req-6166d72e-afa8-438d-a8e5-8be47a9e7032 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:50.187776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-124ef743-0be4-405b-880b-711ee10211ed req-6166d72e-afa8-438d-a8e5-8be47a9e7032 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:50.211430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:50.251344 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-124ef743-0be4-405b-880b-711ee10211ed req-6166d72e-afa8-438d-a8e5-8be47a9e7032 service nova] Creating event network-vif-plugged:2d564a74-8d4e-49ec-8c11-d2677dc23759 for instance ffe90175-4da8-43b3-aa10-4b19ca890877 on n-h1-781139-2 Oct 03 15:03:50.257501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-124ef743-0be4-405b-880b-711ee10211ed req-6166d72e-afa8-438d-a8e5-8be47a9e7032 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112543 Oct 03 15:03:50.258125 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2885/5923] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:50.280371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:50.281145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:50.316065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:50.321874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:50.324413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:50.329427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:50.336573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:50.337804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:50.672597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:50.691658 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e2f00775-1bbf-460c-a569-49f649fb89ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.415413 Oct 03 15:03:50.692470 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3039/5924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:50 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:51.718959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:51.720322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:51.747624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:51.748179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:51.748684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:51.757848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:51.758356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:51.758822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:52.238734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:52.250478 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6c16659b-99d2-49bb-83e8-4c4287f98eca tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1365 microversion: 2.1 time: 0.537504 Oct 03 15:03:52.283170 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2886/5925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:51 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1365 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:53.288885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:53.290398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:53.326196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:53.331483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:53.333120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:53.334101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:53.342571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:53.343275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:53.568827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:53.580390 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fee4935e-5831-40ee-9e44-866e0685cb94 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1555 microversion: 2.1 time: 0.295485 Oct 03 15:03:53.581970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3040/5926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:53 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:53.607272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:53.607789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:53.636345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:53.636906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:53.637390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:53.638143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:53.638602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:53.639034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:53.812604 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba0343c3-164a-4966-9bc5-70ecc673834d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209848 Oct 03 15:03:53.813258 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2887/5927] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:03:53 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:55.570381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3a7c4835-947f-4a96-8dc1-49d3a3ba3aac req-7b6afb6e-7604-41ee-ad4f-60c5bcc1af24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe90175-4da8-43b3-aa10-4b19ca890877", "tag": "2d564a74-8d4e-49ec-8c11-d2677dc23759"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:03:55.590234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=57 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:03:55.593118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3a7c4835-947f-4a96-8dc1-49d3a3ba3aac req-7b6afb6e-7604-41ee-ad4f-60c5bcc1af24 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:55.597184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3a7c4835-947f-4a96-8dc1-49d3a3ba3aac req-7b6afb6e-7604-41ee-ad4f-60c5bcc1af24 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:55.600548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3a7c4835-947f-4a96-8dc1-49d3a3ba3aac req-7b6afb6e-7604-41ee-ad4f-60c5bcc1af24 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:55.622796 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3a7c4835-947f-4a96-8dc1-49d3a3ba3aac req-7b6afb6e-7604-41ee-ad4f-60c5bcc1af24 service nova] Creating event network-changed:2d564a74-8d4e-49ec-8c11-d2677dc23759 for instance ffe90175-4da8-43b3-aa10-4b19ca890877 on n-h1-781139-2 Oct 03 15:03:55.643261 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3a7c4835-947f-4a96-8dc1-49d3a3ba3aac req-7b6afb6e-7604-41ee-ad4f-60c5bcc1af24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076848 Oct 03 15:03:55.647991 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3041/5928] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:03:59.090671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:59.092055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:59.101215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:59.102033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:59.102629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:59.103675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:59.104283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:59.105037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:59.575398 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ab0e939-8388-4999-bd6c-48b7f721d106 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1832 microversion: 2.1 time: 0.485298 Oct 03 15:03:59.576584 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2888/5929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:59 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1832 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:03:59.601371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:03:59.601995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:03:59.615507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:59.616071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:59.616432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:59.623679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:03:59.624292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:03:59.624757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:03:59.906482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:03:59.926053 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c16e09cb-6ace-451c-ad8d-67a9e19776f5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1681 microversion: 2.1 time: 0.330159 Oct 03 15:03:59.927285 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3042/5930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:03:59 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1681 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:00.484238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:00.486628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:00.505147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:00.505646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:00.506085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:00.506794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:00.507250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:00.507767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:00.585302 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a69bcd55-8e40-4dda-88af-68148a803814 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action" status: 200 len: 32635 microversion: 2.1 time: 0.105451 Oct 03 15:04:00.592748 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2889/5931] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:04:00 2022] POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action => generated 32635 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:04:00.727369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:00.728540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:00.740328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:00.741386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:00.742197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:00.743249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:00.744784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:00.745578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:00.851493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '497edf4ef6794842a21196e4442cf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83dca7ab64643f59a4b59b2bf18dba1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:00.852450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] flavor_id is None. Assuming migration. {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 15:04:00.853090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:04:01.347742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56081be3-2646-430e-8a97-3ab6b376d6d3 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action" status: 202 len: 0 microversion: 2.1 time: 0.624080 Oct 03 15:04:01.353077 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3043/5932] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:04:00 2022] POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:04:01.362472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:01.363537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:01.385171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:01.386223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:01.387795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:01.389917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:01.391682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:01.393895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:01.727512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:01.739919 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13de20d3-c6ae-4e58-9556-6227f47367df tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1690 microversion: 2.1 time: 0.382040 Oct 03 15:04:01.744912 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2890/5933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:01 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1690 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:02.774270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:02.775850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:02.793813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:02.794838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:02.795866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:02.798175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:02.799066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:02.801624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:03.575395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:03.591213 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-479e932c-acaf-4c51-9560-75990b931e51 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1690 microversion: 2.1 time: 0.822390 Oct 03 15:04:03.591841 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3044/5934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:02 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1690 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:04.621468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:04.622142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:04.638900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:04.644971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:04.645878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:04.649555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:04.650334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:04.651001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:05.359977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:05.394899 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13aae82d-fee0-4b50-935c-b1ca3c57467d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1690 microversion: 2.1 time: 0.776195 Oct 03 15:04:05.396309 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2891/5935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:04 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1690 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:06.432180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:06.433481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:06.456421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:06.457220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:06.458729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:06.459640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:06.463515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:06.464180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:06.950320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:06.952751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:06.969401 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3088d88-54c4-420e-9b74-9535e20405b6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1690 microversion: 2.1 time: 0.548645 Oct 03 15:04:06.989781 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3045/5936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:06 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1690 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:08.005684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:08.006882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:08.023238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:08.029768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:08.030486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:08.033958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:08.034638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:08.035088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:08.404495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:08.416587 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37d70644-5f18-40f5-9c98-9bd1f102e052 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1695 microversion: 2.1 time: 0.414856 Oct 03 15:04:08.417837 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2892/5937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:08 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1695 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:09.452565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:09.455028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:09.482032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:09.487815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:09.489502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:09.491063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:09.491706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:09.492352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:09.786162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:09.797500 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6e7292f-242a-487d-84b5-3518d693a875 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1695 microversion: 2.1 time: 0.357591 Oct 03 15:04:09.799159 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3046/5938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:09 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1695 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:10.822133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:10.823404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:10.837309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:10.837941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:10.838281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:10.839202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:10.839845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:10.840585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:11.225893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:11.238701 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f99015ac-b4f9-4090-8005-f17ac38f6158 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1695 microversion: 2.1 time: 0.421056 Oct 03 15:04:11.243546 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2893/5939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:10 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1695 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:11.464539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:11.466665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:11.487587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:11.488569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:11.489814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:11.491418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:11.492069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:11.492654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:11.651622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lazy-loading 'services' on Instance uuid e655a610-872b-49b4-9d79-39debb37d219 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:04:11.809098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d3a75a0-29e1-45c1-9b2b-d844e7f3a378 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-volume_attachments/f4d1a579-adda-4c60-a7eb-bc068cf3b05b" status: 202 len: 0 microversion: 2.1 time: 0.349218 Oct 03 15:04:11.810207 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3047/5940] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:04:11 2022] DELETE /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-volume_attachments/f4d1a579-adda-4c60-a7eb-bc068cf3b05b => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:04:12.267576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:12.269525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:12.288999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:12.290494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:12.291292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:12.293516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:12.295328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:12.296170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:12.736708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:12.751454 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0117d5fd-1a30-4212-a13c-c80c779f47d9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1695 microversion: 2.1 time: 0.488389 Oct 03 15:04:12.752418 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2894/5941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:12 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1695 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:13.778455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:13.779160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:13.796387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:13.796889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:13.797359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:13.798113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:13.798566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:13.798989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:15.097874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:15.107068 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b76c2d99-97d7-4bf9-8f29-c839b9361be9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1695 microversion: 2.1 time: 1.332846 Oct 03 15:04:15.115021 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3048/5942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:13 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1695 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:16.140164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:16.142296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:16.154291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=34 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:16.156155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:16.161261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:16.162156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:16.163155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:16.165468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:16.166172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:16.427870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:16.440719 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1f494940-ee73-4f31-89a3-f41dc7a8df4f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1695 microversion: 2.1 time: 0.304395 Oct 03 15:04:16.441845 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2895/5943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:16 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1695 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:17.465140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:17.465768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:17.480587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:17.481764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:17.483133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:17.483946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:17.485507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:17.486971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:17.867249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:17.890345 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4b6da90-28da-409b-92b0-bed56753a612 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1695 microversion: 2.1 time: 0.420521 Oct 03 15:04:17.894578 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3049/5944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:17 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1695 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:18.923762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:18.924370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:18.945360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:18.946204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:18.950875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:18.952238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:18.966460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:18.972494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:19.509060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:19.548686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c180f1dd-9211-47b9-864e-3c2b87bb8641 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1694 microversion: 2.1 time: 0.626107 Oct 03 15:04:19.553854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2896/5945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:18 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1694 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:20.583839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:20.586996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:20.601730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:20.601730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:20.601730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:20.602492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:20.602706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:20.604080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:21.237715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-abe79ded-07e9-4b9c-ac6f-b7f905813618 req-094e9aba-197c-40ae-92dd-afe9f8816bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "name": "network-vif-unplugged", "status": "completed", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:21.241716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:21.266169 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6dc5ffb0-0b1a-45fb-be03-050f7a7deaef tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1694 microversion: 2.1 time: 0.689318 Oct 03 15:04:21.274881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abe79ded-07e9-4b9c-ac6f-b7f905813618 req-094e9aba-197c-40ae-92dd-afe9f8816bf2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:21.277595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abe79ded-07e9-4b9c-ac6f-b7f905813618 req-094e9aba-197c-40ae-92dd-afe9f8816bf2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:21.278790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-abe79ded-07e9-4b9c-ac6f-b7f905813618 req-094e9aba-197c-40ae-92dd-afe9f8816bf2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:21.280756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3050/5946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:20 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1694 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:21.324524 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-abe79ded-07e9-4b9c-ac6f-b7f905813618 req-094e9aba-197c-40ae-92dd-afe9f8816bf2 service nova] Creating event network-vif-unplugged:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h1-781139-2 Oct 03 15:04:21.351215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-abe79ded-07e9-4b9c-ac6f-b7f905813618 req-094e9aba-197c-40ae-92dd-afe9f8816bf2 service nova] Instance e644a8e2-cd64-42d6-bacd-db67a356142c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:04:21.399429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-abe79ded-07e9-4b9c-ac6f-b7f905813618 req-094e9aba-197c-40ae-92dd-afe9f8816bf2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165830 Oct 03 15:04:21.400038 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2897/5947] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:04:22.299808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:22.301129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:22.325012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:22.325468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:22.325916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:22.326645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:22.327107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:22.339859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:22.738351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:22.749903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29566f78-5aaa-472e-9ad4-a0c745e83984 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1694 microversion: 2.1 time: 0.457459 Oct 03 15:04:22.768487 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3051/5948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:22 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1694 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:23.227198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f0c2eb66-769d-423a-b742-c2566623f59e tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:23.255625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0c2eb66-769d-423a-b742-c2566623f59e tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.256270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0c2eb66-769d-423a-b742-c2566623f59e tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.256741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0c2eb66-769d-423a-b742-c2566623f59e tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:23.276610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=68 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:23.334519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f0c2eb66-769d-423a-b742-c2566623f59e tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Going to try to stop instance {{(pid=128868) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 15:04:23.463285 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f0c2eb66-769d-423a-b742-c2566623f59e tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action" status: 202 len: 0 microversion: 2.1 time: 0.240753 Oct 03 15:04:23.465374 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2898/5949] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:04:23 2022] POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:04:23.473219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:23.474455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:23.490757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.493674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3f3013b7-b163-4249-b782-f6b9c5c6b5cd req-ae148bab-61ca-4e4d-98ea-ad17d5ffa04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:23.502764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.505885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:23.507029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.514396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.516704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:23.550570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3f3013b7-b163-4249-b782-f6b9c5c6b5cd req-ae148bab-61ca-4e4d-98ea-ad17d5ffa04a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.552736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3f3013b7-b163-4249-b782-f6b9c5c6b5cd req-ae148bab-61ca-4e4d-98ea-ad17d5ffa04a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.554004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3f3013b7-b163-4249-b782-f6b9c5c6b5cd req-ae148bab-61ca-4e4d-98ea-ad17d5ffa04a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:23.610449 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3f3013b7-b163-4249-b782-f6b9c5c6b5cd req-ae148bab-61ca-4e4d-98ea-ad17d5ffa04a service nova] Creating event network-changed:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h1-781139-2 Oct 03 15:04:23.647118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-3f3013b7-b163-4249-b782-f6b9c5c6b5cd req-ae148bab-61ca-4e4d-98ea-ad17d5ffa04a service nova] Instance e644a8e2-cd64-42d6-bacd-db67a356142c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:04:23.689921 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3f3013b7-b163-4249-b782-f6b9c5c6b5cd req-ae148bab-61ca-4e4d-98ea-ad17d5ffa04a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204068 Oct 03 15:04:23.690605 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2899/5950] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:23.778590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:23.779592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:23.797970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.798928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.801581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:23.802539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:23.806241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:23.807059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:23.928269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:23.951811 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7203383b-9272-4e37-957e-a76ec3bf6a30 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1677 microversion: 2.1 time: 0.483195 Oct 03 15:04:23.960821 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3052/5951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:23 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1677 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:24.220574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:24.231098 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-284252b7-c2f4-437d-af34-695b1ae86ee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1694 microversion: 2.1 time: 0.456813 Oct 03 15:04:24.241157 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2900/5952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:23 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1694 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:24.984542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:24.985279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:25.020758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:25.021297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:25.021738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:25.033401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:25.034022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:25.034482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:25.260690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:25.262036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:25.281933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:25.282661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:25.283387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:25.284276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:25.284896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:25.285507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:25.334543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:25.375042 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e13f5500-e42d-492d-8893-6969b811a433 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1677 microversion: 2.1 time: 0.394238 Oct 03 15:04:25.399579 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3053/5953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:24 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1677 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:25.587351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:25.597622 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6487618-cb5f-4924-8c93-e7d85fd7ba79 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1692 microversion: 2.1 time: 0.345977 Oct 03 15:04:25.598232 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2901/5954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:25 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1692 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:26.423338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:26.427742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:26.470010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=28 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:26.475254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:26.496622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:26.504602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:26.510091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:26.516810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:26.518749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:26.623879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:26.625146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:26.637303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:26.641657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:26.642348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:26.643261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:26.643880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:26.644469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:26.778604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:26.795785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4426c036-4737-4219-a887-307d90863d1a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1677 microversion: 2.1 time: 0.379599 Oct 03 15:04:26.796389 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3054/5955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:26 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1677 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:27.227855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:27.254820 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58fa04d7-e74c-472a-bcc3-293f9a7f759d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1692 microversion: 2.1 time: 0.634840 Oct 03 15:04:27.258545 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2902/5956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:26 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1692 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:27.820823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:27.821474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:27.837309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:27.837808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:27.838264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:27.838974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:27.839429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:27.839864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:28.295939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:28.297458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:28.318527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:28.324731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:28.326683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:28.331042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:28.337529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:28.341694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:28.660465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:28.668585 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c7dc5b5-7674-4862-90e6-1fe0b29d0ec5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1677 microversion: 2.1 time: 0.852129 Oct 03 15:04:28.689440 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3055/5957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:27 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1677 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:28.787023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:28.796231 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5926408-ea7c-4331-8e33-687bdc0abf4d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1689 microversion: 2.1 time: 0.508377 Oct 03 15:04:28.799449 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2903/5958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:28 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1689 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:28.839984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:28.841235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:28.859473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:28.860188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:28.860716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:28.861762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:28.861970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:28.862403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:29.006895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d00b1fe-87cd-49b6-80f1-3c08be05e6dd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action" status: 204 len: 0 microversion: 2.1 time: 0.170703 Oct 03 15:04:29.008184 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3056/5959] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:04:28 2022] POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:04:29.017013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:29.018035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:29.028493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:29.030999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:29.031670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:29.032702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:29.035674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:29.036340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:29.717604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:29.718533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:29.741423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:29.741927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:29.742365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:29.743104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:29.763139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:29.765067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:30.108095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:30.147327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba8002f1-c3f2-442a-abb4-e609e9ff131b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1689 microversion: 2.1 time: 1.134454 Oct 03 15:04:30.170049 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2904/5960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:29 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1689 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:30.688003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:30.697514 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e78c6682-63ea-4824-b320-f26f2e66c8a0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1677 microversion: 2.1 time: 0.984095 Oct 03 15:04:30.698252 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3057/5961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:29 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1677 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:31.180417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:31.181116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:31.204866 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:04:31.209261 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c (ip 10.222.0.20) !!! Oct 03 15:04:31.211797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.212314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.229769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:31.230564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.231045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.231485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:31.724075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:31.724741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:31.743813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.744894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.750627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:31.753641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:31.756412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:31.757091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:32.208096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:32.228413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f08aaa3-a0f0-4ff4-bf55-df3589d7dde3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1677 microversion: 2.1 time: 0.509206 Oct 03 15:04:32.247814 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3058/5962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:31 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1677 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:32.519263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:32.533885 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e87e979b-0dfc-4a55-ad31-66fd84356730 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1689 microversion: 2.1 time: 1.357359 Oct 03 15:04:32.536169 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2905/5963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:31 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1689 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:33.257185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:33.258209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:33.291912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:33.293549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:33.294068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:33.297763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:33.299238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:33.301048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:33.727010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:33.736909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0e04a12c-526b-452f-beab-c7b7c26173da req-db6bc38a-b14f-4579-8b23-416d68929553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "name": "network-vif-plugged", "status": "completed", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:33.752093 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-568fc087-fa6a-44fe-b274-46bbeab3abee tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1677 microversion: 2.1 time: 0.499774 Oct 03 15:04:33.765127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0e04a12c-526b-452f-beab-c7b7c26173da req-db6bc38a-b14f-4579-8b23-416d68929553 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:33.765685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0e04a12c-526b-452f-beab-c7b7c26173da req-db6bc38a-b14f-4579-8b23-416d68929553 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:33.767437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0e04a12c-526b-452f-beab-c7b7c26173da req-db6bc38a-b14f-4579-8b23-416d68929553 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:33.769977 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2906/5964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:33 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1677 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:33.788351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:33.793004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:33.805574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:33.806779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:33.808155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:33.810192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:33.811877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:33.812527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:33.841651 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0e04a12c-526b-452f-beab-c7b7c26173da req-db6bc38a-b14f-4579-8b23-416d68929553 service nova] Creating event network-vif-plugged:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h1-781139-2 Oct 03 15:04:33.851048 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0e04a12c-526b-452f-beab-c7b7c26173da req-db6bc38a-b14f-4579-8b23-416d68929553 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.651607 Oct 03 15:04:33.861853 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3059/5965] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:34.232233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:34.247316 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d6e3a5ed-629c-4390-9bc1-49407ca96285 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1681 microversion: 2.1 time: 0.473120 Oct 03 15:04:34.251100 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2907/5966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:33 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1681 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:34.790067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:34.791819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:34.803450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:34.804196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:34.804961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:34.809971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:34.811391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:34.812026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:35.325224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:35.333956 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e04c4386-d865-4ffe-99a1-a622fb1de200 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1654 microversion: 2.1 time: 0.553664 Oct 03 15:04:35.339499 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3060/5967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:34 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1654 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:35.365463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a431a48e-3c2d-479a-9c43-8aaedb0ebb80 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:35.375111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a431a48e-3c2d-479a-9c43-8aaedb0ebb80 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:35.376300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a431a48e-3c2d-479a-9c43-8aaedb0ebb80 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:35.376967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a431a48e-3c2d-479a-9c43-8aaedb0ebb80 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:35.409403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a431a48e-3c2d-479a-9c43-8aaedb0ebb80 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Going to try to start instance {{(pid=128868) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 15:04:35.493960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a431a48e-3c2d-479a-9c43-8aaedb0ebb80 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action" status: 202 len: 0 microversion: 2.1 time: 0.134473 Oct 03 15:04:35.497124 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2908/5968] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:04:35 2022] POST /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:04:35.505603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:35.507195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:35.518049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:35.519374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:35.521343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:35.522326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:35.524307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:35.525044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:35.532822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:36.333039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:36.350195 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8aea9640-24dc-4092-af01-5896e7580b03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1663 microversion: 2.1 time: 0.848524 Oct 03 15:04:36.360948 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3061/5969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:35 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1663 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:37.378731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:37.379439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:37.386560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:37.387353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:37.387962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:37.388849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:37.389482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:37.390062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:37.686464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:37.706025 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ae9fdd62-6932-40ca-b069-e221396ee18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1663 microversion: 2.1 time: 0.331217 Oct 03 15:04:37.726274 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2909/5970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:37 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1663 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:38.729835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:38.731089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:38.747908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:38.748727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:38.750617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:38.753259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:38.756122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:38.756749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:39.167274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:39.176763 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbea7638-1479-4d2d-bfcd-e5ba2ee29f05 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1667 microversion: 2.1 time: 0.450975 Oct 03 15:04:39.180619 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3062/5971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:38 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1667 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:41.548941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1375736390", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c0c080c0-4410-459e-a2a2-6ded76e951b3"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:41.652064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] validate_networks() for [('c0c080c0-4410-459e-a2a2-6ded76e951b3', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:04:42.454457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:04:42.455321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:04:42.455972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:04:42.456672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:04:42.457304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:04:42.471708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:42.477259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:42.478576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:42.479826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:42.480833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:42.482124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:42.531900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Getting quotas for project 1962e8d93772453baa6ca8f18db1fe27. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:04:42.546872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Getting quotas for user 1e9f551a247b4b8ca719f52e0cc61e80 and project 1962e8d93772453baa6ca8f18db1fe27. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:04:42.583022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:04:42.586892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:04:42.700865 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f473da1a-4b1a-40af-a150-36338c2445b6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393099 Oct 03 15:04:42.709339 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2910/5972] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:04:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:04:42.714653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b728381-7941-48ca-aa7b-b8f8bf10cf27 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:42.715279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b728381-7941-48ca-aa7b-b8f8bf10cf27 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:42.880040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b728381-7941-48ca-aa7b-b8f8bf10cf27 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:42.894091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b728381-7941-48ca-aa7b-b8f8bf10cf27 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1214 microversion: 2.1 time: 0.183498 Oct 03 15:04:42.894382 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3063/5973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:42 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:43.921330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:43.922476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:43.955070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:43.956105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:43.956902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:43.957822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:43.969821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:43.970189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:44.141099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:44.153953 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-892999ea-af4b-497c-9b8c-49474054f3dd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1266 microversion: 2.1 time: 0.236636 Oct 03 15:04:44.168252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2911/5974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:43 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:45.181170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:45.181777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:45.198177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:45.198671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:45.199107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:45.199826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:45.200278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:45.200706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:45.361166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:45.379696 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cdc65d4-e632-444f-b63e-cc855fea6973 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1272 microversion: 2.1 time: 0.204083 Oct 03 15:04:45.394397 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3064/5975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:45 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:46.411890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:46.416818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:46.435474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:46.437792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:46.438339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:46.439021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:46.439883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:46.440515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:46.441073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:46.854775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:46.866727 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ae1866d-d371-43e1-9c3d-c3763a759dd6 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1314 microversion: 2.1 time: 0.461243 Oct 03 15:04:46.900703 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2912/5976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:46 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:47.298586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1800636276", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:47.420419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:04:47.976246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1de7c18f-dcb8-4b26-b1c2-116f4c1ed07b req-b0f2b47c-ca27-4896-8725-637bae646d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409d2f8d-1e83-462f-a7f0-aff8dedc4c2d", "tag": "0c84353c-9896-4252-aa87-8231ddf4487e"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:48.004827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1de7c18f-dcb8-4b26-b1c2-116f4c1ed07b req-b0f2b47c-ca27-4896-8725-637bae646d77 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:48.005577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1de7c18f-dcb8-4b26-b1c2-116f4c1ed07b req-b0f2b47c-ca27-4896-8725-637bae646d77 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:48.006173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1de7c18f-dcb8-4b26-b1c2-116f4c1ed07b req-b0f2b47c-ca27-4896-8725-637bae646d77 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:48.038673 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1de7c18f-dcb8-4b26-b1c2-116f4c1ed07b req-b0f2b47c-ca27-4896-8725-637bae646d77 service nova] Creating event network-changed:0c84353c-9896-4252-aa87-8231ddf4487e for instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d on n-h1-781139-2 Oct 03 15:04:48.043913 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1de7c18f-dcb8-4b26-b1c2-116f4c1ed07b req-b0f2b47c-ca27-4896-8725-637bae646d77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.472970 Oct 03 15:04:48.044884 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2913/5977] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:48.050328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:48.051043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:48.063877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:04:48.064300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:04:48.064777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:04:48.065461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:04:48.065936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:04:48.072367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:48.072875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:48.073349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:48.074085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:48.074630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:48.075064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:48.084590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:48.085142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:48.098381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:48.099527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:48.100170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:48.100780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:48.106062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:48.139814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Getting quotas for project 9c6de269713748308dfb05cb0c9acda1. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:04:48.147883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Getting quotas for user de2f70e15ab141738c01f38116871cdd and project 9c6de269713748308dfb05cb0c9acda1. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:04:48.165366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:04:48.168489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:04:48.260504 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88815d31-5014-4c6c-b598-063c2b23bc5c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966834 Oct 03 15:04:48.268095 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3065/5978] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:04:48.283260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3ed89f4-ece3-494c-a217-9893a1130436 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:48.293783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3ed89f4-ece3-494c-a217-9893a1130436 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:48.473886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3ed89f4-ece3-494c-a217-9893a1130436 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:48.485251 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3ed89f4-ece3-494c-a217-9893a1130436 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1215 microversion: 2.1 time: 0.206124 Oct 03 15:04:48.486183 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3066/5979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:48 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:48.633678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:48.644476 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49624025-d8f7-429a-a572-e9fcc1e448a9 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1314 microversion: 2.1 time: 0.596968 Oct 03 15:04:48.647463 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2914/5980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:48 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:49.519729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:49.520856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:49.537600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:49.538339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:49.538938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:49.539855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:49.540464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:49.541069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:49.655145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:49.677918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:49.678637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:49.696713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:49.698323 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b041c99e-0795-47c3-b9d2-248289c2f572 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1267 microversion: 2.1 time: 0.183821 Oct 03 15:04:49.698712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:49.700648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:49.700816 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3067/5981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:49 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:49.701604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:49.702137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:49.702687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:49.963504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:49.974802 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7481c02a-e20b-45f2-8dfa-f376f66cf5de tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1314 microversion: 2.1 time: 0.311116 Oct 03 15:04:49.975431 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2915/5982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:49 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:50.737916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:50.742313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:50.753306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:50.755672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:50.760668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:50.761734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:50.762426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:50.763069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:50.927696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:50.940002 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db1fc1f6-0bf3-42fe-8b9a-7e600c1e3251 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1273 microversion: 2.1 time: 0.209676 Oct 03 15:04:50.943516 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3068/5983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:50 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:51.002741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:51.003953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:51.014752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:51.018766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:51.019753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:51.020771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:51.023565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:51.024010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:51.676380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:51.705800 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ccaffd4-978c-4dcf-8624-9f22f93c7830 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1314 microversion: 2.1 time: 0.707215 Oct 03 15:04:51.707765 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2916/5984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:50 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:51.966495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:51.967747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:51.989845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:51.990807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:51.991407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:51.992328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:51.994765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:51.995522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:52.196558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:52.211565 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-175f2b67-404d-41e1-a681-448b9dab074c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.246996 Oct 03 15:04:52.230757 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3069/5985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:51 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:52.730482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:52.731191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:52.735424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:52.736180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:52.743789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:52.744295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:52.744732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:52.745483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:52.747298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:52.747752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:53.030354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:53.039392 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-243d8eb2-8cf2-462d-a05a-a071d6232efb tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1314 microversion: 2.1 time: 0.314021 Oct 03 15:04:53.049070 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2917/5986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:52 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:53.240095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:53.240908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:53.249378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:53.250829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:53.252297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:53.253994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:53.254461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:53.254899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:53.418249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1d0ababe-e121-4de3-9e15-77763b747e8c req-ade97175-e551-4f12-b84f-9308ea5bc436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c87878a-bdee-4bde-9904-16fb6530d423", "tag": "98defa9d-b9a6-4950-b30d-0ca248b93f58"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:53.428014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1d0ababe-e121-4de3-9e15-77763b747e8c req-ade97175-e551-4f12-b84f-9308ea5bc436 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:53.428611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1d0ababe-e121-4de3-9e15-77763b747e8c req-ade97175-e551-4f12-b84f-9308ea5bc436 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:53.429314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1d0ababe-e121-4de3-9e15-77763b747e8c req-ade97175-e551-4f12-b84f-9308ea5bc436 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:53.442621 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1d0ababe-e121-4de3-9e15-77763b747e8c req-ade97175-e551-4f12-b84f-9308ea5bc436 service nova] Creating event network-changed:98defa9d-b9a6-4950-b30d-0ca248b93f58 for instance 3c87878a-bdee-4bde-9904-16fb6530d423 on n-h2-781139-2 Oct 03 15:04:53.448624 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1d0ababe-e121-4de3-9e15-77763b747e8c req-ade97175-e551-4f12-b84f-9308ea5bc436 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035852 Oct 03 15:04:53.449937 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2918/5987] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:53.503067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:53.521924 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-417a7127-c6a6-4905-bd8b-c705fc84edd2 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.290164 Oct 03 15:04:53.523520 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3070/5988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:53 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:54.063829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:54.066604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:54.074219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:54.074892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:54.075560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:54.076888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:54.077712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:54.078198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:54.390649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:54.402305 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5fe9568-a94e-499a-a6aa-86cc959d903b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1314 microversion: 2.1 time: 0.344293 Oct 03 15:04:54.403525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2919/5989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:54 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:54.527438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-483d783b-c455-4547-ae16-40179f439bb3 req-431a91e0-0009-4c8c-9a77-b38ec4c114cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409d2f8d-1e83-462f-a7f0-aff8dedc4c2d", "name": "network-vif-plugged", "status": "completed", "tag": "0c84353c-9896-4252-aa87-8231ddf4487e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:04:54.553910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:54.554888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:54.559054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-483d783b-c455-4547-ae16-40179f439bb3 req-431a91e0-0009-4c8c-9a77-b38ec4c114cb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:54.559512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-483d783b-c455-4547-ae16-40179f439bb3 req-431a91e0-0009-4c8c-9a77-b38ec4c114cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:54.559941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-483d783b-c455-4547-ae16-40179f439bb3 req-431a91e0-0009-4c8c-9a77-b38ec4c114cb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:54.564195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:54.567003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:54.577972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:54.579071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:54.581634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:54.582233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:54.594840 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-483d783b-c455-4547-ae16-40179f439bb3 req-431a91e0-0009-4c8c-9a77-b38ec4c114cb service nova] Creating event network-vif-plugged:0c84353c-9896-4252-aa87-8231ddf4487e for instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d on n-h1-781139-2 Oct 03 15:04:54.616611 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-483d783b-c455-4547-ae16-40179f439bb3 req-431a91e0-0009-4c8c-9a77-b38ec4c114cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092755 Oct 03 15:04:54.620806 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3071/5990] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:04:54.813959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:54.826419 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5631dab0-f1d7-4c76-a490-4fd480ede707 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.276025 Oct 03 15:04:54.827837 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2920/5991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:54 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:04:55.428063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:55.429437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:55.443331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:55.443854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:55.444652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:55.446109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:55.446564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:55.446988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:55.640206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:55.648446 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d10f3cda-527e-4d65-916b-945aba394652 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1314 microversion: 2.1 time: 0.224882 Oct 03 15:04:55.649294 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3072/5992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:55 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:55.853226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:55.858976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:55.870548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:55.871405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:55.872650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:55.873943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:55.876314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:55.878613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:56.120548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:56.136400 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03bb0563-6f7e-4020-816c-9f78f43f5abe tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.287096 Oct 03 15:04:56.138873 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2921/5993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:55 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:56.676804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:56.677540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:56.680507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:56.689588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:56.690376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:56.691025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:56.691928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:56.692607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:56.693337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:56.846630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:56.855140 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96418e54-ba34-4462-9e48-60ec26b9de28 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1497 microversion: 2.1 time: 0.184635 Oct 03 15:04:56.856803 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3073/5994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:56 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:57.165395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:57.166625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:57.188312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:57.188953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:57.189426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:57.190265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:57.192943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:57.193529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:57.473106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:57.489280 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06343b7a-a754-4ba0-9c8b-03166bc44ce1 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.331047 Oct 03 15:04:57.489280 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2922/5995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:57 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:58.513699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:58.514292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:58.517639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:58.518549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:04:58.529953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:58.530847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:58.531575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:58.532711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:58.533246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:58.533740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:58.885069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:04:58.896112 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1b77e44-d521-487a-bce4-6407985debdc tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.386514 Oct 03 15:04:58.899756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3074/5996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:58 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:04:59.928184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:04:59.928184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:04:59.948843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:59.949361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:59.949788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:04:59.950494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:04:59.950938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:04:59.951359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:00.185342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f89a8d2c-980d-4e55-9e17-c1af371415ac req-4b7d590a-9bba-4402-a539-a99869cff545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c87878a-bdee-4bde-9904-16fb6530d423", "name": "network-vif-plugged", "status": "completed", "tag": "98defa9d-b9a6-4950-b30d-0ca248b93f58"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:00.214336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f89a8d2c-980d-4e55-9e17-c1af371415ac req-4b7d590a-9bba-4402-a539-a99869cff545 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:00.217136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f89a8d2c-980d-4e55-9e17-c1af371415ac req-4b7d590a-9bba-4402-a539-a99869cff545 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:00.218091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f89a8d2c-980d-4e55-9e17-c1af371415ac req-4b7d590a-9bba-4402-a539-a99869cff545 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:00.231642 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f89a8d2c-980d-4e55-9e17-c1af371415ac req-4b7d590a-9bba-4402-a539-a99869cff545 service nova] Creating event network-vif-plugged:98defa9d-b9a6-4950-b30d-0ca248b93f58 for instance 3c87878a-bdee-4bde-9904-16fb6530d423 on n-h2-781139-2 Oct 03 15:05:00.238657 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f89a8d2c-980d-4e55-9e17-c1af371415ac req-4b7d590a-9bba-4402-a539-a99869cff545 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057893 Oct 03 15:05:00.239800 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3075/5997] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:00.258113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:00.267876 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6190e426-c8d3-48ed-a505-55697b241c9e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.347033 Oct 03 15:05:00.269158 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2923/5998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:04:59 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:01.163039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:01.173899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:01.183186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:01.184665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:01.185847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:01.188142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:01.189374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:01.190550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:01.256316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:05:01.291558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:01.293176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:01.307257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:01.308101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:01.308784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:01.310170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:01.311235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:01.318707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:01.470873 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-734cb0d2-519a-40fa-9672-ec81710cb5be tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "DELETE /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 204 len: 0 microversion: 2.1 time: 0.320502 Oct 03 15:05:01.471591 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3076/5999] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:05:01 2022] DELETE /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:05:01.482126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:01.482887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:01.490944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:01.491763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:01.492618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:01.493557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:01.494342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:01.494978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:01.790078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:01.799905 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9051b422-17fa-49fc-926c-29faf28eda25 tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1503 microversion: 2.1 time: 0.323629 Oct 03 15:05:01.800512 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3077/6000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:01 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:01.860962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:01.874872 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c9b31fb-bfb0-4d2f-9e7a-8f8140a6774a tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1315 microversion: 2.1 time: 0.587692 Oct 03 15:05:01.881650 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2924/6001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:01 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:02.603478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:02.606514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:02.617522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.618261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.618922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:02.619891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.620548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.621229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:02.737597 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74378ae8-cc24-4356-b433-e65b2d82dd54 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action" status: 200 len: 24578 microversion: 2.1 time: 0.138471 Oct 03 15:05:02.746157 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3078/6002] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:05:02 2022] POST /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c/action => generated 24578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:05:02.834822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:02.835445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:02.854554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.855033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.855496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:02.856238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.856704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.857166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:02.899321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:02.900165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:02.915983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.916497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.916963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:02.917817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:02.918164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:02.918595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:03.179329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:03.197385 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dafcdc46-3e34-4154-8b94-dc0d572340bd tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1503 microversion: 2.1 time: 0.359325 Oct 03 15:05:03.201518 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2925/6003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:02 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1503 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:03.683364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:03.696521 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02cff0cf-8d68-45c8-943c-845bb144f615 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1465 microversion: 2.1 time: 0.801279 Oct 03 15:05:03.700019 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3079/6004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:02 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1465 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:03.780000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:03.780877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:03.789035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:03.789922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:03.790543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:03.793104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:03.793859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:03.794678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:03.828988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:05:03.948675 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2b3b2316-4a85-4f05-a65b-6d4db508337e tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 204 len: 0 microversion: 2.1 time: 0.174234 Oct 03 15:05:03.950605 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2926/6005] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:05:03 2022] DELETE /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:05:03.959157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:03.959780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:03.967471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:03.968054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:03.968596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:03.969366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:03.969851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:03.970269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:03.995182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:04.148888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b1a3e6e1-dea4-4ebf-bdcf-e618215606dd req-927d8e18-3b32-4ed6-9274-d0c56932b60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409d2f8d-1e83-462f-a7f0-aff8dedc4c2d", "name": "network-vif-deleted", "tag": "0c84353c-9896-4252-aa87-8231ddf4487e"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:04.166209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b1a3e6e1-dea4-4ebf-bdcf-e618215606dd req-927d8e18-3b32-4ed6-9274-d0c56932b60d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:04.166688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b1a3e6e1-dea4-4ebf-bdcf-e618215606dd req-927d8e18-3b32-4ed6-9274-d0c56932b60d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:04.167127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b1a3e6e1-dea4-4ebf-bdcf-e618215606dd req-927d8e18-3b32-4ed6-9274-d0c56932b60d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:04.184892 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b1a3e6e1-dea4-4ebf-bdcf-e618215606dd req-927d8e18-3b32-4ed6-9274-d0c56932b60d service nova] Creating event network-vif-deleted:0c84353c-9896-4252-aa87-8231ddf4487e for instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d on n-h1-781139-2 Oct 03 15:05:04.197604 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b1a3e6e1-dea4-4ebf-bdcf-e618215606dd req-927d8e18-3b32-4ed6-9274-d0c56932b60d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052655 Oct 03 15:05:04.198233 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2927/6006] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:04.229035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:04.229793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:04.239479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:04.239978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:04.241313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:04.242062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:04.242533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:04.242967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:04.302285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:04.311509 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70d5b3fb-cf7d-43bc-855d-aab554e609bb tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1471 microversion: 2.1 time: 0.356281 Oct 03 15:05:04.312589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3080/6007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:03 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1471 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:04.330449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e9f551a247b4b8ca719f52e0cc61e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1962e8d93772453baa6ca8f18db1fe27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:04.339594 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0feb962d-2f8c-4591-b45e-b30756f30b6b tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 200 len: 1299 microversion: 2.1 time: 0.116310 Oct 03 15:05:04.340513 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2928/6008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:04 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:05.360193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:05.360965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:05.364083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:05.364846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] [instance: 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:05.376372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:05.381865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:05.382691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:05.383326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:05.384266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:05.385043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:05.385908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:05.387387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:05.388147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:05.389766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:05.391346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:05.394052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:05.414327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] HTTP exception thrown: Instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d could not be found. Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Request method failure captured: Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d HTTP/1.1 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvoFP9akzBKVJ_3X5_7kkKKYWtzoQzOM2euDPEv8DT_eC7DL7Hr6zgucxyBtxgZ4gz1F32J9bT0XLrrYUDRUcFvWmSYf1MJdHVALdW4cACN4cmnWbccXooHR5oTZLJdmmEfMbc1whkEmm5BHvSrpnqQ_Arcgge4e4WkVAOUFZ8JgNO4 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 1962e8d93772453baa6ca8f18db1fe27 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesActionsTest-820098144 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1962e8d93772453baa6ca8f18db1fe27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1962e8d93772453baa6ca8f18db1fe27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1962e8d93772453baa6ca8f18db1fe27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1962e8d93772453baa6ca8f18db1fe27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesActionsTest-820098144 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 1962e8d93772453baa6ca8f18db1fe27 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesActionsTest-820098144 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesActionsTest-820098144-project Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 1e9f551a247b4b8ca719f52e0cc61e80 Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesActionsTest-820098144-project Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d could not be found. Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '409d2f8d-1e83-462f-a7f0-aff8dedc4c2d'} Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d could not be found. Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d could not be found. Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:05.418791 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:05.424057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:05.424057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:05.424057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:05.424057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:05:05.424057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:05:05.424057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d could not be found. Oct 03 15:05:05.424057 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:05.436087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] Returning 404 to user: Instance 409d2f8d-1e83-462f-a7f0-aff8dedc4c2d could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:05:05.437365 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0bf9ad83-9135-4dce-82a3-98df957014ff tempest-VolumesActionsTest-820098144 tempest-VolumesActionsTest-820098144-project] 10.222.0.20 "GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d" status: 404 len: 111 microversion: 2.1 time: 0.077459 Oct 03 15:05:05.438479 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2929/6009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:05 2022] GET /compute/v2.1/servers/409d2f8d-1e83-462f-a7f0-aff8dedc4c2d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:05:06.004308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:06.013422 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78fedcfd-519f-4412-b927-1e3b743ce8cd tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1471 microversion: 2.1 time: 0.679119 Oct 03 15:05:06.029394 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3081/6010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:05 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1471 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:06.472765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c20a4478-ec40-4e64-9e10-fa900fa5e849 req-235cf12b-075f-4060-9c83-35d30b424864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c87878a-bdee-4bde-9904-16fb6530d423", "name": "network-vif-deleted", "tag": "98defa9d-b9a6-4950-b30d-0ca248b93f58"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:06.508240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c20a4478-ec40-4e64-9e10-fa900fa5e849 req-235cf12b-075f-4060-9c83-35d30b424864 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:06.514090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c20a4478-ec40-4e64-9e10-fa900fa5e849 req-235cf12b-075f-4060-9c83-35d30b424864 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:06.515907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c20a4478-ec40-4e64-9e10-fa900fa5e849 req-235cf12b-075f-4060-9c83-35d30b424864 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:06.551507 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c20a4478-ec40-4e64-9e10-fa900fa5e849 req-235cf12b-075f-4060-9c83-35d30b424864 service nova] Creating event network-vif-deleted:98defa9d-b9a6-4950-b30d-0ca248b93f58 for instance 3c87878a-bdee-4bde-9904-16fb6530d423 on n-h2-781139-2 Oct 03 15:05:06.573843 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c20a4478-ec40-4e64-9e10-fa900fa5e849 req-235cf12b-075f-4060-9c83-35d30b424864 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105820 Oct 03 15:05:06.574896 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2930/6011] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:07.076878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:07.079159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:07.101283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:07.102460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:07.103397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:07.104334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:07.105075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:07.121989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:07.309905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:07.310931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:07.312532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:07.345699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lazy-loading 'fault' on Instance uuid 3c87878a-bdee-4bde-9904-16fb6530d423 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:05:07.548393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de2f70e15ab141738c01f38116871cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6de269713748308dfb05cb0c9acda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:07.561459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5593ed37-5877-4c25-9ecc-285a0f9fc559 tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 200 len: 1305 microversion: 2.1 time: 0.520849 Oct 03 15:05:07.567068 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3082/6012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:07 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 1305 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:08.592728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:08.594129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] [instance: 3c87878a-bdee-4bde-9904-16fb6530d423] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:08.603013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:08.603817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:08.604413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:08.605367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:08.605992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:08.606762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:08.623895 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] HTTP exception thrown: Instance 3c87878a-bdee-4bde-9904-16fb6530d423 could not be found. Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Request method failure captured: Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 HTTP/1.1 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvoMGhR0tAqj33ePPLLq9_zj47GzIAAXCtys_DDF2FTWrs0Bu9ThOTP94OLl1sLLc0Rb_MJaalLlwv6u6DTdMx5vwvo-wkxXF2rupUcK8nPJOa2nyF50j1S1RENqgj36_uJ30i4WpRZauF-waJj4jXG0m-PfNAYEnmRcOeqcFo-7B_U Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 9c6de269713748308dfb05cb0c9acda1 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesNegativeTest-87320881 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9c6de269713748308dfb05cb0c9acda1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9c6de269713748308dfb05cb0c9acda1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c6de269713748308dfb05cb0c9acda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9c6de269713748308dfb05cb0c9acda1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesNegativeTest-87320881 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 9c6de269713748308dfb05cb0c9acda1 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesNegativeTest-87320881 Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesNegativeTest-87320881-project Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: de2f70e15ab141738c01f38116871cdd Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesNegativeTest-87320881-project Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 3c87878a-bdee-4bde-9904-16fb6530d423 could not be found. Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3c87878a-bdee-4bde-9904-16fb6530d423'} Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c87878a-bdee-4bde-9904-16fb6530d423 could not be found. Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c87878a-bdee-4bde-9904-16fb6530d423 could not be found. Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:08.625933 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:08.631083 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:08.631083 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:08.631083 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:08.631083 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:05:08.631083 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:05:08.631083 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c87878a-bdee-4bde-9904-16fb6530d423 could not be found. Oct 03 15:05:08.631083 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:05:08.632903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] Returning 404 to user: Instance 3c87878a-bdee-4bde-9904-16fb6530d423 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:05:08.634126 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-57afa824-e8c0-43e0-a74d-7d13b6ba856c tempest-VolumesNegativeTest-87320881 tempest-VolumesNegativeTest-87320881-project] 10.222.0.20 "GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423" status: 404 len: 111 microversion: 2.1 time: 0.046155 Oct 03 15:05:08.635229 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2931/6013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:08 2022] GET /compute/v2.1/servers/3c87878a-bdee-4bde-9904-16fb6530d423 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:05:09.115794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:09.116376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:09.131622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:09.132354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:09.132614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:09.133362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:09.133815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:09.134235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:09.206006 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-04ba3876-9386-4275-838b-44ea5ca842e2 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/ips" status: 200 len: 149 microversion: 2.1 time: 0.094440 Oct 03 15:05:09.210651 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3083/6014] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 15:05:09 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/ips => generated 149 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:12.076965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8b2d43-1b52-44d6-a8dc-7c87876f7e55"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:12.080061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:12.092697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.093222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.093660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.094384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.094875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.095305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.184826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:12.187351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:12.214043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.219495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.223799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.224176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:12.226333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.227654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.229655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.322278 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12915c47-8562-41c0-83ab-c0505bf65f7b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144510 Oct 03 15:05:12.324560 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3084/6015] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:12 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:05:12.454399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:12.455089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:12.466813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.467725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.468347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.471834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.472494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.473264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.534855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:05:12.625902 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2545a079-2335-4680-8d2d-bd8b63f8f414 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "POST /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550809 Oct 03 15:05:12.634245 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2932/6016] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:05:12 2022] POST /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:12.717644 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43ee89d7-d70a-47c4-b1eb-6d5d02cdce3b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 204 len: 0 microversion: 2.1 time: 0.268857 Oct 03 15:05:12.718600 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3085/6017] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:05:12 2022] DELETE /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:05:12.729855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:12.731013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:12.751243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.751758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.752204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:12.753143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:12.753601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:12.754034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:13.250081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:13.262961 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a30f86f-6df5-4be3-8086-c074dfa1436c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1673 microversion: 2.1 time: 0.539135 Oct 03 15:05:13.277844 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2933/6018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:12 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1673 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:14.288807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:14.289697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:14.309448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:14.318803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:14.320264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:14.321129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:14.321609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:14.322038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:15.099913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:15.114175 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-beaf5efc-171e-400f-81af-649f63e732fd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1673 microversion: 2.1 time: 0.830906 Oct 03 15:05:15.116294 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3086/6019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:14 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1673 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:16.144191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:16.144971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:16.166187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:16.172947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:16.173394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:16.174157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:16.174634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:16.176952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:16.498343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:16.516493 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2229c5a2-3144-4418-9b20-376b7ae51acc tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1605 microversion: 2.1 time: 0.381650 Oct 03 15:05:16.529215 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2934/6020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:16 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1605 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:17.401246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-35f50ce1-dd03-4f52-b543-975947e7fe64 req-04797353-43b1-43e6-a8ec-84457b0a4cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e655a610-872b-49b4-9d79-39debb37d219", "name": "network-vif-deleted", "tag": "7fdee40e-2f28-468a-b7e8-9f23e8bb0984"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:17.440990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-35f50ce1-dd03-4f52-b543-975947e7fe64 req-04797353-43b1-43e6-a8ec-84457b0a4cbf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:17.448346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-35f50ce1-dd03-4f52-b543-975947e7fe64 req-04797353-43b1-43e6-a8ec-84457b0a4cbf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:17.453090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-35f50ce1-dd03-4f52-b543-975947e7fe64 req-04797353-43b1-43e6-a8ec-84457b0a4cbf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:17.506585 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-35f50ce1-dd03-4f52-b543-975947e7fe64 req-04797353-43b1-43e6-a8ec-84457b0a4cbf service nova] Creating event network-vif-deleted:7fdee40e-2f28-468a-b7e8-9f23e8bb0984 for instance e655a610-872b-49b4-9d79-39debb37d219 on n-h2-781139-2 Oct 03 15:05:17.542146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:17.543506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:17.546891 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-35f50ce1-dd03-4f52-b543-975947e7fe64 req-04797353-43b1-43e6-a8ec-84457b0a4cbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150141 Oct 03 15:05:17.547518 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3087/6021] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:17.575083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:17.606113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:17.611975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:17.615285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:17.620794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:17.621329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:17.621770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:17.781689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:17.789785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:17.790460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:17.791103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lazy-loading 'fault' on Instance uuid e655a610-872b-49b4-9d79-39debb37d219 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:05:17.929742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:17.939517 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35d5a82f-37ad-424a-ac74-b250d5be4889 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 200 len: 1327 microversion: 2.1 time: 0.402298 Oct 03 15:05:17.943600 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2935/6022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:17 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 1327 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:18.969537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:18.970252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:18.985503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:19.017963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:19.019233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:19.025549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:19.026211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:19.026661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:19.174901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] HTTP exception thrown: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Request method failure captured: Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 HTTP/1.1 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvlZIRyR-e8UDmqZFG0uxwo60bsNWmmQtemxVFEuxhShFeCoyTiW5XyFn__ub1Y7ZHlXbMnFKHVeGHkP6dSOcW6Q1LJMDti5joP2zhA9_rQ9oFGtibFOY5SsZC8B-KDi9XyCtpIA2rNlJPfjuehOYNp6V7XWj5JdF9vpQtWoS5Od8aw Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdf7775cd80545c18da6599765b0e690", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7d21903a3b0047b6ba5a19908d3b99c5 Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e655a610-872b-49b4-9d79-39debb37d219'} Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:19.188066 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:19.192689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:19.192689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:19.192689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:19.192689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:05:19.192689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:05:19.192689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:05:19.192689 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:19.194056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Returning 404 to user: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:05:19.194332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b684d1f5-d5fc-4096-a750-b1a5d12119b8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 404 len: 111 microversion: 2.1 time: 0.229921 Oct 03 15:05:19.200402 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3088/6023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:18 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:05:19.208715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d6bbf35-d026-417e-807d-fefe4f1d5074 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '.version_select at 0x7fb22b519430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:19.356561 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d6bbf35-d026-417e-807d-fefe4f1d5074 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995865680" status: 202 len: 0 microversion: 2.1 time: 0.156261 Oct 03 15:05:19.361631 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2936/6024] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 15:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995865680 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:05:21.632665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f8dc8d4-e083-44ac-b703-e6e573dcd5e7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'create', calling method: .version_select at 0x7fb234bbc280>, body: {"keypair": {"name": "tempest-keypair-1651234369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/UDdlHN9yG6g5BwcF1Lp4IOM00/yF984QpVGtyR/aF8V5rrewVnkfb5rRPyxrq5WdhHvC+BfG+mdw7D07gnFhFQkYnmu9MZ+a3L+MhicScklZ0VtQFHDH70iszqQWKCg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:21.763833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f8dc8d4-e083-44ac-b703-e6e573dcd5e7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for project fdf7775cd80545c18da6599765b0e690. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:05:21.798492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4f8dc8d4-e083-44ac-b703-e6e573dcd5e7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for user 7d21903a3b0047b6ba5a19908d3b99c5 and project fdf7775cd80545c18da6599765b0e690. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:05:21.891633 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f8dc8d4-e083-44ac-b703-e6e573dcd5e7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263008 Oct 03 15:05:21.894496 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3089/6025] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:05:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:25.430861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:25.431363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:25.451911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:25.452408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:25.452849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:25.466466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:25.467025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:25.467484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:25.977362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1072093748", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d3bd0bdc-483f-45cf-a590-2aa5e727aca0"}], "security_groups": [{"name": "tempest-securitygroup--2045893571"}], "key_name": "tempest-keypair-1651234369", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:26.141229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54412586-461f-4127-b432-05d0d0a84ebd tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1832 microversion: 2.1 time: 0.709802 Oct 03 15:05:26.142070 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2937/6026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:25 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1832 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:27.372444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] validate_networks() for [('d3bd0bdc-483f-45cf-a590-2aa5e727aca0', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:05:28.273507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:28.633140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:05:28.633769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:05:28.634109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:05:28.634791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:05:28.635428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:05:28.647180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:28.648002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:28.648761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:28.649830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:28.650501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:28.651145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:28.684157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for project fdf7775cd80545c18da6599765b0e690. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:05:28.691222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Getting quotas for user 7d21903a3b0047b6ba5a19908d3b99c5 and project fdf7775cd80545c18da6599765b0e690. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:05:28.709356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:05:28.714110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:05:28.782476 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ce023d5-1185-43fc-9edc-aef0032b9657 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.810752 Oct 03 15:05:28.784065 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3090/6027] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:05:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:05:28.795316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-296c4c21-fba0-4a57-ad37-0a558bc4bac9 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:28.796200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-296c4c21-fba0-4a57-ad37-0a558bc4bac9 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:29.043967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-296c4c21-fba0-4a57-ad37-0a558bc4bac9 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:29.064276 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-296c4c21-fba0-4a57-ad37-0a558bc4bac9 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1238 microversion: 2.1 time: 0.273149 Oct 03 15:05:29.072411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2938/6028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:28 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1238 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:30.039184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3570ed8c-00a9-450b-957b-c881e221fd07 req-f34feae5-784b-4db1-8be1-162eed754600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:30.042690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:30.043193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:30.064573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:30.065428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:30.066057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:30.068464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:30.069172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:30.070263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:30.080890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3570ed8c-00a9-450b-957b-c881e221fd07 req-f34feae5-784b-4db1-8be1-162eed754600 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:30.082321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3570ed8c-00a9-450b-957b-c881e221fd07 req-f34feae5-784b-4db1-8be1-162eed754600 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:30.082986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3570ed8c-00a9-450b-957b-c881e221fd07 req-f34feae5-784b-4db1-8be1-162eed754600 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:30.104348 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3570ed8c-00a9-450b-957b-c881e221fd07 req-f34feae5-784b-4db1-8be1-162eed754600 service nova] Creating event network-changed:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h1-781139-2 Oct 03 15:05:30.122306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:05:30.158039 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3570ed8c-00a9-450b-957b-c881e221fd07 req-f34feae5-784b-4db1-8be1-162eed754600 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123529 Oct 03 15:05:30.161327 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2939/6029] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:30.187296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:30.190169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:30.243653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:30.244873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:30.250206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:30.251492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:30.254074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:30.255335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:30.371850 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39292353-00a4-41ed-b2f0-bf03e6517e1b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 204 len: 0 microversion: 2.1 time: 0.342550 Oct 03 15:05:30.372831 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3091/6030] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:05:30 2022] DELETE /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:05:30.381611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:30.407565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:30.434210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:30.434731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:30.435195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:30.435985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:30.436440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:30.436862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:30.663351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:30.678723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0444f7ab-e7b3-4e1c-ab35-56f6568122df tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1290 microversion: 2.1 time: 0.513659 Oct 03 15:05:30.679510 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2940/6031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:30 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1290 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:30.983011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:31.000439 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3b863e6-bdf0-431b-9a21-ef89345b9549 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1687 microversion: 2.1 time: 0.617893 Oct 03 15:05:31.001129 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3092/6032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:30 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1687 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:31.702632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:31.710322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:31.737388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:31.738342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:31.745714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:31.746644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:31.747176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:31.747621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:32.030643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:32.032006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:32.061339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:32.062265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:32.063571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:32.068609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:32.070668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:32.071657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:32.606457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:32.620765 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f9c2395-4bce-45f9-bd20-75096ed96f3e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1687 microversion: 2.1 time: 0.594299 Oct 03 15:05:32.622458 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3093/6033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:32 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1687 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:33.610632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:33.611374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:33.629061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:33.629565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:33.636246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:33.636246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:33.636246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:33.636246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:33.880316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lazy-loading 'services' on Instance uuid ffe90175-4da8-43b3-aa10-4b19ca890877 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:05:33.995761 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4417a142-a5da-4a61-8bfe-55989b1576a5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments/3d8b2d43-1b52-44d6-a8dc-7c87876f7e55" status: 202 len: 0 microversion: 2.1 time: 0.390225 Oct 03 15:05:33.996655 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3094/6034] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:05:33 2022] DELETE /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments/3d8b2d43-1b52-44d6-a8dc-7c87876f7e55 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:05:34.020009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:34.023702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:34.031666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:34.033322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:34.034171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:34.035421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:34.036116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:34.036785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:34.166691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:34.579202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:34.596810 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93885f28-3da5-45d6-bd94-e8deb82e1947 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1687 microversion: 2.1 time: 0.598572 Oct 03 15:05:34.598001 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3095/6035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:33 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1687 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:34.612102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:34.614873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:34.637883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:34.657634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:34.658110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:34.658939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:34.659415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:34.659847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:34.756631 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19d02730-88d3-4373-ae0e-0f0d6143b4d7 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157134 Oct 03 15:05:34.760639 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3096/6036] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:34 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:34.954922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:34.963544 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dfbe3819-dc7e-40e2-a897-5da11efb009c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 3.264816 Oct 03 15:05:34.981478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2941/6037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:31 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 3283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:35.105047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-86bd079c-4343-44db-963f-e43e512e6787 req-e15d2d5b-a2b7-4f52-82be-4e5dcb98a740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "name": "network-vif-unplugged", "status": "completed", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:35.131099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86bd079c-4343-44db-963f-e43e512e6787 req-e15d2d5b-a2b7-4f52-82be-4e5dcb98a740 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:35.132322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86bd079c-4343-44db-963f-e43e512e6787 req-e15d2d5b-a2b7-4f52-82be-4e5dcb98a740 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:35.139037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86bd079c-4343-44db-963f-e43e512e6787 req-e15d2d5b-a2b7-4f52-82be-4e5dcb98a740 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:35.168526 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-86bd079c-4343-44db-963f-e43e512e6787 req-e15d2d5b-a2b7-4f52-82be-4e5dcb98a740 service nova] Creating event network-vif-unplugged:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h1-781139-2 Oct 03 15:05:35.216332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-86bd079c-4343-44db-963f-e43e512e6787 req-e15d2d5b-a2b7-4f52-82be-4e5dcb98a740 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113017 Oct 03 15:05:35.220721 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3097/6038] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:35.623988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:35.624600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:35.648787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:35.650153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:35.652342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:35.654110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:35.656230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:35.657517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:35.774492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:35.776987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:35.795274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:35.797860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:35.798388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:35.802344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:35.804573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:35.805444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:35.949906 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-820ab103-20e4-45d5-a795-a9163b18934d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180233 Oct 03 15:05:35.967118 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3098/6039] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:35 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:35.995095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:35.995631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:36.011698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:36.012204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:36.012641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:36.028179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:36.029201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:36.029367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:36.284612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:36.297170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55ea575d-853c-423b-8a5b-d7ff7f32bef0 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 0.306173 Oct 03 15:05:36.298101 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3099/6040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:35 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:36.966196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:36.968562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:37.035791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:37.037233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:37.044111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:37.053438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:37.053980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:37.054424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:37.226674 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45740e79-e63c-457c-b10c-a792aa1ffdeb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.267773 Oct 03 15:05:37.242663 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3100/6041] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:36 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:37.320055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:37.320672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:37.341101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:37.344028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:37.346784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:37.352830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:37.354106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:37.354791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:37.809487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:37.820071 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-360ba046-af30-4c9e-a143-a01df3769a29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 200 len: 1687 microversion: 2.1 time: 2.200172 Oct 03 15:05:37.829553 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2942/6042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:35 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 1687 bytes in 2210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:37.837195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-42000854-0b2e-497a-9842-3751fc5db247 req-2c61dabf-08e6-438a-b2b9-c217cece897a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e644a8e2-cd64-42d6-bacd-db67a356142c", "name": "network-vif-deleted", "tag": "aa2d76c2-73b5-4234-b843-00d7885b56ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:37.879747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42000854-0b2e-497a-9842-3751fc5db247 req-2c61dabf-08e6-438a-b2b9-c217cece897a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:37.893668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42000854-0b2e-497a-9842-3751fc5db247 req-2c61dabf-08e6-438a-b2b9-c217cece897a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:37.894446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-42000854-0b2e-497a-9842-3751fc5db247 req-2c61dabf-08e6-438a-b2b9-c217cece897a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:37.936632 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-42000854-0b2e-497a-9842-3751fc5db247 req-2c61dabf-08e6-438a-b2b9-c217cece897a service nova] Creating event network-vif-deleted:aa2d76c2-73b5-4234-b843-00d7885b56ad for instance e644a8e2-cd64-42d6-bacd-db67a356142c on n-h1-781139-2 Oct 03 15:05:37.950833 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-42000854-0b2e-497a-9842-3751fc5db247 req-2c61dabf-08e6-438a-b2b9-c217cece897a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119577 Oct 03 15:05:37.954018 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2943/6043] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:38.240717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:38.243304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:38.267502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:38.275321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:38.282077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:38.283034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:38.283681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:38.284289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:38.349266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:38.367590 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea81d398-f1eb-4530-943f-c0c4dd25184b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 1.047462 Oct 03 15:05:38.370537 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3101/6044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:37 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:38.425723 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d90a21be-5a4e-4868-9ca3-51e2d5f7cd65 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188419 Oct 03 15:05:38.434011 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2944/6045] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:38 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:38.847692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:38.848320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: e644a8e2-cd64-42d6-bacd-db67a356142c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:38.861175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:38.862951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:38.864589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:38.865311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:38.865795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:38.866617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:38.867228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:38.867660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:38.892747 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] HTTP exception thrown: Instance e644a8e2-cd64-42d6-bacd-db67a356142c could not be found. Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Request method failure captured: Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c HTTP/1.1 Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvmOJMtA3yZ3VRNyDgCMX43zmwjrbdhjvhL8yIgpoK1-95ReIlsj3oT6mmUK5tpwsNEBIm4CZJMr0BJXguTttgilbBtd_BPojnzml0C5A9Tfj2WMYxeUZxJYkZJSdfBB8RuLuj6_29AYcbqeAhxUtqW-1JXUsrxL-EqqaUkvbHQOvtY Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e38fd82ced714172a26f3bd1488ef82f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 74d29217f20d49d8b9ee984c1db2dbdf Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e644a8e2-cd64-42d6-bacd-db67a356142c could not be found. Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e644a8e2-cd64-42d6-bacd-db67a356142c'} Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e644a8e2-cd64-42d6-bacd-db67a356142c could not be found. Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e644a8e2-cd64-42d6-bacd-db67a356142c could not be found. Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:38.906454 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e644a8e2-cd64-42d6-bacd-db67a356142c could not be found. Oct 03 15:05:38.911243 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:05:38.915401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Returning 404 to user: Instance e644a8e2-cd64-42d6-bacd-db67a356142c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:05:38.930415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc6382fc-aed0-4675-9af0-59904b56816c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c" status: 404 len: 111 microversion: 2.1 time: 0.085445 Oct 03 15:05:38.933677 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3102/6046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:38 2022] GET /compute/v2.1/servers/e644a8e2-cd64-42d6-bacd-db67a356142c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:05:39.396886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:39.397638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:39.407752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:39.415200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:39.422183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:39.423730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:39.434187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:39.434187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:39.434187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:39.443890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:39.443890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:39.462961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:39.469371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:39.470024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:39.470958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:39.471427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:39.471855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:39.525647 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edd5b7b8-9bee-4b48-ba35-9d20464bbd0b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089522 Oct 03 15:05:39.526281 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3103/6047] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:39 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:40.101773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d433d339-9abb-42f4-82ff-ba9eb6301531 req-899b15b2-f57b-44e7-9431-580a6a912511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb33e2a-6696-423d-a89f-b7da23a9c114", "tag": "a907d752-a34c-496f-9e62-f10407a5624d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:40.123096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d433d339-9abb-42f4-82ff-ba9eb6301531 req-899b15b2-f57b-44e7-9431-580a6a912511 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:40.123625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d433d339-9abb-42f4-82ff-ba9eb6301531 req-899b15b2-f57b-44e7-9431-580a6a912511 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:40.125633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d433d339-9abb-42f4-82ff-ba9eb6301531 req-899b15b2-f57b-44e7-9431-580a6a912511 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:40.163669 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d433d339-9abb-42f4-82ff-ba9eb6301531 req-899b15b2-f57b-44e7-9431-580a6a912511 service nova] Creating event network-changed:a907d752-a34c-496f-9e62-f10407a5624d for instance ddb33e2a-6696-423d-a89f-b7da23a9c114 on n-h2-781139-2 Oct 03 15:05:40.179664 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d433d339-9abb-42f4-82ff-ba9eb6301531 req-899b15b2-f57b-44e7-9431-580a6a912511 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081706 Oct 03 15:05:40.182039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3104/6048] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:40.539252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:40.541655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:40.564940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:40.565716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:40.566382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:40.568230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:40.573223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:40.574098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:40.624766 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c74150db-c84e-4977-ab91-e33a6082bbc4 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090020 Oct 03 15:05:40.625754 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3105/6049] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:40 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:41.158547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:41.209670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f526b82-fb1f-46aa-b09b-1495800a3e3a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 1.814135 Oct 03 15:05:41.210645 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2945/6050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:39 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:41.649049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:41.651419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:41.686324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:41.688206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:41.689101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:41.690259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:41.691084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:41.691678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:41.791808 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8adec815-b782-44f0-9c56-e8c36f4d0a45 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157300 Oct 03 15:05:41.793392 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3106/6051] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:41 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:42.253812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:42.256558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:42.279955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:42.280547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:42.284072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:42.286294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:42.288816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:42.289388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:42.443146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:42.827505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:42.836666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:42.888417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:42.891027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:42.894381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:42.900414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:42.901645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:42.908286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:43.144552 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-016b9429-5e0f-4115-a9ba-2ede3fed3161 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.340233 Oct 03 15:05:43.154483 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3107/6052] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:42 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:44.162518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:44.167871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:44.191637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:44.193879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:44.195264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:44.200717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:44.201937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:44.205516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:44.317133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62fb9248-a18a-44a9-92e7-af8878016b51 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162148 Oct 03 15:05:44.317982 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3108/6053] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:44 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:44.533439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:44.561785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5b9db8c7-1388-4a1b-892c-fd9276f607b4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 2.322495 Oct 03 15:05:44.562488 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2946/6054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:42 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:45.334016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:45.337791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:45.360872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:45.361457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:45.363642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:45.364551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:45.366924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:45.373196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:45.490219 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-30b0c9a9-0ee4-48ca-8381-38d76bb05383 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162349 Oct 03 15:05:45.491690 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3109/6055] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:45 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:45.589495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:45.590340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:45.606954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:45.606954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:45.606954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:45.607715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:45.609206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:45.609651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:46.223160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:46.223657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:46.236894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:46.245372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:46.245372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:46.248523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:46.259200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:46.262536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:46.455724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:46.470011 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0fc3d6c9-8082-415e-87e7-f8f2690e73fa tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 0.880713 Oct 03 15:05:46.470878 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2947/6056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:45 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:46.505115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:46.508099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:46.533213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:46.537152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:46.539059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:46.539956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:46.542220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:46.546314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:46.582657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lazy-loading 'services' on Instance uuid 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:05:46.682626 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b619aec-9bef-476e-b0ea-b38c5adb8f46 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182445 Oct 03 15:05:46.683279 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2948/6057] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:46 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:46.742504 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88659ab2-83db-45b1-9053-0d72c9ccfa45 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5/os-volume_attachments/216fc8a6-d9da-495a-a296-b04f78643b95" status: 202 len: 0 microversion: 2.1 time: 0.523839 Oct 03 15:05:46.743331 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3110/6058] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:05:46 2022] DELETE /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5/os-volume_attachments/216fc8a6-d9da-495a-a296-b04f78643b95 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:05:47.496824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:47.497759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:47.504633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:47.505525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:47.506230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:47.508027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:47.509574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:47.510274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:47.698258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:47.700734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:47.719637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:47.720381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:47.722596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:47.723592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:47.725402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:47.726832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:47.828464 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2767a737-7b85-4f56-bcdf-7fae82287a0d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136585 Oct 03 15:05:47.831336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3111/6059] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:47 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:05:48.318923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:48.337725 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f8e75ee0-0271-44ef-a053-575eab23e5f4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 0.846058 Oct 03 15:05:48.358542 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2949/6060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:47 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:48.842589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:48.845697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:48.866787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:48.866787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:48.866787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:48.866787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:48.873253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:48.874204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:48.950998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1f5b596-5f6c-4058-b62c-e44f70f24dfb tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112618 Oct 03 15:05:48.961713 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3112/6061] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:05:48 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:05:49.189112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:49.189624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:49.198730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:49.209963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:49.210444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:49.211063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:49.211839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:49.212156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:49.212586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:49.357337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:05:49.379418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:49.380421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:49.399286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:49.402231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:49.405070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:49.409392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:49.417283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:49.417934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:49.437111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:49.632227 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e727948-a249-4fc7-adb7-3a4d0ca89ad5 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 204 len: 0 microversion: 2.1 time: 0.447438 Oct 03 15:05:49.633674 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2950/6062] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:05:49 2022] DELETE /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:05:49.644183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:49.646641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:49.664336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:49.667245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:49.670411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:49.671423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:49.672053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:49.673424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:50.532694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:50.546199 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db3bff36-bde9-42db-8dec-cbb619d816ac tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1679 microversion: 2.1 time: 0.903984 Oct 03 15:05:50.549390 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2951/6063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:49 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1679 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:50.605996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:50.615431 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38322917-2225-4266-89f3-7480dafc0685 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 1.240353 Oct 03 15:05:50.616026 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3113/6064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:49 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:51.570368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:51.571949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:51.588094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:51.592201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:51.598122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:51.599153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:51.599784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:51.601928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:51.643371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:51.644823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:51.658236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:51.668901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:51.669930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:51.670913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:51.680430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:51.681322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:52.418676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:52.428459 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ea2adb8-4899-493a-a73b-c9052b0db35e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1679 microversion: 2.1 time: 0.862302 Oct 03 15:05:52.429096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2952/6065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:51 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1679 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:52.553177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-992716b1-58fa-456c-9eb5-7afef305d9e4 req-e8259a70-786f-4c5e-a905-54983a31690f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb33e2a-6696-423d-a89f-b7da23a9c114", "name": "network-vif-plugged", "status": "completed", "tag": "a907d752-a34c-496f-9e62-f10407a5624d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:52.595576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-992716b1-58fa-456c-9eb5-7afef305d9e4 req-e8259a70-786f-4c5e-a905-54983a31690f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:52.596720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-992716b1-58fa-456c-9eb5-7afef305d9e4 req-e8259a70-786f-4c5e-a905-54983a31690f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:52.600298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-992716b1-58fa-456c-9eb5-7afef305d9e4 req-e8259a70-786f-4c5e-a905-54983a31690f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:52.637628 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-992716b1-58fa-456c-9eb5-7afef305d9e4 req-e8259a70-786f-4c5e-a905-54983a31690f service nova] Creating event network-vif-plugged:a907d752-a34c-496f-9e62-f10407a5624d for instance ddb33e2a-6696-423d-a89f-b7da23a9c114 on n-h2-781139-2 Oct 03 15:05:52.659596 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-992716b1-58fa-456c-9eb5-7afef305d9e4 req-e8259a70-786f-4c5e-a905-54983a31690f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110453 Oct 03 15:05:52.663875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2953/6066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:53.201793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:53.219761 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2d102b4-b06e-4d04-b8cf-9eced17bebc4 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 1.580607 Oct 03 15:05:53.220375 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3114/6067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:51 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:53.457474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:53.458577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:53.481439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:53.483142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:53.487728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:53.489054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:53.492702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:53.495179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:53.980412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:54.020413 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-abd9a6ff-bd79-4581-8db3-89a307f55656 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1612 microversion: 2.1 time: 0.564966 Oct 03 15:05:54.024103 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2954/6068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:53 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1612 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:54.244478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:54.245255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:54.260725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:54.274606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:54.275142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:54.275966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:54.276387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:54.276823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:54.822548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:54.833706 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8cbbe69a-d3af-47f6-9d19-2e99454e045c tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 0.593393 Oct 03 15:05:54.836777 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3115/6069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:54 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:55.051217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:55.051842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:55.066679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:55.067788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:55.068241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:55.075786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:55.077972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:55.079935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:55.860511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:55.862837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:55.880463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:55.887023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:55.905248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:55.905549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:55.914555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:55.915018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:56.140118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:56.159903 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2f91877-e2ef-43f2-be55-b6e184c0764b tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1612 microversion: 2.1 time: 1.112313 Oct 03 15:05:56.162154 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2955/6070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:55 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1612 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:56.693705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:56.703070 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72573421-e34d-41bf-a74d-4b5d6c4c1aaf tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1364 microversion: 2.1 time: 0.847093 Oct 03 15:05:56.717361 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3116/6071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:55 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1364 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:57.184216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:57.185152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:57.213922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:57.218743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:57.222413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:57.227107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:57.230325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:57.230824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:57.729879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:57.730502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:57.744436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:57.745242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:57.745851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:57.750671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:57.752123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:57.752740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:57.826695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:57.835766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53c13671-e852-4479-9ed5-610367a3babe tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1612 microversion: 2.1 time: 0.655722 Oct 03 15:05:57.836290 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2956/6072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:57 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1612 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:05:58.066654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-06e9b348-c035-4e5f-abf8-8a3ff1bf6633 req-dfe9b9b8-ad3d-4efc-aec6-fda7048c34b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe90175-4da8-43b3-aa10-4b19ca890877", "name": "network-vif-deleted", "tag": "2d564a74-8d4e-49ec-8c11-d2677dc23759"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:05:58.086477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-06e9b348-c035-4e5f-abf8-8a3ff1bf6633 req-dfe9b9b8-ad3d-4efc-aec6-fda7048c34b5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:58.087271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-06e9b348-c035-4e5f-abf8-8a3ff1bf6633 req-dfe9b9b8-ad3d-4efc-aec6-fda7048c34b5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:58.088029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-06e9b348-c035-4e5f-abf8-8a3ff1bf6633 req-dfe9b9b8-ad3d-4efc-aec6-fda7048c34b5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:58.138579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-06e9b348-c035-4e5f-abf8-8a3ff1bf6633 req-dfe9b9b8-ad3d-4efc-aec6-fda7048c34b5 service nova] Creating event network-vif-deleted:2d564a74-8d4e-49ec-8c11-d2677dc23759 for instance ffe90175-4da8-43b3-aa10-4b19ca890877 on n-h1-781139-2 Oct 03 15:05:58.154887 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-06e9b348-c035-4e5f-abf8-8a3ff1bf6633 req-dfe9b9b8-ad3d-4efc-aec6-fda7048c34b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091787 Oct 03 15:05:58.156252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2957/6073] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:05:58.863573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:58.865331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:58.878830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:58.888012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:58.888767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:58.893276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:58.893867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:58.894312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:59.015838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:59.026285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:59.027127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:59.027874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lazy-loading 'fault' on Instance uuid ffe90175-4da8-43b3-aa10-4b19ca890877 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:05:59.136570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4048c225333488babee42b8bbe86bfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c93601b06e4575980d5d65c27bebad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:59.142813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:05:59.155476 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72d770b5-97df-4a43-8d15-10a9122c4c56 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 200 len: 1330 microversion: 2.1 time: 0.290468 Oct 03 15:05:59.159868 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3435a670-66e2-439d-b13b-f44c61dc0d03 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1549 microversion: 2.1 time: 1.432292 Oct 03 15:05:59.174422 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3117/6074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:57 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1549 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:59.179139 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2958/6075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:05:58 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 1330 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:05:59.207013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:05:59.209729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:05:59.218247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:05:59.244887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:59.245487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:59.250751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:59.251653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:05:59.256403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:05:59.257232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:05:59.439498 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c70d922-092f-46e1-a6bb-cd7f5424c24d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255229 Oct 03 15:05:59.440570 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3118/6076] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:05:59 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:00.184610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:00.185930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:00.199512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:00.202509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:00.203950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:00.207617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:00.210133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:00.211246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:00.266955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 HTTP/1.1 Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'ffe90175-4da8-43b3-aa10-4b19ca890877'} Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:00.271959 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:00.277522 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:00.277522 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:00.277522 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:00.277522 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:00.277522 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:00.277522 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:00.277522 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:00.279408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:00.282024 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6cc03522-3246-48bf-b76f-6cc6af9c0429 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 404 len: 111 microversion: 2.1 time: 0.102257 Oct 03 15:06:00.284884 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2959/6077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:00 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:00.298348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8d19ffbb-83fc-4cd5-896a-d1d7efb56309 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '.version_select at 0x7fb23096f160>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:00.346663 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8d19ffbb-83fc-4cd5-896a-d1d7efb56309 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690291359" status: 202 len: 0 microversion: 2.1 time: 0.056806 Oct 03 15:06:00.347268 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3119/6078] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 15:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690291359 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:06:00.533988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0552d91b-027a-4277-9360-85875186cb5f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '.version_select at 0x7fb234add4c0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:00.582816 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0552d91b-027a-4277-9360-85875186cb5f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-418102029" status: 202 len: 0 microversion: 2.1 time: 0.054116 Oct 03 15:06:00.583800 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2960/6079] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 3 15:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-418102029 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:06:00.637533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd98f9a4-1967-4e0c-998e-95b05c6fae5d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: .version_select at 0x7fb22b677280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1760489738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwl+uXovRytnRY7Lv7//e9TvZgNiFvxsORApOncJnf2O6WCYWmizmMQTxCmkX/5N9Gia9awgqdVYT1OrJYJcT9D70y6I1boaxB+kBzD8ufdcJj+sopBJlO54awoL4Cq0A=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:00.673773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bd98f9a4-1967-4e0c-998e-95b05c6fae5d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:06:00.687998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bd98f9a4-1967-4e0c-998e-95b05c6fae5d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:06:00.751922 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd98f9a4-1967-4e0c-998e-95b05c6fae5d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.118726 Oct 03 15:06:00.752704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3120/6080] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:06:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:01.349457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:01.350500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:01.363314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:01.378008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:01.385676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:01.386724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:01.387441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:01.388840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:01.484269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:06:01.708661 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-68008bb5-c44a-45b1-8090-da4034e0437e tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 204 len: 0 microversion: 2.1 time: 0.362863 Oct 03 15:06:01.711244 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2961/6081] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:06:01 2022] DELETE /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:06:01.720629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:01.721352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:01.736810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:01.737735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:01.738176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:01.738903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:01.739356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:01.739781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:02.619314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:02.633256 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f78cc4ca-f4a6-4948-8003-a05c36f6dd9a tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1469 microversion: 2.1 time: 0.915870 Oct 03 15:06:02.633902 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3121/6082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:01 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1469 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:03.665351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:03.666593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:03.679757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:03.681675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:03.684797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:03.685926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:03.686582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:03.693278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:04.138709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-2fdc277b-b932-49f8-8ec5-0e7401258d99 req-ff2e5cfe-a2e6-4c91-b682-90a218926af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddb33e2a-6696-423d-a89f-b7da23a9c114", "tag": "a907d752-a34c-496f-9e62-f10407a5624d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:04.165789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2fdc277b-b932-49f8-8ec5-0e7401258d99 req-ff2e5cfe-a2e6-4c91-b682-90a218926af0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:04.166796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2fdc277b-b932-49f8-8ec5-0e7401258d99 req-ff2e5cfe-a2e6-4c91-b682-90a218926af0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:04.167226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2fdc277b-b932-49f8-8ec5-0e7401258d99 req-ff2e5cfe-a2e6-4c91-b682-90a218926af0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:04.177474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:04.203652 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-2fdc277b-b932-49f8-8ec5-0e7401258d99 req-ff2e5cfe-a2e6-4c91-b682-90a218926af0 service nova] Creating event network-changed:a907d752-a34c-496f-9e62-f10407a5624d for instance ddb33e2a-6696-423d-a89f-b7da23a9c114 on n-h2-781139-2 Oct 03 15:06:04.226416 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-2fdc277b-b932-49f8-8ec5-0e7401258d99 req-ff2e5cfe-a2e6-4c91-b682-90a218926af0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.684325 Oct 03 15:06:04.229065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2962/6083] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:04.338282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:04.376538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eea1a24c-6acc-4fa3-8bd6-d23b620e723d tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1469 microversion: 2.1 time: 0.717851 Oct 03 15:06:04.389922 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3122/6084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:03 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1469 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:05.409449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:05.413508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:05.431028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:05.432236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:05.433141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:05.447386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:05.448297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:05.449020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:06.748756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:06.769477 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04ec22c9-6d3e-45b6-b6d5-cbd81b18a2b7 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1469 microversion: 2.1 time: 1.365664 Oct 03 15:06:06.772407 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2963/6085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:05 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1469 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:07.795946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:07.805647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:07.828061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:07.837747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:07.841173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:07.843521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:07.847721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:07.850091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:09.323920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c747995b-310c-4878-bc4e-3251e29ef55a req-6a72853e-2c9e-4a91-a81c-580a607096ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5", "name": "network-vif-deleted", "tag": "73943ebd-aa16-493e-8d27-a1ba6d7134c9"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:09.358246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c747995b-310c-4878-bc4e-3251e29ef55a req-6a72853e-2c9e-4a91-a81c-580a607096ae service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:09.358741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c747995b-310c-4878-bc4e-3251e29ef55a req-6a72853e-2c9e-4a91-a81c-580a607096ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:09.365195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c747995b-310c-4878-bc4e-3251e29ef55a req-6a72853e-2c9e-4a91-a81c-580a607096ae service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:09.416975 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c747995b-310c-4878-bc4e-3251e29ef55a req-6a72853e-2c9e-4a91-a81c-580a607096ae service nova] Creating event network-vif-deleted:73943ebd-aa16-493e-8d27-a1ba6d7134c9 for instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 on n-h1-781139-2 Oct 03 15:06:09.440620 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c747995b-310c-4878-bc4e-3251e29ef55a req-6a72853e-2c9e-4a91-a81c-580a607096ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128339 Oct 03 15:06:09.446453 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2964/6086] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 03 15:06:09.910044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96529b60c8db4875a975aa0db5fdcf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a5a64f239ff4e6786dbea364bb59d2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:09.938154 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-884a236d-adb0-4856-b659-828d2b6f3464 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 200 len: 1469 microversion: 2.1 time: 2.146049 Oct 03 15:06:09.959306 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3123/6087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:07 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 1469 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:10.966438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:10.967326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] [instance: 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:10.984801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:10.988349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:10.988986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:10.992754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:10.993369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:10.993929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:11.041118 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] HTTP exception thrown: Instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 could not be found. Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Request method failure captured: Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 HTTP/1.1 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvm2beE5MlgHwoUclEKznqodxBUaGCEW3z9xJEQOvQrDQAmvX2jZaIbDi91hb0LgEBGABeh4j3ifja_eGHvmZsF0oVinUIZStFw-Pf5a4efruhkkcnY4NFuEhBY9Re1uY2TqR0XGCJEzWDmh73VZ5FosBNOrdUWvzrvc36mg6VzzmZE Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 1a5a64f239ff4e6786dbea364bb59d2c Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-VolumesBackupsTest-1670273126 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a5a64f239ff4e6786dbea364bb59d2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a5a64f239ff4e6786dbea364bb59d2c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a5a64f239ff4e6786dbea364bb59d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a5a64f239ff4e6786dbea364bb59d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-VolumesBackupsTest-1670273126 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 1a5a64f239ff4e6786dbea364bb59d2c Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-VolumesBackupsTest-1670273126 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-VolumesBackupsTest-1670273126-project Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 96529b60c8db4875a975aa0db5fdcf57 Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-VolumesBackupsTest-1670273126-project Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 could not be found. Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5'} Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 could not be found. Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 could not be found. Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:11.043710 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 could not be found. Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.049435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] Returning 404 to user: Instance 42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:11.050403 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c84dd389-9fd9-42dc-9bc5-d98c2b4c3221 tempest-VolumesBackupsTest-1670273126 tempest-VolumesBackupsTest-1670273126-project] 10.222.0.20 "GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5" status: 404 len: 111 microversion: 2.1 time: 0.087096 Oct 03 15:06:11.056296 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2965/6088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:10 2022] GET /compute/v2.1/servers/42d84ad6-22d4-4d22-8c7b-ad5a9c3becb5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:11.266065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:11.267311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:11.282159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:11.285347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:11.286091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:11.286874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:11.287862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:11.288582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:11.289302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:11.323152 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 HTTP/1.1 Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ffe90175-4da8-43b3-aa10-4b19ca890877'} Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:11.326855 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.331392 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.342657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:11.344146 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37ec3138-d8dd-4870-acc1-3097e5f7645e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 404 len: 111 microversion: 2.1 time: 0.082206 Oct 03 15:06:11.345643 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3124/6089] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:06:11 2022] DELETE /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:11.354116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:11.355161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: ffe90175-4da8-43b3-aa10-4b19ca890877] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:11.372070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:11.372803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:11.373378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:11.374239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:11.374797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:11.375321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:11.408737 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 HTTP/1.1 Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'ffe90175-4da8-43b3-aa10-4b19ca890877'} Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:11.414386 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:11.420096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance ffe90175-4da8-43b3-aa10-4b19ca890877 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:11.422462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5042d88e-d425-49b8-9844-aba8c021aaf0 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877" status: 404 len: 111 microversion: 2.1 time: 0.072752 Oct 03 15:06:11.428443 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2966/6090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:11 2022] GET /compute/v2.1/servers/ffe90175-4da8-43b3-aa10-4b19ca890877 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:13.120735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:13.123250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:13.123902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:13.124441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:13.125321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:13.132216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:13.134853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:13.208422 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28aee127-3e3f-4650-8d3a-340027a38850 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.181973 Oct 03 15:06:13.212008 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3125/6091] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 3 15:06:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:13.381503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-465729955", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "availability_zone": "nova:n-h2-781139-2", "networks": [{"uuid": "515727a8-d50a-4383-b8d2-ae41998e21e4"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:13.496627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] validate_networks() for [('515727a8-d50a-4383-b8d2-ae41998e21e4', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:06:17.079345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:06:17.080001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:06:17.080237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:06:17.080649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:06:17.081095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:06:17.096783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:17.097314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:17.097750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:17.098478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:17.102992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:17.103550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:17.184907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Getting quotas for project f784531c71e444c39e55cb83bb194f78. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:06:17.193126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Getting quotas for user 7384b4371bd349e89ec798a75532dcb3 and project f784531c71e444c39e55cb83bb194f78. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:06:17.241058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:06:17.251120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:06:17.391757 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-657b4b68-a303-4399-abda-f0ee403234c0 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.013861 Oct 03 15:06:17.401150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2967/6092] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:06:17.408380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01643249-95d9-41b2-a232-fcd5c680a269 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:17.413658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01643249-95d9-41b2-a232-fcd5c680a269 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:17.632499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01643249-95d9-41b2-a232-fcd5c680a269 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1328 microversion: 2.1 time: 0.231667 Oct 03 15:06:17.649085 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3126/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:17 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1328 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:18.662382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82fbdf39-fc8f-4a02-ab02-14e4c0cfdf98 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:18.664372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82fbdf39-fc8f-4a02-ab02-14e4c0cfdf98 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:18.872436 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82fbdf39-fc8f-4a02-ab02-14e4c0cfdf98 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1328 microversion: 2.1 time: 0.210017 Oct 03 15:06:18.893341 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2968/6094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:18 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1328 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:19.899498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:19.900183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:19.912405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:19.912898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:19.921689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:19.922477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:19.922952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:19.923382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:20.039550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=56 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:20.516146 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89b53f21-bb42-4393-858c-f633c221ffc3 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1415 microversion: 2.1 time: 0.620279 Oct 03 15:06:20.546311 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3127/6095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:19 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1415 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:20.798731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:20.799284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:20.828082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:20.831340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:20.841262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:20.841849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:20.842639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:20.851686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:20.852252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:20.898799 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 HTTP/1.1 Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '343dcbf0-a74e-4293-8fe7-873c3fb31ed3'} Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:20.905623 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:20.910957 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:20.923391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:20.926931 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dea02801-f7e8-491a-906a-441aae073e7d tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 404 len: 111 microversion: 2.1 time: 0.133859 Oct 03 15:06:20.938200 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2969/6096] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:06:20 2022] DELETE /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:20.942984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:20.943759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 343dcbf0-a74e-4293-8fe7-873c3fb31ed3] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:20.959469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:20.961470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:20.965503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:20.974030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:20.974599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:20.975153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.020081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 HTTP/1.1 Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '343dcbf0-a74e-4293-8fe7-873c3fb31ed3'} Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:21.025115 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.030591 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.030591 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:21.030591 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:21.030591 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:21.030591 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:21.030591 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. Oct 03 15:06:21.030591 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.032240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 343dcbf0-a74e-4293-8fe7-873c3fb31ed3 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:21.039456 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae016cf6-52d4-4645-8519-2223f4c49a1a tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3" status: 404 len: 111 microversion: 2.1 time: 0.098695 Oct 03 15:06:21.043180 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3128/6097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:20 2022] GET /compute/v2.1/servers/343dcbf0-a74e-4293-8fe7-873c3fb31ed3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:21.049245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:21.050324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:21.062339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:21.079665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:21.081339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.088231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:21.090153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:21.090810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.148346 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 HTTP/1.1 Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '147e2c8d-3333-4c10-9130-3139e3313608'} Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:21.153464 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.158746 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.166737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:21.169013 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-899a4cbc-0ada-4a01-b3c0-5801d2044b9e tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 404 len: 111 microversion: 2.1 time: 0.124013 Oct 03 15:06:21.177240 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2970/6098] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:06:21 2022] DELETE /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:21.180950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:21.181698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 147e2c8d-3333-4c10-9130-3139e3313608] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:21.200676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:21.201667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:21.202347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.203343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:21.204045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:21.204706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.238513 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 HTTP/1.1 Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '147e2c8d-3333-4c10-9130-3139e3313608'} Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:21.240778 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.248082 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:21.248082 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:21.248082 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:21.248082 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:21.248082 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:21.248082 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. Oct 03 15:06:21.248082 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:06:21.251277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 147e2c8d-3333-4c10-9130-3139e3313608 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:21.256022 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-627e16e1-da04-4509-bf53-ada685b8c07f tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608" status: 404 len: 111 microversion: 2.1 time: 0.079357 Oct 03 15:06:21.257322 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3129/6099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:21 2022] GET /compute/v2.1/servers/147e2c8d-3333-4c10-9130-3139e3313608 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:06:21.550479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:21.551111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:21.600139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:21.600827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:21.601390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:21.602015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:21.602488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:21.613434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:22.336393 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d97e484e-1fa7-468c-a509-4855f52ead35 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 0.790166 Oct 03 15:06:22.338442 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2971/6100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:21 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:23.163090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:23.365238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:23.366694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:23.398200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:23.398709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:23.399158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:23.399879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:23.400323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:23.400744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:23.782919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7798da89-c4a2-45fd-9b07-d8dc53ff5322 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1105303068", "availability_zone": "foo_zone"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:23.788050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.aggregate [None req-7798da89-c4a2-45fd-9b07-d8dc53ff5322 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Generated uuid 18edc1b3-6411-4e33-af7c-505f72b5896f for aggregate {{(pid=128869) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 03 15:06:23.866842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7798da89-c4a2-45fd-9b07-d8dc53ff5322 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.005994 Oct 03 15:06:23.873925 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3130/6101] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 3 15:06:22 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:23.895394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37af61dc-1a6e-4ca9-901e-63c793e936cd tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:23.998975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37af61dc-1a6e-4ca9-901e-63c793e936cd tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.115655 Oct 03 15:06:24.006146 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3131/6102] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 15:06:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:24.027743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:24.039476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:24.041161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:24.043599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:24.044809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:24.047875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:24.050771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:24.173123 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14184df8-e904-4841-a1e2-82dd2a317cb5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.161605 Oct 03 15:06:24.175729 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3132/6103] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 3 15:06:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:24.192464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d60a380e-048d-44e1-8046-0a1425300df5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:24.229618 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d60a380e-048d-44e1-8046-0a1425300df5 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.044906 Oct 03 15:06:24.240981 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3133/6104] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 3 15:06:24 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:24.277695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ac5bf85-fd2a-4152-9908-2eebdb924941 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-781139-2"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:24.334334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac5bf85-fd2a-4152-9908-2eebdb924941 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:24.338669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac5bf85-fd2a-4152-9908-2eebdb924941 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:24.339590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ac5bf85-fd2a-4152-9908-2eebdb924941 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:24.693680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ac5bf85-fd2a-4152-9908-2eebdb924941 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.449775 Oct 03 15:06:24.697490 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3134/6105] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 15:06:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:24.709163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8285cc4-2e74-4260-846e-37c9a7258905 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:24.736023 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d85a319-340a-4b0b-ba10-0da150ea858e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 1.377224 Oct 03 15:06:24.743961 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8285cc4-2e74-4260-846e-37c9a7258905 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.037527 Oct 03 15:06:24.746940 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3135/6106] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 15:06:24 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:24.757048 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2972/6107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:23 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:24.759593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c98df41-506f-4d14-ae55-5137b0f93d35 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-100266492", "availability_zone": "foo_zone"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:24.901331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c98df41-506f-4d14-ae55-5137b0f93d35 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.146588 Oct 03 15:06:24.909229 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3136/6108] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 3 15:06:24 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:24.925960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8f322ca7-56c5-4bdb-b46f-78d39fd04b91 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:25.027479 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8f322ca7-56c5-4bdb-b46f-78d39fd04b91 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.107950 Oct 03 15:06:25.032822 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2973/6109] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 15:06:24 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:25.040772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be612f9d-d074-4445-a77d-0a0506d9dca7 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:25.057017 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be612f9d-d074-4445-a77d-0a0506d9dca7 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.019868 Oct 03 15:06:25.064848 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3137/6110] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 3 15:06:25 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:25.070419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05137a81-5d8f-4c29-866e-190e1041d899 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-781139-2"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:25.104844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05137a81-5d8f-4c29-866e-190e1041d899 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:25.110506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05137a81-5d8f-4c29-866e-190e1041d899 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:25.111230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05137a81-5d8f-4c29-866e-190e1041d899 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:25.583449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-edcd4977-ec20-4155-bfa0-e6cac379d325 req-7836b86a-9923-4031-b82a-6dd9520b1909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f5e0e1b-59dd-406d-a486-8f153f088014", "tag": "49f3aeca-17d8-4d9a-9208-b95c1606ad92"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:25.621620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-edcd4977-ec20-4155-bfa0-e6cac379d325 req-7836b86a-9923-4031-b82a-6dd9520b1909 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:25.622108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-edcd4977-ec20-4155-bfa0-e6cac379d325 req-7836b86a-9923-4031-b82a-6dd9520b1909 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:25.622556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-edcd4977-ec20-4155-bfa0-e6cac379d325 req-7836b86a-9923-4031-b82a-6dd9520b1909 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:25.701749 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-edcd4977-ec20-4155-bfa0-e6cac379d325 req-7836b86a-9923-4031-b82a-6dd9520b1909 service nova] Creating event network-changed:49f3aeca-17d8-4d9a-9208-b95c1606ad92 for instance 2f5e0e1b-59dd-406d-a486-8f153f088014 on n-h2-781139-2 Oct 03 15:06:25.754294 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05137a81-5d8f-4c29-866e-190e1041d899 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.680350 Oct 03 15:06:25.759665 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2974/6111] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 3 15:06:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:25.762355 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-edcd4977-ec20-4155-bfa0-e6cac379d325 req-7836b86a-9923-4031-b82a-6dd9520b1909 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182618 Oct 03 15:06:25.766340 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3138/6112] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:06:25.770905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7500d800-1450-48a5-ad71-89423a07e951 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:25.838097 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7500d800-1450-48a5-ad71-89423a07e951 tempest-TestAggregatesBasicOps-1656198006 tempest-TestAggregatesBasicOps-1656198006-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.071814 Oct 03 15:06:25.839920 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2975/6113] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 15:06:25 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 03 15:06:25.847044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:25.850077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:25.910312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:25.912241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:25.915018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:25.917707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:25.922077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:25.923198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:26.633660 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4072596f-36ba-4359-bf41-3f8ef85449ac tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 0.862841 Oct 03 15:06:26.634496 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3139/6114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:25 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:27.657583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:27.661975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:27.662601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:27.703213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:27.703642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:27.704083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:27.711783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:27.716045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:27.722502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:28.358542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:28.359137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:28.367828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:28.406627 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc347910-4491-497b-8dc7-65053bc83456 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 0.749049 Oct 03 15:06:28.407228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:28.407752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:28.408786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:28.411125 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2976/6115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:27 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:28.411265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:28.415861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:28.417269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:28.497830 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28fc55b5-04d2-467d-a6f1-59839eef4800 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/ips" status: 200 len: 145 microversion: 2.1 time: 0.144444 Oct 03 15:06:28.502293 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3140/6116] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 3 15:06:28 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/ips => generated 145 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:06:29.429390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:29.458326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:29.458951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:29.522946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:29.523356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:29.524516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:29.530098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:29.531790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:29.533051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:30.448744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1472254013", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "96d884a0-61e2-4928-9f58-32cdbfaa2541"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1760489738", "security_groups": [{"name": "tempest-secgroup-smoke-488255109"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:30.502617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:31.114611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] validate_networks() for [('96d884a0-61e2-4928-9f58-32cdbfaa2541', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:06:31.635605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-826963ea-f890-43ff-9b50-5170cb9a046f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 2.207707 Oct 03 15:06:31.643963 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2977/6117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:29 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:31.661631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:31.663759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:31.686237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:31.687081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:31.687715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:31.688880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:31.693026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:31.694515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:31.729583 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc HTTP/1.1 Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6ccc88d8-616d-4b2d-a989-e12540aa12bc'} Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:31.735707 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.741384 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.745705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:31.751902 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-57328626-59c2-443c-a405-18cd46e76c67 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 404 len: 111 microversion: 2.1 time: 0.102320 Oct 03 15:06:31.757743 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2978/6118] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:06:31 2022] DELETE /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:31.763739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:31.764640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] [instance: 6ccc88d8-616d-4b2d-a989-e12540aa12bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:31.771137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:31.771946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:31.772671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:31.774033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:31.775403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:31.776074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:31.800939 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] HTTP exception thrown: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Request method failure captured: Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc HTTP/1.1 Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvgysNq1pTI2888LlinZIXdjmEH35aUkc9PmZp4U2b6Yfs2SQO2OabF3WG8XWDwudxx4K-yUJmrEG9si35En_Zknw3xtLyG0YKlwvblFAoa-xIQ-bv8aXk6m6N63AlTq2cKvONf4d17_femQ3UJ3eRqtE6mS4W4oK_V0mIrok87NLls Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_74c93601b06e4575980d5d65c27bebad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/74c93601b06e4575980d5d65c27bebad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 74c93601b06e4575980d5d65c27bebad Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1066765550 Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: d4048c225333488babee42b8bbe86bfe Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeNegativeTest-1066765550-project Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6ccc88d8-616d-4b2d-a989-e12540aa12bc'} Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:06:31.813311 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:06:31.818323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] Returning 404 to user: Instance 6ccc88d8-616d-4b2d-a989-e12540aa12bc could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:06:31.818890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-12e57bc1-5ce6-4614-a9be-6676d4912793 tempest-AttachVolumeNegativeTest-1066765550 tempest-AttachVolumeNegativeTest-1066765550-project] 10.222.0.20 "GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc" status: 404 len: 111 microversion: 2.1 time: 0.058984 Oct 03 15:06:31.821280 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2979/6119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:31 2022] GET /compute/v2.1/servers/6ccc88d8-616d-4b2d-a989-e12540aa12bc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:06:32.674609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:32.675260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:32.700700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:32.707554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:32.708052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:32.713027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:32.720390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:32.720872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:33.334177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:06:33.334755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:06:33.335119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:06:33.335532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:06:33.335941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:06:33.368989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:33.373191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:33.375745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:33.379226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:33.380045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:33.382815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:33.466954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:06:33.483348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:06:33.536428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:06:33.543109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:06:33.663818 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-797042dc-2547-4906-911a-996d6744cfcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.218957 Oct 03 15:06:33.666451 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3141/6120] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:06:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 3222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:06:33.682579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ba5630e-653f-4305-bbb6-ecffbd3f5f18"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:33.686420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:33.721749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:33.722437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:33.723057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:33.727188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:33.734968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:33.735432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:34.504275 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-93f59eac-3bf4-47d4-b6f0-afcb18a7594d tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834058 Oct 03 15:06:34.505509 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3142/6121] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:06:33 2022] POST /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:34.538407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ca50a55d-90cb-41ee-8a33-dd5e18851e89 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:34.540638 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e1c3f83-a757-4c06-ae04-d5cf2db6a553 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 1.856418 Oct 03 15:06:34.547709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ca50a55d-90cb-41ee-8a33-dd5e18851e89 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:34.547972 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2980/6122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:32 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:34.801967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ca50a55d-90cb-41ee-8a33-dd5e18851e89 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:34.811489 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ca50a55d-90cb-41ee-8a33-dd5e18851e89 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1267 microversion: 2.1 time: 0.304649 Oct 03 15:06:34.813530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3143/6123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:34 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:35.571028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:35.571778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:35.620174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:35.620174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:35.620174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:35.620174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:35.623017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:35.623564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:35.688179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=58 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:35.837307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:35.838102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:35.866925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:35.867052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:35.867622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:35.868663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:35.882327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:35.885493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:36.259758 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e524613d-aa7f-4a75-aae7-76febf268f93 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 0.695280 Oct 03 15:06:36.261306 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2981/6124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:35 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:36.308361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:36.319297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c2b0f05-f2c8-445b-b13b-76bf20c80596 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1319 microversion: 2.1 time: 0.486838 Oct 03 15:06:36.325005 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3144/6125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:35 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:37.288171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:37.289752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:37.305476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:37.310437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:37.311301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:37.312321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:37.318442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:37.319152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:37.358103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:37.358729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:37.378677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:37.386072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:37.386533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:37.387297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:37.387751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:37.388172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:38.499169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6fbd8fbf-f19f-448d-8713-319c52bd8c03 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 1.214823 Oct 03 15:06:38.508019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:38.521289 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2982/6126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:37 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:38.521918 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ff8fbe1-98ee-4e13-853d-392acf840dcd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1325 microversion: 2.1 time: 1.164008 Oct 03 15:06:38.527910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3145/6127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:37 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1325 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:39.555357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:39.556897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:39.558235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:39.559459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:39.590377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:39.591707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:39.592850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:39.593101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:39.593732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:39.594483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:39.596298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:39.596507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:39.601420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:39.602281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:39.602941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:39.603557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:40.105682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:40.117722 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc9abefc-0068-4fdd-a3a9-9993d22c9c08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1325 microversion: 2.1 time: 0.566259 Oct 03 15:06:40.121673 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3146/6128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:39 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1325 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:40.127241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ff0da785-5849-478b-9000-abc6f5aa5235 req-bf267963-f4a4-4ae5-bc21-cb7197fe8023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5e0e1b-59dd-406d-a486-8f153f088014", "name": "network-vif-plugged", "status": "completed", "tag": "49f3aeca-17d8-4d9a-9208-b95c1606ad92"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:40.142088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ff0da785-5849-478b-9000-abc6f5aa5235 req-bf267963-f4a4-4ae5-bc21-cb7197fe8023 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:40.142925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ff0da785-5849-478b-9000-abc6f5aa5235 req-bf267963-f4a4-4ae5-bc21-cb7197fe8023 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:40.146872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ff0da785-5849-478b-9000-abc6f5aa5235 req-bf267963-f4a4-4ae5-bc21-cb7197fe8023 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:40.186362 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ff0da785-5849-478b-9000-abc6f5aa5235 req-bf267963-f4a4-4ae5-bc21-cb7197fe8023 service nova] Creating event network-vif-plugged:49f3aeca-17d8-4d9a-9208-b95c1606ad92 for instance 2f5e0e1b-59dd-406d-a486-8f153f088014 on n-h2-781139-2 Oct 03 15:06:40.201706 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ff0da785-5849-478b-9000-abc6f5aa5235 req-bf267963-f4a4-4ae5-bc21-cb7197fe8023 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077866 Oct 03 15:06:40.206335 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3147/6129] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:41.151290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:41.153148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:41.174234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:41.175677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:41.176789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:41.185679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:41.186842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:41.187938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:41.413569 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-441dc507-1376-4a04-900d-e5c6c77a6908 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 1.867251 Oct 03 15:06:41.415421 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2983/6130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:39 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:41.455591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:41.475296 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19825e7a-b484-4a21-a963-baf936e59c18 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1325 microversion: 2.1 time: 0.330697 Oct 03 15:06:41.480004 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3148/6131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:41 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:42.441358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:42.442232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:42.468106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:42.468973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:42.469666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:42.470866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:42.472194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:42.472911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:42.507914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:42.509954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:42.556040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:42.566412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:42.579096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:42.580104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:42.580600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:42.592189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:42.750948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:42.758994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-244d803e-a924-4a5c-b7f3-3809a53073b5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1325 microversion: 2.1 time: 0.257577 Oct 03 15:06:42.759590 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3149/6132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:42 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:43.311783 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c464501-4c0a-47f4-b029-37e6c190f857 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1463 microversion: 2.1 time: 0.876101 Oct 03 15:06:43.318236 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2984/6133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:42 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1463 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:43.790485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:43.791166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:43.794641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:43.831044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:43.831546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:43.831991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:43.832713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:43.843305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:43.844057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:44.030742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:44.045699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-181f1b04-e54f-4cdc-a391-9d1803c6eb68 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1325 microversion: 2.1 time: 0.263923 Oct 03 15:06:44.046724 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3150/6134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:43 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1325 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:44.340613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:44.341277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:44.361214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:44.362156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:44.362610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:44.363362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:44.363843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:44.364795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:45.061710 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-468b4772-2f32-4d3f-92d5-46b98623975b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1648 microversion: 2.1 time: 0.725426 Oct 03 15:06:45.072631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:45.074315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:45.085303 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2985/6135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:44 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1648 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:45.088884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:45.099382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:45.102384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:45.102852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:45.106380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:45.109581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:45.110992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:45.112501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:45.113901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:45.123377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:45.123887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:45.124334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:45.125546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:45.126012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:45.126445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:45.607890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3141442b-af11-4a11-a7aa-3f61371ed852 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1648 microversion: 2.1 time: 0.512816 Oct 03 15:06:45.608524 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2986/6136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:45 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1648 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:45.631604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:45.632220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:45.640484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:45.641001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:45.645399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:45.647635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:45.648338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:45.649416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:45.951223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:45.962503 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3229a8cc-de49-4dce-9133-64cd2007c3fb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.895444 Oct 03 15:06:45.968304 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3151/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:45 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:46.992260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:46.992864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:47.025238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:47.026173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:47.030261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:47.032529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:47.034632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:47.035271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:47.068661 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59f89301-da3d-42c4-bdb4-4a74edaec097 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1648 microversion: 2.1 time: 1.435821 Oct 03 15:06:47.075217 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2987/6138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:45 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1648 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:47.435194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-124225270", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "availability_zone": "nova:n-h1-781139-2", "networks": [{"uuid": "515727a8-d50a-4383-b8d2-ae41998e21e4"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:47.604418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] validate_networks() for [('515727a8-d50a-4383-b8d2-ae41998e21e4', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:06:47.687216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:47.702980 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-94d09bf0-bacb-465d-8c0a-91b9d1de48ac tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.715677 Oct 03 15:06:47.703844 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3152/6139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:46 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:48.017685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-705a18fa-c335-4ad3-ac6b-5cb83efbd1e1 req-02c37a3c-277d-49a0-8d9e-a376c8f03cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:48.045693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-705a18fa-c335-4ad3-ac6b-5cb83efbd1e1 req-02c37a3c-277d-49a0-8d9e-a376c8f03cd1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:48.046090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-705a18fa-c335-4ad3-ac6b-5cb83efbd1e1 req-02c37a3c-277d-49a0-8d9e-a376c8f03cd1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:48.046524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-705a18fa-c335-4ad3-ac6b-5cb83efbd1e1 req-02c37a3c-277d-49a0-8d9e-a376c8f03cd1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:48.070702 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-705a18fa-c335-4ad3-ac6b-5cb83efbd1e1 req-02c37a3c-277d-49a0-8d9e-a376c8f03cd1 service nova] Creating event network-changed:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:06:48.076494 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-705a18fa-c335-4ad3-ac6b-5cb83efbd1e1 req-02c37a3c-277d-49a0-8d9e-a376c8f03cd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062427 Oct 03 15:06:48.077502 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3153/6140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:48.733058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:48.733781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:48.744448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:48.747241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:48.748807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:48.749609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:48.754852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:48.755464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:49.084095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:49.086795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:49.101316 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a78d46e2-09ed-4593-abd2-c9605323a055 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.373121 Oct 03 15:06:49.102199 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3154/6141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:48 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:49.671393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:06:49.671974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:06:49.672505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:06:49.673049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:06:49.673695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:06:49.695546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:49.696238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:49.697018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:49.698235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:49.699826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:49.700705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:49.739882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Getting quotas for project f784531c71e444c39e55cb83bb194f78. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:06:49.747343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Getting quotas for user 7384b4371bd349e89ec798a75532dcb3 and project f784531c71e444c39e55cb83bb194f78. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:06:49.776599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:06:49.778844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:06:49.873108 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aad90e87-04d1-4de6-9227-a52fd362452f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.443347 Oct 03 15:06:49.880548 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2988/6142] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:06:49.889662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad9ded3c-5663-472a-a791-eac39210bd11 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:49.891479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad9ded3c-5663-472a-a791-eac39210bd11 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:50.134950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:50.138627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:50.156869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:50.160296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:50.161263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:50.166256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:50.166997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:50.167636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:50.368973 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad9ded3c-5663-472a-a791-eac39210bd11 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1328 microversion: 2.1 time: 0.487284 Oct 03 15:06:50.370745 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3155/6143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:49 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:50.462121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:50.473952 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5fd49126-925c-483f-be31-b1244a231460 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.350021 Oct 03 15:06:50.474934 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2989/6144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:50 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:51.397035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:51.397645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:51.415520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:51.416391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:51.418104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:51.421134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:51.423398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:51.424047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:51.502299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:51.502891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:51.519558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:51.520430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:51.521124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:51.522019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:51.522639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:51.523290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:51.569750 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12dcc972-de44-4cf0-ad1b-bd953f951963 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1345 microversion: 2.1 time: 0.180357 Oct 03 15:06:51.572242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3156/6145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:51 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:52.045569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:52.058698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7895bdbb-7de5-4d8f-9ec4-bc8b76ef7fb5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.558862 Oct 03 15:06:52.059427 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2990/6146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:51 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:52.597227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:52.598041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:52.620892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:52.621561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:52.625791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:52.626694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:52.627254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:52.628988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:52.893547 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98ff82cf-761e-43ee-be34-9f8fab3237cc tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1415 microversion: 2.1 time: 0.300057 Oct 03 15:06:52.897905 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3157/6147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:52 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1415 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:53.085414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:53.086806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:53.101309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:53.112607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.114876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.120351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.122014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.124206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.124993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.369945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:53.371306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:53.390378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.392457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.394375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.395650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.396577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.400040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.463139 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20eb98f6-82d1-4f06-af70-837b5c364a76 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098274 Oct 03 15:06:53.464557 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3158/6148] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:06:53 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:06:53.480222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:53.480716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:53.494146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.495422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.499819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.502939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.505668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.507970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.594624 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78bdfcf5-99b2-45fb-b999-3ee44769cce3 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/8ba5630e-653f-4305-bbb6-ecffbd3f5f18" status: 200 len: 194 microversion: 2.1 time: 0.122970 Oct 03 15:06:53.599302 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3159/6149] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 3 15:06:53 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/8ba5630e-653f-4305-bbb6-ecffbd3f5f18 => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:53.918749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:53.919524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:53.939714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.948123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.948900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:53.949809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:53.953229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:53.953830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:54.742216 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d3c3100-9d74-4afa-835e-3303e7746419 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1421 microversion: 2.1 time: 0.827992 Oct 03 15:06:54.744660 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3160/6150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:53 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1421 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:06:55.333421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:55.385549 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8620964d-1efa-44bf-ba0e-02fd37004587 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 2.305027 Oct 03 15:06:55.396487 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2991/6151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:53 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:55.770368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:55.772007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:55.832113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:55.852394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:55.867451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:55.873500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:55.878624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:55.881095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:56.317716 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fd25a64-06e9-454f-a9e0-5159f7fcc802 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1421 microversion: 2.1 time: 0.551164 Oct 03 15:06:56.320348 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3161/6152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:55 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1421 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:56.424431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:56.425143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:56.470463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:56.473822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:56.476182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:56.481397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:56.485350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:56.502248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:56.924218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:56.937205 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac6b6224-c0e7-4a33-9c6c-4240d7ba46b2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.514591 Oct 03 15:06:56.938374 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2992/6153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:56 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:57.352208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:57.352990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:57.371830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:57.372793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:57.373760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:57.376093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:57.378025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:57.381030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:57.850254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d4521f-6ef7-4eae-b04e-603b4255b1f1"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:57.855153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:57.866811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:57.868186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:57.868971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:57.870133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:57.870773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:57.871370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:58.344951 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0a735fe9-c8b1-4ce5-a36d-8a778b6d5e08 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.997300 Oct 03 15:06:58.347660 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3162/6154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:57 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:58.365846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:58.367271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:58.379882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:58.380401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:58.380847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:58.385788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:58.386274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:58.386715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:58.393870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1353862d-dec6-4f6d-b78f-afadbf62a18a tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "POST /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548311 Oct 03 15:06:58.395093 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2993/6155] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:06:57 2022] POST /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:06:58.802585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-978bf343-07b4-4e2d-a01a-2971d60cfc4a req-c00c3e58-a298-4edb-8672-ac44d43e1261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e159369-3354-4575-8c6d-c025f543ab25", "tag": "37cf3bea-314d-4e52-8822-96da63ebee31"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:06:58.829006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-978bf343-07b4-4e2d-a01a-2971d60cfc4a req-c00c3e58-a298-4edb-8672-ac44d43e1261 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:58.829863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-978bf343-07b4-4e2d-a01a-2971d60cfc4a req-c00c3e58-a298-4edb-8672-ac44d43e1261 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:58.831410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-978bf343-07b4-4e2d-a01a-2971d60cfc4a req-c00c3e58-a298-4edb-8672-ac44d43e1261 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:58.861211 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-978bf343-07b4-4e2d-a01a-2971d60cfc4a req-c00c3e58-a298-4edb-8672-ac44d43e1261 service nova] Creating event network-changed:37cf3bea-314d-4e52-8822-96da63ebee31 for instance 2e159369-3354-4575-8c6d-c025f543ab25 on n-h1-781139-2 Oct 03 15:06:58.880312 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-978bf343-07b4-4e2d-a01a-2971d60cfc4a req-c00c3e58-a298-4edb-8672-ac44d43e1261 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081390 Oct 03 15:06:58.882081 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2994/6156] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:06:59.041215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:06:59.050355 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dee3af16-9a07-4223-8e43-10dc4e54ce8a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.700688 Oct 03 15:06:59.055211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3163/6157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:58 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:06:59.374249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:06:59.375602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:06:59.393408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:59.398435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:59.398959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:59.399723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:06:59.400192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:06:59.400724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:06:59.717082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:06:59.757853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:00.021154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8c327fba-4180-4e32-906d-4c1f8bf8d38d req-41181e5a-7004-422d-9da4-598f8c3b70cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "name": "network-vif-plugged", "status": "completed", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:00.051978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8c327fba-4180-4e32-906d-4c1f8bf8d38d req-41181e5a-7004-422d-9da4-598f8c3b70cc service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:00.060797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8c327fba-4180-4e32-906d-4c1f8bf8d38d req-41181e5a-7004-422d-9da4-598f8c3b70cc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:00.063269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8c327fba-4180-4e32-906d-4c1f8bf8d38d req-41181e5a-7004-422d-9da4-598f8c3b70cc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:00.100145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8c327fba-4180-4e32-906d-4c1f8bf8d38d req-41181e5a-7004-422d-9da4-598f8c3b70cc service nova] Creating event network-vif-plugged:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:07:00.133721 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8c327fba-4180-4e32-906d-4c1f8bf8d38d req-41181e5a-7004-422d-9da4-598f8c3b70cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117602 Oct 03 15:07:00.141138 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3164/6158] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:00.153301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:00.154366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:00.173035 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c4af223-3acd-4688-b9b2-5d975454f155 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.803125 Oct 03 15:07:00.198213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2995/6159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:06:59 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:00.207105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:00.207777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:00.209182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:00.212018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:00.232347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:00.232870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:00.368260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:00.590254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:00.615079 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c6ff9287-d415-49ea-9ec5-2d97354589ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.469320 Oct 03 15:07:00.617429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3165/6160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:00 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:01.209316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:01.210056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:01.218734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:01.219235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:01.219678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:01.233295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:01.239352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:01.240037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:01.642402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:01.643397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:01.659163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:01.668124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:01.670917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:01.671412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:01.676133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:01.677912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:01.679415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:01.744915 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9e7c19c7-17ba-499d-bb68-1b6b83563e91 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.538979 Oct 03 15:07:01.750457 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2996/6161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:01 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:02.139896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:02.151582 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0140c256-5f06-4338-ae75-65ad47e82bec tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.512905 Oct 03 15:07:02.164948 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3166/6162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:01 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:07:02.779736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:02.780464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:02.787448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:02.789511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:02.790170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:02.791243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:02.791888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:02.792475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:03.180366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:03.180898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:03.195261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:03.197630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:03.198094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:03.198853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:03.199314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:03.199738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:03.463439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:03.468844 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fcc3ff2d-d4a5-4585-a868-ef94309051f1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.692838 Oct 03 15:07:03.470982 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2997/6163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:02 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:03.519869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:03.546818 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1045ae0d-91de-425a-be03-44868f1c2a3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1392 microversion: 2.1 time: 0.370374 Oct 03 15:07:03.560986 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3167/6164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:03 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1392 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:07:04.497773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:04.499003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:04.518635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:04.519467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:04.520959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:04.523296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:04.524034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:04.524824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:04.576550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:04.577916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:04.592678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:04.593539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:04.594297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:04.596027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:04.596730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:04.597537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:04.968869 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa1d4ed5-b8cd-4744-8fd7-7e2bf588613b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.475840 Oct 03 15:07:04.973165 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2998/6165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:04 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:05.133928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:05.146595 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7522393e-aca1-4fb9-8df7-1e6e20d20e71 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1565 microversion: 2.1 time: 0.574596 Oct 03 15:07:05.147687 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3168/6166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:04 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1565 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:07:05.174851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:05.175696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:05.186336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:05.189033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:05.189727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:05.193895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:05.194606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:05.195220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:05.745209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:05.756643 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-945b227a-d5df-4d47-b254-90adde955d9e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1565 microversion: 2.1 time: 0.585754 Oct 03 15:07:05.770079 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 2999/6167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:05 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1565 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:06.004730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:06.010139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:06.026339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:06.027121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:06.028551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:06.034388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:06.035097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:06.035708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:06.711853 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26631c27-143d-4a65-a2bb-ebf63d1cb539 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.719083 Oct 03 15:07:06.718395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3169/6168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:05 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:07.743380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:07.744310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:07.771871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:07.772528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:07.774810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:07.776196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:07.781972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:07.783011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:09.084709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c7330a53-fe0b-4037-b2d2-9d5126797624 req-fad3f8ef-7b76-4847-aee6-69bc2a3565ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e159369-3354-4575-8c6d-c025f543ab25", "name": "network-vif-plugged", "status": "completed", "tag": "37cf3bea-314d-4e52-8822-96da63ebee31"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:09.117422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c7330a53-fe0b-4037-b2d2-9d5126797624 req-fad3f8ef-7b76-4847-aee6-69bc2a3565ac service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:09.118449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c7330a53-fe0b-4037-b2d2-9d5126797624 req-fad3f8ef-7b76-4847-aee6-69bc2a3565ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:09.119205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c7330a53-fe0b-4037-b2d2-9d5126797624 req-fad3f8ef-7b76-4847-aee6-69bc2a3565ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:09.163810 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c7330a53-fe0b-4037-b2d2-9d5126797624 req-fad3f8ef-7b76-4847-aee6-69bc2a3565ac service nova] Creating event network-vif-plugged:37cf3bea-314d-4e52-8822-96da63ebee31 for instance 2e159369-3354-4575-8c6d-c025f543ab25 on n-h1-781139-2 Oct 03 15:07:09.176286 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c7330a53-fe0b-4037-b2d2-9d5126797624 req-fad3f8ef-7b76-4847-aee6-69bc2a3565ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095904 Oct 03 15:07:09.176837 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3170/6169] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:07:09.549336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-02f2d9dd-6fed-46ef-a9c8-910647864538 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 1.809809 Oct 03 15:07:09.549336 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3000/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:07 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:10.582597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:10.583305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:10.592945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:10.593436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:10.594008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:10.605768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:10.606260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:10.606700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:10.996469 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43ae6613-bd6d-4164-8069-6475b05d7e5a tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.422746 Oct 03 15:07:11.015520 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3171/6171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:10 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:12.030288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:12.032779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:12.064153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:12.065508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:12.067966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:12.070973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:12.073625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:12.075148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:12.868181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:12.870542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:12.888446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:12.888973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:12.889423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:12.901730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:12.902278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:12.902742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:13.008990 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-348e44b2-a261-403b-b8ac-8b9cc2284668 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1463 microversion: 2.1 time: 0.985038 Oct 03 15:07:13.012950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3001/6172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:12 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1463 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:13.039968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-89d0db92-78b7-4b88-9e30-893201dcbf3c req-14df6932-90a1-4516-9482-b68c383c82ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:13.089195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-89d0db92-78b7-4b88-9e30-893201dcbf3c req-14df6932-90a1-4516-9482-b68c383c82ac service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:13.092914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-89d0db92-78b7-4b88-9e30-893201dcbf3c req-14df6932-90a1-4516-9482-b68c383c82ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:13.093684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-89d0db92-78b7-4b88-9e30-893201dcbf3c req-14df6932-90a1-4516-9482-b68c383c82ac service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:13.141564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-89d0db92-78b7-4b88-9e30-893201dcbf3c req-14df6932-90a1-4516-9482-b68c383c82ac service nova] Creating event network-changed:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:07:13.168969 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-89d0db92-78b7-4b88-9e30-893201dcbf3c req-14df6932-90a1-4516-9482-b68c383c82ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147352 Oct 03 15:07:13.173118 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3002/6173] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:13.343618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:13.357521 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-be37fee2-3471-4007-91d5-e26f4b2b787b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1565 microversion: 2.1 time: 0.496487 Oct 03 15:07:13.360558 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3172/6174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:12 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1565 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:14.041189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:14.041918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:14.057543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:14.058447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:14.060733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:14.061687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:14.062166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:14.064180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:14.897067 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f97355e0-d736-4101-b9fd-45d8834a5c0e tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1649 microversion: 2.1 time: 0.860061 Oct 03 15:07:14.897686 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3003/6175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:14 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1649 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:14.928238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:14.929910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:14.940742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:14.944728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:14.945770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:14.948658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:14.957994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:14.960804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:16.221671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:16.231924 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-561f93aa-6abf-4a1c-8cd0-d4e64a1f0aa7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1649 microversion: 2.1 time: 1.306272 Oct 03 15:07:16.235739 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3173/6176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:14 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1649 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:16.258990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:16.259720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:16.273331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:16.273937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:16.276026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:16.280735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:16.281445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:16.281965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:17.272202 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-11695066-7e3c-4bd2-94ce-73111e8f81d9 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1649 microversion: 2.1 time: 1.017171 Oct 03 15:07:17.294372 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3004/6177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:16 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1649 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:17.298353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:17.299163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:17.312678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:17.313722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:17.314399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:17.315371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:17.316052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:17.316691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:17.353742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:07:17.489481 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-860e522a-a53c-41d6-b7ce-72b9462a82ba tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 204 len: 0 microversion: 2.1 time: 0.195056 Oct 03 15:07:17.490701 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3174/6178] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:07:17 2022] DELETE /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:07:17.503597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:17.504580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:17.525091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:17.528953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:17.529700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:17.531880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:17.533011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:17.534920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:17.907018 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-88bb42f8-84d3-40f0-9370-d9de2cbb0c9c tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1655 microversion: 2.1 time: 0.407188 Oct 03 15:07:17.907642 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3005/6179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:17 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1655 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:18.932837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:18.934246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:18.946392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:18.948059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:18.948793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:18.949953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:18.951758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:18.952493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:19.430553 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f441e0e9-50b9-4855-af4f-4a2585ce31ef tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1655 microversion: 2.1 time: 0.501844 Oct 03 15:07:19.431117 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3175/6180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:18 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1655 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:20.394314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:20.396545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:20.412539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.413070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.413671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:20.414396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.416136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.416742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:20.454325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:20.455503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:20.478531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.479313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.479763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:20.480497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.481055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.487239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:20.523490 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b02c8ec4-6eee-4d67-98a1-5ec6d63fb8dd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.133254 Oct 03 15:07:20.536070 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3006/6181] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:07:20 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:20.668286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:20.669364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:20.677220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.679936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.680398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:20.690416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.691799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.692747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:20.815876 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c4cf207-c803-4607-9452-582ec3d0d287 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/8ba5630e-653f-4305-bbb6-ecffbd3f5f18" status: 200 len: 194 microversion: 2.1 time: 0.151986 Oct 03 15:07:20.822293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3007/6182] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 3 15:07:20 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/8ba5630e-653f-4305-bbb6-ecffbd3f5f18 => generated 194 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:20.829350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:20.830641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:20.838267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.838953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.839725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:20.840600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:20.841233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:20.841810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:21.007909 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0acece50-6398-4b60-9cb0-d88326778189 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1655 microversion: 2.1 time: 0.557612 Oct 03 15:07:21.016982 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3176/6183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:20 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1655 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:21.038375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lazy-loading 'services' on Instance uuid ddb33e2a-6696-423d-a89f-b7da23a9c114 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:07:21.257868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-564efe8a-2167-4bdc-b001-5ae558bad238 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/8ba5630e-653f-4305-bbb6-ecffbd3f5f18" status: 202 len: 0 microversion: 2.1 time: 0.432365 Oct 03 15:07:21.263487 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3008/6184] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:07:20 2022] DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/8ba5630e-653f-4305-bbb6-ecffbd3f5f18 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:07:21.888018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7eee4fcf-3685-43cc-b77f-412485132187 req-886cda13-7dbf-486c-a458-e1dc46a9be2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e159369-3354-4575-8c6d-c025f543ab25", "name": "network-vif-deleted", "tag": "37cf3bea-314d-4e52-8822-96da63ebee31"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:21.925333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7eee4fcf-3685-43cc-b77f-412485132187 req-886cda13-7dbf-486c-a458-e1dc46a9be2d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:21.948108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7eee4fcf-3685-43cc-b77f-412485132187 req-886cda13-7dbf-486c-a458-e1dc46a9be2d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:21.953540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7eee4fcf-3685-43cc-b77f-412485132187 req-886cda13-7dbf-486c-a458-e1dc46a9be2d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:22.024867 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7eee4fcf-3685-43cc-b77f-412485132187 req-886cda13-7dbf-486c-a458-e1dc46a9be2d service nova] Creating event network-vif-deleted:37cf3bea-314d-4e52-8822-96da63ebee31 for instance 2e159369-3354-4575-8c6d-c025f543ab25 on n-h1-781139-2 Oct 03 15:07:22.032970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:22.035238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:22.037099 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7eee4fcf-3685-43cc-b77f-412485132187 req-886cda13-7dbf-486c-a458-e1dc46a9be2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153071 Oct 03 15:07:22.042548 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3177/6185] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:22.061500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:22.064706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:22.066607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:22.071052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:22.074392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:22.075049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:22.226959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:22.228264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:22.230973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:22.234068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lazy-loading 'fault' on Instance uuid 2e159369-3354-4575-8c6d-c025f543ab25 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:07:22.455731 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-32e126bc-7b8f-4ea7-988c-cd22982b1fd1 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 200 len: 1453 microversion: 2.1 time: 0.426769 Oct 03 15:07:22.460351 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3009/6186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:22 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 1453 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:07:23.484237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:23.485232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2e159369-3354-4575-8c6d-c025f543ab25] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:23.508375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:23.511826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:23.513872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:23.521014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:23.526346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:23.529374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:23.615813 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] HTTP exception thrown: Instance 2e159369-3354-4575-8c6d-c025f543ab25 could not be found. Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Request method failure captured: Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 HTTP/1.1 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvpkH63K5HT-DQ8GXhQFKP_0kSVfCh4JoY6cac73Pl6qVZTWqi9dbH8CMYp9Gg3DziVjLhMPk6g3W3fR31AtOBS05DnIaSdQcJouwWYv1F8eb0thWqVwZUjzXrXToubRMDdEmGjeIc7zbPFNX7Xe3cjSbVQDPhHYHc5TTICrwf-yo6A Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f784531c71e444c39e55cb83bb194f78 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestServerMultinode-2139699968 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f784531c71e444c39e55cb83bb194f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f784531c71e444c39e55cb83bb194f78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f784531c71e444c39e55cb83bb194f78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f784531c71e444c39e55cb83bb194f78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestServerMultinode-2139699968 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f784531c71e444c39e55cb83bb194f78 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestServerMultinode-2139699968 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestServerMultinode-2139699968-project-admin Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7384b4371bd349e89ec798a75532dcb3 Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestServerMultinode-2139699968-project-admin Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 2e159369-3354-4575-8c6d-c025f543ab25 could not be found. Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '2e159369-3354-4575-8c6d-c025f543ab25'} Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e159369-3354-4575-8c6d-c025f543ab25 could not be found. Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e159369-3354-4575-8c6d-c025f543ab25 could not be found. Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:07:23.617657 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:23.621340 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:23.621340 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:07:23.621340 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:07:23.621340 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:07:23.621340 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:07:23.621340 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e159369-3354-4575-8c6d-c025f543ab25 could not be found. Oct 03 15:07:23.621340 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:23.622987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Returning 404 to user: Instance 2e159369-3354-4575-8c6d-c025f543ab25 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:07:23.632518 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66c955d0-cc20-49ea-8f8c-1219ed08dc0d tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25" status: 404 len: 111 microversion: 2.1 time: 0.152755 Oct 03 15:07:23.641658 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3178/6187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:23 2022] GET /compute/v2.1/servers/2e159369-3354-4575-8c6d-c025f543ab25 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:07:23.652785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:23.653364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:23.664012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=40 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:23.678431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:23.686028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:23.686509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:23.689944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:23.691307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:23.693601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:23.786902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:07:24.107802 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c203258-c956-4f7b-b35a-129d7425e063 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 204 len: 0 microversion: 2.1 time: 0.460508 Oct 03 15:07:24.108990 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3010/6188] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:07:23 2022] DELETE /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:07:24.118003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:24.118740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:24.128017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:24.128528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:24.129000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:24.129722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:24.130176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:24.130597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:24.750314 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2799debb-d2a1-4c50-a458-a8bb4ed27a06 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1654 microversion: 2.1 time: 0.636878 Oct 03 15:07:24.752693 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3179/6189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:24 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1654 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:25.782119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:25.782840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:25.791261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:25.791759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:25.792206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:25.793085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:25.793405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:25.803884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:26.191464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac3b6e1a-aa68-44b3-8b98-849fe35bc93f tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1612 microversion: 2.1 time: 0.413303 Oct 03 15:07:26.193081 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3011/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:25 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1612 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:26.351731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6da288d8-79db-4d43-9e65-bfda4b4945df req-d6356032-f457-4cb3-9f67-75ce97a6e2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f5e0e1b-59dd-406d-a486-8f153f088014", "name": "network-vif-deleted", "tag": "49f3aeca-17d8-4d9a-9208-b95c1606ad92"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:26.378411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6da288d8-79db-4d43-9e65-bfda4b4945df req-d6356032-f457-4cb3-9f67-75ce97a6e2e2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:26.382948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6da288d8-79db-4d43-9e65-bfda4b4945df req-d6356032-f457-4cb3-9f67-75ce97a6e2e2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:26.383452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6da288d8-79db-4d43-9e65-bfda4b4945df req-d6356032-f457-4cb3-9f67-75ce97a6e2e2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:26.425855 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6da288d8-79db-4d43-9e65-bfda4b4945df req-d6356032-f457-4cb3-9f67-75ce97a6e2e2 service nova] Creating event network-vif-deleted:49f3aeca-17d8-4d9a-9208-b95c1606ad92 for instance 2f5e0e1b-59dd-406d-a486-8f153f088014 on n-h2-781139-2 Oct 03 15:07:26.443139 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6da288d8-79db-4d43-9e65-bfda4b4945df req-d6356032-f457-4cb3-9f67-75ce97a6e2e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095150 Oct 03 15:07:26.444522 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3180/6191] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:27.225967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:27.227266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:27.238780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:27.239529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:27.243064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:27.244385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:27.245487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:27.249587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:27.291945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:27.353967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:27.355768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:27.356475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:27.362520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lazy-loading 'fault' on Instance uuid 2f5e0e1b-59dd-406d-a486-8f153f088014 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:07:27.457028 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-15c7c628-82c8-4bd2-aad5-d3994a9da6f7 tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 200 len: 1453 microversion: 2.1 time: 0.232422 Oct 03 15:07:27.459411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3012/6192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:27 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:07:28.484640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:28.485422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] [instance: 2f5e0e1b-59dd-406d-a486-8f153f088014] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:28.499881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:28.500491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:28.500958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:28.501718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:28.502173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:28.502605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:28.534919 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] HTTP exception thrown: Instance 2f5e0e1b-59dd-406d-a486-8f153f088014 could not be found. Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Request method failure captured: Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 HTTP/1.1 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvpkH63K5HT-DQ8GXhQFKP_0kSVfCh4JoY6cac73Pl6qVZTWqi9dbH8CMYp9Gg3DziVjLhMPk6g3W3fR31AtOBS05DnIaSdQcJouwWYv1F8eb0thWqVwZUjzXrXToubRMDdEmGjeIc7zbPFNX7Xe3cjSbVQDPhHYHc5TTICrwf-yo6A Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f784531c71e444c39e55cb83bb194f78 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestServerMultinode-2139699968 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f784531c71e444c39e55cb83bb194f78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f784531c71e444c39e55cb83bb194f78", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f784531c71e444c39e55cb83bb194f78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f784531c71e444c39e55cb83bb194f78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestServerMultinode-2139699968 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f784531c71e444c39e55cb83bb194f78 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestServerMultinode-2139699968 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestServerMultinode-2139699968-project-admin Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7384b4371bd349e89ec798a75532dcb3 Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestServerMultinode-2139699968-project-admin Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 2f5e0e1b-59dd-406d-a486-8f153f088014 could not be found. Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '2f5e0e1b-59dd-406d-a486-8f153f088014'} Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f5e0e1b-59dd-406d-a486-8f153f088014 could not be found. Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f5e0e1b-59dd-406d-a486-8f153f088014 could not be found. Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:07:28.536636 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:28.539638 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:28.539638 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:07:28.539638 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:07:28.539638 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:07:28.539638 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:07:28.539638 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f5e0e1b-59dd-406d-a486-8f153f088014 could not be found. Oct 03 15:07:28.539638 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:07:28.545406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] Returning 404 to user: Instance 2f5e0e1b-59dd-406d-a486-8f153f088014 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:07:28.546390 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c7b2236-0fd2-4cbc-a1d4-4b8d2196986b tempest-TestServerMultinode-2139699968 tempest-TestServerMultinode-2139699968-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014" status: 404 len: 111 microversion: 2.1 time: 0.066742 Oct 03 15:07:28.547344 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3181/6193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:28 2022] GET /compute/v2.1/servers/2f5e0e1b-59dd-406d-a486-8f153f088014 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:07:31.899689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:31.901010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:31.914482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:31.918922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:31.919636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:31.933051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:31.933770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:31.934465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:32.000238 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8abd5f0c-82ac-4fab-890b-83a26e37ffb7 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/65d4521f-6ef7-4eae-b04e-603b4255b1f1" status: 200 len: 194 microversion: 2.1 time: 0.104849 Oct 03 15:07:32.001636 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3013/6194] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 3 15:07:31 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/65d4521f-6ef7-4eae-b04e-603b4255b1f1 => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:32.019124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:32.022786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:32.033328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:32.036965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:32.038320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:32.040989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:32.041972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:32.043287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:32.045007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:32.160963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lazy-loading 'services' on Instance uuid ddb33e2a-6696-423d-a89f-b7da23a9c114 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:07:32.284005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bbb09cf-b06c-445b-ad68-fc1cf69a069b tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/65d4521f-6ef7-4eae-b04e-603b4255b1f1" status: 202 len: 0 microversion: 2.1 time: 0.271585 Oct 03 15:07:32.285227 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3182/6195] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:07:32 2022] DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments/65d4521f-6ef7-4eae-b04e-603b4255b1f1 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:07:40.731697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:40.734160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:40.756717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:40.757236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:40.757678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:40.758524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:40.767463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:40.767926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:40.897741 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f52b7c3-f9d2-4199-8fa9-815619d3fc5a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action" status: 200 len: 24568 microversion: 2.1 time: 0.170070 Oct 03 15:07:40.899636 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3014/6196] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:07:40 2022] POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action => generated 24568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:07:45.500148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:45.501332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:45.511506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:45.523203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:45.546216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:45.548617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:45.550940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:45.553639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:45.555508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:45.568388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:45.663386 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1fa236a-5b1e-4de9-97a4-b58c59f509d1 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165251 Oct 03 15:07:45.666593 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3183/6197] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:07:45 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:07:46.024411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:46.028282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:46.045365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.046104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.046674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:46.047570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.048301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.049266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:46.129486 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-79ecf788-c2e7-4a62-a06f-0a553c1945cd tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122485 Oct 03 15:07:46.141273 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3015/6198] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:07:46 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:07:46.294278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:46.298846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:46.324975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.325483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.340511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:46.341402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.341886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.342357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:46.428260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:07:46.632878 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13db3715-a827-4bfc-8ec5-65db7834c568 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 204 len: 0 microversion: 2.1 time: 0.349668 Oct 03 15:07:46.637970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3184/6199] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:07:46 2022] DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:07:46.643279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:46.643912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:46.665521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.666025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.666462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:46.667172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:46.667626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:46.668046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:47.211968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:47.230871 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-85536f4c-0d30-4534-be0f-0ec99b02e944 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1674 microversion: 2.1 time: 0.590194 Oct 03 15:07:47.252684 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3016/6200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:46 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1674 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:07:48.261747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:48.263535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:48.293155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:48.295324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:48.296295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:48.304762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:48.305483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:48.306768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:49.263062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:49.278226 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-71e4c310-4ade-4616-8d40-1fa3174488b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1674 microversion: 2.1 time: 1.020680 Oct 03 15:07:49.294038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3185/6201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:48 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1674 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:50.306690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:50.307384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:50.325993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:50.326496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:50.326939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:50.327665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:50.328121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:50.328545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:51.581842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:51.600130 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5a454a0-63bf-4e9f-ad06-d395b01ebd90 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1674 microversion: 2.1 time: 1.297163 Oct 03 15:07:51.600755 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3017/6202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:50 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1674 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:52.634827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:52.636572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:52.676892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:52.678537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:52.681936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:52.687029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:52.692100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:52.692728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:52.903166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:52.918220 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3baa3f6d-ca07-4b03-b894-b9a5317f0d37 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1606 microversion: 2.1 time: 0.294220 Oct 03 15:07:52.933033 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3186/6203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:52 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1606 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:07:53.802750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f678afac-e30c-4379-8eb3-b22af326d190 req-70ce97f7-f8ad-40be-b7a6-96377a09d4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb33e2a-6696-423d-a89f-b7da23a9c114", "name": "network-vif-deleted", "tag": "a907d752-a34c-496f-9e62-f10407a5624d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:07:53.862023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:07:53.892891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f678afac-e30c-4379-8eb3-b22af326d190 req-70ce97f7-f8ad-40be-b7a6-96377a09d4a4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:53.894772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f678afac-e30c-4379-8eb3-b22af326d190 req-70ce97f7-f8ad-40be-b7a6-96377a09d4a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:53.895594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f678afac-e30c-4379-8eb3-b22af326d190 req-70ce97f7-f8ad-40be-b7a6-96377a09d4a4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:53.943259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:53.945199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:53.945379 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f678afac-e30c-4379-8eb3-b22af326d190 req-70ce97f7-f8ad-40be-b7a6-96377a09d4a4 service nova] Creating event network-vif-deleted:a907d752-a34c-496f-9e62-f10407a5624d for instance ddb33e2a-6696-423d-a89f-b7da23a9c114 on n-h2-781139-2 Oct 03 15:07:53.972558 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f678afac-e30c-4379-8eb3-b22af326d190 req-70ce97f7-f8ad-40be-b7a6-96377a09d4a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168694 Oct 03 15:07:53.973091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:53.974698 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3018/6204] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:07:53.976257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:53.986505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:53.987562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:53.988283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:53.995143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:54.136481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:54.137363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:54.138145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:54.141539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lazy-loading 'fault' on Instance uuid ddb33e2a-6696-423d-a89f-b7da23a9c114 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:07:54.327774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d21903a3b0047b6ba5a19908d3b99c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdf7775cd80545c18da6599765b0e690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:07:54.341541 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d31da8a2-383a-46fc-b81a-4d2e25726dae tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 200 len: 1328 microversion: 2.1 time: 0.401879 Oct 03 15:07:54.343837 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3187/6205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:53 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 1328 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:07:55.373841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:55.374560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:07:55.397902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:55.398657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:55.399120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:55.400148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:07:55.400899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:07:55.401384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:07:55.432381 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] HTTP exception thrown: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Request method failure captured: Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 HTTP/1.1 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvlZIRyR-e8UDmqZFG0uxwo60bsNWmmQtemxVFEuxhShFeCoyTiW5XyFn__ub1Y7ZHlXbMnFKHVeGHkP6dSOcW6Q1LJMDti5joP2zhA9_rQ9oFGtibFOY5SsZC8B-KDi9XyCtpIA2rNlJPfjuehOYNp6V7XWj5JdF9vpQtWoS5Od8aw Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdf7775cd80545c18da6599765b0e690", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 7d21903a3b0047b6ba5a19908d3b99c5 Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'ddb33e2a-6696-423d-a89f-b7da23a9c114'} Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:07:55.434150 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:07:55.437523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Returning 404 to user: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:07:55.442395 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d95acd6b-abb6-4184-9f17-99d66bb26cac tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 404 len: 111 microversion: 2.1 time: 0.074629 Oct 03 15:07:55.454768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef6fe920-fd1d-479d-8ab7-96326c019821 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '.version_select at 0x7fb234bbc430>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:07:55.459996 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3019/6206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:07:55 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:07:55.532141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef6fe920-fd1d-479d-8ab7-96326c019821 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651234369" status: 202 len: 0 microversion: 2.1 time: 0.080245 Oct 03 15:07:55.537750 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3188/6207] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 15:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651234369 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:08:11.389239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:11.401035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=37 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:12.043851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:12.045793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:12.063811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:12.064358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:12.064786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:12.065537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:12.066054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:12.066397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:13.632487 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-01edca89-e116-41d1-a2d8-1c3d6a28a65e tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1834 microversion: 2.1 time: 2.265785 Oct 03 15:08:13.634384 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3020/6208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:11 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1834 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:13.662278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:13.663178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:14.157118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:14.158502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:14.182344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:14.182846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:14.183280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:14.183998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:14.184449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:14.184871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:14.814894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:14.827029 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c33f3a3-f6a1-442c-89e1-d3478808c598 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1683 microversion: 2.1 time: 1.168395 Oct 03 15:08:14.828165 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3189/6209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:13 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1683 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:15.066498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:15.069195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:15.094036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.094572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.094989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:15.106821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.107173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.107612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:15.253683 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99c31e0c-0c3e-4659-be40-c7d165dc451c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action" status: 200 len: 32643 microversion: 2.1 time: 0.190721 Oct 03 15:08:15.255540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3021/6210] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:08:15 2022] POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action => generated 32643 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:08:15.409769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:15.410334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:15.422805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.423308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.423746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:15.424464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.424917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.425389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:15.484719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '497edf4ef6794842a21196e4442cf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd83dca7ab64643f59a4b59b2bf18dba1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:15.489549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] flavor_id is None. Assuming migration. {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 03 15:08:15.490041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:08:15.756313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1e534b7-5a58-4b46-8e31-3436caa409ac tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action" status: 202 len: 0 microversion: 2.1 time: 0.351400 Oct 03 15:08:15.760216 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3190/6211] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:08:15 2022] POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:08:15.769666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:15.771243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:15.828098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.828604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.829077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:15.838143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:15.838657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:15.839123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.309928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:16.311449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:16.320056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:16.334157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:16.337040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.338043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:16.340142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:16.340835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.402857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:16.403385 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] HTTP exception thrown: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Request method failure captured: Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 HTTP/1.1 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvlZIRyR-e8UDmqZFG0uxwo60bsNWmmQtemxVFEuxhShFeCoyTiW5XyFn__ub1Y7ZHlXbMnFKHVeGHkP6dSOcW6Q1LJMDti5joP2zhA9_rQ9oFGtibFOY5SsZC8B-KDi9XyCtpIA2rNlJPfjuehOYNp6V7XWj5JdF9vpQtWoS5Od8aw Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdf7775cd80545c18da6599765b0e690", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7d21903a3b0047b6ba5a19908d3b99c5 Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ddb33e2a-6696-423d-a89f-b7da23a9c114'} Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:08:16.405541 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.410315 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.413734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Returning 404 to user: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:08:16.414973 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10bcaf02-0f0e-49ce-a6c5-a6220c43a9b2 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 404 len: 111 microversion: 2.1 time: 0.109043 Oct 03 15:08:16.425663 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3191/6212] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:08:16 2022] DELETE /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:08:16.435160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:16.436194 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a44e0f4b-24be-4dfd-8f6d-c6e4f336bed5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1692 microversion: 2.1 time: 0.670700 Oct 03 15:08:16.436696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: ddb33e2a-6696-423d-a89f-b7da23a9c114] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:16.455194 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3022/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:15 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1692 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:16.462251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:16.464085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:16.465564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.466528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:16.467235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:16.474232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:16.519035 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] HTTP exception thrown: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Request method failure captured: Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 HTTP/1.1 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvlZIRyR-e8UDmqZFG0uxwo60bsNWmmQtemxVFEuxhShFeCoyTiW5XyFn__ub1Y7ZHlXbMnFKHVeGHkP6dSOcW6Q1LJMDti5joP2zhA9_rQ9oFGtibFOY5SsZC8B-KDi9XyCtpIA2rNlJPfjuehOYNp6V7XWj5JdF9vpQtWoS5Od8aw Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdf7775cd80545c18da6599765b0e690", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7d21903a3b0047b6ba5a19908d3b99c5 Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'ddb33e2a-6696-423d-a89f-b7da23a9c114'} Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:16.520827 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.524335 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:16.524335 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:16.524335 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:16.524335 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:08:16.524335 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:08:16.524335 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. Oct 03 15:08:16.524335 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:16.531351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Returning 404 to user: Instance ddb33e2a-6696-423d-a89f-b7da23a9c114 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:08:16.532446 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5efd591b-161e-485a-9d11-a1c7de0fc6e8 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114" status: 404 len: 111 microversion: 2.1 time: 0.102560 Oct 03 15:08:16.533563 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3192/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:16 2022] GET /compute/v2.1/servers/ddb33e2a-6696-423d-a89f-b7da23a9c114 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:08:17.468939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:17.470034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:17.502144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:17.506432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:17.507598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:17.512154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:17.515307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:17.518387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:18.056198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:18.075462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da3efa57-f2bb-4cb0-9d76-b303b17ee75b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1692 microversion: 2.1 time: 0.611322 Oct 03 15:08:18.076420 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3023/6215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:17 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1692 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:19.105555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:19.106818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:19.119405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:19.120363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:19.125393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:19.126570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:19.127434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:19.129860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:19.451393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:19.462615 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f125bb25-2a7c-47f0-91ca-75325ed23afa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1692 microversion: 2.1 time: 0.363007 Oct 03 15:08:19.464175 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3193/6216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:19 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1692 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:20.490487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:20.491169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:20.514876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:20.524980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:20.525807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:20.527922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:20.530793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:20.533108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:21.050085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:21.070809 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-290eb328-52c4-48d8-ad60-b9371f9a432d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1692 microversion: 2.1 time: 0.585233 Oct 03 15:08:21.075797 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3024/6217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:20 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1692 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:22.095735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:22.096450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:22.108812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:22.108812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:22.108812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:22.108812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:22.108812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:22.108812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:22.639024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:22.655937 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b9e4ca7-22e4-4b55-a2ab-ff8446578336 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.564029 Oct 03 15:08:22.660174 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3194/6218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:22 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:23.693102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:23.693873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:23.706545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:23.740615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:23.754622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:23.755620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:23.756304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:23.758046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:24.234651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:24.251337 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ebd57d00-fb33-408a-bc0f-4a366a8d83ba tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.563185 Oct 03 15:08:24.252120 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3025/6219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:23 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:24.561744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:24.562500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:24.576153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:24.576706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:24.577346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:24.584552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:24.586031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:24.586839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:24.630486 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] HTTP exception thrown: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Request method failure captured: Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 HTTP/1.1 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvlZIRyR-e8UDmqZFG0uxwo60bsNWmmQtemxVFEuxhShFeCoyTiW5XyFn__ub1Y7ZHlXbMnFKHVeGHkP6dSOcW6Q1LJMDti5joP2zhA9_rQ9oFGtibFOY5SsZC8B-KDi9XyCtpIA2rNlJPfjuehOYNp6V7XWj5JdF9vpQtWoS5Od8aw Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdf7775cd80545c18da6599765b0e690", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7d21903a3b0047b6ba5a19908d3b99c5 Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e655a610-872b-49b4-9d79-39debb37d219'} Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:08:24.632503 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.635895 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.643883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Returning 404 to user: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:08:24.647018 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6fceee70-8818-4bac-82cf-152dd5a90235 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 404 len: 111 microversion: 2.1 time: 0.088424 Oct 03 15:08:24.649812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3195/6220] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:08:24 2022] DELETE /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:08:24.658084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:24.658933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] [instance: e655a610-872b-49b4-9d79-39debb37d219] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:24.670053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:24.673138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:24.675725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:24.676677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:24.678555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:24.679208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:24.716823 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] HTTP exception thrown: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Request method failure captured: Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 HTTP/1.1 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvlZIRyR-e8UDmqZFG0uxwo60bsNWmmQtemxVFEuxhShFeCoyTiW5XyFn__ub1Y7ZHlXbMnFKHVeGHkP6dSOcW6Q1LJMDti5joP2zhA9_rQ9oFGtibFOY5SsZC8B-KDi9XyCtpIA2rNlJPfjuehOYNp6V7XWj5JdF9vpQtWoS5Od8aw Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fdf7775cd80545c18da6599765b0e690", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fdf7775cd80545c18da6599765b0e690"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: fdf7775cd80545c18da6599765b0e690 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1301235351 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 7d21903a3b0047b6ba5a19908d3b99c5 Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-AttachVolumeTestJSON-1301235351-project Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'e655a610-872b-49b4-9d79-39debb37d219'} Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:08:24.721255 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.724909 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:08:24.724909 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:08:24.724909 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:08:24.724909 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:08:24.724909 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:08:24.724909 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. Oct 03 15:08:24.724909 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:08:24.729955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] Returning 404 to user: Instance e655a610-872b-49b4-9d79-39debb37d219 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:08:24.733097 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1171364c-b6e0-41b7-9dfd-df75715ac9b5 tempest-AttachVolumeTestJSON-1301235351 tempest-AttachVolumeTestJSON-1301235351-project] 10.222.0.20 "GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219" status: 404 len: 111 microversion: 2.1 time: 0.080287 Oct 03 15:08:24.736301 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3026/6221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:24 2022] GET /compute/v2.1/servers/e655a610-872b-49b4-9d79-39debb37d219 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:08:25.276091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:25.277129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:25.287327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:25.293962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:25.295072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:25.297734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:25.298288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:25.298794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:25.666287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:25.675400 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57ca2318-a063-4dc2-b87d-0c4f32a53864 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.403406 Oct 03 15:08:25.697112 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3196/6222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:25 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:26.705957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:26.706588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:26.717453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:26.717950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:26.718397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:26.719127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:26.719576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:26.729724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:27.053824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:27.068691 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fcd1814-d0f6-4e28-ae8a-56ed6c015cb7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.367923 Oct 03 15:08:27.071643 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3027/6223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:26 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:28.099867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:28.100780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:28.111898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:28.116392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:28.116899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:28.118547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:28.119018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:28.121006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:28.606017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:28.618729 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-751f4d73-f798-4457-9362-00d23f5cfeee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.523179 Oct 03 15:08:28.625034 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3197/6224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:28 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:29.644024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:29.646129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:29.660704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:29.664497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:29.666243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:29.667976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:29.669821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:29.671751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:30.986617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:31.074915 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cb2e0605-2060-44c0-9bdf-375940f41891 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 1.435430 Oct 03 15:08:31.078742 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3028/6225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:29 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:32.103001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:32.103771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:32.117711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:32.118563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:32.119397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:32.120381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:32.121934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:32.126535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:32.513547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:32.529777 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eafa4193-e7be-43cb-a654-0b5c5227d468 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.432012 Oct 03 15:08:32.531179 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3198/6226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:32 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:33.557961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:33.558699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:33.567663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:33.568497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:33.568647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:33.569584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:33.570186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:33.570616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:34.008666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:34.030873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b07d59de-af43-40bd-aa2e-4332a403451a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.476890 Oct 03 15:08:34.031837 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3029/6227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:33 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:35.059193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:35.062543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:35.074841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:35.076383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:35.078495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:35.080903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:35.081630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:35.082870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:35.332410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:35.352847 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f64381d-1921-4c65-ab9e-f52be1a9458c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.297435 Oct 03 15:08:35.355035 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3199/6228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:35 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:36.378481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:36.382297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:36.395000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:36.401730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:36.408556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:36.418522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:36.427099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:36.430995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:36.683024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:36.695520 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72975617-63a1-4654-89cf-1f6853b04fd8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.320896 Oct 03 15:08:36.711967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3030/6229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:36 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:37.740716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:37.741863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:37.761578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:37.764968 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:37.767608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:37.768452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:37.769519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:37.772360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:38.080177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:38.094788 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4192841-4e61-4d7d-9d39-59e22da329e1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1697 microversion: 2.1 time: 0.358153 Oct 03 15:08:38.111110 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3200/6230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:37 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1697 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:39.127509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:39.128159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:39.142361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ed807845-e2ee-438e-9fd4-3d3fbf5f2e9d req-b13e17f0-6c9f-4a02-973b-0eae8a209a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "name": "network-vif-unplugged", "status": "completed", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:39.161621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:39.162133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:39.163019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:39.164259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:39.164796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:39.184741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed807845-e2ee-438e-9fd4-3d3fbf5f2e9d req-b13e17f0-6c9f-4a02-973b-0eae8a209a56 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:39.185264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed807845-e2ee-438e-9fd4-3d3fbf5f2e9d req-b13e17f0-6c9f-4a02-973b-0eae8a209a56 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:39.185695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ed807845-e2ee-438e-9fd4-3d3fbf5f2e9d req-b13e17f0-6c9f-4a02-973b-0eae8a209a56 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:39.189348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:39.228666 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ed807845-e2ee-438e-9fd4-3d3fbf5f2e9d req-b13e17f0-6c9f-4a02-973b-0eae8a209a56 service nova] Creating event network-vif-unplugged:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h2-781139-2 Oct 03 15:08:39.260432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-ed807845-e2ee-438e-9fd4-3d3fbf5f2e9d req-b13e17f0-6c9f-4a02-973b-0eae8a209a56 service nova] Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:08:39.342725 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ed807845-e2ee-438e-9fd4-3d3fbf5f2e9d req-b13e17f0-6c9f-4a02-973b-0eae8a209a56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204338 Oct 03 15:08:39.345359 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3201/6231] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:39.844398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:39.850417 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6f34da3-fa78-4dcd-b41e-c25fe0a2841d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1696 microversion: 2.1 time: 0.726488 Oct 03 15:08:39.854570 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3031/6232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:39 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1696 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:40.352224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-774f3ccc-9d88-4af0-afa1-a6fe1fbcd7ae tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb22b5eaca0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:40.482673 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-774f3ccc-9d88-4af0-afa1-a6fe1fbcd7ae tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6f103484-80e5-4d34-bd78-0227a0ae26ab" status: 200 len: 351 microversion: 2.1 time: 0.144161 Oct 03 15:08:40.483269 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3202/6233] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:08:40 2022] GET /compute/v2.1/os-volumes/6f103484-80e5-4d34-bd78-0227a0ae26ab => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:40.881790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:40.883074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:40.905453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:40.906327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:40.907063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:40.908091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:40.908752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:40.910422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:41.515527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5db7aa92-18da-477a-b1fa-138ff75234ab req-911ac88f-f9d8-4699-a5e3-145f960180ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:41.541732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5db7aa92-18da-477a-b1fa-138ff75234ab req-911ac88f-f9d8-4699-a5e3-145f960180ee service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:41.542239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5db7aa92-18da-477a-b1fa-138ff75234ab req-911ac88f-f9d8-4699-a5e3-145f960180ee service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:41.542814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5db7aa92-18da-477a-b1fa-138ff75234ab req-911ac88f-f9d8-4699-a5e3-145f960180ee service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:41.558123 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5db7aa92-18da-477a-b1fa-138ff75234ab req-911ac88f-f9d8-4699-a5e3-145f960180ee service nova] Creating event network-changed:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h2-781139-2 Oct 03 15:08:41.567937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-5db7aa92-18da-477a-b1fa-138ff75234ab req-911ac88f-f9d8-4699-a5e3-145f960180ee service nova] Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:08:41.588983 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5db7aa92-18da-477a-b1fa-138ff75234ab req-911ac88f-f9d8-4699-a5e3-145f960180ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077509 Oct 03 15:08:41.591210 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3203/6234] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:08:42.904168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:42.912596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=71 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:42.923346 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a9f86d3e-0238-48e9-b893-deb627cdca61 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1696 microversion: 2.1 time: 2.038246 Oct 03 15:08:42.924376 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3032/6235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:40 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1696 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:43.670285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cced100-7b69-4a2f-915e-1ff773543439 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb22b808b80>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:43.791464 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cced100-7b69-4a2f-915e-1ff773543439 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b5aa05d8-f223-4f77-ace0-11e2a5d94904" status: 200 len: 351 microversion: 2.1 time: 0.126291 Oct 03 15:08:43.794293 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3204/6236] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:08:43 2022] GET /compute/v2.1/os-volumes/b5aa05d8-f223-4f77-ace0-11e2a5d94904 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:43.955722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:43.957999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:43.983481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=27 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:43.987426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:43.988112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:43.988555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:43.996689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:43.997237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:43.997683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:44.668901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:44.680167 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bc9e31fb-1f5f-49e6-bf6f-45116ddb92a9 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1694 microversion: 2.1 time: 0.728326 Oct 03 15:08:44.681194 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3033/6237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:43 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1694 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:45.706095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:45.709831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:45.737182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=31 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:45.744617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:45.753444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:45.754004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:45.754780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:45.772691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:45.772691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:45.828857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:08:46.247146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:46.262725 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-70af0461-651c-42e7-b483-9c97220d14a8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1691 microversion: 2.1 time: 0.557539 Oct 03 15:08:46.265531 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3205/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:45 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1691 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:46.303940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:46.304497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:46.320860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:46.323999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:46.324501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:46.328273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:46.339112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:46.340151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:46.710274 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-73398851-bb63-4723-970d-a854e18517f4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action" status: 202 len: 0 microversion: 2.1 time: 0.408033 Oct 03 15:08:46.711678 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3034/6239] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:08:46 2022] POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:08:46.725179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:46.727156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:46.737210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:46.737973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:46.738929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:46.740569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:46.741571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:46.742161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:46.958234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1d7a783-d523-4446-a4da-eb3567a152aa tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb2300a2ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:47.058482 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1d7a783-d523-4446-a4da-eb3567a152aa tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d2485761-681a-45f6-be65-8ab806330dd2" status: 200 len: 350 microversion: 2.1 time: 0.105157 Oct 03 15:08:47.059727 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3035/6240] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 3 15:08:46 2022] GET /compute/v2.1/os-volumes/d2485761-681a-45f6-be65-8ab806330dd2 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:47.077147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0fae3eb6-5a47-44d0-8cbb-36a2a5afb398 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb22b4cdc10>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:47.138428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:47.149052 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0b934fb-a233-4f8e-9925-44aa070d6283 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.432940 Oct 03 15:08:47.158441 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3206/6241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:46 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:47.310247 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0fae3eb6-5a47-44d0-8cbb-36a2a5afb398 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.241103 Oct 03 15:08:47.311600 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3036/6242] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 3 15:08:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:08:47.331679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-355e96d8-36b0-4ff0-8b5c-32a84ce66baa tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb23096fdc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:47.493899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-355e96d8-36b0-4ff0-8b5c-32a84ce66baa tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.165313 Oct 03 15:08:47.502087 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3207/6243] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 3 15:08:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:47.519912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9dcc326f-6f84-4d0e-8c2e-4812489d73bc tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb230304790>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:47.749584 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9dcc326f-6f84-4d0e-8c2e-4812489d73bc tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.234160 Oct 03 15:08:47.759648 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3037/6244] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 3 15:08:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:47.776046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b057d10e-3008-4f69-8126-b04c11702b4a tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb22b531820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:47.938304 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b057d10e-3008-4f69-8126-b04c11702b4a tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.167538 Oct 03 15:08:47.939316 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3208/6245] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 3 15:08:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:47.953801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7cc5ae79-c3cd-400e-b941-30ee01c78584 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb22b520430>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:48.076854 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7cc5ae79-c3cd-400e-b941-30ee01c78584 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127190 Oct 03 15:08:48.089830 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3038/6246] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 3 15:08:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:48.096159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c2e057a-cf87-49c1-8abf-526a88552a42 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb22b531d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:48.200277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:48.201313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:48.213098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:48.213957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:48.214899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:48.216341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:48.218210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:48.219594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:48.490160 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c2e057a-cf87-49c1-8abf-526a88552a42 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.399559 Oct 03 15:08:48.499632 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3209/6247] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 15:08:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:48.506192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5eada4be-52dc-4698-aea7-4e2b5ad7ec3d tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb22b511e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:48.617617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:48.625869 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e93740f8-b141-4ca6-83fa-e6c86cfcf952 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.430254 Oct 03 15:08:48.636249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3039/6248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:48 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:48.643999 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5eada4be-52dc-4698-aea7-4e2b5ad7ec3d tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.142954 Oct 03 15:08:48.645505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3210/6249] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Oct 3 15:08:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:48.663137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-860640c0-d6e6-4cbf-8745-1f37cd0be283 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] Calling method '.version_select at 0x7fb23058a9d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:48.700788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5e55257b-acd6-4c56-b0f6-aa4feff63c94 req-84bfbb2b-23a8-433c-a607-5c7e376cf958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "name": "network-vif-plugged", "status": "completed", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:48.748035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5e55257b-acd6-4c56-b0f6-aa4feff63c94 req-84bfbb2b-23a8-433c-a607-5c7e376cf958 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:48.748521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5e55257b-acd6-4c56-b0f6-aa4feff63c94 req-84bfbb2b-23a8-433c-a607-5c7e376cf958 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:48.755221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5e55257b-acd6-4c56-b0f6-aa4feff63c94 req-84bfbb2b-23a8-433c-a607-5c7e376cf958 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:48.807089 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5e55257b-acd6-4c56-b0f6-aa4feff63c94 req-84bfbb2b-23a8-433c-a607-5c7e376cf958 service nova] Creating event network-vif-plugged:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h2-781139-2 Oct 03 15:08:48.842666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-5e55257b-acd6-4c56-b0f6-aa4feff63c94 req-84bfbb2b-23a8-433c-a607-5c7e376cf958 service nova] Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:08:48.881626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5e55257b-acd6-4c56-b0f6-aa4feff63c94 req-84bfbb2b-23a8-433c-a607-5c7e376cf958 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194953 Oct 03 15:08:48.882839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3211/6250] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:48.942649 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-860640c0-d6e6-4cbf-8745-1f37cd0be283 tempest-VolumesTestJSON-498310874 tempest-VolumesTestJSON-498310874-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.283484 Oct 03 15:08:48.943806 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3040/6251] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 3 15:08:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:08:49.672348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:49.673188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:49.704297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:49.704910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:49.705503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:49.706381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:49.706900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:49.707384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:49.965986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:49.982625 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2cacd784-6f03-4152-9bba-3d5f9e7bea97 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.324022 Oct 03 15:08:50.023320 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3212/6252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:49 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:51.008385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:51.009683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:51.030954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:51.031469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:51.031908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:51.043322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:51.044201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:51.046413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:51.437484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:51.455735 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d866b148-b2e8-44ee-8362-41ff9948ec3d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.450576 Oct 03 15:08:51.462211 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3041/6253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:51 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:52.284131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-10ec65d3-b1f3-4767-8131-cebf1215c283 req-f6e2b0da-98a5-4215-8252-17274df4e7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "name": "network-vif-unplugged", "status": "completed", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:52.316846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10ec65d3-b1f3-4767-8131-cebf1215c283 req-f6e2b0da-98a5-4215-8252-17274df4e7c2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:52.317390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10ec65d3-b1f3-4767-8131-cebf1215c283 req-f6e2b0da-98a5-4215-8252-17274df4e7c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:52.317830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-10ec65d3-b1f3-4767-8131-cebf1215c283 req-f6e2b0da-98a5-4215-8252-17274df4e7c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:52.352206 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-10ec65d3-b1f3-4767-8131-cebf1215c283 req-f6e2b0da-98a5-4215-8252-17274df4e7c2 service nova] Creating event network-vif-unplugged:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:08:52.367800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-10ec65d3-b1f3-4767-8131-cebf1215c283 req-f6e2b0da-98a5-4215-8252-17274df4e7c2 service nova] Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:08:52.397742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-10ec65d3-b1f3-4767-8131-cebf1215c283 req-f6e2b0da-98a5-4215-8252-17274df4e7c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118135 Oct 03 15:08:52.399854 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3213/6254] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:52.490140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:52.492331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:52.515280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:52.515986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:52.516660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:52.518119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:52.518732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:52.519810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:52.989250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:53.020556 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a62dea9-0fa0-4983-b12a-49c441c42688 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.540094 Oct 03 15:08:53.023551 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3042/6255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:52 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:54.055190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:54.055902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:54.066870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:54.071294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:54.071741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:54.074276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:54.074887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:54.075317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:54.444315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:54.454581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3c84b72a-3924-4979-a7e6-1766b361d88d req-8e67507e-848c-4022-b097-25230f74a580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:08:54.461470 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-705a1c12-01da-44ff-bdfe-2ca90a969ff5 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.410753 Oct 03 15:08:54.481294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3c84b72a-3924-4979-a7e6-1766b361d88d req-8e67507e-848c-4022-b097-25230f74a580 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:54.481537 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3214/6256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:54 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:54.482269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3c84b72a-3924-4979-a7e6-1766b361d88d req-8e67507e-848c-4022-b097-25230f74a580 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:54.482754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3c84b72a-3924-4979-a7e6-1766b361d88d req-8e67507e-848c-4022-b097-25230f74a580 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:54.512738 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3c84b72a-3924-4979-a7e6-1766b361d88d req-8e67507e-848c-4022-b097-25230f74a580 service nova] Creating event network-changed:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:08:54.525124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-3c84b72a-3924-4979-a7e6-1766b361d88d req-8e67507e-848c-4022-b097-25230f74a580 service nova] Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:08:54.551451 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3c84b72a-3924-4979-a7e6-1766b361d88d req-8e67507e-848c-4022-b097-25230f74a580 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099442 Oct 03 15:08:54.554985 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3043/6257] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:08:55.491162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:55.492513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:55.502250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:55.502995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:55.504064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:55.505032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:55.506269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:55.507005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:55.812022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:55.834926 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e73b19d-1976-4c83-ae33-e7bd8e1740dc tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.349453 Oct 03 15:08:55.835585 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3215/6258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:55 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:56.862029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:56.862820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:56.887792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:56.888348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:56.888809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:56.892736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:56.893307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:56.895464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:57.185457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:57.196258 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e2c6997d-b14e-4c12-b0c9-e233c830bda0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1690 microversion: 2.1 time: 0.337064 Oct 03 15:08:57.196917 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3044/6259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:56 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1690 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:08:58.227288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:08:58.229216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:08:58.244898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:58.245755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:58.248638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:58.249429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:08:58.249975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:08:58.252245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:08:58.662068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:08:58.675094 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5717381-f58a-4013-9f0f-e1e60e145623 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1683 microversion: 2.1 time: 0.450553 Oct 03 15:08:58.704213 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3216/6260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:08:58 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1683 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:00.790702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c99201e8-1674-448d-b9d1-08ed5f1beb88 req-9f3d60f2-c45e-4fca-852e-6d5547d7057b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "name": "network-vif-plugged", "status": "completed", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:09:00.822159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c99201e8-1674-448d-b9d1-08ed5f1beb88 req-9f3d60f2-c45e-4fca-852e-6d5547d7057b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:00.822566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c99201e8-1674-448d-b9d1-08ed5f1beb88 req-9f3d60f2-c45e-4fca-852e-6d5547d7057b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:00.830464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c99201e8-1674-448d-b9d1-08ed5f1beb88 req-9f3d60f2-c45e-4fca-852e-6d5547d7057b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:00.906860 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c99201e8-1674-448d-b9d1-08ed5f1beb88 req-9f3d60f2-c45e-4fca-852e-6d5547d7057b service nova] Creating event network-vif-plugged:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:09:00.923411 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c99201e8-1674-448d-b9d1-08ed5f1beb88 req-9f3d60f2-c45e-4fca-852e-6d5547d7057b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137356 Oct 03 15:09:00.924601 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3045/6261] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:09:33.026880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:09:33.039735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:33.056103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=15 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:33.059637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=43 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:33.062776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:33.065884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:33.066995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:33.068291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:33.070840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:33.071441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:33.236879 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78cec32a-fc6b-4b24-bc68-c4870c032627 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action" status: 200 len: 63129 microversion: 2.1 time: 0.213701 Oct 03 15:09:33.239454 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3217/6262] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:09:33 2022] POST /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13/action => generated 63129 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:09:49.673560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:49.683382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:49.704829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=19 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:49.705973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:49.706869 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:09:49.707036 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 (ip 10.222.0.20) !!! Oct 03 15:09:49.717674 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:09:49.717870 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 (ip 10.222.0.20) !!! Oct 03 15:09:49.730820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:49.739185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:49.739711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:49.740525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:49.741206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:49.741640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:50.405426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37231d72-7197-45e1-b9e7-2dc83149289d tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1834 microversion: 2.1 time: 0.728990 Oct 03 15:09:50.417082 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3046/6263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:49 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1834 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:54.846392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:54.847809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:54.865307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-4eb66110-d7ca-40b3-ab3d-07173bf5ccff req-cbbb55ef-f874-4b25-af9d-c12c6057e17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:09:54.877178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:54.882069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:09:54.886301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:54.886848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:54.887320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:54.890734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4eb66110-d7ca-40b3-ab3d-07173bf5ccff req-cbbb55ef-f874-4b25-af9d-c12c6057e17c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:54.891508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4eb66110-d7ca-40b3-ab3d-07173bf5ccff req-cbbb55ef-f874-4b25-af9d-c12c6057e17c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:54.892199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4eb66110-d7ca-40b3-ab3d-07173bf5ccff req-cbbb55ef-f874-4b25-af9d-c12c6057e17c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:54.892673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:54.893211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:54.898284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:54.932265 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4eb66110-d7ca-40b3-ab3d-07173bf5ccff req-cbbb55ef-f874-4b25-af9d-c12c6057e17c service nova] Creating event network-changed:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:09:54.945336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-4eb66110-d7ca-40b3-ab3d-07173bf5ccff req-cbbb55ef-f874-4b25-af9d-c12c6057e17c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084024 Oct 03 15:09:54.947238 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3047/6264] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:09:54.963032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:09:55.169998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e760fa74-8060-449c-b52c-0c8294df16a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 204 len: 0 microversion: 2.1 time: 0.328018 Oct 03 15:09:55.170791 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3218/6265] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:09:54 2022] DELETE /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:09:55.180492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:55.181532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:55.192033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:55.199896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:55.200469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:55.201644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:55.204044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:55.209252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:55.637317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:55.652552 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f62d0ac-f9bc-4167-80bf-9926a433e4ca tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1689 microversion: 2.1 time: 0.476227 Oct 03 15:09:55.654005 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3048/6266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:55 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1689 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:56.687393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:56.690814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:56.717787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:56.718286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:56.718735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:56.719459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:56.719912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:56.728344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:57.248361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:57.261713 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14b77d00-bd9c-4323-a6f2-c04602eb9755 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1689 microversion: 2.1 time: 0.585336 Oct 03 15:09:57.263266 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3219/6267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:56 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1689 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:58.296079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:58.297193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:58.316391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:58.331845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:58.333549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:58.335712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:58.349733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:58.350191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:58.489337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:58.489804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:58.490141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:58.500525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lazy-loading 'fault' on Instance uuid c7e67d6d-20c9-4099-8b58-d46f36ae9f13 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:09:58.659165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:09:58.669232 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-331a70b8-7744-451b-96e5-947b5916d83a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 200 len: 1357 microversion: 2.1 time: 0.377665 Oct 03 15:09:58.680325 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3220/6268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:58 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 1357 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:09:58.737433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f3913cc6-e2bf-43d4-b8cf-5ae060aa97c2 req-0923ff9c-dca9-449d-91cf-cf0f454d26f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e67d6d-20c9-4099-8b58-d46f36ae9f13", "name": "network-vif-deleted", "tag": "2e6a4957-d560-4edb-af21-14c5b7ac7941"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:09:58.758396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3913cc6-e2bf-43d4-b8cf-5ae060aa97c2 req-0923ff9c-dca9-449d-91cf-cf0f454d26f2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:58.761735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3913cc6-e2bf-43d4-b8cf-5ae060aa97c2 req-0923ff9c-dca9-449d-91cf-cf0f454d26f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:58.762344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3913cc6-e2bf-43d4-b8cf-5ae060aa97c2 req-0923ff9c-dca9-449d-91cf-cf0f454d26f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:58.783527 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f3913cc6-e2bf-43d4-b8cf-5ae060aa97c2 req-0923ff9c-dca9-449d-91cf-cf0f454d26f2 service nova] Creating event network-vif-deleted:2e6a4957-d560-4edb-af21-14c5b7ac7941 for instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 on n-h1-781139-2 Oct 03 15:09:58.796763 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f3913cc6-e2bf-43d4-b8cf-5ae060aa97c2 req-0923ff9c-dca9-449d-91cf-cf0f454d26f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.749623 Oct 03 15:09:58.801865 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3049/6269] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:09:59.703513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:09:59.704141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: c7e67d6d-20c9-4099-8b58-d46f36ae9f13] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:09:59.717446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:59.717912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:59.718386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:59.719108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:09:59.719724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:09:59.719994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:09:59.789044 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] HTTP exception thrown: Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 could not be found. Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Request method failure captured: Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 HTTP/1.1 Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvmOJMtA3yZ3VRNyDgCMX43zmwjrbdhjvhL8yIgpoK1-95ReIlsj3oT6mmUK5tpwsNEBIm4CZJMr0BJXguTttgilbBtd_BPojnzml0C5A9Tfj2WMYxeUZxJYkZJSdfBB8RuLuj6_29AYcbqeAhxUtqW-1JXUsrxL-EqqaUkvbHQOvtY Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e38fd82ced714172a26f3bd1488ef82f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 74d29217f20d49d8b9ee984c1db2dbdf Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 could not be found. Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c7e67d6d-20c9-4099-8b58-d46f36ae9f13'} Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 could not be found. Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 could not be found. Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:09:59.790695 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 could not be found. Oct 03 15:09:59.794590 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:09:59.801028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Returning 404 to user: Instance c7e67d6d-20c9-4099-8b58-d46f36ae9f13 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:09:59.809907 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c58d6e4a-9257-49c2-b56c-3cfb7fa78292 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13" status: 404 len: 111 microversion: 2.1 time: 0.109068 Oct 03 15:09:59.815450 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3221/6270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:09:59 2022] GET /compute/v2.1/servers/c7e67d6d-20c9-4099-8b58-d46f36ae9f13 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:10:10.662238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ca67cc76-df9a-4ddd-9982-7c3659bcba95 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '.version_select at 0x7fb230d85ca0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:10.673601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:10.674274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=16 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:10.703917 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ca67cc76-df9a-4ddd-9982-7c3659bcba95 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1760489738" status: 202 len: 0 microversion: 2.1 time: 0.069944 Oct 03 15:10:10.705099 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3050/6271] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Oct 3 15:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1760489738 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:10:10.747774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:10.749362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:10.753740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91aefb0d-f682-4e23-92e6-6e88f9781fad tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: .version_select at 0x7fb230231d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-688889151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcDGT4NCH8T8N/6LN0FHMALlZHMZfZ84wAN+SmRj+YPEF/XZr4/rxCraCH3Pg0Ipn9pFAK7vJBiXSrZaW6jrWDFhHJy/RFDf1xCgX8IaMeHgIi+RNzYbCDeLBzyRgA4xg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:10.811738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-91aefb0d-f682-4e23-92e6-6e88f9781fad tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:10:10.822072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-91aefb0d-f682-4e23-92e6-6e88f9781fad tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:10:10.871731 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-91aefb0d-f682-4e23-92e6-6e88f9781fad tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [872bb6e8-db13-48b6-8058-7944b349ec71] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:10:11.881023 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-91aefb0d-f682-4e23-92e6-6e88f9781fad tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [872bb6e8-db13-48b6-8058-7944b349ec71] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45300. Oct 03 15:10:11.914276 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91aefb0d-f682-4e23-92e6-6e88f9781fad tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.164231 Oct 03 15:10:11.916727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3222/6272] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:10:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:10:28.417710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-585077912", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "ea73294d-6e1c-49bc-be57-1594c665f357"}], "key_name": "tempest-TestNetworkAdvancedServerOps-688889151", "security_groups": [{"name": "tempest-secgroup-smoke-1508065070"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:28.482315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:28.771597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] validate_networks() for [('ea73294d-6e1c-49bc-be57-1594c665f357', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:10:30.327938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:10:30.328486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:10:30.328834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:10:30.329274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:10:30.329699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:10:30.347603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:30.348109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:30.348552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:30.350581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:30.351086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:30.352703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:30.396958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:10:30.410554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:10:30.442281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:10:30.444762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:10:30.583631 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c80c51b4-37cc-4fea-b80e-2386a3bf8020 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.169830 Oct 03 15:10:30.590648 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3051/6273] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:10:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:10:30.593857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:30.594551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:30.598998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d6fb700-6aec-484e-8be1-a2f6149e21db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:30.599866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d6fb700-6aec-484e-8be1-a2f6149e21db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:31.475815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d6fb700-6aec-484e-8be1-a2f6149e21db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:31.489527 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d6fb700-6aec-484e-8be1-a2f6149e21db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1265 microversion: 2.1 time: 0.897361 Oct 03 15:10:31.496439 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3223/6274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:30 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1265 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:32.515862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:32.516479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:32.539854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:32.540685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:32.541481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:32.545766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:32.548730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:32.551270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:33.109703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:33.124738 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6925ec54-5dc3-4438-bd38-715612c71f05 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1269 microversion: 2.1 time: 0.608586 Oct 03 15:10:33.130347 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3052/6275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:32 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1269 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:34.152051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:34.152672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:34.171007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:34.171518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:34.171962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:34.172696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:34.173189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:34.173691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:34.431607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:34.443514 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0717aba6-d115-42b3-8961-ddb94a55855b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1323 microversion: 2.1 time: 0.294188 Oct 03 15:10:34.460739 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3224/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:34 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:35.468399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:35.469990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:35.487794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:35.489528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:35.491803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:35.494034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:35.495096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:35.496163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:36.069167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:36.084891 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a4ee3750-6f61-470d-a2bb-62f902f12afe tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.618219 Oct 03 15:10:36.087012 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3053/6277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:35 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:37.063326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-92cd5d88-dfe4-42c6-a1f1-5e44e1960387 req-d077722b-d6fc-4f50-b409-caf8538e3ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:37.098765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92cd5d88-dfe4-42c6-a1f1-5e44e1960387 req-d077722b-d6fc-4f50-b409-caf8538e3ba6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:37.099716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92cd5d88-dfe4-42c6-a1f1-5e44e1960387 req-d077722b-d6fc-4f50-b409-caf8538e3ba6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:37.100380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92cd5d88-dfe4-42c6-a1f1-5e44e1960387 req-d077722b-d6fc-4f50-b409-caf8538e3ba6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:37.112649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:37.114053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:37.133312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:37.135342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:37.137500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:37.139178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:37.142593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:37.143597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:37.147777 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-92cd5d88-dfe4-42c6-a1f1-5e44e1960387 req-d077722b-d6fc-4f50-b409-caf8538e3ba6 service nova] Creating event network-changed:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h2-781139-2 Oct 03 15:10:37.187592 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-92cd5d88-dfe4-42c6-a1f1-5e44e1960387 req-d077722b-d6fc-4f50-b409-caf8538e3ba6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120873 Oct 03 15:10:37.192157 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3225/6278] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:10:37.760435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:37.790331 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dcd66ba1-d05b-442b-be58-f7fadda96a2a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.682338 Oct 03 15:10:37.793367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3054/6279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:37 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:10:38.818613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:38.820039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:38.828867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:38.829704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:38.830393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:38.831400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:38.832078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:38.832983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:39.566389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:39.581470 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0b19231-76f9-4f6a-8aa8-aa3439ca4af2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.762458 Oct 03 15:10:39.583133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3226/6280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:38 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:40.608343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:40.608980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:40.643482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:40.644681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:40.663830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:40.666686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:40.671431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:40.674173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:40.674896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:40.677143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:41.237695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:41.252122 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f614ac0-573b-42b3-a8d9-e46b8e3aece2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.649062 Oct 03 15:10:41.268954 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3055/6281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:40 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:42.285727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:10:42.291961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:42.292851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:42.314195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:42.315138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:42.316684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:42.321325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:42.327448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:42.328851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:43.109521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:43.120377 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e1000f8-29cf-4cab-a829-67d762285f15 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.837852 Oct 03 15:10:43.121000 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3227/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:42 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:44.152975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:44.154423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:44.167817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:44.170056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:44.174644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:44.175895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:44.176571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:44.182199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:44.627712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:44.642085 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5021c8e4-c11a-4bb9-bc9c-2d8ffd5599fa tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.493402 Oct 03 15:10:44.642852 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3056/6283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:44 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:45.640439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9ce433f6-c240-4903-a362-5860c61e285b req-f423c5e3-5f8f-4a23-9b2d-b18725c6cf3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "name": "network-vif-plugged", "status": "completed", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:45.665398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ce433f6-c240-4903-a362-5860c61e285b req-f423c5e3-5f8f-4a23-9b2d-b18725c6cf3c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:45.665879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ce433f6-c240-4903-a362-5860c61e285b req-f423c5e3-5f8f-4a23-9b2d-b18725c6cf3c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:45.666417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9ce433f6-c240-4903-a362-5860c61e285b req-f423c5e3-5f8f-4a23-9b2d-b18725c6cf3c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:45.669229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:45.670858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:45.684618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:45.685062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:45.685527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:45.686253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:45.686704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:45.687132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:45.698213 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9ce433f6-c240-4903-a362-5860c61e285b req-f423c5e3-5f8f-4a23-9b2d-b18725c6cf3c service nova] Creating event network-vif-plugged:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h2-781139-2 Oct 03 15:10:45.719330 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9ce433f6-c240-4903-a362-5860c61e285b req-f423c5e3-5f8f-4a23-9b2d-b18725c6cf3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.503648 Oct 03 15:10:45.724603 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3228/6284] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:10:46.519928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:46.541760 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5b7b731-9887-4dbe-b304-4d37a27ff9af tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.874029 Oct 03 15:10:46.542859 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3057/6285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:45 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:47.585023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:47.585726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:47.622520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:47.624710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:47.629873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:47.635969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:47.637651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:47.640912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:48.349209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:48.362486 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ad2756c-93f8-4139-95f5-f73774241763 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1391 microversion: 2.1 time: 0.782646 Oct 03 15:10:48.363143 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3229/6286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:47 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1391 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:49.397627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:49.399228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:49.418314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:49.418885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:49.425354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:49.426471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:49.426971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:49.427416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:49.745114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:49.756309 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-75bce670-8b80-4a28-986b-c26428099d00 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1563 microversion: 2.1 time: 0.363431 Oct 03 15:10:49.761368 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3058/6287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:49 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1563 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:49.787829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:49.789342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:49.802188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:49.808100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:49.810061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:49.814128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:49.814128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:49.814429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:50.105157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:50.133178 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ed6c5b4-6985-4aaf-8fd3-2accd66fcee2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1563 microversion: 2.1 time: 0.349471 Oct 03 15:10:50.142966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3230/6288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:49 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1563 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:10:56.880497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:10:56.881187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:10:56.891329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:56.892092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:56.892535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:56.905204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4bf43633-a533-412c-b4d2-7b81f15c26cc req-ae108b5e-37a9-4117-a51d-ea462cad5885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:10:56.916071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:56.916607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:56.917094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:56.941858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bf43633-a533-412c-b4d2-7b81f15c26cc req-ae108b5e-37a9-4117-a51d-ea462cad5885 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:10:56.946705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bf43633-a533-412c-b4d2-7b81f15c26cc req-ae108b5e-37a9-4117-a51d-ea462cad5885 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:10:56.950901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bf43633-a533-412c-b4d2-7b81f15c26cc req-ae108b5e-37a9-4117-a51d-ea462cad5885 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:10:57.004401 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4bf43633-a533-412c-b4d2-7b81f15c26cc req-ae108b5e-37a9-4117-a51d-ea462cad5885 service nova] Creating event network-changed:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h2-781139-2 Oct 03 15:10:57.043381 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4bf43633-a533-412c-b4d2-7b81f15c26cc req-ae108b5e-37a9-4117-a51d-ea462cad5885 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121852 Oct 03 15:10:57.045370 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3231/6289] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:10:57.789886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:10:57.831424 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e16b2d47-2b06-4aaa-81f6-b3f5e6264092 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1563 microversion: 2.1 time: 0.955677 Oct 03 15:10:57.835398 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3059/6290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:10:56 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1563 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:12.590879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:12.594561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:12.606366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=20 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:12.611599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:12.662302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:12.662851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:12.663300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:12.670482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:12.671119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:12.671511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:12.766768 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96f0b50f-9d7d-4bc9-8154-7f93ff39a675 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action" status: 200 len: 24568 microversion: 2.1 time: 0.181151 Oct 03 15:11:12.775029 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3232/6291] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:11:12 2022] POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action => generated 24568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:11:19.189020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:19.190382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:19.193545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:19.202445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=50 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:19.209947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:19.210728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:19.211411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:19.212511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:19.213324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:19.214007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:19.390020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:19.400535 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-560e4937-2016-4771-a0af-98b29f00262e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1682 microversion: 2.1 time: 0.217127 Oct 03 15:11:19.401858 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3060/6292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:19 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:19.581162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:19.591649 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:19.612862 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:11:19.613304 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:11:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action (ip 10.222.0.20) !!! Oct 03 15:11:19.616113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:19.619211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:19.619868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:19.621772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:19.622991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:19.624561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:19.753201 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26970d09-41bc-41a1-925e-f0b0433dd50e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action" status: 200 len: 32643 microversion: 2.1 time: 0.177917 Oct 03 15:11:19.755795 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3233/6293] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:11:19 2022] POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action => generated 32643 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:11:19.988500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:19.989585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:20.024344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:20.026105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:20.026560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:20.030475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:20.031052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:20.032507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:20.320748 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6400889e-8f70-4bac-b8c0-4e00778d7183 tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1833 microversion: 2.1 time: 0.344582 Oct 03 15:11:20.323999 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3061/6294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:19 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1833 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:20.370455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:20.376763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:20.402653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:20.404152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:20.407305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:20.409600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:20.413023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:20.413795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:20.492656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lazy-loading 'flavor' on Instance uuid 3ec749c7-4ce8-42b3-8680-a77dedd53f0f {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:11:20.541990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Going to try to live migrate instance to another host {{(pid=128869) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 03 15:11:26.968107 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-034a4e25-7902-482a-acbf-1f6820300c5c tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action" status: 202 len: 0 microversion: 2.1 time: 6.604156 Oct 03 15:11:26.969217 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3234/6295] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:11:20 2022] POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action => generated 0 bytes in 6607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:11:26.979559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:26.980499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:26.994369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:26.995046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:26.997288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:27.003013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:27.003789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:27.004542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:27.798172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:27.817376 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e8567ace-2c25-442e-b5cb-6acfe030bf08 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.833803 Oct 03 15:11:27.820379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3062/6296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:26 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:28.848628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:28.849282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:28.866211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:28.866700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:28.867140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:28.867852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:28.868484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:28.869117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:29.331262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:29.343898 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b4c9e39-d3e9-4b7a-ad94-4a65973c7085 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.499785 Oct 03 15:11:29.370903 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3235/6297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:28 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:30.373658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:30.374271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:30.382466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:30.383173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:30.384193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:30.385028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:30.386270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:30.386950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:30.930333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:30.944728 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4d32c5d3-c689-4730-8bb7-9108afcbed6d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.576662 Oct 03 15:11:30.945794 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3063/6298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:30 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:31.969671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:31.970373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:31.992051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:31.992756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:31.993510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:31.996218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:31.999077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:32.000168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:32.310154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:32.336428 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-047357f6-971d-44e9-b094-4e7c5fcd6da1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.371274 Oct 03 15:11:32.350078 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3236/6299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:31 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:32.510891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-577b41d4-34cc-44aa-9c7f-f910131bac42 req-b3c10f9a-b437-4c04-accb-b8674f3dc610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:32.533661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-577b41d4-34cc-44aa-9c7f-f910131bac42 req-b3c10f9a-b437-4c04-accb-b8674f3dc610 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:32.534517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-577b41d4-34cc-44aa-9c7f-f910131bac42 req-b3c10f9a-b437-4c04-accb-b8674f3dc610 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:32.537540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-577b41d4-34cc-44aa-9c7f-f910131bac42 req-b3c10f9a-b437-4c04-accb-b8674f3dc610 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:32.571950 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-577b41d4-34cc-44aa-9c7f-f910131bac42 req-b3c10f9a-b437-4c04-accb-b8674f3dc610 service nova] Creating event network-vif-unplugged:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h2-781139-2 Oct 03 15:11:32.581318 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-577b41d4-34cc-44aa-9c7f-f910131bac42 req-b3c10f9a-b437-4c04-accb-b8674f3dc610 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073942 Oct 03 15:11:32.582611 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3064/6300] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:11:33.366150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:33.367527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:33.377351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:33.378111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:33.379875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:33.381710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:33.382394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:33.383278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:33.667953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:33.678382 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd9f8855-8103-41da-85b1-0acfb9f31ce7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.315375 Oct 03 15:11:33.679653 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3237/6301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:33 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:34.607593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-27ffde67-5b8b-4349-ae80-61f4e20f8e59 req-3a90d795-1b87-47c1-a332-505f03aa2072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:34.632187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-27ffde67-5b8b-4349-ae80-61f4e20f8e59 req-3a90d795-1b87-47c1-a332-505f03aa2072 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:34.633140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-27ffde67-5b8b-4349-ae80-61f4e20f8e59 req-3a90d795-1b87-47c1-a332-505f03aa2072 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:34.633807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-27ffde67-5b8b-4349-ae80-61f4e20f8e59 req-3a90d795-1b87-47c1-a332-505f03aa2072 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:34.663259 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-27ffde67-5b8b-4349-ae80-61f4e20f8e59 req-3a90d795-1b87-47c1-a332-505f03aa2072 service nova] Creating event network-changed:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h2-781139-2 Oct 03 15:11:34.673462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-27ffde67-5b8b-4349-ae80-61f4e20f8e59 req-3a90d795-1b87-47c1-a332-505f03aa2072 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070069 Oct 03 15:11:34.677759 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3065/6302] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:11:34.710454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:34.712702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:34.739460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:34.741332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:34.742863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:34.744527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:34.745280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:34.745916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:35.221807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:35.230584 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d971468-3318-48fe-ad2f-607dddb2dbde tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.530615 Oct 03 15:11:35.254797 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3238/6303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:34 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:36.263890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:36.265617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:36.278442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:36.278946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:36.279380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:36.286650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:36.287516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:36.288139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:36.572320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:36.581413 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fc230baa-fb9d-4d28-812e-4c3c596f5200 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.322018 Oct 03 15:11:36.582014 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3066/6304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:36 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:37.610509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:37.611675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:37.627461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:37.628006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:37.629430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:37.630933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:37.631393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:37.631818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:38.058290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:38.069154 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-410a5711-e6d5-4ec2-a455-22e422bd5ade tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.463686 Oct 03 15:11:38.080422 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3239/6305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:37 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:39.093762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:39.094410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:39.113347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:39.117309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:39.118279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:39.120998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:39.121743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:39.129773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:39.778465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:39.792547 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33004fe2-0856-4c97-a9de-c15b8682542f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.702013 Oct 03 15:11:39.793962 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3067/6306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:39 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:40.824216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:40.826369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:40.835621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:40.836423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:40.836870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:40.838042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:40.838489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:40.839110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:41.062052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:41.074018 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9aec02a1-3eeb-446b-9f46-bae43e8c0e38 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.260761 Oct 03 15:11:41.087420 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3240/6307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:40 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:41.260367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e8c23099-6cad-4823-9e5d-e7f54a58c4de tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Action: 'create', calling method: .version_select at 0x7fb22b496790>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1639198808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL1cXjFqnAWdddYp1bq61G+XueQb9zp/qMcl06pz5ygnSXHaESn8b994UyWiKulikvVt/9mjyBeB25N/QUdlDZD8dG3uTwQO/z9/T9RgiF/YLUeftLvlZEQXXbLW6fJtQ=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:41.298227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e8c23099-6cad-4823-9e5d-e7f54a58c4de tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Getting quotas for project f4bbb8a22f164693bbb7988bf33b53eb. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:11:41.324392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e8c23099-6cad-4823-9e5d-e7f54a58c4de tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Getting quotas for user a2924706c8894ab28221128d00352c4d and project f4bbb8a22f164693bbb7988bf33b53eb. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:11:41.403667 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e8c23099-6cad-4823-9e5d-e7f54a58c4de tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.147200 Oct 03 15:11:41.404581 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3068/6308] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:11:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:11:42.105166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:42.106900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:42.122934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:42.123712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:42.127438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:42.128455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:42.129161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:42.129807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:42.433631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:42.446333 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e09b608-d9be-4a1c-9cfb-9991777622ee tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.348875 Oct 03 15:11:42.460190 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3241/6309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:42 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:43.472195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:43.473600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:43.491138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:43.493836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:43.494550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:43.505271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:43.508027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:43.508722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:43.821602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:43.852097 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-443e37f7-f583-4983-a97a-b0913407881f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.381028 Oct 03 15:11:43.852963 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3069/6310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:43 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:44.547907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1933334195", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d5fc7a5f-806e-46d0-8873-c3f090dc9bd8", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1639198808", "security_groups": [{"name": "tempest-secgroup-smoke-660109492"}], "networks": [{"uuid": "1f9dfcb3-5cf5-445c-b78a-8d18f7a7a19d"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:44.586340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:44.885546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:44.886914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:44.890985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] validate_networks() for [('1f9dfcb3-5cf5-445c-b78a-8d18f7a7a19d', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:11:44.908555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:44.910355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:44.911303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:44.912524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:44.913266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:44.913920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:45.573805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:45.585808 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76230962-ad2c-4ced-9ae8-9cd14da81957 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1692 microversion: 2.1 time: 0.704453 Oct 03 15:11:45.590129 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3070/6311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:44 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1692 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:46.158611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:11:46.159073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:11:46.159610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:11:46.160162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:11:46.160714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:11:46.180809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:46.181695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:46.182359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:46.183316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:46.183976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:46.184605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:46.196380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:46.216769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Getting quotas for project f4bbb8a22f164693bbb7988bf33b53eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:11:46.228221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Getting quotas for user a2924706c8894ab28221128d00352c4d and project f4bbb8a22f164693bbb7988bf33b53eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:11:46.333683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:11:46.336170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5fc7a5f-806e-46d0-8873-c3f090dc9bd8',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:11:46.581313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4da0b97a-2e51-48bb-8bc3-da3f7daa2da8 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.037680 Oct 03 15:11:46.601606 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3242/6312] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:11:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:11:46.611911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e86d936f-04f5-4fc8-9c2e-f4550c2d7120 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:46.612524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e86d936f-04f5-4fc8-9c2e-f4550c2d7120 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:46.619205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:46.619819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:46.679096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:46.679596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:46.680033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:46.680758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:46.682944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:46.683378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:46.758145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e86d936f-04f5-4fc8-9c2e-f4550c2d7120 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:46.771745 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e86d936f-04f5-4fc8-9c2e-f4550c2d7120 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1099 microversion: 2.1 time: 0.163381 Oct 03 15:11:46.773899 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3071/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:46 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1099 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:47.035506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:47.052415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78355dab-9194-4692-9c7b-34f715348af8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1682 microversion: 2.1 time: 0.438154 Oct 03 15:11:47.054552 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3243/6314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:46 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1682 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:47.077847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:47.078804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:47.093910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:47.095234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:47.096832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:47.097714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:47.098977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:47.099687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:47.597361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0c798b5f-a44a-4489-9e1f-8751c916f8bc req-8cfd2e55-3a05-4cb8-9a88-b4ca3a265c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "name": "network-vif-plugged", "status": "completed", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:47.630792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c798b5f-a44a-4489-9e1f-8751c916f8bc req-8cfd2e55-3a05-4cb8-9a88-b4ca3a265c2f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:47.631276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c798b5f-a44a-4489-9e1f-8751c916f8bc req-8cfd2e55-3a05-4cb8-9a88-b4ca3a265c2f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:47.631709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0c798b5f-a44a-4489-9e1f-8751c916f8bc req-8cfd2e55-3a05-4cb8-9a88-b4ca3a265c2f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:47.665948 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0c798b5f-a44a-4489-9e1f-8751c916f8bc req-8cfd2e55-3a05-4cb8-9a88-b4ca3a265c2f service nova] Creating event network-vif-plugged:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h1-781139-2 Oct 03 15:11:47.668128 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5e8bc0df-a73d-4201-9e1f-304cbeec046a tempest-TestNetworkAdvancedServerOps-1648071447 tempest-TestNetworkAdvancedServerOps-1648071447-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1833 microversion: 2.1 time: 0.594746 Oct 03 15:11:47.671580 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3072/6315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:47 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1833 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:47.687748 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0c798b5f-a44a-4489-9e1f-8751c916f8bc req-8cfd2e55-3a05-4cb8-9a88-b4ca3a265c2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094614 Oct 03 15:11:47.693793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:47.694433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:47.695182 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3244/6316] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:11:47.700840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:47.701374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:47.701818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:47.702797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:47.703366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:47.703802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:47.797760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:47.798468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:47.818180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:47.819547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:47.820168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:47.821088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:47.821687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:47.822258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:47.939452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:47.949486 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2fa5c815-62ed-4d9f-97c7-4fef7373330e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1197 microversion: 2.1 time: 0.157255 Oct 03 15:11:47.950686 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3245/6317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:47 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:48.049157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:48.057942 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ab39fa13-aba1-481a-bdc5-35754450b8db tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1682 microversion: 2.1 time: 0.368409 Oct 03 15:11:48.058804 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3073/6318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:47 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1682 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:48.217395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:48.220061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:48.228691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:48.229475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:48.230131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:48.231244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:48.232257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:48.232879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:48.333179 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86980e97-9a13-416b-b9de-263c9f6b3d12 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action" status: 200 len: 38623 microversion: 2.1 time: 0.120387 Oct 03 15:11:48.334520 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3246/6319] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:11:48 2022] POST /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f/action => generated 38623 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:11:48.977234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:48.978197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:49.004013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:49.004724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:49.005220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:49.005990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:49.006460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:49.006877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:49.197781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:49.208099 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7edf8799-60ae-4c58-8e09-497dfdd70e65 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1215 microversion: 2.1 time: 0.235007 Oct 03 15:11:49.213257 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3074/6320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:48 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1215 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:50.235552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:50.236269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:50.255826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:50.256390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:50.256845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:50.257828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:50.260168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:50.260657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:51.191235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-516c5e8f-4731-4ccf-ac9d-5aad3f397892 req-e530e2fa-bc12-4bcd-bc87-b0d3ec018905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325ba6cd-1639-47d9-99f7-cc2114676c3c", "tag": "b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:51.207633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:51.218312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-516c5e8f-4731-4ccf-ac9d-5aad3f397892 req-e530e2fa-bc12-4bcd-bc87-b0d3ec018905 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:51.218825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-516c5e8f-4731-4ccf-ac9d-5aad3f397892 req-e530e2fa-bc12-4bcd-bc87-b0d3ec018905 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:51.242567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-516c5e8f-4731-4ccf-ac9d-5aad3f397892 req-e530e2fa-bc12-4bcd-bc87-b0d3ec018905 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:51.244199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:51.255707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=71 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:51.260846 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-11bf891e-496d-4606-b5f6-29d110dfc870 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1282 microversion: 2.1 time: 1.030865 Oct 03 15:11:51.277977 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3247/6321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:50 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1282 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:51.286313 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-516c5e8f-4731-4ccf-ac9d-5aad3f397892 req-e530e2fa-bc12-4bcd-bc87-b0d3ec018905 service nova] Creating event network-changed:b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3 for instance 325ba6cd-1639-47d9-99f7-cc2114676c3c on n-h1-781139-2 Oct 03 15:11:51.302585 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-516c5e8f-4731-4ccf-ac9d-5aad3f397892 req-e530e2fa-bc12-4bcd-bc87-b0d3ec018905 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114718 Oct 03 15:11:51.303957 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3075/6322] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:11:52.147620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:52.148256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:52.164879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:52.165931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:52.166404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:52.169136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:52.171471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:52.172155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:52.246533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:11:52.476394 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0735407-837d-4d1f-8e35-f2b009032e4a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 204 len: 0 microversion: 2.1 time: 0.334369 Oct 03 15:11:52.479348 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3248/6323] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:11:52 2022] DELETE /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:11:52.492441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:52.494664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:52.511971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:52.512888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:52.516311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:52.519672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:52.520752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:52.521445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:52.558398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6cb121b1-42a4-4923-8974-ea4fd55a9a46 req-64fe66a8-3a09-407f-916a-94da468a60f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:52.589131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cb121b1-42a4-4923-8974-ea4fd55a9a46 req-64fe66a8-3a09-407f-916a-94da468a60f6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:52.593456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cb121b1-42a4-4923-8974-ea4fd55a9a46 req-64fe66a8-3a09-407f-916a-94da468a60f6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:52.594307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6cb121b1-42a4-4923-8974-ea4fd55a9a46 req-64fe66a8-3a09-407f-916a-94da468a60f6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:52.624501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6cb121b1-42a4-4923-8974-ea4fd55a9a46 req-64fe66a8-3a09-407f-916a-94da468a60f6 service nova] Creating event network-changed:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h1-781139-2 Oct 03 15:11:52.642836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6cb121b1-42a4-4923-8974-ea4fd55a9a46 req-64fe66a8-3a09-407f-916a-94da468a60f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.495893 Oct 03 15:11:52.643998 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3076/6324] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:11:52.649502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:52.654612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:52.672040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:52.672729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:52.673303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:52.674213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:52.674792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:52.675321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:52.884256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:52.902786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27ed511a-0a5b-45db-b6eb-d86ac821bc4d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1282 microversion: 2.1 time: 0.421560 Oct 03 15:11:52.903382 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3249/6325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:52 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1282 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:53.444390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:53.453338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-86eb3cec-5001-40f2-b03a-284d5e4056ed tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1688 microversion: 2.1 time: 0.807837 Oct 03 15:11:53.460794 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3077/6326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:52 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1688 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:53.927198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:53.930957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:53.945032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:53.945524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:53.945959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:53.946674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:53.947123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:53.947540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:54.460617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:54.469008 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22b5c437-ddf6-4d3d-af35-68299f1a4fdf tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1282 microversion: 2.1 time: 0.546120 Oct 03 15:11:54.469606 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3250/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:53 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1282 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:54.484588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:54.485249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:54.498343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:54.499485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:54.501007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:54.502495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:54.503247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:54.504994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:54.763952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fabe07ad-fb4a-48ea-864d-ffe1f6e6cc7f req-b3268987-e118-44fc-bb9c-6834cd50fb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec749c7-4ce8-42b3-8680-a77dedd53f0f", "name": "network-vif-deleted", "tag": "8d6c5725-dece-4219-9442-11ae821decec"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:11:54.776995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fabe07ad-fb4a-48ea-864d-ffe1f6e6cc7f req-b3268987-e118-44fc-bb9c-6834cd50fb33 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:54.781446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fabe07ad-fb4a-48ea-864d-ffe1f6e6cc7f req-b3268987-e118-44fc-bb9c-6834cd50fb33 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:54.782295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fabe07ad-fb4a-48ea-864d-ffe1f6e6cc7f req-b3268987-e118-44fc-bb9c-6834cd50fb33 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:54.817103 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fabe07ad-fb4a-48ea-864d-ffe1f6e6cc7f req-b3268987-e118-44fc-bb9c-6834cd50fb33 service nova] Creating event network-vif-deleted:8d6c5725-dece-4219-9442-11ae821decec for instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f on n-h1-781139-2 Oct 03 15:11:54.834251 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fabe07ad-fb4a-48ea-864d-ffe1f6e6cc7f req-b3268987-e118-44fc-bb9c-6834cd50fb33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074136 Oct 03 15:11:54.835221 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3251/6328] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:11:55.063311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:55.071769 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f56e623-49db-43ed-b96e-66eeee88f690 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 200 len: 1620 microversion: 2.1 time: 0.592895 Oct 03 15:11:55.087941 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3078/6329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:54 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 1620 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:55.497660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:55.501811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:55.510577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:55.511399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:55.511987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:55.512852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:55.513578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:55.514252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:55.953895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:55.965572 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-610d3f10-e781-4a89-94bd-a5d15f23f826 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1282 microversion: 2.1 time: 0.473174 Oct 03 15:11:55.976954 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3252/6330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:55 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1282 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:56.098465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:56.099766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: 3ec749c7-4ce8-42b3-8680-a77dedd53f0f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:56.114106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:56.114964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:56.115599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:56.116635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:56.117924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:56.118424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:56.134591 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] HTTP exception thrown: Instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f could not be found. Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Request method failure captured: Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f HTTP/1.1 Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvmOJMtA3yZ3VRNyDgCMX43zmwjrbdhjvhL8yIgpoK1-95ReIlsj3oT6mmUK5tpwsNEBIm4CZJMr0BJXguTttgilbBtd_BPojnzml0C5A9Tfj2WMYxeUZxJYkZJSdfBB8RuLuj6_29AYcbqeAhxUtqW-1JXUsrxL-EqqaUkvbHQOvtY Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e38fd82ced714172a26f3bd1488ef82f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 74d29217f20d49d8b9ee984c1db2dbdf Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f could not be found. Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3ec749c7-4ce8-42b3-8680-a77dedd53f0f'} Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f could not be found. Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f could not be found. Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:11:56.136739 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f could not be found. Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Returning 404 to user: Instance 3ec749c7-4ce8-42b3-8680-a77dedd53f0f could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:11:56.141466 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5777b72c-f506-4d90-b7a0-d2a7edff2dbd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f" status: 404 len: 111 microversion: 2.1 time: 0.048393 Oct 03 15:11:56.145534 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3079/6331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:56 2022] GET /compute/v2.1/servers/3ec749c7-4ce8-42b3-8680-a77dedd53f0f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:11:56.994824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:56.997963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:57.001855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:57.003033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:57.016236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:57.017136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:57.018008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:57.020423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:57.021657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:57.022313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:57.398980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:57.411486 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dace77ab-25d5-49d4-9847-17739e9d53d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1282 microversion: 2.1 time: 0.424712 Oct 03 15:11:57.412534 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3253/6332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:56 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1282 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:58.435261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:58.437219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:58.451605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:11:58.452010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:58.452358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:58.456797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:58.461349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:58.461845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:58.463474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:58.741461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:11:58.751993 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-757b51b6-53b3-41fe-ae42-3fc2c14ed364 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1282 microversion: 2.1 time: 0.320792 Oct 03 15:11:58.756075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3080/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:58 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1282 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:11:59.779589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:11:59.781405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:11:59.793456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:59.798980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:59.800048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:11:59.801378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:11:59.802024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:11:59.803986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:00.540209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:00.557071 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5eba6c39-765f-4e73-9e49-3e6939d55c38 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.776392 Oct 03 15:12:00.558746 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3254/6334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:11:59 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:01.579865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:01.580469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:01.612450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:01.612450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:01.612450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:01.612450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:01.612450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:01.612450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:02.036423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:02.056209 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-75909ce4-9db0-46ff-b800-aa9a5d4bbcd5 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.476534 Oct 03 15:12:02.056916 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3081/6335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:01 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:02.818146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-560cd861-71cd-45b1-a9ed-37c527a9c8e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '.version_select at 0x7fb22b529550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:02.872627 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-560cd861-71cd-45b1-a9ed-37c527a9c8e4 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-688889151" status: 202 len: 0 microversion: 2.1 time: 0.058823 Oct 03 15:12:02.873748 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3255/6336] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 3 15:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-688889151 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:12:02.906279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50062a90-02ff-4e2b-81b0-405e1f84e099 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: .version_select at 0x7fb22b4d8280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1302075171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEobhCBiXFHYIFmCTRIbisHgBS5XopUHNWdOkFncD8GIK5y9DOh+/3D4jwH+J6nOO0gbv6ivDesGtNwo4xVkKsUHP8jziau5/SMJRLEJtdClHtlMqVdbpMq9uPllHWBh7g=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:02.930800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-50062a90-02ff-4e2b-81b0-405e1f84e099 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:12:02.937491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-50062a90-02ff-4e2b-81b0-405e1f84e099 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:12:02.969262 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50062a90-02ff-4e2b-81b0-405e1f84e099 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.068807 Oct 03 15:12:02.969883 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3082/6337] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:12:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:12:03.078583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:03.079506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:03.085820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:03.086530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:03.087120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:03.088007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:03.088629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:03.089229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:03.315653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:03.331739 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0677980b-149a-4b99-aa23-d7b34fac22d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.254407 Oct 03 15:12:03.333237 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3256/6338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:03 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:04.360286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:04.361739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:04.370264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:04.371137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:04.371797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:04.372754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:04.373840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:04.374545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:04.801234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:04.807825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17d10543-c92f-4639-b05e-4e2b9e2044ed tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.453380 Oct 03 15:12:04.809176 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3083/6339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:04 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:05.835706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:05.836534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:05.844858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:05.845428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:05.846267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:05.847001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:05.847540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:05.854410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:06.155152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:06.181021 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d8081909-b094-42c7-983c-bcb7c5f74421 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.349909 Oct 03 15:12:06.184514 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3257/6340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:05 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:07.204422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:07.205674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:07.233272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:07.233928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:07.234466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:07.238673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:07.240144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:07.243691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:07.726104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:07.757028 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b5e7828d-b155-4730-b94f-8da28e9b322d tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.557055 Oct 03 15:12:07.760805 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3084/6341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:07 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:08.787185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:08.787557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:08.801886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:08.802714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:08.802900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:08.803664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:08.808841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:08.809586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:09.113450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:09.126788 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6194835-4684-4ef9-9e7d-99956ad0c838 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.346786 Oct 03 15:12:09.127817 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3258/6342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:08 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:10.150027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:10.150649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:10.168547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:10.169249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:10.170244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:10.174389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:10.175057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:10.175667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:10.759757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:10.770493 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34a607d5-f906-4d83-abf8-cb4ac5574a82 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.624331 Oct 03 15:12:10.773285 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3085/6343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:10 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:11.798459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:11.800248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:11.829336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:11.833198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:11.834963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:11.835921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:11.836538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:11.837293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:12.227598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:12.241290 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ce1eb3f-3258-4c4f-8682-9ce49390a990 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.447781 Oct 03 15:12:12.242220 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3259/6344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:11 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:13.262583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:13.276269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:13.277250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:13.315491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:13.329194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:13.332288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:13.349386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:13.349904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:13.354312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:13.855107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:13.893667 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2882a9bf-ddc7-47e3-a701-bee600a0a5fb tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.625570 Oct 03 15:12:13.905697 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3086/6345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:13 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:14.727393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-62b64e79-74d5-4775-ab92-539893978134 req-5b05fc53-b770-41c6-ab6b-4c686eb4e517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325ba6cd-1639-47d9-99f7-cc2114676c3c", "name": "network-vif-plugged", "status": "completed", "tag": "b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:14.757001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:14.760313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62b64e79-74d5-4775-ab92-539893978134 req-5b05fc53-b770-41c6-ab6b-4c686eb4e517 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:14.760832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62b64e79-74d5-4775-ab92-539893978134 req-5b05fc53-b770-41c6-ab6b-4c686eb4e517 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:14.761303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-62b64e79-74d5-4775-ab92-539893978134 req-5b05fc53-b770-41c6-ab6b-4c686eb4e517 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:14.812756 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-62b64e79-74d5-4775-ab92-539893978134 req-5b05fc53-b770-41c6-ab6b-4c686eb4e517 service nova] Creating event network-vif-plugged:b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3 for instance 325ba6cd-1639-47d9-99f7-cc2114676c3c on n-h1-781139-2 Oct 03 15:12:14.821776 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-62b64e79-74d5-4775-ab92-539893978134 req-5b05fc53-b770-41c6-ab6b-4c686eb4e517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098260 Oct 03 15:12:14.824098 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3260/6346] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:12:14.917897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:14.918524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:14.953206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2008203229", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "b7d4c24d-5c85-4e33-af25-e1b0f3763b99"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1302075171", "security_groups": [{"name": "tempest-secgroup-smoke-1971026547"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:14.962991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:14.963485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:14.969173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:14.970319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:14.971030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:14.971675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:15.146594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] validate_networks() for [('b7d4c24d-5c85-4e33-af25-e1b0f3763b99', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:12:16.008994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:12:16.016046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:12:16.016163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:12:16.016511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:12:16.016977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:12:16.063856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:16.065613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:16.068530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:16.072327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:16.083250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:16.084129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:16.119635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:16.169140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:12:16.186969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Getting quotas for user 74d29217f20d49d8b9ee984c1db2dbdf and project e38fd82ced714172a26f3bd1488ef82f. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:12:16.278963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:16.294234 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-08e21888-e291-40d4-bd55-25c8a23c3a07 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 1.380988 Oct 03 15:12:16.317889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3087/6347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:14 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:16.327461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:12:16.330012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:12:16.446936 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e27349b6-3559-426c-ab24-dd62bf13212c tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.503989 Oct 03 15:12:16.447620 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3261/6348] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:12:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:12:16.459501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6287c7f-f246-4365-81ca-d549f24c00a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:16.460132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6287c7f-f246-4365-81ca-d549f24c00a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:16.768574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e6287c7f-f246-4365-81ca-d549f24c00a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:16.776225 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6287c7f-f246-4365-81ca-d549f24c00a2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1267 microversion: 2.1 time: 0.320636 Oct 03 15:12:16.780324 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3088/6349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:16 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1267 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:17.331357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:17.331986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:17.362120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:17.362634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:17.363084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:17.363812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:17.364265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:17.364694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:17.812866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:17.845345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:17.873781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:17.946368 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4daed00e-980b-4f17-973d-5aaf5d811b16 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1270 microversion: 2.1 time: 0.618626 Oct 03 15:12:17.952774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:17.957048 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3262/6350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:17 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1270 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:17.958819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:17.963504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:17.966574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:17.968363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:17.969496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:18.235304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:18.247088 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8dd7fa0-e6cb-4d75-8ef0-9bded9e1f0b1 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1263 microversion: 2.1 time: 0.442645 Oct 03 15:12:18.262482 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3089/6351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:17 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1263 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:18.974912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:18.975568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:18.993488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:18.993991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:18.994425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:18.995146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:18.995617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:19.001832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:19.277878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:19.278532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:19.302838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:19.303355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:19.303806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:19.304544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:19.314051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:19.316034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:19.553341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:19.563759 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05bb4ca2-5fc8-42c8-abe6-d7b9024fe39e tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1459 microversion: 2.1 time: 0.593601 Oct 03 15:12:19.569865 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3263/6352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:18 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1459 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:19.597913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:19.598669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:19.609902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:19.613066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:19.613585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:19.614655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:19.616618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:19.617383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:19.635196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:19.654368 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d6545e1-6811-41e8-9183-2c93b3961c29 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1325 microversion: 2.1 time: 0.382622 Oct 03 15:12:19.676097 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3090/6353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:19 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1325 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:20.473317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:20.486351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7b68d3e5-19e2-481e-907d-37eeb17f0f94 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1459 microversion: 2.1 time: 0.893096 Oct 03 15:12:20.497873 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3264/6354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:19 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1459 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:20.681268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:20.681885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:20.706209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:20.717066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:20.721689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:20.722771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:20.724670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:20.731064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:20.920784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:20.933760 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d54cf155-3ffa-4d4b-ad38-cabc2e866b22 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1325 microversion: 2.1 time: 0.257077 Oct 03 15:12:20.951659 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3091/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:20 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:21.963270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:21.963892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:21.982037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:21.982552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:21.982997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:21.983721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:21.984175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:21.984594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:22.708597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:22.724427 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c15931d-9b5b-4fff-83bb-b37ebf7cc2a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1393 microversion: 2.1 time: 0.764555 Oct 03 15:12:22.725071 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3265/6356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:21 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1393 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:23.751288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:23.752648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:23.760672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:23.781428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:23.786327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:23.787085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:23.791965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:23.792757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:23.793405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:23.805890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=78 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:24.154857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-be848c8a-c530-4c6f-9a7e-efa9d7f6e833 req-abc40f49-f33e-4369-a246-8ca0bc2f8102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac190084-cb73-4d8e-af0a-12e7ded30dbb", "tag": "b6d7e36e-1eaf-4601-8509-04d1a9309b45"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:24.208646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-be848c8a-c530-4c6f-9a7e-efa9d7f6e833 req-abc40f49-f33e-4369-a246-8ca0bc2f8102 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:24.209162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-be848c8a-c530-4c6f-9a7e-efa9d7f6e833 req-abc40f49-f33e-4369-a246-8ca0bc2f8102 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:24.219009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-be848c8a-c530-4c6f-9a7e-efa9d7f6e833 req-abc40f49-f33e-4369-a246-8ca0bc2f8102 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:24.220739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:24.229741 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2ec4130-3c35-4f83-b556-b73b01892f6a tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1393 microversion: 2.1 time: 0.483114 Oct 03 15:12:24.236526 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3092/6357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:23 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1393 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:12:24.272235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-be848c8a-c530-4c6f-9a7e-efa9d7f6e833 req-abc40f49-f33e-4369-a246-8ca0bc2f8102 service nova] Creating event network-changed:b6d7e36e-1eaf-4601-8509-04d1a9309b45 for instance ac190084-cb73-4d8e-af0a-12e7ded30dbb on n-h2-781139-2 Oct 03 15:12:24.278025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-be848c8a-c530-4c6f-9a7e-efa9d7f6e833 req-abc40f49-f33e-4369-a246-8ca0bc2f8102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128020 Oct 03 15:12:24.289328 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3266/6358] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:12:25.262824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:25.263969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:25.274778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:25.277664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:25.278328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:25.281276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:25.281923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:25.282543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:25.666527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:25.681317 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8463cb73-d3bb-4613-bd22-1a646f3b3017 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1393 microversion: 2.1 time: 0.420623 Oct 03 15:12:25.682218 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3093/6359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:25 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1393 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:25.867370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6a1949cd-c276-4e65-a41d-c25bf725692e req-c14a0521-6a72-4aa6-bb51-8f1d23f1db4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325ba6cd-1639-47d9-99f7-cc2114676c3c", "tag": "b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:25.884018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a1949cd-c276-4e65-a41d-c25bf725692e req-c14a0521-6a72-4aa6-bb51-8f1d23f1db4a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:25.884513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a1949cd-c276-4e65-a41d-c25bf725692e req-c14a0521-6a72-4aa6-bb51-8f1d23f1db4a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:25.884982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6a1949cd-c276-4e65-a41d-c25bf725692e req-c14a0521-6a72-4aa6-bb51-8f1d23f1db4a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:25.901148 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6a1949cd-c276-4e65-a41d-c25bf725692e req-c14a0521-6a72-4aa6-bb51-8f1d23f1db4a service nova] Creating event network-changed:b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3 for instance 325ba6cd-1639-47d9-99f7-cc2114676c3c on n-h1-781139-2 Oct 03 15:12:25.924117 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6a1949cd-c276-4e65-a41d-c25bf725692e req-c14a0521-6a72-4aa6-bb51-8f1d23f1db4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059756 Oct 03 15:12:25.927147 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3267/6360] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:12:26.711209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:26.711824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:26.726906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:26.727403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:26.728026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:26.728900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:26.734049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:26.734693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:26.775309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:27.890920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:27.905238 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c044ba20-0990-4890-a719-6864a594ae76 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1393 microversion: 2.1 time: 1.198066 Oct 03 15:12:27.907400 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3094/6361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:26 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1393 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:28.951738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:28.956989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:28.961507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:28.963166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:28.975965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:28.977153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:28.979211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:28.982752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:28.983682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:28.985700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:29.333738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:29.358077 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85db6ce8-01ff-48c7-8ef3-b393fef91dd0 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1393 microversion: 2.1 time: 0.415849 Oct 03 15:12:29.362079 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3268/6362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:28 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1393 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:29.512538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f3cfa85e-c1fb-407c-a60a-21c5a1e07d4f req-69fe981c-7094-4aac-b7e8-d25fe404c071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac190084-cb73-4d8e-af0a-12e7ded30dbb", "name": "network-vif-plugged", "status": "completed", "tag": "b6d7e36e-1eaf-4601-8509-04d1a9309b45"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:29.546420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3cfa85e-c1fb-407c-a60a-21c5a1e07d4f req-69fe981c-7094-4aac-b7e8-d25fe404c071 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:29.547017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3cfa85e-c1fb-407c-a60a-21c5a1e07d4f req-69fe981c-7094-4aac-b7e8-d25fe404c071 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:29.547451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f3cfa85e-c1fb-407c-a60a-21c5a1e07d4f req-69fe981c-7094-4aac-b7e8-d25fe404c071 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:29.579138 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f3cfa85e-c1fb-407c-a60a-21c5a1e07d4f req-69fe981c-7094-4aac-b7e8-d25fe404c071 service nova] Creating event network-vif-plugged:b6d7e36e-1eaf-4601-8509-04d1a9309b45 for instance ac190084-cb73-4d8e-af0a-12e7ded30dbb on n-h2-781139-2 Oct 03 15:12:29.603029 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f3cfa85e-c1fb-407c-a60a-21c5a1e07d4f req-69fe981c-7094-4aac-b7e8-d25fe404c071 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100982 Oct 03 15:12:29.604061 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3095/6363] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:12:29.705262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1f380b86-75df-44a7-b291-e7ab0edda754 req-800e11a2-efed-46e2-9418-7e861e02a363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325ba6cd-1639-47d9-99f7-cc2114676c3c", "tag": "b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:29.726480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1f380b86-75df-44a7-b291-e7ab0edda754 req-800e11a2-efed-46e2-9418-7e861e02a363 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:29.726883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1f380b86-75df-44a7-b291-e7ab0edda754 req-800e11a2-efed-46e2-9418-7e861e02a363 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:29.727311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1f380b86-75df-44a7-b291-e7ab0edda754 req-800e11a2-efed-46e2-9418-7e861e02a363 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:29.740340 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1f380b86-75df-44a7-b291-e7ab0edda754 req-800e11a2-efed-46e2-9418-7e861e02a363 service nova] Creating event network-changed:b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3 for instance 325ba6cd-1639-47d9-99f7-cc2114676c3c on n-h1-781139-2 Oct 03 15:12:29.755994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1f380b86-75df-44a7-b291-e7ab0edda754 req-800e11a2-efed-46e2-9418-7e861e02a363 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055394 Oct 03 15:12:29.757462 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3269/6364] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:12:30.397709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:30.398439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:30.417452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:30.418007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:30.418467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:30.426727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:30.427282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:30.427739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:30.762918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:30.773501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-71bb1591-ef41-4d4f-97ba-e095df7661c6 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1393 microversion: 2.1 time: 0.381686 Oct 03 15:12:30.782081 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3096/6365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:30 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1393 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:31.812618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:31.816881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:31.839736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:31.845498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-74a67859-55c3-4325-ab6d-9dcd568c136a req-0f904384-135c-4616-be1c-3e34bae61cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325ba6cd-1639-47d9-99f7-cc2114676c3c", "tag": "b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:31.855072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:31.855675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:31.857005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:31.857940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:31.859082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:31.881146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-74a67859-55c3-4325-ab6d-9dcd568c136a req-0f904384-135c-4616-be1c-3e34bae61cea service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:31.881739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-74a67859-55c3-4325-ab6d-9dcd568c136a req-0f904384-135c-4616-be1c-3e34bae61cea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:31.882278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-74a67859-55c3-4325-ab6d-9dcd568c136a req-0f904384-135c-4616-be1c-3e34bae61cea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:31.927760 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-74a67859-55c3-4325-ab6d-9dcd568c136a req-0f904384-135c-4616-be1c-3e34bae61cea service nova] Creating event network-changed:b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3 for instance 325ba6cd-1639-47d9-99f7-cc2114676c3c on n-h1-781139-2 Oct 03 15:12:31.939198 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-74a67859-55c3-4325-ab6d-9dcd568c136a req-0f904384-135c-4616-be1c-3e34bae61cea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097787 Oct 03 15:12:31.945361 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3097/6366] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:12:32.053332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:32.064143 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac9651cc-0bf1-4d78-b904-72f17524f107 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1565 microversion: 2.1 time: 0.263695 Oct 03 15:12:32.078687 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3270/6367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:31 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1565 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:32.091213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:32.092942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:32.101010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:32.101937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:32.102946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:32.103843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:32.104481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:32.105144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:32.802170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:32.812436 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-950bacb8-9da4-40b4-98e1-41ca5c0ffe0b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1565 microversion: 2.1 time: 0.726278 Oct 03 15:12:32.813851 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3098/6368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:32 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1565 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:35.555920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:35.557130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:35.560364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-54dd2804-95a6-4765-93fe-565e6c233daa req-f6358930-dacc-456e-a6c2-331d201e032c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac190084-cb73-4d8e-af0a-12e7ded30dbb", "tag": "b6d7e36e-1eaf-4601-8509-04d1a9309b45"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:35.572414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:35.575522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:35.576222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:35.578440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-54dd2804-95a6-4765-93fe-565e6c233daa req-f6358930-dacc-456e-a6c2-331d201e032c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:35.578959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-54dd2804-95a6-4765-93fe-565e6c233daa req-f6358930-dacc-456e-a6c2-331d201e032c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:35.579392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-54dd2804-95a6-4765-93fe-565e6c233daa req-f6358930-dacc-456e-a6c2-331d201e032c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:35.580848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:35.582471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:35.584524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:35.605913 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-54dd2804-95a6-4765-93fe-565e6c233daa req-f6358930-dacc-456e-a6c2-331d201e032c service nova] Creating event network-changed:b6d7e36e-1eaf-4601-8509-04d1a9309b45 for instance ac190084-cb73-4d8e-af0a-12e7ded30dbb on n-h2-781139-2 Oct 03 15:12:35.627069 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-54dd2804-95a6-4765-93fe-565e6c233daa req-f6358930-dacc-456e-a6c2-331d201e032c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071015 Oct 03 15:12:35.627701 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3099/6369] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:12:36.080886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:36.097305 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b323fd20-37cb-4328-a51b-0ed0efc59423 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1565 microversion: 2.1 time: 0.545023 Oct 03 15:12:36.099446 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3271/6370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:35 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1565 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:12:56.549732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:56.553775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:56.561205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=15 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:56.562738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=35 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:56.565962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:56.567634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:56.568461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:56.569531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:56.570188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:56.570795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:56.654482 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e33b435c-a45a-48db-a123-50e8d182fbdb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb/action" status: 200 len: 24570 microversion: 2.1 time: 0.112715 Oct 03 15:12:56.656331 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3100/6371] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:12:56 2022] POST /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb/action => generated 24570 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:12:58.465792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:58.466469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:58.478249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:58.483005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=49 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:12:58.488541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:58.489189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:58.490915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:58.494108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:58.495633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:58.496603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-676a4aec-069f-4637-a7c0-223ffcb9a69c req-522f3e2d-a1c9-4f7e-b44d-547c83e08b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325ba6cd-1639-47d9-99f7-cc2114676c3c", "tag": "b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:12:58.498941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:58.517473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-676a4aec-069f-4637-a7c0-223ffcb9a69c req-522f3e2d-a1c9-4f7e-b44d-547c83e08b0f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:58.518005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-676a4aec-069f-4637-a7c0-223ffcb9a69c req-522f3e2d-a1c9-4f7e-b44d-547c83e08b0f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:58.518396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-676a4aec-069f-4637-a7c0-223ffcb9a69c req-522f3e2d-a1c9-4f7e-b44d-547c83e08b0f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:58.554411 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-676a4aec-069f-4637-a7c0-223ffcb9a69c req-522f3e2d-a1c9-4f7e-b44d-547c83e08b0f service nova] Creating event network-changed:b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3 for instance 325ba6cd-1639-47d9-99f7-cc2114676c3c on n-h1-781139-2 Oct 03 15:12:58.566752 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-676a4aec-069f-4637-a7c0-223ffcb9a69c req-522f3e2d-a1c9-4f7e-b44d-547c83e08b0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074652 Oct 03 15:12:58.567663 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3101/6372] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:12:58.575246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:12:58.797377 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fdc9b221-7a42-4c1e-836e-66c348ca4738 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "DELETE /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 204 len: 0 microversion: 2.1 time: 0.335777 Oct 03 15:12:58.801193 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3272/6373] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:12:58 2022] DELETE /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:12:58.814519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:12:58.815550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:12:58.823599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:58.824105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:58.824716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:58.825820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:12:58.826442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:12:58.827027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:12:59.199453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:12:59.209344 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ec778e6-1108-469f-9c6a-828b439927a3 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1583 microversion: 2.1 time: 0.405969 Oct 03 15:12:59.210303 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3102/6374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:12:58 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1583 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:00.241283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:00.242852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:00.254534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:00.278182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:00.278899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:00.279553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:00.280024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:00.280448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:00.536623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:00.551106 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ddbaf5de-30db-47ae-98bd-a0bb7eb4e6e0 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1583 microversion: 2.1 time: 0.316044 Oct 03 15:13:00.552211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3273/6375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:00 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1583 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:01.498352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d56d0fc1-ccaa-439a-94fe-bc42c4f03d05 req-bb00a3ca-7599-4513-8c98-92e9866a0590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325ba6cd-1639-47d9-99f7-cc2114676c3c", "name": "network-vif-deleted", "tag": "b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:01.521059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d56d0fc1-ccaa-439a-94fe-bc42c4f03d05 req-bb00a3ca-7599-4513-8c98-92e9866a0590 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:01.521963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d56d0fc1-ccaa-439a-94fe-bc42c4f03d05 req-bb00a3ca-7599-4513-8c98-92e9866a0590 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:01.522645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d56d0fc1-ccaa-439a-94fe-bc42c4f03d05 req-bb00a3ca-7599-4513-8c98-92e9866a0590 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:01.537962 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d56d0fc1-ccaa-439a-94fe-bc42c4f03d05 req-bb00a3ca-7599-4513-8c98-92e9866a0590 service nova] Creating event network-vif-deleted:b81ab4d0-3b2e-4ae7-b955-ad7957c91cf3 for instance 325ba6cd-1639-47d9-99f7-cc2114676c3c on n-h1-781139-2 Oct 03 15:13:01.547114 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d56d0fc1-ccaa-439a-94fe-bc42c4f03d05 req-bb00a3ca-7599-4513-8c98-92e9866a0590 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055836 Oct 03 15:13:01.553413 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3103/6376] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:01.577544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:01.578632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:01.608695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:01.609587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:01.612483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:01.613473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:01.613943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:01.614372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:01.801952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:01.828764 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2dd06460-fe57-4a9e-b3fb-2bd27636773b tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1230 microversion: 2.1 time: 0.255872 Oct 03 15:13:01.831240 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3274/6377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:01 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1230 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:02.852837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:02.853732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:02.861512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:02.862330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:02.863082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:02.864207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:02.864852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:02.865727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:02.985023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:02.993405 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-84472c6f-b5c0-403e-98f9-a0e5d126e220 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1230 microversion: 2.1 time: 0.145244 Oct 03 15:13:02.994013 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3104/6378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:02 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1230 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:03.102166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:03.107338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:03.124602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:03.125170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:03.125616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:03.129011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:03.129517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:03.130419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:03.225477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:13:03.226157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:13:03.226847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:13:03.227451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:13:03.228684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:13:03.330174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:03.357881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:03.359358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:03.367321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:03.370744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:03.373207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:03.374189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:03.436267 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-828de163-bf44-4d8e-bfc7-785f64432f1e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb/action" status: 202 len: 1137 microversion: 2.1 time: 0.338898 Oct 03 15:13:03.450884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3275/6379] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:13:03 2022] POST /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb/action => generated 1137 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 03 15:13:03.458195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:03.458881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:03.485677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:03.486207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:03.486650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:03.487381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:03.493254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:03.493720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:03.849595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:03.875000 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-717d12a8-1cf9-4d5d-8866-47c2c05644c2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 0.420839 Oct 03 15:13:03.876764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3105/6380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:03 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:04.017451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:04.018169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:04.030731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:04.034177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:04.035063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:04.035838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:04.036326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:04.040178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:04.147862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:04.171646 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8697749c-2cbf-47a9-8dff-ca1bd62c1282 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1230 microversion: 2.1 time: 0.158827 Oct 03 15:13:04.174704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3276/6381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:04 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1230 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:04.906337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:04.906991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:04.914854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:04.918058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:04.919646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:04.920394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:04.928385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:04.929163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:05.195207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:05.195912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:05.208305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:05.209039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:05.211650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:05.212598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:05.213186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:05.217077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:05.358749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:05.366780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:05.367136 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66bc257f-5767-4bcc-b22a-ffcdab10fb55 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 0.464852 Oct 03 15:13:05.368419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3106/6382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:04 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:05.376760 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-767cb79d-c3e9-40e1-a935-3b89be6da514 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1230 microversion: 2.1 time: 0.185353 Oct 03 15:13:05.389596 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3277/6383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:05 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1230 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:06.396880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:06.397728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:06.413004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:06.413709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:06.414262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:06.415367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:06.420999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:06.421630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:06.786714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:06.799207 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-934810c9-840e-4d2d-8b65-e26eb9b61dcb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 0.410924 Oct 03 15:13:06.802515 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3107/6384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:06 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:06.866566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:06.867325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:06.881745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:06.882258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:06.882698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:06.883424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:06.883889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:06.884319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:06.996730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:07.009868 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-824b5e8d-a5d2-4e5e-ab6c-ea7d26e47092 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1230 microversion: 2.1 time: 0.613491 Oct 03 15:13:07.010472 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3278/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:06 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1230 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:07.828727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:07.829324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:07.845484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:07.845625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:07.846038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:07.846957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:07.848430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:07.849082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:08.036694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:08.037450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:08.054720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:08.055662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:08.056116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:08.056853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:08.061625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:08.062346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:08.189625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:08.201452 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef011396-b47d-41e1-9f5b-7e6f055f06d4 tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1230 microversion: 2.1 time: 0.170876 Oct 03 15:13:08.202320 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3279/6386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:08 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1230 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:13:08.440736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:08.449875 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c7a75620-6e97-473b-a2a5-e967ae0f739b tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 0.625881 Oct 03 15:13:08.459682 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3108/6387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:07 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:09.225990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:09.226597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:09.258735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:09.260587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:09.262026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:09.266532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:09.267115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:09.267642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:09.364526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:09.365459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:09.366104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:09.366759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lazy-loading 'fault' on Instance uuid 325ba6cd-1639-47d9-99f7-cc2114676c3c {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:13:09.444791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2924706c8894ab28221128d00352c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4bbb8a22f164693bbb7988bf33b53eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:09.468300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0c66bdc-1e6a-4858-877d-b96e3c8bc2ec tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 200 len: 1235 microversion: 2.1 time: 0.246107 Oct 03 15:13:09.479572 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3280/6388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:09 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 1235 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:09.484557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:09.485281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:09.495425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:09.499710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:09.502118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:09.503497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:09.504437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:09.506813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:09.867772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:09.884824 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa3bb9b2-2f8a-4984-8f21-8aaa4a78da3f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 0.406127 Oct 03 15:13:09.889891 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3109/6389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:09 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:10.497607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:10.499190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] [instance: 325ba6cd-1639-47d9-99f7-cc2114676c3c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:10.515124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:10.518010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:10.519784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:10.527481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:10.528494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:10.529901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:10.566379 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] HTTP exception thrown: Instance 325ba6cd-1639-47d9-99f7-cc2114676c3c could not be found. Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Request method failure captured: Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c HTTP/1.1 Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvrBGL_F7S09FmOXYxp6zhseCuGBrZQqekUxeI8ZpyjAvxer0C3UiLBkORpZmqm3dLJlxYUvcNsBKa9XFLicXWzLgbpFY7YvIvoGFrkMMXpifubvwnrd3-18UiBIwpjhBdDnpGp3I7N9_Z-qI_ftweFJZYXhNwVxjPnw10F7cjXYGTE Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f4bbb8a22f164693bbb7988bf33b53eb Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBackupRestore-145737876 Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f4bbb8a22f164693bbb7988bf33b53eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f4bbb8a22f164693bbb7988bf33b53eb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4bbb8a22f164693bbb7988bf33b53eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f4bbb8a22f164693bbb7988bf33b53eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBackupRestore-145737876 Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f4bbb8a22f164693bbb7988bf33b53eb Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBackupRestore-145737876 Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBackupRestore-145737876-project Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: a2924706c8894ab28221128d00352c4d Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBackupRestore-145737876-project Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 325ba6cd-1639-47d9-99f7-cc2114676c3c could not be found. Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '325ba6cd-1639-47d9-99f7-cc2114676c3c'} Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325ba6cd-1639-47d9-99f7-cc2114676c3c could not be found. Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325ba6cd-1639-47d9-99f7-cc2114676c3c could not be found. Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:13:10.569056 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:13:10.573346 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:13:10.573346 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:13:10.573346 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:13:10.573346 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:13:10.573346 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:13:10.573346 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325ba6cd-1639-47d9-99f7-cc2114676c3c could not be found. Oct 03 15:13:10.573346 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:13:10.575406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Returning 404 to user: Instance 325ba6cd-1639-47d9-99f7-cc2114676c3c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:13:10.576602 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90db7c94-e005-4038-a8eb-e5a9542975ba tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c" status: 404 len: 111 microversion: 2.1 time: 0.084637 Oct 03 15:13:10.577462 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3281/6390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:10 2022] GET /compute/v2.1/servers/325ba6cd-1639-47d9-99f7-cc2114676c3c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:13:10.878086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c4e71c4-d082-418f-bb19-93b94144396f tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] Calling method '.version_select at 0x7fb230a1a550>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:10.891582 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:13:10.893610 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1639198808 (ip 10.222.0.20) !!! Oct 03 15:13:10.915214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:10.915834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:10.942519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c4e71c4-d082-418f-bb19-93b94144396f tempest-TestVolumeBackupRestore-145737876 tempest-TestVolumeBackupRestore-145737876-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1639198808" status: 202 len: 0 microversion: 2.1 time: 0.070073 Oct 03 15:13:10.946866 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3110/6391] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 3 15:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1639198808 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:13:10.952103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:10.957537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:10.958020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:10.958929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:10.959232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:10.959661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:11.285761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:11.299097 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8acfef5-b4dc-49ac-b150-c02587d13b19 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 0.387708 Oct 03 15:13:11.299696 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3282/6392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:10 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:12.330972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:12.332113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:12.358417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:12.358763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:12.359128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:12.359852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:12.360310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:12.360735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:12.875525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:12.886602 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c845204-2d78-48b0-96ca-bb5957aa969f tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 0.558409 Oct 03 15:13:12.899010 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3111/6393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:12 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:14.438601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:14.439749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:14.472289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:14.472797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:14.481083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:14.488019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:14.488544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:14.492052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:15.083010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:15.092677 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c35068fe-6d3a-4b59-b7d4-0df27d50be6e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1692 microversion: 2.1 time: 1.172905 Oct 03 15:13:15.117300 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3283/6394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:13 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1692 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:16.140889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:16.142953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:16.173541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:16.174766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:16.178975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:16.180402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:16.183827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:16.184900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:17.775770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-70c5560f-8dfd-4642-b368-0b7d0894765c req-5482eabf-87d3-4a64-9987-c72425cb28a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac190084-cb73-4d8e-af0a-12e7ded30dbb", "name": "network-vif-unplugged", "status": "completed", "tag": "b6d7e36e-1eaf-4601-8509-04d1a9309b45"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:17.814860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70c5560f-8dfd-4642-b368-0b7d0894765c req-5482eabf-87d3-4a64-9987-c72425cb28a6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:17.819016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70c5560f-8dfd-4642-b368-0b7d0894765c req-5482eabf-87d3-4a64-9987-c72425cb28a6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:17.819418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-70c5560f-8dfd-4642-b368-0b7d0894765c req-5482eabf-87d3-4a64-9987-c72425cb28a6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:17.859704 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-70c5560f-8dfd-4642-b368-0b7d0894765c req-5482eabf-87d3-4a64-9987-c72425cb28a6 service nova] Creating event network-vif-unplugged:b6d7e36e-1eaf-4601-8509-04d1a9309b45 for instance ac190084-cb73-4d8e-af0a-12e7ded30dbb on n-h2-781139-2 Oct 03 15:13:17.866894 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-70c5560f-8dfd-4642-b368-0b7d0894765c req-5482eabf-87d3-4a64-9987-c72425cb28a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095239 Oct 03 15:13:17.868153 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3284/6395] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:17.920405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:17.929125 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-07350dff-5acd-4c6f-abbe-121eba41caa2 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1698 microversion: 2.1 time: 1.798735 Oct 03 15:13:17.930096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3112/6396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:16 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1698 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:18.957554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:18.958370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:18.976011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:18.979197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:18.981120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:18.982866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:18.986682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:18.988841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:19.385145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:19.390196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:19.398932 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ccc740b-77cc-47d2-840f-10032ba2699e tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1683 microversion: 2.1 time: 0.446827 Oct 03 15:13:19.416906 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3285/6397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:18 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1683 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:21.911545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e18caed-b6e4-46ab-9bfa-31126980aa79 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'create', calling method: .version_select at 0x7fb22b44f4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1616811925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLel5ETcxzxSbu16HHVQNdh/fmlqbtRoovOc9+a1y5bUk2FuEhZOl6O788q1KHJ1rEUOQMGew31jh5d++bfcKz6AVSnHWnFeSmsxh4UYLqquA0aQeXNO4E7Xu+nlg0/2Vg=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:21.945126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6e18caed-b6e4-46ab-9bfa-31126980aa79 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:13:21.961054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-6e18caed-b6e4-46ab-9bfa-31126980aa79 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for user 29afda2312af4c12b881f6c1da67ef79 and project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:13:22.009735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-dab3ebba-3a33-4658-a8c0-c336fbc2ffe6 req-538acf3f-a38d-476d-bb7e-670914304803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac190084-cb73-4d8e-af0a-12e7ded30dbb", "name": "network-vif-plugged", "status": "completed", "tag": "b6d7e36e-1eaf-4601-8509-04d1a9309b45"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:22.044379 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6e18caed-b6e4-46ab-9bfa-31126980aa79 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.136725 Oct 03 15:13:22.046439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dab3ebba-3a33-4658-a8c0-c336fbc2ffe6 req-538acf3f-a38d-476d-bb7e-670914304803 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:22.046955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dab3ebba-3a33-4658-a8c0-c336fbc2ffe6 req-538acf3f-a38d-476d-bb7e-670914304803 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:22.047389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-dab3ebba-3a33-4658-a8c0-c336fbc2ffe6 req-538acf3f-a38d-476d-bb7e-670914304803 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:22.052646 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3113/6398] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:13:21 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:22.083086 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-dab3ebba-3a33-4658-a8c0-c336fbc2ffe6 req-538acf3f-a38d-476d-bb7e-670914304803 service nova] Creating event network-vif-plugged:b6d7e36e-1eaf-4601-8509-04d1a9309b45 for instance ac190084-cb73-4d8e-af0a-12e7ded30dbb on n-h2-781139-2 Oct 03 15:13:22.097809 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-dab3ebba-3a33-4658-a8c0-c336fbc2ffe6 req-538acf3f-a38d-476d-bb7e-670914304803 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093875 Oct 03 15:13:22.099644 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3286/6399] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:13:26.067982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2128274666", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "8c01de08-56ce-40f5-b0e3-089e256935df"}], "key_name": "tempest-TestNetworkBasicOps-1616811925", "security_groups": [{"name": "tempest-secgroup-smoke-1240601911"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:26.377304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] validate_networks() for [('8c01de08-56ce-40f5-b0e3-089e256935df', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:13:26.818188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:27.495019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:13:27.497220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:13:27.497983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:13:27.499124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:13:27.499747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:13:27.515863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:27.516703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:27.517375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:27.518352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:27.518971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:27.519690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:27.532046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=63 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:27.546014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:13:27.554429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for user 29afda2312af4c12b881f6c1da67ef79 and project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:13:27.588957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:13:27.602625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:13:27.708035 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed301a70-442a-4808-83e2-67f9e397c475 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.644081 Oct 03 15:13:27.717305 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3114/6400] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:13:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:13:27.721388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f8de889-585c-4c8e-8cf2-92670e0e6d78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:27.722180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f8de889-585c-4c8e-8cf2-92670e0e6d78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:27.928813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6f8de889-585c-4c8e-8cf2-92670e0e6d78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:27.936236 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f8de889-585c-4c8e-8cf2-92670e0e6d78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1249 microversion: 2.1 time: 0.219261 Oct 03 15:13:27.936843 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3287/6401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:27 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1249 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:13:28.960827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:28.961781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:28.980770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:28.981471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:28.982036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:28.984263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:28.984841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:28.986635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:29.177638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:29.195579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dafd59f7-852d-4593-9fbf-e666c133a2a5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1301 microversion: 2.1 time: 0.239444 Oct 03 15:13:29.218258 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3115/6402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:28 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1301 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:30.225384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:30.226583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:30.235995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:30.239176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:30.240093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:30.240891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:30.242137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:30.242892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:30.244129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:30.409478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:30.427660 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3da43a29-de72-495c-beb7-66bb88e95810 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1307 microversion: 2.1 time: 0.207885 Oct 03 15:13:30.430985 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3288/6403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:30 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1307 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:31.454936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:31.455706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:31.489659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:31.491793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:31.495488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:31.497255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:31.498570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:31.502223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:31.923728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:31.943465 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b678ae9-aa2d-4e9d-a1b7-d7f8b83626f8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.495189 Oct 03 15:13:31.946638 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3116/6404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:31 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:32.472993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-22b02310-adfb-44c3-8229-81211a572534 req-1d13451b-1c89-4e25-9edc-819339711f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7bf744d-b26b-4261-b03a-343a4834b976", "tag": "63841745-2f34-40f2-be83-b97366261cff"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:32.500179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-22b02310-adfb-44c3-8229-81211a572534 req-1d13451b-1c89-4e25-9edc-819339711f0d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:32.500678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-22b02310-adfb-44c3-8229-81211a572534 req-1d13451b-1c89-4e25-9edc-819339711f0d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:32.501140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-22b02310-adfb-44c3-8229-81211a572534 req-1d13451b-1c89-4e25-9edc-819339711f0d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:32.533703 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-22b02310-adfb-44c3-8229-81211a572534 req-1d13451b-1c89-4e25-9edc-819339711f0d service nova] Creating event network-changed:63841745-2f34-40f2-be83-b97366261cff for instance e7bf744d-b26b-4261-b03a-343a4834b976 on n-h1-781139-2 Oct 03 15:13:32.541844 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-22b02310-adfb-44c3-8229-81211a572534 req-1d13451b-1c89-4e25-9edc-819339711f0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074794 Oct 03 15:13:32.550972 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3289/6405] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:32.968695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:32.969337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:32.976350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:32.977138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:32.977790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:32.978732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:32.979441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:32.981160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:33.416439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:33.429864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-812c0497-f868-4812-b8a3-a9c0f110ec78 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.465310 Oct 03 15:13:33.430560 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3117/6406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:32 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:34.468727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:34.471568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:34.491537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:34.492057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:34.492513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:34.493279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:34.493743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:34.499032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:34.859645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:34.872633 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6d07354c-c3f8-4136-af30-8d572a501e08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.420871 Oct 03 15:13:34.890050 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3290/6407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:34 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:35.902385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:35.903623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:35.920985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:35.921777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:35.922843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:35.923743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:35.924361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:35.924964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:36.238861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:36.250522 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54256b50-3c4c-4bbb-a61e-d1848625f6a7 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.353251 Oct 03 15:13:36.252359 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3118/6408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:35 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:37.281318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:37.288997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:37.310343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:37.312565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:37.313177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:37.315933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:37.316388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:37.317402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:37.673421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:37.684754 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b59ec2a2-f60c-4855-81c2-3cf248aba5df tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.409798 Oct 03 15:13:37.685384 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3291/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:37 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:38.711055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:38.711916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:38.719407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:38.723090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:38.732083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:38.734175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:38.734789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:38.735835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:38.736439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:38.737037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:39.077259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:39.086727 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4cb718f5-ffec-4860-a5c8-3be5753b3231 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.380347 Oct 03 15:13:39.087623 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3119/6410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:38 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:40.114036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:40.114708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:40.120366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:40.146081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:40.146641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:40.147096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:40.149702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:40.150180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:40.150619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:40.866200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:40.874680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-19de4278-e76c-445e-92c8-d85390e54d51 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.765967 Oct 03 15:13:40.875284 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3292/6411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:40 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:41.810867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:41.814390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:41.826435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:41.832100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:41.832733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:41.836100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:41.836596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:41.840667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:41.901422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:41.902270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:41.928185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:41.928185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:41.928185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:41.941329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:41.941961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:41.942422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:41.989791 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-518838a6-b241-4fa3-88c8-741dadbd6afd tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "POST /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb/action" status: 200 len: 24568 microversion: 2.1 time: 0.183822 Oct 03 15:13:41.997084 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3120/6412] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:13:41 2022] POST /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb/action => generated 24568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:13:42.556019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:42.567644 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5874bda3-667e-48ae-a75b-5aa372fde2a9 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.670362 Oct 03 15:13:42.568489 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3293/6413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:41 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:13:43.359261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-aba84397-a7a9-4749-807d-960a5eb457c1 req-95198476-190f-42e3-b8ed-c2a558a3b497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7bf744d-b26b-4261-b03a-343a4834b976", "name": "network-vif-plugged", "status": "completed", "tag": "63841745-2f34-40f2-be83-b97366261cff"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:43.391804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aba84397-a7a9-4749-807d-960a5eb457c1 req-95198476-190f-42e3-b8ed-c2a558a3b497 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:43.393517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aba84397-a7a9-4749-807d-960a5eb457c1 req-95198476-190f-42e3-b8ed-c2a558a3b497 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:43.394256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aba84397-a7a9-4749-807d-960a5eb457c1 req-95198476-190f-42e3-b8ed-c2a558a3b497 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:43.411874 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-aba84397-a7a9-4749-807d-960a5eb457c1 req-95198476-190f-42e3-b8ed-c2a558a3b497 service nova] Creating event network-vif-plugged:63841745-2f34-40f2-be83-b97366261cff for instance e7bf744d-b26b-4261-b03a-343a4834b976 on n-h1-781139-2 Oct 03 15:13:43.419836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-aba84397-a7a9-4749-807d-960a5eb457c1 req-95198476-190f-42e3-b8ed-c2a558a3b497 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071164 Oct 03 15:13:43.421852 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3121/6414] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:43.620186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:43.620797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:43.661201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:43.661201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:43.661201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:43.661201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:43.661560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:43.661656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:44.048195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:44.064050 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf887b51-9f23-4f1d-bf06-06cc7e68bcf3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.471298 Oct 03 15:13:44.068216 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3294/6415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:43 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:45.097402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:45.098113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:45.125017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:45.126676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:45.127735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:45.132141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:45.136190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:45.140202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:45.473956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:45.490200 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-35b161ed-bf1d-4cd3-a8a2-d50adbadd018 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1375 microversion: 2.1 time: 0.397461 Oct 03 15:13:45.490483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3122/6416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:45 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1375 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:46.520107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:46.522315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:46.542382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:46.547085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:46.547756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:46.548673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:46.549312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:46.550768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:46.925510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:46.936224 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd3a8a36-96e7-4981-a9e6-4043d1e80bc6 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1547 microversion: 2.1 time: 0.425505 Oct 03 15:13:46.937293 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3295/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:46 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1547 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:46.965882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:46.967258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:46.974326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:46.975092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:46.975740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:46.976848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:46.977563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:46.978198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:47.244862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:47.253305 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2488d4e3-3ab7-48bd-a29d-47d70977b87f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1547 microversion: 2.1 time: 0.292743 Oct 03 15:13:47.254636 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3123/6418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:46 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1547 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:51.834542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f9d08bf0-15dd-40c5-96ce-a00c69d93268 req-52526bea-3bb0-4a75-aa68-be35fc218e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7bf744d-b26b-4261-b03a-343a4834b976", "tag": "63841745-2f34-40f2-be83-b97366261cff"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:51.854718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9d08bf0-15dd-40c5-96ce-a00c69d93268 req-52526bea-3bb0-4a75-aa68-be35fc218e1c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:51.860247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9d08bf0-15dd-40c5-96ce-a00c69d93268 req-52526bea-3bb0-4a75-aa68-be35fc218e1c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:51.860692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f9d08bf0-15dd-40c5-96ce-a00c69d93268 req-52526bea-3bb0-4a75-aa68-be35fc218e1c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:51.888290 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f9d08bf0-15dd-40c5-96ce-a00c69d93268 req-52526bea-3bb0-4a75-aa68-be35fc218e1c service nova] Creating event network-changed:63841745-2f34-40f2-be83-b97366261cff for instance e7bf744d-b26b-4261-b03a-343a4834b976 on n-h1-781139-2 Oct 03 15:13:51.904538 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f9d08bf0-15dd-40c5-96ce-a00c69d93268 req-52526bea-3bb0-4a75-aa68-be35fc218e1c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071884 Oct 03 15:13:51.907557 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3296/6419] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:55.413719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:55.415077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:55.419068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a38c5e43-603d-423d-9235-f85b0bff236a req-fb17b063-c243-4142-81c7-cd26f3ac4cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac190084-cb73-4d8e-af0a-12e7ded30dbb", "tag": "b6d7e36e-1eaf-4601-8509-04d1a9309b45"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:55.439845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:55.441234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:55.443297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:55.445588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a38c5e43-603d-423d-9235-f85b0bff236a req-fb17b063-c243-4142-81c7-cd26f3ac4cc8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:55.445766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:55.447363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a38c5e43-603d-423d-9235-f85b0bff236a req-fb17b063-c243-4142-81c7-cd26f3ac4cc8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:55.447766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a38c5e43-603d-423d-9235-f85b0bff236a req-fb17b063-c243-4142-81c7-cd26f3ac4cc8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:55.448059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:55.449010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:55.467145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a38c5e43-603d-423d-9235-f85b0bff236a req-fb17b063-c243-4142-81c7-cd26f3ac4cc8 service nova] Creating event network-changed:b6d7e36e-1eaf-4601-8509-04d1a9309b45 for instance ac190084-cb73-4d8e-af0a-12e7ded30dbb on n-h2-781139-2 Oct 03 15:13:55.473047 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a38c5e43-603d-423d-9235-f85b0bff236a req-fb17b063-c243-4142-81c7-cd26f3ac4cc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059825 Oct 03 15:13:55.474079 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3297/6420] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:55.514875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:13:55.693182 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d400f560-19c5-40ea-bafd-5c3f230c48a7 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 204 len: 0 microversion: 2.1 time: 0.282898 Oct 03 15:13:55.695746 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3124/6421] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:13:55 2022] DELETE /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:13:55.705716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:55.706472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:55.725940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:55.726442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:55.727238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:55.728160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:55.728849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:55.729556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:56.069165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:56.078762 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e0f155a-ebd4-4f8d-9bcc-9a12c4a59ccb tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1689 microversion: 2.1 time: 0.377341 Oct 03 15:13:56.093519 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3298/6422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:55 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1689 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:57.109558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:57.111311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:57.129566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:57.134837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:57.138189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:57.139465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:57.145830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:57.146532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:57.147161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:57.784820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:57.792118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:57.798974 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d6ed190-e592-4072-9f89-0b96cf151d23 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1689 microversion: 2.1 time: 0.694349 Oct 03 15:13:57.803928 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3125/6423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:57 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1689 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:13:58.152816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cf3eedc3-1154-4eae-be02-316cb9561d23 req-31f965b4-3fda-4756-883a-ea9bca71a91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac190084-cb73-4d8e-af0a-12e7ded30dbb", "name": "network-vif-deleted", "tag": "b6d7e36e-1eaf-4601-8509-04d1a9309b45"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:58.168703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cf3eedc3-1154-4eae-be02-316cb9561d23 req-31f965b4-3fda-4756-883a-ea9bca71a91f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:58.169218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cf3eedc3-1154-4eae-be02-316cb9561d23 req-31f965b4-3fda-4756-883a-ea9bca71a91f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:58.170908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cf3eedc3-1154-4eae-be02-316cb9561d23 req-31f965b4-3fda-4756-883a-ea9bca71a91f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:58.176530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=57 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:13:58.187364 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cf3eedc3-1154-4eae-be02-316cb9561d23 req-31f965b4-3fda-4756-883a-ea9bca71a91f service nova] Creating event network-vif-deleted:b6d7e36e-1eaf-4601-8509-04d1a9309b45 for instance ac190084-cb73-4d8e-af0a-12e7ded30dbb on n-h2-781139-2 Oct 03 15:13:58.195318 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cf3eedc3-1154-4eae-be02-316cb9561d23 req-31f965b4-3fda-4756-883a-ea9bca71a91f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049412 Oct 03 15:13:58.201178 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3299/6424] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:13:58.782331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1636881474", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ddf321ca-8aa2-499b-a271-c4691589662b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:13:58.832476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:58.833218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:13:58.853000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:58.853937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:58.856097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:58.859743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:58.861202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:58.861832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:58.940199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:13:58.972959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:58.973473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:58.973904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:58.975311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lazy-loading 'fault' on Instance uuid ac190084-cb73-4d8e-af0a-12e7ded30dbb {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:13:59.084875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d29217f20d49d8b9ee984c1db2dbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38fd82ced714172a26f3bd1488ef82f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:13:59.100826 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-661d61f8-9834-4b82-aa59-31cfddc26c11 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 200 len: 1508 microversion: 2.1 time: 0.272997 Oct 03 15:13:59.101864 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3300/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:58 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:13:59.577005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:13:59.577799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:13:59.578661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:13:59.579290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:13:59.579938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:13:59.603431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:59.604003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:59.604549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:59.605691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:13:59.606154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:13:59.606584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:13:59.626282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:13:59.632109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:13:59.743716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:13:59.745873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddf321ca-8aa2-499b-a271-c4691589662b',volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:13:59.975988 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6525a42-62b3-439f-8973-f3729842ee81 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.199083 Oct 03 15:13:59.977806 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3126/6426] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:13:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:13:59.989594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ff2cd329-f63e-488a-8465-0abc00b6f47c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:13:59.990952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ff2cd329-f63e-488a-8465-0abc00b6f47c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:00.085797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ff2cd329-f63e-488a-8465-0abc00b6f47c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:00.102142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ff2cd329-f63e-488a-8465-0abc00b6f47c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1057 microversion: 2.1 time: 0.116995 Oct 03 15:14:00.103213 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3301/6427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:13:59 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1057 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:00.127642 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:00.128272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] [instance: ac190084-cb73-4d8e-af0a-12e7ded30dbb] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:00.140614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:00.145951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:00.146410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:00.147319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:00.147783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:00.148211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:00.171184 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] HTTP exception thrown: Instance ac190084-cb73-4d8e-af0a-12e7ded30dbb could not be found. Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Request method failure captured: Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb HTTP/1.1 Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvmOJMtA3yZ3VRNyDgCMX43zmwjrbdhjvhL8yIgpoK1-95ReIlsj3oT6mmUK5tpwsNEBIm4CZJMr0BJXguTttgilbBtd_BPojnzml0C5A9Tfj2WMYxeUZxJYkZJSdfBB8RuLuj6_29AYcbqeAhxUtqW-1JXUsrxL-EqqaUkvbHQOvtY Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e38fd82ced714172a26f3bd1488ef82f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e38fd82ced714172a26f3bd1488ef82f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: e38fd82ced714172a26f3bd1488ef82f Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-243841845 Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 74d29217f20d49d8b9ee984c1db2dbdf Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestNetworkAdvancedServerOps-243841845-project Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ac190084-cb73-4d8e-af0a-12e7ded30dbb could not be found. Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'ac190084-cb73-4d8e-af0a-12e7ded30dbb'} Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac190084-cb73-4d8e-af0a-12e7ded30dbb could not be found. Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac190084-cb73-4d8e-af0a-12e7ded30dbb could not be found. Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:00.176806 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac190084-cb73-4d8e-af0a-12e7ded30dbb could not be found. Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Returning 404 to user: Instance ac190084-cb73-4d8e-af0a-12e7ded30dbb could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d62fbc9-aaa2-4b9b-ab74-35671ada937d tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb" status: 404 len: 111 microversion: 2.1 time: 0.054996 Oct 03 15:14:00.181644 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3127/6428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:00 2022] GET /compute/v2.1/servers/ac190084-cb73-4d8e-af0a-12e7ded30dbb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:14:01.133314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:01.134924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:01.154272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=32 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:01.157761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:01.158378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:01.160509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:01.163855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:01.164853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:01.164972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:01.356385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:01.373378 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-599c7bda-a836-4dea-88a6-7c2cc8f2b962 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1155 microversion: 2.1 time: 0.246005 Oct 03 15:14:01.377456 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3302/6429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:01 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1155 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:02.395943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:02.396727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:02.419229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:02.419876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:02.420338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:02.421126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:02.421591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:02.422233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:02.541620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:02.553960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd7c8ae1-56ff-4d5b-ab06-3d58bf43ae1e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1173 microversion: 2.1 time: 0.162122 Oct 03 15:14:02.555562 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3128/6430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:02 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1173 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:03.577525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:03.579787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:03.600317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:03.600818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:03.601508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:03.602236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:03.602696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:03.603176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:04.116912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:04.125313 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2525d77-9e3e-47bd-90b3-82e0a3660033 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1173 microversion: 2.1 time: 0.551512 Oct 03 15:14:04.127094 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3303/6431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:03 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1173 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:05.156578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:05.157958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:05.165787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:05.166669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:05.167291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:05.168335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:05.168971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:05.170283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:05.931797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:05.953186 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-01ce53f9-9a8c-4d4d-a3c4-9b7cf35a924d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1215 microversion: 2.1 time: 0.790949 Oct 03 15:14:05.958454 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3129/6432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:05 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1215 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:06.437143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5c24cfab-1c2c-414d-92d9-9e98b18514b7 req-6c9d18d5-a2c9-498a-9875-009fef3ca9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26bf99f-9127-4e53-8f3d-b5884339b35a", "tag": "6bf4b3e9-72f1-409a-af3c-5ec4e74561a0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:06.451390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5c24cfab-1c2c-414d-92d9-9e98b18514b7 req-6c9d18d5-a2c9-498a-9875-009fef3ca9d8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:06.451892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5c24cfab-1c2c-414d-92d9-9e98b18514b7 req-6c9d18d5-a2c9-498a-9875-009fef3ca9d8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:06.452293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5c24cfab-1c2c-414d-92d9-9e98b18514b7 req-6c9d18d5-a2c9-498a-9875-009fef3ca9d8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:06.499406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5c24cfab-1c2c-414d-92d9-9e98b18514b7 req-6c9d18d5-a2c9-498a-9875-009fef3ca9d8 service nova] Creating event network-changed:6bf4b3e9-72f1-409a-af3c-5ec4e74561a0 for instance b26bf99f-9127-4e53-8f3d-b5884339b35a on n-h2-781139-2 Oct 03 15:14:06.517421 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5c24cfab-1c2c-414d-92d9-9e98b18514b7 req-6c9d18d5-a2c9-498a-9875-009fef3ca9d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081273 Oct 03 15:14:06.518066 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3304/6433] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:06.981634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:06.983026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:07.015161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:07.015857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:07.019353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:07.020305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:07.021584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:07.025951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:07.438720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:07.469981 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90d8ec73-452f-44ed-8a84-c15d2af312cc tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1215 microversion: 2.1 time: 0.491563 Oct 03 15:14:07.474645 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3130/6434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:06 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1215 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:08.116662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7245536f-9298-4514-8513-09ad66a406f8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] Calling method '.version_select at 0x7fb22b44eaf0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:08.156584 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7245536f-9298-4514-8513-09ad66a406f8 tempest-TestNetworkAdvancedServerOps-243841845 tempest-TestNetworkAdvancedServerOps-243841845-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1302075171" status: 202 len: 0 microversion: 2.1 time: 0.044034 Oct 03 15:14:08.157276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3305/6435] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Oct 3 15:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1302075171 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:14:08.499167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:08.499652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:08.506667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:08.507400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:08.507997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:08.508865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:08.509650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:08.510245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:08.704949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:08.715240 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56b2ba79-cfd7-40b5-9d99-fd7c08d74773 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1215 microversion: 2.1 time: 0.219912 Oct 03 15:14:08.716225 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3131/6436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:08 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:09.743067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:09.744498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:09.752171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:09.752784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:09.753270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:09.754080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:09.754604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:09.755043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:09.901967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:09.910324 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0991d10-e185-4ea4-ba44-2ce3ed221702 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.173978 Oct 03 15:14:09.911015 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3306/6437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:09 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:10.936004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:10.936603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:10.941331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:10.942170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:10.946542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:10.947271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:10.947978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:10.948992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:10.949622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:10.950311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:11.132557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:11.143821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-468d7757-b92c-43d6-afa7-6520a501e52d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.213661 Oct 03 15:14:11.144404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3132/6438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:10 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:12.065633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:12.168160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:12.168783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:12.176830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:12.177502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:12.178018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:12.178808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:12.179428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:12.179954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:12.290266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e37b6ac9-3e6f-4019-a819-0c4bfae92df3 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Action: 'create', calling method: .version_select at 0x7fb22b46bb80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-31114426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW5L+tGKe1RhislH6mWSj0s0St2ThFzx5nrQAiEYd9O+rTR0sJWeX1NlWA8WZEYBZUeOsP1l8v4oWjMi/9GjxBrpg9LTevTsIRO7IFWD2tKKBUwVzayGl9S6SL4aL357g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:12.316671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e37b6ac9-3e6f-4019-a819-0c4bfae92df3 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Getting quotas for project 044e27cbe4c5482abc99697c5447f235. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:14:12.323345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e37b6ac9-3e6f-4019-a819-0c4bfae92df3 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Getting quotas for user bd0d476f160a4c248fd3693f2b515ace and project 044e27cbe4c5482abc99697c5447f235. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:14:12.330700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:12.339665 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4367fcf5-76dd-4bcf-9cb6-acef2ebca038 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.175424 Oct 03 15:14:12.341145 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3133/6439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:12 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:14:12.371006 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e37b6ac9-3e6f-4019-a819-0c4bfae92df3 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.309966 Oct 03 15:14:12.372027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3307/6440] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:14:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:13.364907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:13.369965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:13.379720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:13.380443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:13.381159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:13.382098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:13.382761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:13.383395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:13.561623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:13.575959 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-26c0f8b8-39c9-4c5b-897a-1a8fc36076e8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.216603 Oct 03 15:14:13.576890 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3134/6441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:13 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:14.600433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:14.601849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:14.618077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:14.619195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:14.619379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:14.622564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:14.625990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:14.626660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:14.788764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:14.799833 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4376190-8cd8-4d5a-b390-b864f16dd7c1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.205436 Oct 03 15:14:14.801976 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3308/6442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:14 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:15.825815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:15.827048 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:15.838224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:15.839025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:15.839907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:15.840836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:15.841556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:15.842195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:16.125817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:16.135159 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ec42fd4-7471-4ad1-80ae-2a030acbfc64 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.313970 Oct 03 15:14:16.141352 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3135/6443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:15 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:17.163939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:17.164541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:17.181161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:17.183890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:17.184529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:17.185452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:17.188916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:17.189557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:17.619609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:17.641243 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-85ac49e3-32da-414f-b0b3-ec565f5b90ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.481021 Oct 03 15:14:17.646813 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3309/6444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:17 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:18.007502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3b07b5f4-640d-4bca-a17e-6bade2297db6 req-7846f7b4-0d7a-44d3-9782-2f1684f9f63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26bf99f-9127-4e53-8f3d-b5884339b35a", "name": "network-vif-plugged", "status": "completed", "tag": "6bf4b3e9-72f1-409a-af3c-5ec4e74561a0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:18.058985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3b07b5f4-640d-4bca-a17e-6bade2297db6 req-7846f7b4-0d7a-44d3-9782-2f1684f9f63e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:18.062275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3b07b5f4-640d-4bca-a17e-6bade2297db6 req-7846f7b4-0d7a-44d3-9782-2f1684f9f63e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:18.062909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3b07b5f4-640d-4bca-a17e-6bade2297db6 req-7846f7b4-0d7a-44d3-9782-2f1684f9f63e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:18.109321 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3b07b5f4-640d-4bca-a17e-6bade2297db6 req-7846f7b4-0d7a-44d3-9782-2f1684f9f63e service nova] Creating event network-vif-plugged:6bf4b3e9-72f1-409a-af3c-5ec4e74561a0 for instance b26bf99f-9127-4e53-8f3d-b5884339b35a on n-h2-781139-2 Oct 03 15:14:18.122132 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3b07b5f4-640d-4bca-a17e-6bade2297db6 req-7846f7b4-0d7a-44d3-9782-2f1684f9f63e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120170 Oct 03 15:14:18.143942 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3136/6445] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:18.667576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:18.668147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:18.685127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:18.686107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:18.686786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:18.687766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:18.688310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:18.688848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:18.976548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:18.990048 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8954487-8eeb-45c6-a35a-51e126a49f8d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1203 microversion: 2.1 time: 0.329314 Oct 03 15:14:18.991747 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3310/6446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:18 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:20.020157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:20.020912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:20.055086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:20.056868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:20.060573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:20.063532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:20.064298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:20.074887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:20.651623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:20.679644 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5480bacc-1f71-413a-966c-3203e635484d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1390 microversion: 2.1 time: 0.665102 Oct 03 15:14:20.689188 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3137/6447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:20 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1390 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:20.714923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:20.716281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:20.736018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:20.737954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:20.738634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:20.740441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:20.744500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:20.753710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:20.946206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:20.948998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:20.983798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:20.986956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:20.987762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:20.990266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:20.991040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:20.993341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:21.112067 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd97c5db-6135-4e55-8f57-17aa1cb1514c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976/action" status: 200 len: 24568 microversion: 2.1 time: 0.168499 Oct 03 15:14:21.114434 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3138/6448] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:14:20 2022] POST /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976/action => generated 24568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:14:21.288892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:21.314351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ff3a910-3cb2-4510-aad3-d2c6871e53d3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1390 microversion: 2.1 time: 0.602566 Oct 03 15:14:21.316491 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3311/6449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:20 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1390 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:21.348862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:21.350297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:21.369436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:21.369950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:21.370390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:21.371116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:21.371575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:21.372005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:21.812865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:21.826681 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b42f4ddb-0a38-4444-9f28-253456491425 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1390 microversion: 2.1 time: 0.481371 Oct 03 15:14:21.828150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3139/6450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:21 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1390 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:21.853198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:21.855137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:21.884988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-362144116-access_point-1492873744", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "2a8ecdcc-7327-4c13-80e9-23eb17c8b976"}], "key_name": "tempest-TestSecurityGroupsBasicOps-31114426", "security_groups": [{"name": "tempest-secgroup_access--1633178887"}, {"name": "tempest-secgroup_general--908217693"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:21.894821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:21.895788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:21.896784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:21.897825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:21.898499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:21.899135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:21.940608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:14:22.142437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bab6e67-9520-44dd-80a2-6817a13d44ed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 204 len: 0 microversion: 2.1 time: 0.293597 Oct 03 15:14:22.144334 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3312/6451] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:14:21 2022] DELETE /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:14:22.168416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:22.169241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:22.176809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:22.177591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:22.178576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:22.182805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:22.183570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:22.184370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:22.214483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] validate_networks() for [('2a8ecdcc-7327-4c13-80e9-23eb17c8b976', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:14:22.332080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:22.432701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:22.441179 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d31b22ab-92fb-414f-b784-4f8d01b9f62f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1396 microversion: 2.1 time: 0.287552 Oct 03 15:14:22.441762 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3313/6452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:22 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1396 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:14:22.905585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:14:22.905585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:14:22.905585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:14:22.905585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:14:22.906251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:14:22.925757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:22.926464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:22.927156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:22.928446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:22.929323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:22.931759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:22.970830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Getting quotas for project 044e27cbe4c5482abc99697c5447f235. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:14:22.989225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Getting quotas for user bd0d476f160a4c248fd3693f2b515ace and project 044e27cbe4c5482abc99697c5447f235. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:14:23.024851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:14:23.037006 n-d-781139-2 devstack@n-api.service[128868]: WARNING nova.utils [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-362144116-access_point-1492873744 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-362144116-acc Oct 03 15:14:23.041100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:14:23.170539 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bcb11132-354d-45df-a22e-699032f5b99f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.289693 Oct 03 15:14:23.171792 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3140/6453] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:14:21 2022] POST /compute/v2.1/servers => generated 457 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:14:23.183187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4b7c4c7-6ee8-4f94-9d1a-713268fbf8dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:23.184657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4b7c4c7-6ee8-4f94-9d1a-713268fbf8dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:23.321709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4b7c4c7-6ee8-4f94-9d1a-713268fbf8dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:23.330642 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4b7c4c7-6ee8-4f94-9d1a-713268fbf8dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1292 microversion: 2.1 time: 0.151418 Oct 03 15:14:23.348588 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3314/6454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:23 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1292 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:23.464541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:23.467003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:23.485701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:23.487356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:23.488446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:23.490299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:23.495353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:23.496131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:24.361146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:24.362110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:24.383458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:24.383976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:24.384678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:24.385335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:24.385780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:24.393715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:24.550573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:24.588103 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63599421-f411-4cb8-86a6-f72f4bf1f2c7 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1288 microversion: 2.1 time: 0.222048 Oct 03 15:14:24.589855 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3315/6455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:24 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1288 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:14:24.907202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:24.917367 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f064b2f0-8038-4127-a403-5c1857f67595 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1396 microversion: 2.1 time: 1.457335 Oct 03 15:14:24.925760 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3141/6456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:23 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1396 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:25.586341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-40a2268e-d7ac-47cc-aa2d-cc667f1547ea req-85384c32-e378-4475-8ed7-83ac6f74b769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26bf99f-9127-4e53-8f3d-b5884339b35a", "name": "network-vif-deleted", "tag": "6bf4b3e9-72f1-409a-af3c-5ec4e74561a0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:25.614816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:25.615785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:25.629008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:25.629518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:25.629954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:25.630749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:25.631242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:25.631663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:25.634601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-40a2268e-d7ac-47cc-aa2d-cc667f1547ea req-85384c32-e378-4475-8ed7-83ac6f74b769 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:25.635637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-40a2268e-d7ac-47cc-aa2d-cc667f1547ea req-85384c32-e378-4475-8ed7-83ac6f74b769 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:25.636404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-40a2268e-d7ac-47cc-aa2d-cc667f1547ea req-85384c32-e378-4475-8ed7-83ac6f74b769 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:25.718912 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-40a2268e-d7ac-47cc-aa2d-cc667f1547ea req-85384c32-e378-4475-8ed7-83ac6f74b769 service nova] Creating event network-vif-deleted:6bf4b3e9-72f1-409a-af3c-5ec4e74561a0 for instance b26bf99f-9127-4e53-8f3d-b5884339b35a on n-h2-781139-2 Oct 03 15:14:25.746100 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-40a2268e-d7ac-47cc-aa2d-cc667f1547ea req-85384c32-e378-4475-8ed7-83ac6f74b769 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163557 Oct 03 15:14:25.747434 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3316/6457] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:25.767948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:25.778686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-519fca29-50ac-4959-98c8-ec34c35a1652 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1350 microversion: 2.1 time: 0.167627 Oct 03 15:14:25.779579 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3142/6458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:25 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:25.957609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:25.959002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:25.972095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:25.973492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:25.974264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:25.975336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:25.976345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:25.977057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:26.107328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:26.117200 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a483b6d1-f0ef-4f3f-b311-c012ef90ffe1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1188 microversion: 2.1 time: 0.165392 Oct 03 15:14:26.118596 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3317/6459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:25 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:26.803640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:26.804368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:26.814893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:26.818928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:26.821309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:26.822531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:26.825584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:26.826348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:27.097501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:27.122976 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e172ae2-ae0e-49f4-8106-44a0b2465e43 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1469 microversion: 2.1 time: 0.323518 Oct 03 15:14:27.124212 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3143/6460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:26 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1469 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:27.142502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:27.143217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:27.152291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:27.152780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:27.153271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:27.153986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:27.154434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:27.156128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:27.298559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:27.327321 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b43c546-e1a2-49c8-ba1f-ca34f68c29e7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1188 microversion: 2.1 time: 0.191283 Oct 03 15:14:27.328430 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3318/6461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:27 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1188 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:27.474267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6726099c-83c9-4a97-9b13-bd9f1d821cae req-965fcf67-d29c-4baa-b67b-32664a29e557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1483db5e-977d-4835-b375-9b5c75fd4fa6", "tag": "bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:27.479800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:27.490485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6726099c-83c9-4a97-9b13-bd9f1d821cae req-965fcf67-d29c-4baa-b67b-32664a29e557 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:27.491380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6726099c-83c9-4a97-9b13-bd9f1d821cae req-965fcf67-d29c-4baa-b67b-32664a29e557 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:27.492075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6726099c-83c9-4a97-9b13-bd9f1d821cae req-965fcf67-d29c-4baa-b67b-32664a29e557 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:27.511877 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6726099c-83c9-4a97-9b13-bd9f1d821cae req-965fcf67-d29c-4baa-b67b-32664a29e557 service nova] Creating event network-changed:bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04 for instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 on n-h2-781139-2 Oct 03 15:14:27.520230 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6726099c-83c9-4a97-9b13-bd9f1d821cae req-965fcf67-d29c-4baa-b67b-32664a29e557 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049509 Oct 03 15:14:27.521435 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3144/6462] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:28.149111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:28.150339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:28.161840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:28.163202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:28.163873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:28.165088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:28.165906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:28.166625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:28.357384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:28.360216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:28.375162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:28.375709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:28.376152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:28.376960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:28.383646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:28.384064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:28.516481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:28.524762 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc7db235-ac49-402d-bd70-772e3a7d1fed tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1188 microversion: 2.1 time: 0.175799 Oct 03 15:14:28.542194 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3145/6463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:28 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1188 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:28.635139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:28.637601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:28.654838 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8396d773-08fb-4a5d-8590-a706d5832404 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1469 microversion: 2.1 time: 0.510475 Oct 03 15:14:28.655788 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3319/6464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:28 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1469 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:29.550129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:29.551508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:29.560618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:29.561618 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:29.562064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:29.562773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:29.563292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:29.563636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:29.568131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:29.638452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:29.651202 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c0ee86d-0ee7-4a69-b493-6f075bd880a7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1188 microversion: 2.1 time: 0.104893 Oct 03 15:14:29.665917 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3146/6465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:29 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1188 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:29.681833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:29.682480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:29.690797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:29.691607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:29.692236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:29.693170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:29.693794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:29.694381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:29.973585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:29.985840 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-497fbb47-5028-4d84-b15f-545aae970d00 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1469 microversion: 2.1 time: 0.309721 Oct 03 15:14:29.989552 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3320/6466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:29 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1469 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:30.674895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:30.675532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:30.696630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:30.696630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:30.696914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:30.700325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:30.701076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:30.701845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:30.791972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:30.804623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6246c64-25bb-4991-94d9-7d497d0ce0e4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 200 len: 1188 microversion: 2.1 time: 0.134288 Oct 03 15:14:30.805832 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3147/6467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:30 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 1188 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:31.010727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:31.011880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:31.019520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:31.020011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:31.020632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:31.021810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:31.022258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:31.023016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:31.185877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:31.195431 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22c07562-bd2a-40e8-9c97-5a46c1a80855 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1469 microversion: 2.1 time: 0.188591 Oct 03 15:14:31.197090 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3321/6468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:31 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:31.828348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:31.829116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: b26bf99f-9127-4e53-8f3d-b5884339b35a] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:31.837006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:31.837917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:31.838744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:31.839691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:31.840683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:31.841350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:31.862183 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance b26bf99f-9127-4e53-8f3d-b5884339b35a could not be found. Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a HTTP/1.1 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance b26bf99f-9127-4e53-8f3d-b5884339b35a could not be found. Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'b26bf99f-9127-4e53-8f3d-b5884339b35a'} Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26bf99f-9127-4e53-8f3d-b5884339b35a could not be found. Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26bf99f-9127-4e53-8f3d-b5884339b35a could not be found. Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:14:31.864664 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:31.869830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:14:31.869830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:14:31.869830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:14:31.869830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:14:31.869830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:14:31.869830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26bf99f-9127-4e53-8f3d-b5884339b35a could not be found. Oct 03 15:14:31.869830 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:14:31.871441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance b26bf99f-9127-4e53-8f3d-b5884339b35a could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:14:31.874064 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a008d7a-eaf2-4f4c-8097-19efdcc1ab2b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a" status: 404 len: 111 microversion: 2.1 time: 0.049130 Oct 03 15:14:31.874868 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3148/6469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:31 2022] GET /compute/v2.1/servers/b26bf99f-9127-4e53-8f3d-b5884339b35a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:14:31.934369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b7abf414-a6af-410e-bdbf-49330ffa40e9 req-dd436cd3-c558-4838-938f-26854680e982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1483db5e-977d-4835-b375-9b5c75fd4fa6", "name": "network-vif-plugged", "status": "completed", "tag": "bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:31.947644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:31.950640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7abf414-a6af-410e-bdbf-49330ffa40e9 req-dd436cd3-c558-4838-938f-26854680e982 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:31.951380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7abf414-a6af-410e-bdbf-49330ffa40e9 req-dd436cd3-c558-4838-938f-26854680e982 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:31.951842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7abf414-a6af-410e-bdbf-49330ffa40e9 req-dd436cd3-c558-4838-938f-26854680e982 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:31.975001 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b7abf414-a6af-410e-bdbf-49330ffa40e9 req-dd436cd3-c558-4838-938f-26854680e982 service nova] Creating event network-vif-plugged:bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04 for instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 on n-h2-781139-2 Oct 03 15:14:31.981604 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b7abf414-a6af-410e-bdbf-49330ffa40e9 req-dd436cd3-c558-4838-938f-26854680e982 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054207 Oct 03 15:14:31.982145 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3322/6470] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:14:32.222467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:32.223885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:32.230723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:32.231339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:32.231966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:32.232740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:32.233425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:32.234157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:32.401230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:32.411254 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b7bc1031-76b6-4b85-87d7-ebf6e7d8c619 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1469 microversion: 2.1 time: 0.191976 Oct 03 15:14:32.412444 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3149/6471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:32 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1469 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:33.439523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:33.440233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:33.444506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:33.454179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:33.454952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:33.455594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:33.456497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:33.457175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:33.457827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:33.651582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:33.660044 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b212fa1f-a3f4-4008-b692-c95450a06ac1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1640 microversion: 2.1 time: 0.225096 Oct 03 15:14:33.660912 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3323/6472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:33 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1640 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:33.684317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:33.684992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:33.688096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:33.689183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:33.696222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:33.696647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:33.697371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:33.699411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:33.699883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:33.700563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:33.881750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:33.893048 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0ca71fb4-b562-47e7-8d52-386497efdbd1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1640 microversion: 2.1 time: 0.212690 Oct 03 15:14:33.894033 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3150/6473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:33 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1640 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:33.918813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:33.920611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:33.928473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:33.928979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:33.929619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:33.930912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:33.931721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:33.934601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:34.276552 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f679eb9-81ce-420b-81f0-76763fb7e95f tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1791 microversion: 2.1 time: 0.362482 Oct 03 15:14:34.277803 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3324/6474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:33 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1791 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:37.439818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-35e94b94-37bb-4b22-adc0-9a4fa754f517 req-00c3cb57-4cfd-498a-9d28-7aa471d49b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1483db5e-977d-4835-b375-9b5c75fd4fa6", "tag": "bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:37.458006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-35e94b94-37bb-4b22-adc0-9a4fa754f517 req-00c3cb57-4cfd-498a-9d28-7aa471d49b15 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:37.459087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-35e94b94-37bb-4b22-adc0-9a4fa754f517 req-00c3cb57-4cfd-498a-9d28-7aa471d49b15 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:37.460061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-35e94b94-37bb-4b22-adc0-9a4fa754f517 req-00c3cb57-4cfd-498a-9d28-7aa471d49b15 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:37.477687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-35e94b94-37bb-4b22-adc0-9a4fa754f517 req-00c3cb57-4cfd-498a-9d28-7aa471d49b15 service nova] Creating event network-changed:bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04 for instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 on n-h2-781139-2 Oct 03 15:14:37.485335 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-35e94b94-37bb-4b22-adc0-9a4fa754f517 req-00c3cb57-4cfd-498a-9d28-7aa471d49b15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051392 Oct 03 15:14:37.486666 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3151/6475] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:38.519352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-325726867", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6e94bd1a-cc64-40b5-a0a0-555fdb32b15b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:38.641011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:14:39.114541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:14:39.114971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:14:39.115918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:14:39.116869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:14:39.118266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:14:39.131174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:39.132075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:39.133150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:39.133933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:39.134400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:39.135138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:39.163425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:14:39.170852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:14:39.238273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:14:39.240789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e94bd1a-cc64-40b5-a0a0-555fdb32b15b',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:14:39.510450 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7c69b6b-9756-478e-8559-4bd19d28774c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994886 Oct 03 15:14:39.511909 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3325/6476] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:14:39.526149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-513bb160-c9c6-44f8-a3d6-923a4cd54dbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:39.526960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-513bb160-c9c6-44f8-a3d6-923a4cd54dbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:39.609710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-513bb160-c9c6-44f8-a3d6-923a4cd54dbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:39.616944 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-513bb160-c9c6-44f8-a3d6-923a4cd54dbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1056 microversion: 2.1 time: 0.097070 Oct 03 15:14:39.618271 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3152/6477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:39 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1056 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:40.641307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:40.642608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:40.661877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:40.662393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:40.662841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:40.663755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:40.664429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:40.665215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:40.748461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:40.758060 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-264511ea-5faa-471d-b108-f3bd29d2988a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1154 microversion: 2.1 time: 0.121686 Oct 03 15:14:40.759810 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3326/6478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:40 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1154 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:14:41.787131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:41.787829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:41.805842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:41.807158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:41.812610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:41.814610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:41.817165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:41.817914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:42.142353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:42.154080 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-325d4eba-2011-4f1a-b663-91412bfedb6a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1214 microversion: 2.1 time: 0.371641 Oct 03 15:14:42.155336 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3153/6479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:41 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:42.722053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d7b41674-a5c7-430e-a99e-b431cc2b63c9 req-2176e95b-9c05-4461-9f22-156e9dd3a9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c815226b-66a8-446b-a07c-0d8e7a985473", "tag": "1879cb15-0636-4d18-9813-180e7d5bed7b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:42.752451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d7b41674-a5c7-430e-a99e-b431cc2b63c9 req-2176e95b-9c05-4461-9f22-156e9dd3a9e4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:42.755168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d7b41674-a5c7-430e-a99e-b431cc2b63c9 req-2176e95b-9c05-4461-9f22-156e9dd3a9e4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:42.756691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d7b41674-a5c7-430e-a99e-b431cc2b63c9 req-2176e95b-9c05-4461-9f22-156e9dd3a9e4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:42.790692 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d7b41674-a5c7-430e-a99e-b431cc2b63c9 req-2176e95b-9c05-4461-9f22-156e9dd3a9e4 service nova] Creating event network-changed:1879cb15-0636-4d18-9813-180e7d5bed7b for instance c815226b-66a8-446b-a07c-0d8e7a985473 on n-h1-781139-2 Oct 03 15:14:42.804000 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d7b41674-a5c7-430e-a99e-b431cc2b63c9 req-2176e95b-9c05-4461-9f22-156e9dd3a9e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094111 Oct 03 15:14:42.808766 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3327/6480] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:43.178272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:43.178886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:43.194362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:43.195234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:43.196897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:43.197888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:43.200046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:43.200704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:43.450544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:43.460114 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c0b57c3-2565-4a2c-9c3c-d1e7cb0dee14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1214 microversion: 2.1 time: 0.285698 Oct 03 15:14:43.466070 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3154/6481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:43 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1214 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:44.485217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:44.485217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:44.505728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:44.506361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:44.507452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:44.509002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:44.509707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:44.510952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:44.677583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:44.689129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-876bf2d0-4a1d-4ab2-8d7d-93e454b16b28 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1214 microversion: 2.1 time: 0.209798 Oct 03 15:14:44.690387 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3328/6482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:44 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:45.712344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:45.714824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:45.726016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:45.727166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:45.727858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:45.729656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:45.730357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:45.731289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:45.919805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:45.928085 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8195b20b-710d-4242-9d4b-6ceaf9c8c42b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1214 microversion: 2.1 time: 0.220181 Oct 03 15:14:45.929024 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3155/6483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:45 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:46.952570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:46.953966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:46.967045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:46.967776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:46.968453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:46.969904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:46.971713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:46.972492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:47.147221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:47.159043 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16817a02-1fbb-4c83-b375-4ef7c828b687 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1214 microversion: 2.1 time: 0.210908 Oct 03 15:14:47.173395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3329/6484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:46 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:48.184214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:48.185504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:48.194268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:48.195265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:48.196431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:48.197517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:48.197909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:48.198341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:48.374486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:48.384247 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db2e993c-86fa-4409-9a3f-41989e85aae0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.205180 Oct 03 15:14:48.388981 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3156/6485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:48 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:49.408096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:49.409622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:49.412727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:49.414221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:49.422066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:49.422856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:49.423526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:49.424231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:49.424906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:49.425427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:49.575908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:49.586096 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e664196-6346-49da-9f1b-502c7a440a27 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.182478 Oct 03 15:14:49.588908 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3330/6486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:49 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:50.611907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:50.613729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:50.617422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:50.634425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:50.635262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:50.636483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:50.637808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:50.639113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:50.644445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:50.829878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:50.839393 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-17e7294c-fdc2-4c1f-8833-9ce465439879 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.231780 Oct 03 15:14:50.840740 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3157/6487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:50 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:51.870807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:51.871501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:51.878835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:51.879309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:51.879741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:51.880466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:51.881027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:51.881531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:52.310748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:52.320548 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f42facdc-6f95-407b-a02a-e8fbac53da39 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.457510 Oct 03 15:14:52.321186 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3331/6488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:51 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:53.343676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:53.344287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:53.354508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:53.354974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:53.355622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:53.356612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:53.357130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:53.357663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:53.501880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:53.510436 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53bc2b76-831f-441d-8c61-9d2cb97e79b0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.171041 Oct 03 15:14:53.511026 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3158/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:53 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:54.535851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:54.540118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:54.559207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:54.559749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:54.560203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:54.561000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:54.561430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:54.561852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:54.754888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:54.765532 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5e76df1-1cef-4d91-8acc-989abcd705e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.235700 Oct 03 15:14:54.766804 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3332/6490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:54 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:55.792029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:55.793426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:55.801857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:55.802680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:55.803314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:55.804641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:55.805447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:55.806090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:55.873414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-491a902c-9706-429f-8322-ccec4d1e2dc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'create', calling method: .version_select at 0x7fb22b4940d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-891637635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjYl378DeYZt3ZQ2l951vGAhjKgwoCegmcgOesKqOozf6mYsTpRDipHXTvrtmC9v8Cz9WKHUQsqMHXdFGQkz06zjeftlhIU8HsSsPeCnaQznsjt2tXZdwWRB9BabNeIyQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:55.931989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-491a902c-9706-429f-8322-ccec4d1e2dc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:14:55.940064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-491a902c-9706-429f-8322-ccec4d1e2dc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for user 29afda2312af4c12b881f6c1da67ef79 and project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:14:55.981650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-491a902c-9706-429f-8322-ccec4d1e2dc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.113849 Oct 03 15:14:55.990625 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3333/6491] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:14:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:14:56.110019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:56.134343 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03c37446-2f03-44d5-b818-ea4f8e67e5fd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.346729 Oct 03 15:14:56.157423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3159/6492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:55 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:57.173232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:57.175530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:57.187819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:57.188577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:57.189293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:57.190242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:57.190943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:57.191556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:57.305623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1128757467", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "f73b8617-eb80-46dd-a922-bed11495a500"}], "key_name": "tempest-TestNetworkBasicOps-891637635", "security_groups": [{"name": "tempest-secgroup-smoke-515406416"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:57.394135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:57.403417 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5313b2a1-373c-46f6-a10e-37e0f9c7348c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.234522 Oct 03 15:14:57.405189 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3334/6493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:57 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:57.493993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] validate_networks() for [('f73b8617-eb80-46dd-a922-bed11495a500', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:14:57.688833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=36 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:57.899211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:14:57.899424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:14:57.900001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:14:57.900517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:14:57.901050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:14:57.912762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:57.915370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:57.916123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:57.917288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:57.917979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:57.918770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:57.940047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:14:57.946568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for user 29afda2312af4c12b881f6c1da67ef79 and project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:14:57.963777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:14:57.967456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:14:58.033306 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0881b781-9330-41ca-98f1-d683638b87ef tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736563 Oct 03 15:14:58.037569 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3160/6494] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:14:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:14:58.045574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1291995-a7d7-4b45-b3bb-ecdf9b323001 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:58.046191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1291995-a7d7-4b45-b3bb-ecdf9b323001 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:58.122020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1291995-a7d7-4b45-b3bb-ecdf9b323001 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:58.134139 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1291995-a7d7-4b45-b3bb-ecdf9b323001 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1248 microversion: 2.1 time: 0.092323 Oct 03 15:14:58.135086 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3335/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:58 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:58.428092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:58.429707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:58.438738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:58.439595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:58.440380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:58.441360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:58.441806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:58.442449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:58.605593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:58.614069 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c356a197-ad7b-4a9a-b76d-ce5ca73eb1a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.189948 Oct 03 15:14:58.614689 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3161/6496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:58 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:58.826790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e02c2f71-ac9d-476c-8307-2f783ea061a7 req-f488cbfd-ee60-46ee-9161-5a83b7e16edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c815226b-66a8-446b-a07c-0d8e7a985473", "name": "network-vif-plugged", "status": "completed", "tag": "1879cb15-0636-4d18-9813-180e7d5bed7b"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:14:58.855746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e02c2f71-ac9d-476c-8307-2f783ea061a7 req-f488cbfd-ee60-46ee-9161-5a83b7e16edd service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:58.856251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e02c2f71-ac9d-476c-8307-2f783ea061a7 req-f488cbfd-ee60-46ee-9161-5a83b7e16edd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:58.859203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e02c2f71-ac9d-476c-8307-2f783ea061a7 req-f488cbfd-ee60-46ee-9161-5a83b7e16edd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:58.892680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e02c2f71-ac9d-476c-8307-2f783ea061a7 req-f488cbfd-ee60-46ee-9161-5a83b7e16edd service nova] Creating event network-vif-plugged:1879cb15-0636-4d18-9813-180e7d5bed7b for instance c815226b-66a8-446b-a07c-0d8e7a985473 on n-h1-781139-2 Oct 03 15:14:58.905625 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e02c2f71-ac9d-476c-8307-2f783ea061a7 req-f488cbfd-ee60-46ee-9161-5a83b7e16edd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082432 Oct 03 15:14:58.907165 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3336/6497] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:14:59.161633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:59.162257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:59.168799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:59.169322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:59.169765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:59.170473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:59.170926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:59.171356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:59.235729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:59.244476 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-160498e3-8344-44af-a65a-14a5babbab19 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1300 microversion: 2.1 time: 0.086668 Oct 03 15:14:59.245341 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3162/6498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:59 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:14:59.640741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:14:59.641549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:14:59.648385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:59.649080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:59.649646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:59.650468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:14:59.651025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:14:59.651585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:14:59.844207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:14:59.848156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=80 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:14:59.857539 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfd78062-b9df-4dc7-8493-79efc17a3c82 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1202 microversion: 2.1 time: 0.221082 Oct 03 15:14:59.858371 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3337/6499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:14:59 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:00.267701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:00.268855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:00.276789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:00.277556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:00.278156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:00.279252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:00.279877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:00.280490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:00.283714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=84 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:00.357967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:00.368548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bfeaaa5f-cfdf-4310-9691-bc372f605cbf tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1306 microversion: 2.1 time: 0.104650 Oct 03 15:15:00.369707 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3163/6500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:00 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:00.879713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:00.880468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:00.892782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:00.895300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:00.896691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:00.898016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:00.902833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:00.903516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.190263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:01.203481 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-703c711d-7f48-466e-957c-8fed4f731841 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1389 microversion: 2.1 time: 0.327477 Oct 03 15:15:01.217619 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3338/6501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:00 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1389 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:01.232442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:01.237172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:01.244396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.245136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.245764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.246781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.247410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.248025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.395258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:01.396803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:01.421417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:01.430316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.432890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2290def0-e413-47a7-9e0c-3627d51f3bcb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1389 microversion: 2.1 time: 0.208728 Oct 03 15:15:01.434661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.437452 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3164/6502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:01 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1389 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:01.441569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.443674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.444347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.446791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.460351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:01.462717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:01.477600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.478483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.479519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.480766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.481579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.482162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.654268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:01.663135 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5b654597-14bd-4016-9f5b-bcaee8c536da tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1389 microversion: 2.1 time: 0.207003 Oct 03 15:15:01.663956 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3165/6503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:01 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1389 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:01.687330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-809ad95d-3acc-49bd-8b85-81b84d0e615a req-be59721a-ccc8-4281-8b91-7a99cb3af8ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f05cf0ce-512a-45eb-b7a9-e8964c209adf", "tag": "9b4c41e3-a92e-4241-bd90-f3841019019e"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:01.698100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-809ad95d-3acc-49bd-8b85-81b84d0e615a req-be59721a-ccc8-4281-8b91-7a99cb3af8ef service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.698701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-809ad95d-3acc-49bd-8b85-81b84d0e615a req-be59721a-ccc8-4281-8b91-7a99cb3af8ef service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.699193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-809ad95d-3acc-49bd-8b85-81b84d0e615a req-be59721a-ccc8-4281-8b91-7a99cb3af8ef service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.720471 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-809ad95d-3acc-49bd-8b85-81b84d0e615a req-be59721a-ccc8-4281-8b91-7a99cb3af8ef service nova] Creating event network-changed:9b4c41e3-a92e-4241-bd90-f3841019019e for instance f05cf0ce-512a-45eb-b7a9-e8964c209adf on n-h2-781139-2 Oct 03 15:15:01.732530 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-809ad95d-3acc-49bd-8b85-81b84d0e615a req-be59721a-ccc8-4281-8b91-7a99cb3af8ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051754 Oct 03 15:15:01.733653 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3166/6504] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:01.740320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:01.741617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:01.746644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:01.749785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.750529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.751126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.752106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.752562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.753447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.756243 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-885bb4b2-7a78-45fc-8f06-2cfedc8c979a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1373 microversion: 2.1 time: 0.366488 Oct 03 15:15:01.760795 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3339/6505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:01 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1373 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:01.790173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:15:01.877611 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8fdc1e5a-eb42-44c8-9d85-358f6c75bd6f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 204 len: 0 microversion: 2.1 time: 0.142270 Oct 03 15:15:01.878284 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3167/6506] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:15:01 2022] DELETE /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:15:01.887043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:01.888297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:01.895263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.895747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.896370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:01.897117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:01.897560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:01.898198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:02.120063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:02.128277 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fb4e8ff7-527f-48c3-bac0-9930ec4a3613 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1395 microversion: 2.1 time: 0.245443 Oct 03 15:15:02.129387 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3340/6507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:01 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1395 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:02.784107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:02.785772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:02.794194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:02.794890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:02.795566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:02.796279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:02.796725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:02.797184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:02.949000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:02.957042 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a786f1c-9ef4-46a8-a77b-bef30d5bb159 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1373 microversion: 2.1 time: 0.177489 Oct 03 15:15:02.957621 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3168/6508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:02 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:03.152529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:03.153836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:03.161448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:03.161936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:03.162369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:03.163071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:03.163634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:03.164113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:03.376306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:03.386345 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05718954-980a-436b-ad6b-7aed1a5f320f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1395 microversion: 2.1 time: 0.238281 Oct 03 15:15:03.387209 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3341/6509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:03 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1395 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:03.982647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:03.984383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:03.993129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:03.994018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:03.994804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:03.995739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:04.014762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:04.015831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:04.232977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:04.241339 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-91292025-8c1d-4544-bc56-3d196c1892eb tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1373 microversion: 2.1 time: 0.264957 Oct 03 15:15:04.242679 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3169/6510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:03 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1373 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:04.410193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:04.410819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:04.414363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:04.424077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:04.425474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:04.432999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:04.433995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:04.434734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:04.434923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:04.544201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:04.554967 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-02b9db95-6386-498f-b00c-a884eb8baef8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1353 microversion: 2.1 time: 0.149057 Oct 03 15:15:04.558509 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3342/6511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:04 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:04.703729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-37a9297f-4a04-4786-a2cf-d7062fdfd45b req-f3c2c103-bb19-4f31-a90d-e33005e03f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c815226b-66a8-446b-a07c-0d8e7a985473", "name": "network-vif-deleted", "tag": "1879cb15-0636-4d18-9813-180e7d5bed7b"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:04.717528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-37a9297f-4a04-4786-a2cf-d7062fdfd45b req-f3c2c103-bb19-4f31-a90d-e33005e03f5f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:04.718485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-37a9297f-4a04-4786-a2cf-d7062fdfd45b req-f3c2c103-bb19-4f31-a90d-e33005e03f5f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:04.719113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-37a9297f-4a04-4786-a2cf-d7062fdfd45b req-f3c2c103-bb19-4f31-a90d-e33005e03f5f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:04.734743 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-37a9297f-4a04-4786-a2cf-d7062fdfd45b req-f3c2c103-bb19-4f31-a90d-e33005e03f5f service nova] Creating event network-vif-deleted:1879cb15-0636-4d18-9813-180e7d5bed7b for instance c815226b-66a8-446b-a07c-0d8e7a985473 on n-h1-781139-2 Oct 03 15:15:04.741699 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-37a9297f-4a04-4786-a2cf-d7062fdfd45b req-f3c2c103-bb19-4f31-a90d-e33005e03f5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283487 Oct 03 15:15:04.745085 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3170/6512] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:15:05.265538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:05.266151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:05.272909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:05.273830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:05.274531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:05.275517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:05.275977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:05.276403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:05.429333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:05.438269 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-333644a7-a794-4d81-867c-c2470b29a60f tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1373 microversion: 2.1 time: 0.177172 Oct 03 15:15:05.438970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3343/6513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:05 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:05.581477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:05.582411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:05.589317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:05.590130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:05.590809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:05.592156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:05.592821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:05.593492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:05.659174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:05.669826 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8891f20e-a490-4dcf-b4c1-8d1410ef6fb2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1187 microversion: 2.1 time: 0.093713 Oct 03 15:15:05.670423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3171/6514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:05 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:06.087242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-050d7db4-36a4-4847-897c-9e9d0f682625 req-77dcd621-2d7a-4d43-97eb-b8f2ecd89446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05cf0ce-512a-45eb-b7a9-e8964c209adf", "name": "network-vif-plugged", "status": "completed", "tag": "9b4c41e3-a92e-4241-bd90-f3841019019e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:06.098567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-050d7db4-36a4-4847-897c-9e9d0f682625 req-77dcd621-2d7a-4d43-97eb-b8f2ecd89446 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:06.099219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-050d7db4-36a4-4847-897c-9e9d0f682625 req-77dcd621-2d7a-4d43-97eb-b8f2ecd89446 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:06.099625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-050d7db4-36a4-4847-897c-9e9d0f682625 req-77dcd621-2d7a-4d43-97eb-b8f2ecd89446 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:06.113976 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-050d7db4-36a4-4847-897c-9e9d0f682625 req-77dcd621-2d7a-4d43-97eb-b8f2ecd89446 service nova] Creating event network-vif-plugged:9b4c41e3-a92e-4241-bd90-f3841019019e for instance f05cf0ce-512a-45eb-b7a9-e8964c209adf on n-h2-781139-2 Oct 03 15:15:06.120335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-050d7db4-36a4-4847-897c-9e9d0f682625 req-77dcd621-2d7a-4d43-97eb-b8f2ecd89446 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036901 Oct 03 15:15:06.120979 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3344/6515] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:15:06.461233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:06.461860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:06.468801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:06.469330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:06.469779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:06.470487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:06.470951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:06.471380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:06.618108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:06.626559 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d50b2f37-30f6-40c0-a096-ab736e5596d3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1373 microversion: 2.1 time: 0.169816 Oct 03 15:15:06.627350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3172/6516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:06 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:06.695812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:06.696553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:06.703623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:06.704277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:06.704853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:06.705678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:06.706387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:06.706855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:06.777829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:06.787111 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cc02ccdd-f00e-4735-8953-35a56f2bc0cb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1187 microversion: 2.1 time: 0.097955 Oct 03 15:15:06.787910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3345/6517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:06 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:07.649619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:07.651017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:07.658145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:07.659074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:07.659563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:07.660480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:07.661169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:07.661597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:07.802735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:07.809655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:07.810989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:07.814515 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ea9ed50c-6f87-46b8-8ac7-ba1272d18c8d tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1545 microversion: 2.1 time: 0.168590 Oct 03 15:15:07.815290 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3173/6518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:07 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1545 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:07.820132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:07.821106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:07.821921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:07.822900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:07.823431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:07.824090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:07.838087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:07.838709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:07.847073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:07.847568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:07.848230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:07.849169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:07.850125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:07.850598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:07.902505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:07.912001 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63618f66-9ef7-4d8c-bf9a-decf52d8d0be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1187 microversion: 2.1 time: 0.105744 Oct 03 15:15:07.926481 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3346/6519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:07 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:07.928789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:07.958609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:08.026821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:08.035870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a47e90d-0125-44f8-bbee-39934c69c759 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1545 microversion: 2.1 time: 0.201699 Oct 03 15:15:08.036971 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3174/6520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:07 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1545 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:08.936520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:08.937212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:08.939314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:08.949270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:08.950083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:08.950774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:08.951602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:08.951962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:08.952398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:08.989503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:08.989992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:08.990438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:08.990895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lazy-loading 'fault' on Instance uuid c815226b-66a8-446b-a07c-0d8e7a985473 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:15:09.037849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:09.046411 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f522b9f2-852e-4c17-a2b2-e3261ad1c759 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 200 len: 1192 microversion: 2.1 time: 0.114007 Oct 03 15:15:09.047013 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3347/6521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:08 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 1192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:10.069104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:10.069744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: c815226b-66a8-446b-a07c-0d8e7a985473] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:10.077077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:10.077574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:10.078005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:10.078713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:10.079157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:10.079582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:10.094840 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance c815226b-66a8-446b-a07c-0d8e7a985473 could not be found. Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 HTTP/1.1 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance c815226b-66a8-446b-a07c-0d8e7a985473 could not be found. Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c815226b-66a8-446b-a07c-0d8e7a985473'} Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c815226b-66a8-446b-a07c-0d8e7a985473 could not be found. Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c815226b-66a8-446b-a07c-0d8e7a985473 could not be found. Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:10.096749 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c815226b-66a8-446b-a07c-0d8e7a985473 could not be found. Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance c815226b-66a8-446b-a07c-0d8e7a985473 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9f7dbb1-0435-402e-b50a-ae47f034fd44 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473" status: 404 len: 111 microversion: 2.1 time: 0.033049 Oct 03 15:15:10.104511 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3175/6522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:10 2022] GET /compute/v2.1/servers/c815226b-66a8-446b-a07c-0d8e7a985473 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:15:19.692270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-455415611", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "05081bfe-0a61-4132-8c3d-782f972aca19"}], "key_name": "tempest-TestSecurityGroupsBasicOps-31114426", "security_groups": []}, "os:scheduler_hints": {"different_host": ["1483db5e-977d-4835-b375-9b5c75fd4fa6"]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:19.704643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=13 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:19.706707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=59 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:19.760093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] validate_networks() for [('05081bfe-0a61-4132-8c3d-782f972aca19', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:15:20.232132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:15:20.232555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:15:20.233057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:15:20.233461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:15:20.233873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:15:20.246453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:20.247723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:20.248245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:20.259844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:20.259844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:20.259844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:20.279249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Getting quotas for project 044e27cbe4c5482abc99697c5447f235. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:15:20.288717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Getting quotas for user bd0d476f160a4c248fd3693f2b515ace and project 044e27cbe4c5482abc99697c5447f235. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:15:20.309766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:15:20.313135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:15:20.370825 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26b285ba-3d04-4ac9-b84c-630f1569eca4 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.681873 Oct 03 15:15:20.380258 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3348/6523] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:15:19 2022] POST /compute/v2.1/servers => generated 361 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:15:20.384162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-abecebef-4bf1-461b-b85c-05df6c83eeda tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:20.384779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-abecebef-4bf1-461b-b85c-05df6c83eeda tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:20.390662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:20.391367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:20.470929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-abecebef-4bf1-461b-b85c-05df6c83eeda tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:20.478005 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-abecebef-4bf1-461b-b85c-05df6c83eeda tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1239 microversion: 2.1 time: 0.098269 Oct 03 15:15:20.478950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3176/6524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:20 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:21.502480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:21.503797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:21.514897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:21.515493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:21.516132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:21.516853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:21.517493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:21.518086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:21.586737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:21.596591 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce9ec868-2285-48a3-9b35-3feb04a5cf73 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1291 microversion: 2.1 time: 0.097984 Oct 03 15:15:21.597600 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3349/6525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:21 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1291 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:22.620314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:22.621160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:22.636912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:22.637750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:22.645392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:22.646353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:22.647152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:22.647755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:22.779227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:22.794390 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f83ea438-d5dc-4620-a093-cfe6553bd674 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.177162 Oct 03 15:15:22.808971 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3177/6526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:22 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:23.819266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:23.821073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:23.828954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:23.830058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:23.831040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:23.832264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:23.832980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:23.833622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:23.932860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:23.941861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8da3e128-2f9b-42f1-9019-241da437329c tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.126723 Oct 03 15:15:23.942460 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3350/6527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:23 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:24.442330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1726f168-7407-4f75-be83-d7b204f40763 req-902469c9-025d-4d5b-b526-13ab2a867513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68", "tag": "835271d6-5f13-4783-9e19-bf91400d8487"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:24.454969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1726f168-7407-4f75-be83-d7b204f40763 req-902469c9-025d-4d5b-b526-13ab2a867513 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:24.455567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1726f168-7407-4f75-be83-d7b204f40763 req-902469c9-025d-4d5b-b526-13ab2a867513 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:24.456101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1726f168-7407-4f75-be83-d7b204f40763 req-902469c9-025d-4d5b-b526-13ab2a867513 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:24.500287 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1726f168-7407-4f75-be83-d7b204f40763 req-902469c9-025d-4d5b-b526-13ab2a867513 service nova] Creating event network-changed:835271d6-5f13-4783-9e19-bf91400d8487 for instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 on n-h1-781139-2 Oct 03 15:15:24.506880 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1726f168-7407-4f75-be83-d7b204f40763 req-902469c9-025d-4d5b-b526-13ab2a867513 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071180 Oct 03 15:15:24.510133 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3178/6528] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:24.965395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:24.966638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:24.973908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:24.974412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:24.974846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:24.975558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:24.976192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:24.976823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:25.090606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:25.101423 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09b2fa07-c644-4990-93cd-7e356c0067dc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.139310 Oct 03 15:15:25.102594 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3351/6529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:24 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:26.129045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:26.129781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:26.136261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:26.136736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:26.137197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:26.137883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:26.138334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:26.138751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:26.232852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:26.247873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-39bbf01e-6bf5-47f7-8ec6-9b1991d511ec tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.123935 Oct 03 15:15:26.249177 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3179/6530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:26 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:27.278489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:27.279354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:27.293416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:27.294219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:27.294886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:27.295826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:27.296245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:27.297045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:27.391349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:27.400128 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2442333-ccb4-4501-aafd-322be4494d4b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.127927 Oct 03 15:15:27.400731 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3352/6531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:27 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:28.423838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:28.425165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:28.434104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:28.434972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:28.435617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:28.452312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:28.452978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:28.453280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:28.671000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:28.683084 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be4bc101-e67c-4a70-a9c6-eac5e57f0baf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.263259 Oct 03 15:15:28.685565 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3180/6532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:28 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:29.708779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:29.709857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:29.720223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:29.720785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:29.721339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:29.722122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:29.722789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:29.723276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:29.821251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:29.830423 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7063f9de-5bd5-41a4-a036-b6072c3f8a90 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.125996 Oct 03 15:15:29.831110 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3353/6533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:29 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:30.670305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-665f49ab-81be-496b-9028-07d6caca53ee req-2b1714c6-b430-41e3-a470-eacfb56949d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68", "name": "network-vif-plugged", "status": "completed", "tag": "835271d6-5f13-4783-9e19-bf91400d8487"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:30.681560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:30.700601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-665f49ab-81be-496b-9028-07d6caca53ee req-2b1714c6-b430-41e3-a470-eacfb56949d3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:30.703156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-665f49ab-81be-496b-9028-07d6caca53ee req-2b1714c6-b430-41e3-a470-eacfb56949d3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:30.703606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-665f49ab-81be-496b-9028-07d6caca53ee req-2b1714c6-b430-41e3-a470-eacfb56949d3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:30.734985 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-665f49ab-81be-496b-9028-07d6caca53ee req-2b1714c6-b430-41e3-a470-eacfb56949d3 service nova] Creating event network-vif-plugged:835271d6-5f13-4783-9e19-bf91400d8487 for instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 on n-h1-781139-2 Oct 03 15:15:30.749321 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-665f49ab-81be-496b-9028-07d6caca53ee req-2b1714c6-b430-41e3-a470-eacfb56949d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082852 Oct 03 15:15:30.752856 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3181/6534] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:30.863804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:30.865234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:30.874862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:30.876578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:30.883499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:30.884585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:30.885278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:30.887929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:30.890972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:30.891594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:31.005182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:31.015602 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d36c0ffe-a2a5-4411-9ea3-8fa6ef7fcb29 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.163131 Oct 03 15:15:31.016379 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3354/6535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:30 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:32.039910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:32.040694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:32.048364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:32.048955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:32.049478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:32.050253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:32.050772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:32.051265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:32.145347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:32.155291 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eb18bdc5-13ea-49cf-9528-8f6ea9a71f5e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1297 microversion: 2.1 time: 0.119967 Oct 03 15:15:32.167717 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3182/6536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:32 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1297 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:33.180703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:33.185683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:33.193873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.195050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.195922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.198354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.199171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.199906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.296334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:33.308349 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7143017d-39e6-44bf-9993-4ef6dcb2f977 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1469 microversion: 2.1 time: 0.132620 Oct 03 15:15:33.319785 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3355/6537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:33 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1469 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:33.331466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:33.332816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:33.341119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.341607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.342267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.343316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.343783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.344387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.470762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:33.484336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4845d394-2d9c-4247-9846-33c787d10326 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1469 microversion: 2.1 time: 0.156654 Oct 03 15:15:33.500383 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3183/6538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:33 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:33.514480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:33.514480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:33.517835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.518569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.519294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.520701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.521302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.522334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.631041 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-077d0fd3-0191-4969-82c7-acd4dc516dd7 tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1620 microversion: 2.1 time: 0.125241 Oct 03 15:15:33.637121 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3356/6539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:33 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1620 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:33.659281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:33.660069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:33.666873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.667485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.668052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.668857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:33.669443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:33.669963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:33.993091 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33947c4c-8c4d-4755-9e0f-f3e3c195225a tempest-TestSecurityGroupsBasicOps-258966502 tempest-TestSecurityGroupsBasicOps-258966502-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1910 microversion: 2.1 time: 0.337434 Oct 03 15:15:33.997146 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3184/6540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:33 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1910 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:34.077663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:34.078093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:34.084457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.090752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.091569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.092344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.092807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.094042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.123593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:15:34.222118 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae2a9817-9818-471c-8be4-16e713fd442b tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 204 len: 0 microversion: 2.1 time: 0.148080 Oct 03 15:15:34.223167 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3357/6541] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:15:34 2022] DELETE /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:15:34.235544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:34.236273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:34.243377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.244157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.244853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.245802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.246448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.247090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.288269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:34.288996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:34.298017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.298720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.299338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.300516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.301279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.301914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.359391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:15:34.379373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:34.390028 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92d6c18a-e6e1-43ce-b6dc-70ebac45e198 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1475 microversion: 2.1 time: 0.161884 Oct 03 15:15:34.393415 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3185/6542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:34 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1475 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:34.504276 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c9b2558-9157-4c40-a321-5eb2b6c91e11 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 204 len: 0 microversion: 2.1 time: 0.220487 Oct 03 15:15:34.505050 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3358/6543] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:15:34 2022] DELETE /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:15:34.513752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:34.514370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:34.523596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.524090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.524529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.530217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:34.530955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:34.531770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:34.750275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:34.769288 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3fcf75a5-ce35-4b89-8497-ad86506f9cc8 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1551 microversion: 2.1 time: 0.255805 Oct 03 15:15:34.770191 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3186/6544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:34 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1551 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:35.431201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:35.432158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:35.441595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:35.442253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:35.442835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:35.443755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:35.444221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:35.445224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:35.550898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:35.568973 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-15c64926-83cf-438c-bc4e-15cf24457165 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1475 microversion: 2.1 time: 0.151366 Oct 03 15:15:35.569910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3359/6545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:35 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1475 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:35.793537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:35.794225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:35.801774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:35.802809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:35.803450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:35.809442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:35.809951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:35.810395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:36.208736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:36.230864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b3faf252-8dfa-425f-9289-7e8ad79535a2 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 200 len: 1551 microversion: 2.1 time: 0.441476 Oct 03 15:15:36.231785 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3187/6546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:35 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 1551 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:36.431247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f5213ff3-cd13-4d88-84fc-a3da784888cf req-ad31613f-1062-4c1e-a163-d32423637232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f05cf0ce-512a-45eb-b7a9-e8964c209adf", "name": "network-vif-deleted", "tag": "9b4c41e3-a92e-4241-bd90-f3841019019e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:36.453184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f5213ff3-cd13-4d88-84fc-a3da784888cf req-ad31613f-1062-4c1e-a163-d32423637232 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:36.456348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f5213ff3-cd13-4d88-84fc-a3da784888cf req-ad31613f-1062-4c1e-a163-d32423637232 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:36.456706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f5213ff3-cd13-4d88-84fc-a3da784888cf req-ad31613f-1062-4c1e-a163-d32423637232 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:36.488388 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f5213ff3-cd13-4d88-84fc-a3da784888cf req-ad31613f-1062-4c1e-a163-d32423637232 service nova] Creating event network-vif-deleted:9b4c41e3-a92e-4241-bd90-f3841019019e for instance f05cf0ce-512a-45eb-b7a9-e8964c209adf on n-h2-781139-2 Oct 03 15:15:36.493458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f5213ff3-cd13-4d88-84fc-a3da784888cf req-ad31613f-1062-4c1e-a163-d32423637232 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066528 Oct 03 15:15:36.497811 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3360/6547] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:36.606907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:36.607735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:36.619051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:36.619925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:36.621076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:36.627258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:36.628888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:36.629370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:36.753611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:36.782189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61558be7-fa63-4cf0-8dd5-da6d2deeacfb tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 200 len: 1475 microversion: 2.1 time: 0.168238 Oct 03 15:15:36.789329 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3188/6548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:36 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 1475 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:36.826578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2eaba418-e733-4c80-b4c5-4f38cfd1dff5 req-c08d0b66-1cd0-41a1-a54a-602e3bd32c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68", "name": "network-vif-deleted", "tag": "835271d6-5f13-4783-9e19-bf91400d8487"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:36.839475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2eaba418-e733-4c80-b4c5-4f38cfd1dff5 req-c08d0b66-1cd0-41a1-a54a-602e3bd32c61 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:36.840255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2eaba418-e733-4c80-b4c5-4f38cfd1dff5 req-c08d0b66-1cd0-41a1-a54a-602e3bd32c61 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:36.840952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2eaba418-e733-4c80-b4c5-4f38cfd1dff5 req-c08d0b66-1cd0-41a1-a54a-602e3bd32c61 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:36.861624 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2eaba418-e733-4c80-b4c5-4f38cfd1dff5 req-c08d0b66-1cd0-41a1-a54a-602e3bd32c61 service nova] Creating event network-vif-deleted:835271d6-5f13-4783-9e19-bf91400d8487 for instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 on n-h1-781139-2 Oct 03 15:15:36.869908 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2eaba418-e733-4c80-b4c5-4f38cfd1dff5 req-c08d0b66-1cd0-41a1-a54a-602e3bd32c61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045703 Oct 03 15:15:36.871279 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3361/6549] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:37.260949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:37.262221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: f05cf0ce-512a-45eb-b7a9-e8964c209adf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:37.278822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:37.279557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:37.280168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:37.281290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:37.283290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:37.284063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:37.309088 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] HTTP exception thrown: Instance f05cf0ce-512a-45eb-b7a9-e8964c209adf could not be found. Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Request method failure captured: Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf HTTP/1.1 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvv_qDyAMEs2SKKqMfBltWvukrDvS5ZtSYOruGhcqaWrizWg5I79Y1E-dSlsmOVaY8leZIwZXEIg2XArepHtxy2X8UnX6gQkVdNlg6IcfMEd401adhJiKFXxgJRSIXTGou1kVK2TbQQbPHazVGK1BT389EsuIAi3MZAkQBVmgKIyWs4 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 911d9ea997ce4ab3ae91e1cfed1e64dc Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911d9ea997ce4ab3ae91e1cfed1e64dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 911d9ea997ce4ab3ae91e1cfed1e64dc Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestNetworkBasicOps-1862598995-project Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 29afda2312af4c12b881f6c1da67ef79 Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestNetworkBasicOps-1862598995-project Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f05cf0ce-512a-45eb-b7a9-e8964c209adf could not be found. Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f05cf0ce-512a-45eb-b7a9-e8964c209adf'} Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f05cf0ce-512a-45eb-b7a9-e8964c209adf could not be found. Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f05cf0ce-512a-45eb-b7a9-e8964c209adf could not be found. Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:37.314032 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.319126 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:37.319126 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:37.319126 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:37.319126 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:15:37.319126 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:15:37.319126 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f05cf0ce-512a-45eb-b7a9-e8964c209adf could not be found. Oct 03 15:15:37.319126 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.321587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Returning 404 to user: Instance f05cf0ce-512a-45eb-b7a9-e8964c209adf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:15:37.322998 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d88074b1-cdf7-448a-95cf-0c4f1068ade5 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf" status: 404 len: 111 microversion: 2.1 time: 0.068143 Oct 03 15:15:37.323832 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3189/6550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:37 2022] GET /compute/v2.1/servers/f05cf0ce-512a-45eb-b7a9-e8964c209adf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:15:37.521639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-976bebac-d7dc-44e2-ad81-b417fae7f035 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '.version_select at 0x7fb22b428c10>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:37.563557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-976bebac-d7dc-44e2-ad81-b417fae7f035 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-891637635" status: 202 len: 0 microversion: 2.1 time: 0.046344 Oct 03 15:15:37.565791 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3362/6551] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 3 15:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-891637635 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:15:37.808780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:37.809571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:37.816660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:37.818815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:37.819382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:37.820598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:37.821653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:37.822389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:37.841906 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] HTTP exception thrown: Instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 could not be found. Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Request method failure captured: Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 HTTP/1.1 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvxCpc0oN2J891VTO0481FvWipcdzLPIoMUUxZmuyErQ4Td87Dwm0OjNCjSgpKbFI_-dCPal0DSFVWBHL1CjxXfbVOFv5x-aWMkhtp4cHbMj45Ek-7-JdJTcqk-PBRy7Q-ohzDsCd03_AKD1CxqSnKjuGh_-Badn_i07AKu6VdQAuno Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 044e27cbe4c5482abc99697c5447f235 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-362144116 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/044e27cbe4c5482abc99697c5447f235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_044e27cbe4c5482abc99697c5447f235", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/044e27cbe4c5482abc99697c5447f235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/044e27cbe4c5482abc99697c5447f235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestSecurityGroupsBasicOps-362144116 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 044e27cbe4c5482abc99697c5447f235 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-362144116 Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestSecurityGroupsBasicOps-362144116-project Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: bd0d476f160a4c248fd3693f2b515ace Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestSecurityGroupsBasicOps-362144116-project Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 could not be found. Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68'} Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 could not be found. Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 could not be found. Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:37.845099 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.849762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:37.849762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:37.849762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:37.849762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:15:37.849762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:15:37.849762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 could not be found. Oct 03 15:15:37.849762 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:37.850671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Returning 404 to user: Instance eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:15:37.854385 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-688c8926-d77b-4b6b-acc4-8610e1b4748f tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68" status: 404 len: 111 microversion: 2.1 time: 0.049562 Oct 03 15:15:37.858764 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3190/6552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:37 2022] GET /compute/v2.1/servers/eec7ff2e-ec7f-4dbd-a9b2-ed86434cbd68 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:15:41.105408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-135740567", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ad139f4c-297f-4fac-8232-fb0e23ea37e6", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:41.255791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:15:41.902799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:41.903592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:41.919022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:41.919543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:41.919986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:41.920715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:41.921195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:41.921620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:41.985455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:15:42.082270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:15:42.083377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:15:42.084090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:15:42.084772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:15:42.085484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:15:42.107803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:42.113404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:42.114263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:42.115279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:42.134785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:42.135651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:42.175887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:15:42.187621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:15:42.192076 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c016d780-3e53-48ff-b74b-9c613b0532aa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 204 len: 0 microversion: 2.1 time: 0.292405 Oct 03 15:15:42.193777 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3191/6553] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:15:41 2022] DELETE /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:15:42.205605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f17991fc-abe9-47a7-952a-55f0684117a5 req-4f90d369-a0cb-49f2-b7ea-5c91b226227f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7bf744d-b26b-4261-b03a-343a4834b976", "tag": "63841745-2f34-40f2-be83-b97366261cff"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:42.221984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:15:42.228642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ad139f4c-297f-4fac-8232-fb0e23ea37e6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:15:42.237156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f17991fc-abe9-47a7-952a-55f0684117a5 req-4f90d369-a0cb-49f2-b7ea-5c91b226227f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:42.238482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f17991fc-abe9-47a7-952a-55f0684117a5 req-4f90d369-a0cb-49f2-b7ea-5c91b226227f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:42.241043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f17991fc-abe9-47a7-952a-55f0684117a5 req-4f90d369-a0cb-49f2-b7ea-5c91b226227f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:42.308890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f17991fc-abe9-47a7-952a-55f0684117a5 req-4f90d369-a0cb-49f2-b7ea-5c91b226227f service nova] Creating event network-changed:63841745-2f34-40f2-be83-b97366261cff for instance e7bf744d-b26b-4261-b03a-343a4834b976 on n-h1-781139-2 Oct 03 15:15:42.318552 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f17991fc-abe9-47a7-952a-55f0684117a5 req-4f90d369-a0cb-49f2-b7ea-5c91b226227f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122365 Oct 03 15:15:42.319472 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3192/6554] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:42.325863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:42.326613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:42.342682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:42.343403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:42.343910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:42.344637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:42.345181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:42.345640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:42.439066 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32ae6992-16da-4449-8701-05bd73f020a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339428 Oct 03 15:15:42.451976 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3363/6555] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:15:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:15:42.479201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b54b740a-7ce3-4998-8465-19b44c2abd34 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:42.480034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b54b740a-7ce3-4998-8465-19b44c2abd34 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:42.631914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b54b740a-7ce3-4998-8465-19b44c2abd34 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:42.650468 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b54b740a-7ce3-4998-8465-19b44c2abd34 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1056 microversion: 2.1 time: 0.193405 Oct 03 15:15:42.651631 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3364/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:42 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1056 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:42.719663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:42.731749 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0377f1f-8d04-488b-8a0b-5d63e71b9edd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1670 microversion: 2.1 time: 0.411084 Oct 03 15:15:42.733217 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3193/6557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:42 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1670 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:43.674560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:43.675182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:43.692271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:43.693086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:43.693972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:43.695131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:43.695765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:43.696363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:43.769961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:43.771381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:43.789234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:43.793633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:43.800400 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09746a61-559d-46e3-9b4b-ee12481ccdbf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1060 microversion: 2.1 time: 0.130330 Oct 03 15:15:43.801713 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3365/6558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:43 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1060 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:43.802184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:43.802861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:43.803307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:43.805521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:43.807767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:43.809394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:44.475275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:44.489889 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d693a422-e099-4e6d-94fb-d9b6dfc2087b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1670 microversion: 2.1 time: 0.732893 Oct 03 15:15:44.491625 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3194/6559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:43 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1670 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:44.825668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:44.827616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:44.848512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:44.849341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:44.849958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:44.851125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:44.851758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:44.852497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:44.953814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:44.966735 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7cad6ec-3aa5-4631-931f-37a699160f20 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1126 microversion: 2.1 time: 0.146120 Oct 03 15:15:44.967344 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3366/6560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:44 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1126 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:45.448674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-fafc4335-06d1-414d-bc83-98941e9ddc39 req-534e64a2-680e-4534-93f1-93581274f7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7bf744d-b26b-4261-b03a-343a4834b976", "name": "network-vif-deleted", "tag": "63841745-2f34-40f2-be83-b97366261cff"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:45.475874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fafc4335-06d1-414d-bc83-98941e9ddc39 req-534e64a2-680e-4534-93f1-93581274f7d6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:45.476871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fafc4335-06d1-414d-bc83-98941e9ddc39 req-534e64a2-680e-4534-93f1-93581274f7d6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:45.479123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fafc4335-06d1-414d-bc83-98941e9ddc39 req-534e64a2-680e-4534-93f1-93581274f7d6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:45.483976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:45.504858 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-fafc4335-06d1-414d-bc83-98941e9ddc39 req-534e64a2-680e-4534-93f1-93581274f7d6 service nova] Creating event network-vif-deleted:63841745-2f34-40f2-be83-b97366261cff for instance e7bf744d-b26b-4261-b03a-343a4834b976 on n-h1-781139-2 Oct 03 15:15:45.512275 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-fafc4335-06d1-414d-bc83-98941e9ddc39 req-534e64a2-680e-4534-93f1-93581274f7d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069253 Oct 03 15:15:45.513463 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3195/6561] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:45.517401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:45.518051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:45.524735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:45.525432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:45.525995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:45.527441 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:45.528004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:45.528762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:45.645308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:45.671971 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-caf319d1-1c89-4248-b16e-098e4f046432 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 200 len: 1334 microversion: 2.1 time: 0.157144 Oct 03 15:15:45.673818 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3367/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:45 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:45.992586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:45.993432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:46.009337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:46.010255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:46.013709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:46.014701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:46.015393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:46.018163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:46.529987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:46.547629 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aab5402b-5e97-4ead-8302-e0ddd0bbebb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.559695 Oct 03 15:15:46.565630 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3196/6563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:45 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:46.699748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:46.701126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: e7bf744d-b26b-4261-b03a-343a4834b976] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:46.712527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:46.713472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:46.717679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:46.718733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:46.719428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:46.720101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:46.751361 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] HTTP exception thrown: Instance e7bf744d-b26b-4261-b03a-343a4834b976 could not be found. Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Request method failure captured: Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 HTTP/1.1 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvv_qDyAMEs2SKKqMfBltWvukrDvS5ZtSYOruGhcqaWrizWg5I79Y1E-dSlsmOVaY8leZIwZXEIg2XArepHtxy2X8UnX6gQkVdNlg6IcfMEd401adhJiKFXxgJRSIXTGou1kVK2TbQQbPHazVGK1BT389EsuIAi3MZAkQBVmgKIyWs4 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 911d9ea997ce4ab3ae91e1cfed1e64dc Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911d9ea997ce4ab3ae91e1cfed1e64dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 911d9ea997ce4ab3ae91e1cfed1e64dc Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestNetworkBasicOps-1862598995-project Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 29afda2312af4c12b881f6c1da67ef79 Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkBasicOps-1862598995-project Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e7bf744d-b26b-4261-b03a-343a4834b976 could not be found. Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e7bf744d-b26b-4261-b03a-343a4834b976'} Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7bf744d-b26b-4261-b03a-343a4834b976 could not be found. Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7bf744d-b26b-4261-b03a-343a4834b976 could not be found. Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:46.754522 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:15:46.761670 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:46.761670 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:46.761670 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:46.761670 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:15:46.761670 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:15:46.761670 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7bf744d-b26b-4261-b03a-343a4834b976 could not be found. Oct 03 15:15:46.761670 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:15:46.764566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Returning 404 to user: Instance e7bf744d-b26b-4261-b03a-343a4834b976 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:15:46.765882 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e784841-9d62-4a3c-ab1a-15d0f895823e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976" status: 404 len: 111 microversion: 2.1 time: 0.070113 Oct 03 15:15:46.771063 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3368/6564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:46 2022] GET /compute/v2.1/servers/e7bf744d-b26b-4261-b03a-343a4834b976 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:15:47.123344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49e96568-c075-4301-8286-127f6f7b100b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '.version_select at 0x7fb22b3dfdc0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:47.132777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:47.133313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:47.147028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:47.147527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:47.147977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:47.148780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:47.149273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:47.149702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:47.177018 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49e96568-c075-4301-8286-127f6f7b100b tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1616811925" status: 202 len: 0 microversion: 2.1 time: 0.058614 Oct 03 15:15:47.181153 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3197/6565] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 15:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1616811925 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:15:47.186186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b02554bd-8bf7-4cfa-9556-0caf34761f27 req-339e8ddb-b91e-434a-9569-e6219e3dbb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1483db5e-977d-4835-b375-9b5c75fd4fa6", "tag": "bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:47.238465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b02554bd-8bf7-4cfa-9556-0caf34761f27 req-339e8ddb-b91e-434a-9569-e6219e3dbb64 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:47.239616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b02554bd-8bf7-4cfa-9556-0caf34761f27 req-339e8ddb-b91e-434a-9569-e6219e3dbb64 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:47.244502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b02554bd-8bf7-4cfa-9556-0caf34761f27 req-339e8ddb-b91e-434a-9569-e6219e3dbb64 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:47.260813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:15:47.280076 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b02554bd-8bf7-4cfa-9556-0caf34761f27 req-339e8ddb-b91e-434a-9569-e6219e3dbb64 service nova] Creating event network-changed:bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04 for instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 on n-h2-781139-2 Oct 03 15:15:47.293551 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b02554bd-8bf7-4cfa-9556-0caf34761f27 req-339e8ddb-b91e-434a-9569-e6219e3dbb64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107291 Oct 03 15:15:47.307992 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3198/6566] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:47.447704 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-10d5aac6-5340-4d4d-8195-90ade90145a1 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 204 len: 0 microversion: 2.1 time: 0.317978 Oct 03 15:15:47.448742 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3369/6567] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:15:47 2022] DELETE /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:15:47.458591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:47.459463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:47.475781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:47.476619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:47.480280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:47.481344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:47.481965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:47.483395 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:47.577331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:47.578041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:47.587898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:47.593524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:47.596781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:47.597897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:47.600787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:47.601570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:48.003854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:48.018907 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-334bc395-a10d-4ca0-bab2-4053875880d9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.447891 Oct 03 15:15:48.038248 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3370/6568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:47 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:48.045627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:48.055127 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0c9984f1-a935-4607-9e41-aa2284bdb2cf tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1765 microversion: 2.1 time: 0.601697 Oct 03 15:15:48.060168 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3199/6569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:47 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1765 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:49.044254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:49.044864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:49.055020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:49.062785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:49.065317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:49.065943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:49.070955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:49.074337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:49.076905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:49.088415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:49.090000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:49.107079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:49.107578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:49.108017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:49.108733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:49.109211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:49.109633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:49.406889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:49.415570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a9d44c6-7e49-4f0a-a1e1-225d543fc9a5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.375510 Oct 03 15:15:49.416686 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3371/6570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:49 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:49.421562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cfed7147-9084-44f2-90cb-cc897145c7f8 req-7b9cfeb3-822b-4810-856a-75c50158904a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1aa4baf-88ee-480f-aa1c-3eea570477bc", "tag": "1e7f6db2-ad3a-4372-a65f-be3ef2da3ab3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:49.442012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cfed7147-9084-44f2-90cb-cc897145c7f8 req-7b9cfeb3-822b-4810-856a-75c50158904a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:49.443148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cfed7147-9084-44f2-90cb-cc897145c7f8 req-7b9cfeb3-822b-4810-856a-75c50158904a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:49.443843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cfed7147-9084-44f2-90cb-cc897145c7f8 req-7b9cfeb3-822b-4810-856a-75c50158904a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:49.460981 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cfed7147-9084-44f2-90cb-cc897145c7f8 req-7b9cfeb3-822b-4810-856a-75c50158904a service nova] Creating event network-changed:1e7f6db2-ad3a-4372-a65f-be3ef2da3ab3 for instance e1aa4baf-88ee-480f-aa1c-3eea570477bc on n-h1-781139-2 Oct 03 15:15:49.471680 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cfed7147-9084-44f2-90cb-cc897145c7f8 req-7b9cfeb3-822b-4810-856a-75c50158904a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053481 Oct 03 15:15:49.472666 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3372/6571] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:15:49.893053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:49.920327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-287bb45c-7670-4ba5-a34e-ee28f94e25e2 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1765 microversion: 2.1 time: 0.831358 Oct 03 15:15:49.941192 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3200/6572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:49 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1765 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:50.493119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:50.500442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:50.523334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:50.524296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:50.525056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:50.526044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:50.526743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:50.527296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:50.622257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3e436db5-0e62-4cab-b114-cf08f2a4e8e0 req-916a3c6a-12d6-40af-b7be-6823fcaf398f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1483db5e-977d-4835-b375-9b5c75fd4fa6", "name": "network-vif-deleted", "tag": "bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:50.660185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:50.672087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3e436db5-0e62-4cab-b114-cf08f2a4e8e0 req-916a3c6a-12d6-40af-b7be-6823fcaf398f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:50.672607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3e436db5-0e62-4cab-b114-cf08f2a4e8e0 req-916a3c6a-12d6-40af-b7be-6823fcaf398f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:50.676355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3e436db5-0e62-4cab-b114-cf08f2a4e8e0 req-916a3c6a-12d6-40af-b7be-6823fcaf398f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:50.744023 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3e436db5-0e62-4cab-b114-cf08f2a4e8e0 req-916a3c6a-12d6-40af-b7be-6823fcaf398f service nova] Creating event network-vif-deleted:bb5a348e-4944-4e5b-bf1b-a0ecd2cefc04 for instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 on n-h2-781139-2 Oct 03 15:15:50.761649 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3e436db5-0e62-4cab-b114-cf08f2a4e8e0 req-916a3c6a-12d6-40af-b7be-6823fcaf398f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143461 Oct 03 15:15:50.764256 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3201/6573] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:15:50.966080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:50.966796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:50.999790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:51.001717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:51.002627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:51.007540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:51.010211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:51.011100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:51.110304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:51.113542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:51.114268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:51.115078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lazy-loading 'fault' on Instance uuid 1483db5e-977d-4835-b375-9b5c75fd4fa6 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:15:51.395343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0d476f160a4c248fd3693f2b515ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044e27cbe4c5482abc99697c5447f235', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:51.415941 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-657b01ca-ae50-4e91-a7dd-cb9f1fd52c51 tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 200 len: 1382 microversion: 2.1 time: 0.454219 Oct 03 15:15:51.424912 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3202/6574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:50 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 1382 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:15:51.794211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:51.807658 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-960d5a97-bb81-4e30-82e5-80b2df42c65a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 1.367909 Oct 03 15:15:51.808600 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3373/6575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:50 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:52.466298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:52.470754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] [instance: 1483db5e-977d-4835-b375-9b5c75fd4fa6] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:52.513228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:52.514197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:52.521465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:52.522657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:52.523843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:52.524779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:52.578776 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] HTTP exception thrown: Instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 could not be found. Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Request method failure captured: Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 HTTP/1.1 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvxCpc0oN2J891VTO0481FvWipcdzLPIoMUUxZmuyErQ4Td87Dwm0OjNCjSgpKbFI_-dCPal0DSFVWBHL1CjxXfbVOFv5x-aWMkhtp4cHbMj45Ek-7-JdJTcqk-PBRy7Q-ohzDsCd03_AKD1CxqSnKjuGh_-Badn_i07AKu6VdQAuno Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 044e27cbe4c5482abc99697c5447f235 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-362144116 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/044e27cbe4c5482abc99697c5447f235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_044e27cbe4c5482abc99697c5447f235", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/044e27cbe4c5482abc99697c5447f235"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/044e27cbe4c5482abc99697c5447f235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestSecurityGroupsBasicOps-362144116 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 044e27cbe4c5482abc99697c5447f235 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-362144116 Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestSecurityGroupsBasicOps-362144116-project Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: bd0d476f160a4c248fd3693f2b515ace Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestSecurityGroupsBasicOps-362144116-project Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 could not be found. Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1483db5e-977d-4835-b375-9b5c75fd4fa6'} Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 could not be found. Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 could not be found. Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:15:52.580761 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:52.587897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:15:52.587897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:15:52.587897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:15:52.587897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:15:52.587897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:15:52.587897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 could not be found. Oct 03 15:15:52.587897 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:15:52.590973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Returning 404 to user: Instance 1483db5e-977d-4835-b375-9b5c75fd4fa6 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:15:52.592298 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f20b0bf-2e4d-4b8b-9800-068ce089681e tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6" status: 404 len: 111 microversion: 2.1 time: 0.132641 Oct 03 15:15:52.593825 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3203/6576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:52 2022] GET /compute/v2.1/servers/1483db5e-977d-4835-b375-9b5c75fd4fa6 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:15:52.835988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:52.837022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:52.840213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:52.842256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:15:52.852283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:52.854270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:52.855349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:52.856571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:52.858103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:52.859079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:53.140693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:53.154018 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03bb04a5-c1cd-44d1-99bb-025e45139645 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.323944 Oct 03 15:15:53.154906 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3374/6577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:52 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:54.181871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:54.184123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:54.206155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:54.208175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:54.209971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:54.211005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:54.212746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:54.214008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:54.808226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:54.821024 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3f8915a8-c55a-4125-bc09-5c1bb6dfad98 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.647653 Oct 03 15:15:54.821950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3204/6578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:54 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:55.843840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:55.844471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:55.870471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:55.871021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:55.871465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:55.881977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:55.883011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:55.883011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:56.274299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:56.296819 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1ef56d12-3338-4848-ac01-5cb9266f5525 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.456775 Oct 03 15:15:56.297493 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3375/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:55 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:57.355176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:57.357000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:57.387457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:57.388699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:57.390467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:57.392688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:57.393260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:57.395875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:57.719293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:57.732500 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9a0d0030-b7d4-44c3-820c-1dd7342b8c1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.406111 Oct 03 15:15:57.737170 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3205/6580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:57 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:58.778563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:15:58.780275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:15:58.800631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:58.802984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:58.803961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:58.805031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:15:58.805952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:15:58.806830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:15:59.213533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:15:59.222744 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0234f96a-f411-4ed3-9e02-bde99c710096 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.456394 Oct 03 15:15:59.241599 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3376/6581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:15:58 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:15:59.565191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70db3da1-4c09-4435-a939-8fda70c0139a tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Action: 'create', calling method: .version_select at 0x7fb22b4955e0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2100393831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsh7ZEWdzBRWoCEO6A8eF6SkxOBBOUzT/kFAtV6vaO7ueqk5UlYjJCY3aJq4UYf2vOn5BLX8FoaIKSPXt7LSj+g2dpwiIbOyIMcZ2409v5xr2/g3igr0DslEHx83qnaxw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:15:59.612172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-70db3da1-4c09-4435-a939-8fda70c0139a tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Getting quotas for project 4031ae7f2bff48cbab24205ad577383e. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:15:59.632617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-70db3da1-4c09-4435-a939-8fda70c0139a tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Getting quotas for user 087977406f834c7ba3d5e7e2282457d2 and project 4031ae7f2bff48cbab24205ad577383e. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:15:59.698168 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70db3da1-4c09-4435-a939-8fda70c0139a tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.506981 Oct 03 15:15:59.706317 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3206/6582] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:15:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:16:00.251246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:00.251966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:00.278287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:00.279028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:00.279556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:00.280368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:00.280899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:00.281426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:00.732325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:00.749356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21fa406c-d725-4b45-bb68-c58a80293060 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.502823 Oct 03 15:16:00.750699 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3377/6583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:00 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:00.927012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b7ca47a-808f-4cdc-8bf1-9f52139901fc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] Calling method '.version_select at 0x7fb22b3da9d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:00.967638 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b7ca47a-808f-4cdc-8bf1-9f52139901fc tempest-TestSecurityGroupsBasicOps-362144116 tempest-TestSecurityGroupsBasicOps-362144116-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-31114426" status: 202 len: 0 microversion: 2.1 time: 0.045361 Oct 03 15:16:00.968317 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3207/6584] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 15:16:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-31114426 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:16:01.776711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:01.777477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:01.790216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:01.796858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:01.799038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:01.800021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:01.800595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:01.801162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:02.222575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:02.237803 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5bb192bf-c808-4e3b-9115-474e18ad2c6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.466249 Oct 03 15:16:02.239144 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3378/6585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:01 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:02.256278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1511679244", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2100393831", "security_groups": [{"name": "tempest-secgroup-smoke-1041619217"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "8924367b-911a-460d-9eae-7c044f3ed763"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:02.512758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] validate_networks() for [('8924367b-911a-460d-9eae-7c044f3ed763', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:16:03.192232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Getting quotas for project 4031ae7f2bff48cbab24205ad577383e. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:16:03.225018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Getting quotas for user 087977406f834c7ba3d5e7e2282457d2 and project 4031ae7f2bff48cbab24205ad577383e. Resources: dict_keys(['metadata_items']) {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:16:03.261115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:16:03.262391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:16:03.263085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:16:03.263680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:16:03.265489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:03.266094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:03.266631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:16:03.280484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:03.282980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:03.284861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:03.287715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:03.288760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:03.289629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:03.296676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:03.297462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:03.301630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:03.302455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:03.303006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:03.303508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:03.356625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Getting quotas for project 4031ae7f2bff48cbab24205ad577383e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:16:03.368507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Getting quotas for user 087977406f834c7ba3d5e7e2282457d2 and project 4031ae7f2bff48cbab24205ad577383e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:16:03.414916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:16:03.418677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:16:03.487277 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c1ac4dc-7d44-4377-a875-74723b2535cd tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.235512 Oct 03 15:16:03.488745 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3208/6586] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:16:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:16:03.503335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a1002db5-a28f-4137-824f-00be3e528503 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:03.507953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a1002db5-a28f-4137-824f-00be3e528503 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:03.673024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a1002db5-a28f-4137-824f-00be3e528503 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:03.702405 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a1002db5-a28f-4137-824f-00be3e528503 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1303 microversion: 2.1 time: 0.197587 Oct 03 15:16:03.703311 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3209/6587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:03 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:03.813652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:03.823446 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f90f4c59-e1ea-4562-bafb-3cc070a259f9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.561524 Oct 03 15:16:03.824078 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3379/6588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:03 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:04.726463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:04.727638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:04.743941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:04.744467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:04.744959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:04.745703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:04.746168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:04.746600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:04.862815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:04.876111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:04.887482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:04.896538 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e8896f0a-9525-4f1e-b9e0-1d9b4bc071f5 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1299 microversion: 2.1 time: 0.174155 Oct 03 15:16:04.897280 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3210/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:04 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:04.903202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:04.903718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:04.904168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:04.904902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:04.905390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:04.922559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:05.361388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:05.377895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56206386-23e2-48cd-8039-08f825cbea30 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.527597 Oct 03 15:16:05.389978 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3380/6590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:04 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:05.923623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:05.924130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:05.948802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:05.951476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:05.953165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:05.955181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:05.955761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:05.957271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:06.219004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:06.237652 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3fb3974-8c52-4fc1-b67d-194144c10bd4 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1361 microversion: 2.1 time: 0.318011 Oct 03 15:16:06.241042 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3211/6591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:05 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:06.409523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:06.411608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:06.432537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:06.433190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:06.433991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:06.434735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:06.435204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:06.435633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:06.903918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:06.919332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1bc6fb5d-c407-4f48-92a0-e378b8a4fba7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.515747 Oct 03 15:16:06.922788 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3381/6592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:06 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:07.267023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:07.267659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:07.283652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:07.284437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:07.296030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:07.297979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:07.298691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:07.299312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:07.657954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:07.678638 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9be1debf-5e79-420a-834b-27b078af0542 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1429 microversion: 2.1 time: 0.413689 Oct 03 15:16:07.680617 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3212/6593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:07 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1429 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:07.945981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:07.947265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:07.964633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:07.971439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:07.971998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:07.972779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:07.973307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:07.973739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:07.984748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:08.303033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:08.315580 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-63841d5a-1346-473d-8b80-4f345e62007f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1168 microversion: 2.1 time: 0.375336 Oct 03 15:16:08.328236 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3382/6594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:07 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1168 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:08.702332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:08.703114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:08.720104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:08.720612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:08.721124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:08.731110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:08.732237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:08.733986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:08.872086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6506823-3aeb-43b6-804e-e2a22499a6e3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'create', calling method: .version_select at 0x7fb234b88430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1010783078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUoMWp6oKXW3l4Xos05EFe+FJolcLfH4c+samkUIaqxQARxRuH52TFrutb8VuDKxMBquB3fj+KEQugOY+ScN4Q4KY8S3todHMgTgtavaKIDUnkvt8XIlwMWzTN21S6azg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:08.909471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d6506823-3aeb-43b6-804e-e2a22499a6e3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:16:08.918042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d6506823-3aeb-43b6-804e-e2a22499a6e3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for user 29afda2312af4c12b881f6c1da67ef79 and project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:16:08.968592 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6506823-3aeb-43b6-804e-e2a22499a6e3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.101814 Oct 03 15:16:08.970791 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3383/6595] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:16:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:16:09.096987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a1532058-e211-4904-bb81-4a334dde032d req-98c1541a-bc9c-452d-abc1-788331e12e6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e", "tag": "352ab650-65a8-4ad8-903b-469ea0e2c18d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:09.131851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a1532058-e211-4904-bb81-4a334dde032d req-98c1541a-bc9c-452d-abc1-788331e12e6a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:09.132490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a1532058-e211-4904-bb81-4a334dde032d req-98c1541a-bc9c-452d-abc1-788331e12e6a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:09.132965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a1532058-e211-4904-bb81-4a334dde032d req-98c1541a-bc9c-452d-abc1-788331e12e6a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:09.155915 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a1532058-e211-4904-bb81-4a334dde032d req-98c1541a-bc9c-452d-abc1-788331e12e6a service nova] Creating event network-changed:352ab650-65a8-4ad8-903b-469ea0e2c18d for instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e on n-h2-781139-2 Oct 03 15:16:09.174059 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a1532058-e211-4904-bb81-4a334dde032d req-98c1541a-bc9c-452d-abc1-788331e12e6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088972 Oct 03 15:16:09.175294 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3384/6596] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:16:09.347745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:09.348395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:09.350005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:09.359605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b9038b0e-9123-425c-b538-295d32970e95 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1429 microversion: 2.1 time: 0.661218 Oct 03 15:16:09.362894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:09.363662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3213/6597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:08 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1429 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:09.365758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:09.368523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:09.369528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:09.372487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:09.373745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:09.648617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:09.667765 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6199d71b-95cc-407a-a2f2-1116e5ec2db8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1214 microversion: 2.1 time: 0.324126 Oct 03 15:16:09.668331 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3385/6598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:09 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:10.391914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:10.393557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:10.401771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:10.402658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:10.403498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:10.404610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:10.405340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:10.406057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:10.659782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:10.671933 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0c717c86-f9e5-4161-b571-9136cb47b7da tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1429 microversion: 2.1 time: 0.283998 Oct 03 15:16:10.673570 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3214/6599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:10 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1429 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:10.692373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:10.693142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:10.705437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:10.705951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:10.706402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:10.707793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:10.708266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:10.709147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:10.813661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1781623080", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "8afa4c8b-6c42-48bd-a7b6-cd6bc496afca"}], "key_name": "tempest-TestNetworkBasicOps-1010783078", "security_groups": [{"name": "tempest-secgroup-smoke-644451936"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:11.041465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] validate_networks() for [('8afa4c8b-6c42-48bd-a7b6-cd6bc496afca', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:16:11.043475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:11.052963 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e488b87-d01c-4b5e-a2ee-9cd733fe6f56 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.365094 Oct 03 15:16:11.061943 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3386/6600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:10 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:11.844101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-518328240", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "555ff00f-bee5-40c3-8ae3-8bec3b0e70ed"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:11.907631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] validate_networks() for [('555ff00f-bee5-40c3-8ae3-8bec3b0e70ed', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:16:12.133867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:16:12.134387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:16:12.134934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:16:12.135372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:16:12.135793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:16:12.147079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.147832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.148447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.149503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.150182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.150800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.170669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:16:12.176643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Getting quotas for user 29afda2312af4c12b881f6c1da67ef79 and project 911d9ea997ce4ab3ae91e1cfed1e64dc. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:16:12.194237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:16:12.196896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:16:12.260015 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be3eea36-5685-4f4d-a429-5342d4b8ef5a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.450950 Oct 03 15:16:12.263114 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3215/6601] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:16:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:16:12.272434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:12.273366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:12.281226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.281973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.282610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.283569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.284255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.284872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.453955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:16:12.454683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:16:12.455328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:16:12.457475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:16:12.458096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:16:12.479827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.481270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.482634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.484784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.486739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.487409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.505785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:12.520149 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f76baba-d11f-40e0-910f-ec385db73a6e tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1429 microversion: 2.1 time: 0.255643 Oct 03 15:16:12.520748 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3216/6602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:12 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1429 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:12.532846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Getting quotas for project f641f1c8b7ba43baafc6b48402378ffc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:16:12.546417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:12.548072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:12.548226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Getting quotas for user f4aaf52744934a4c93ef5989b1fb3c7c and project f641f1c8b7ba43baafc6b48402378ffc. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:16:12.559103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.559619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.560082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.560813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:12.561677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:12.562127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:12.584045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:16:12.594897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:16:12.683845 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a05e5c1-d13f-4dd8-a23d-a62789f00897 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051120 Oct 03 15:16:12.684263 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3387/6603] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:16:12.699819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89450719-755c-42ce-8e0f-421fa3c3d5a3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:12.701876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89450719-755c-42ce-8e0f-421fa3c3d5a3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:12.798362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89450719-755c-42ce-8e0f-421fa3c3d5a3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:12.811928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:12.821425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b0562eda-bb9e-4f01-992d-51fb97e81cfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.281892 Oct 03 15:16:12.822039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3217/6604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:12 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:12.829963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aceb2ead-683a-44dd-8a00-46a11aba3b44 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:12.830445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aceb2ead-683a-44dd-8a00-46a11aba3b44 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:12.839524 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89450719-755c-42ce-8e0f-421fa3c3d5a3 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1249 microversion: 2.1 time: 0.135933 Oct 03 15:16:12.840128 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3388/6605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:12 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1249 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:12.914416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-aceb2ead-683a-44dd-8a00-46a11aba3b44 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:12.924133 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aceb2ead-683a-44dd-8a00-46a11aba3b44 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1214 microversion: 2.1 time: 0.098810 Oct 03 15:16:12.925487 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3218/6606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:12 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:13.550095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:13.551166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:13.562528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:13.563323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:13.564054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:13.565250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:13.566018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:13.566734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:13.705415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:13.714515 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-965f7985-278e-4f4c-979d-f610d70c017d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1429 microversion: 2.1 time: 0.170896 Oct 03 15:16:13.715090 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3389/6607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:13 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:13.845290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:13.845932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:13.856368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:13.856973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:13.857428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:13.863738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:13.864370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:13.867597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:13.868390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:13.870737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:13.874689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:13.875366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:13.875802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:13.876495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:13.879249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:13.879831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:13.991798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:14.004811 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc3a55ed-bf39-479e-8665-f133daae4b1e tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1309 microversion: 2.1 time: 0.145183 Oct 03 15:16:14.005663 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3390/6608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:13 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:14.033849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:14.034615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:14.048297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:14.050002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:14.050607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:14.053216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:14.053868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:14.054571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:14.070008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:14.081283 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c8bad00a-bb93-4488-9892-55f73308417f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.239917 Oct 03 15:16:14.081828 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3219/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:13 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:14.137937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:14.145954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c2db26a-19f6-491e-9e1d-0eaf56839981 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1266 microversion: 2.1 time: 0.119957 Oct 03 15:16:14.146542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3391/6610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:14 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:14.439980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-34a24032-bc76-4fb4-9b02-8a534fe456f4 req-500e441e-a69c-41d3-b800-9bec540b437a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e", "name": "network-vif-plugged", "status": "completed", "tag": "352ab650-65a8-4ad8-903b-469ea0e2c18d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:14.454698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-34a24032-bc76-4fb4-9b02-8a534fe456f4 req-500e441e-a69c-41d3-b800-9bec540b437a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:14.455509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-34a24032-bc76-4fb4-9b02-8a534fe456f4 req-500e441e-a69c-41d3-b800-9bec540b437a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:14.456138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-34a24032-bc76-4fb4-9b02-8a534fe456f4 req-500e441e-a69c-41d3-b800-9bec540b437a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:14.471140 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-34a24032-bc76-4fb4-9b02-8a534fe456f4 req-500e441e-a69c-41d3-b800-9bec540b437a service nova] Creating event network-vif-plugged:352ab650-65a8-4ad8-903b-469ea0e2c18d for instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e on n-h2-781139-2 Oct 03 15:16:14.480692 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-34a24032-bc76-4fb4-9b02-8a534fe456f4 req-500e441e-a69c-41d3-b800-9bec540b437a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141911 Oct 03 15:16:14.482511 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3220/6611] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:14.739489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:14.740190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:14.747656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:14.748155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:14.748590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:14.749328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:14.749779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:14.750216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.032989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:15.034265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:15.041922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:15.042450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:15.042890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.043780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:15.044230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:15.044854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.050984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:15.258782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:15.267875 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68e59d73-684b-4134-a95c-f00267c3ca65 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1429 microversion: 2.1 time: 0.533713 Oct 03 15:16:15.271927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:15.274445 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3392/6612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:14 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1429 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:15.285741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:15.286364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:15.288650 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37c3a79f-eae2-4eeb-8096-94eccc940293 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.260237 Oct 03 15:16:15.289665 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3221/6613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:15 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:15.295669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:15.296164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:15.297230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:15.297893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.298458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:15.298626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:15.299249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:15.299812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.304073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:15.311179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:15.312279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:15.312821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.313983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:15.315339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:15.315866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.395978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:15.404797 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c79f22ee-dc02-4ef4-a4df-04113ecc2a6e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1272 microversion: 2.1 time: 0.112077 Oct 03 15:16:15.409058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3222/6614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:15 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:15.527724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:15.536109 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a82d4ba-e8f7-4343-8fae-b23e2f199578 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.260930 Oct 03 15:16:15.537116 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3393/6615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:15 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:15.924682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-eb3778bd-4c90-43e9-a105-0b4e0b2609b0 req-a4b77d43-3463-4bf7-9a9e-78e3f2008de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb58eccf-d0d3-4c49-ae35-d164df556293", "tag": "8ab0bd83-1f3f-450d-9e49-f5ac4c654b72"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:15.935028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eb3778bd-4c90-43e9-a105-0b4e0b2609b0 req-a4b77d43-3463-4bf7-9a9e-78e3f2008de6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:15.935478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eb3778bd-4c90-43e9-a105-0b4e0b2609b0 req-a4b77d43-3463-4bf7-9a9e-78e3f2008de6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:15.935891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eb3778bd-4c90-43e9-a105-0b4e0b2609b0 req-a4b77d43-3463-4bf7-9a9e-78e3f2008de6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:15.950153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-eb3778bd-4c90-43e9-a105-0b4e0b2609b0 req-a4b77d43-3463-4bf7-9a9e-78e3f2008de6 service nova] Creating event network-changed:8ab0bd83-1f3f-450d-9e49-f5ac4c654b72 for instance eb58eccf-d0d3-4c49-ae35-d164df556293 on n-h1-781139-2 Oct 03 15:16:15.955398 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-eb3778bd-4c90-43e9-a105-0b4e0b2609b0 req-a4b77d43-3463-4bf7-9a9e-78e3f2008de6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034387 Oct 03 15:16:15.956083 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3223/6616] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:16.283153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-976340b0-36dd-47b4-829b-8650c1704849 req-fb6c9397-e9fb-4f6c-8d84-b64aa5d0826f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71a648d-7a88-4e21-b7fe-d478caa68c9f", "tag": "99d78a82-5284-48b4-9bfa-cc490aa4d9bd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:16.294049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:16.295588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:16.301806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-976340b0-36dd-47b4-829b-8650c1704849 req-fb6c9397-e9fb-4f6c-8d84-b64aa5d0826f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.302295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-976340b0-36dd-47b4-829b-8650c1704849 req-fb6c9397-e9fb-4f6c-8d84-b64aa5d0826f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.302734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-976340b0-36dd-47b4-829b-8650c1704849 req-fb6c9397-e9fb-4f6c-8d84-b64aa5d0826f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.303808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.304498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.305152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.306105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.307908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.307908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.315650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-976340b0-36dd-47b4-829b-8650c1704849 req-fb6c9397-e9fb-4f6c-8d84-b64aa5d0826f service nova] Creating event network-changed:99d78a82-5284-48b4-9bfa-cc490aa4d9bd for instance b71a648d-7a88-4e21-b7fe-d478caa68c9f on n-h1-781139-2 Oct 03 15:16:16.321325 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-976340b0-36dd-47b4-829b-8650c1704849 req-fb6c9397-e9fb-4f6c-8d84-b64aa5d0826f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042208 Oct 03 15:16:16.321920 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3394/6617] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:16.329151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:16.329881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:16.336505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.337015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.337471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.338184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.338634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.339059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.448806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:16.456623 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f29d3431-903f-4c6d-9636-de842c2082ae tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1608 microversion: 2.1 time: 0.168718 Oct 03 15:16:16.457265 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3224/6618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:16 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1608 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:16.461691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:16.462330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:16.468197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.468679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.469133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.469816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.470475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.471073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.478390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:16.486198 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f32e274f-a839-4738-9199-1aa4971630cd tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.162710 Oct 03 15:16:16.486788 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3395/6619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:16 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:16.492609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:16.493447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:16.499712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.500193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.500637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.501358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.501831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.502260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.606768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:16.614864 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-efefc598-43ba-4e46-aa9e-0b9f94c1abf8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.156612 Oct 03 15:16:16.615447 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3225/6620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:16 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:16.621094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:16.621888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:16.628319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.628881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.629422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.630172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.630632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.631053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.638951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:16.646925 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fbcc8151-6d28-4fca-843e-e4aa9ba50eda tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1608 microversion: 2.1 time: 0.158221 Oct 03 15:16:16.647700 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3396/6621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:16 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1608 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:16.668721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:16.669356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:16.675657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.676078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.676503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.677230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:16.677678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:16.680086 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:16.762164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:16.770464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d47e50a1-d337-4e09-8cdf-12bb78420d0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.153155 Oct 03 15:16:16.771242 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3226/6622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:16 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:16.815941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:16.824065 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4d848b4-8537-4feb-a7f0-69a10489c6cc tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1608 microversion: 2.1 time: 0.159096 Oct 03 15:16:16.824626 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3397/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:16 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1608 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:17.508897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:17.509435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:17.516358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:17.516835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:17.517291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:17.517990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:17.518430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:17.518857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:17.638757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:17.639434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:17.647643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:17.648158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:17.648604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:17.649357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:17.649826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:17.650261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:17.718452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:17.727320 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e942158-a8b2-4000-842a-8d00a9afb676 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.222796 Oct 03 15:16:17.728388 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3227/6624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:17 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:17.788139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:17.793392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:17.794145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:17.800125 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35019eac-841b-44e9-aaee-52d847539661 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.165360 Oct 03 15:16:17.800829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:17.801404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:17.801638 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3398/6625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:17 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:17.801890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:17.802565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:17.803084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:17.803665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:18.049964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:18.058058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a94442a3-3a5f-40d6-aba8-5d3ff7e4d8df tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.268819 Oct 03 15:16:18.058673 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3228/6626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:17 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:18.751969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:18.752493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:18.760352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:18.760850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:18.761319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:18.762033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:18.762735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:18.763344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:18.825707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:18.826908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:18.837229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:18.838567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:18.839942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:18.840903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:18.842317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:18.842954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:18.915660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:18.923591 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6755af8b-91ed-4319-b730-c9659d39045c tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.175679 Oct 03 15:16:18.924179 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3399/6627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:18 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:19.081949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:19.082559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:19.089417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:19.089906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:19.090331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:19.091036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:19.091484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:19.091905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:19.094550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:19.104374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50c54b17-bd63-435f-b2b8-c1520342a691 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.283643 Oct 03 15:16:19.105008 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3229/6628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:18 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:19.273571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:19.282060 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aeb979fc-17f9-40b3-b352-c713bd5585c0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.204045 Oct 03 15:16:19.282840 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3400/6629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:19 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:19.756562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b68e4805-2958-4876-8d64-a22ce8033b7d req-6d48f9a3-26f2-448d-b635-7ea1361c76da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e", "tag": "352ab650-65a8-4ad8-903b-469ea0e2c18d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:19.768278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b68e4805-2958-4876-8d64-a22ce8033b7d req-6d48f9a3-26f2-448d-b635-7ea1361c76da service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:19.768775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b68e4805-2958-4876-8d64-a22ce8033b7d req-6d48f9a3-26f2-448d-b635-7ea1361c76da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:19.769229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b68e4805-2958-4876-8d64-a22ce8033b7d req-6d48f9a3-26f2-448d-b635-7ea1361c76da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:19.783421 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b68e4805-2958-4876-8d64-a22ce8033b7d req-6d48f9a3-26f2-448d-b635-7ea1361c76da service nova] Creating event network-changed:352ab650-65a8-4ad8-903b-469ea0e2c18d for instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e on n-h2-781139-2 Oct 03 15:16:19.789160 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b68e4805-2958-4876-8d64-a22ce8033b7d req-6d48f9a3-26f2-448d-b635-7ea1361c76da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037650 Oct 03 15:16:19.789723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3230/6630] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:19.947637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:19.948645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:19.952812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:19.957309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:19.957890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:19.958500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:19.959540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:19.959988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:19.960647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:20.109013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:20.118563 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a028bdd-142e-47a6-9e8e-fd817c53dee1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.175088 Oct 03 15:16:20.119364 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3401/6631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:19 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:20.133663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:20.134929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:20.141387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:20.141873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:20.142311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:20.143012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:20.143463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:20.143885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:20.306322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:20.307164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:20.313977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:20.314550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:20.315067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:20.315847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:20.316406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:20.317065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:20.371272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:20.383604 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce97576b-06fa-477d-987e-a1bf8dcf2f77 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.255370 Oct 03 15:16:20.385585 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3231/6632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:20 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:20.489117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:20.492815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:20.498235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a11a6f2f-1c5c-462e-8ec4-9c424cc46ca7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.197067 Oct 03 15:16:20.498839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3402/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:20 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:21.015050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-eed209aa-9b54-4f8d-b0b9-1d5f9a76e27d req-c4214e00-bc36-481e-9a09-d9a73f16aa79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1aa4baf-88ee-480f-aa1c-3eea570477bc", "name": "network-vif-plugged", "status": "completed", "tag": "1e7f6db2-ad3a-4372-a65f-be3ef2da3ab3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:21.025003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eed209aa-9b54-4f8d-b0b9-1d5f9a76e27d req-c4214e00-bc36-481e-9a09-d9a73f16aa79 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:21.025328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eed209aa-9b54-4f8d-b0b9-1d5f9a76e27d req-c4214e00-bc36-481e-9a09-d9a73f16aa79 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:21.025751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eed209aa-9b54-4f8d-b0b9-1d5f9a76e27d req-c4214e00-bc36-481e-9a09-d9a73f16aa79 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:21.142124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:21.144503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:21.153643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:21.154275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:21.154838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:21.155873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:21.156411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:21.157963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:21.326157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:21.334505 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65612544-e6ea-459a-abf6-5d0f2b1259b4 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.196575 Oct 03 15:16:21.335117 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3403/6634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:21 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:21.342035 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-eed209aa-9b54-4f8d-b0b9-1d5f9a76e27d req-c4214e00-bc36-481e-9a09-d9a73f16aa79 service nova] Creating event network-vif-plugged:1e7f6db2-ad3a-4372-a65f-be3ef2da3ab3 for instance e1aa4baf-88ee-480f-aa1c-3eea570477bc on n-h1-781139-2 Oct 03 15:16:21.348059 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-eed209aa-9b54-4f8d-b0b9-1d5f9a76e27d req-c4214e00-bc36-481e-9a09-d9a73f16aa79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338954 Oct 03 15:16:21.348655 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3232/6635] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:21.414091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:21.414740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:21.421450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:21.421949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:21.422390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:21.423110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:21.423571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:21.423997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:21.524647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:21.525666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:21.533200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:21.533886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:21.534598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:21.535303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:21.535941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:21.536369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:21.607639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:21.623396 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f4101526-6658-438a-bbcc-7ecfcf77dbc8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.213368 Oct 03 15:16:21.637422 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3404/6636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:21 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:21.770369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:21.781938 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3e673bce-8b64-44a6-8e29-3f36d33ad630 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.263882 Oct 03 15:16:21.782622 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3233/6637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:21 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:22.363774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:22.365113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:22.378354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:22.379158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:22.379894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:22.381245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:22.381829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:22.382358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:22.509561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:22.531483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:22.539672 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-68bc3361-1ef0-45d1-811a-89832ed70bc1 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.183626 Oct 03 15:16:22.540261 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3405/6638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:22 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:22.646406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:22.647717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:22.650266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:22.656446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:22.656963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:22.657391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:22.658090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:22.658542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:22.658958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:22.793535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:22.801751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-18f5bfd4-3a79-4d00-a032-19e59bcfea36 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.159248 Oct 03 15:16:22.802828 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3234/6639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:22 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:22.813308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:22.814172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:22.819753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:22.822246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:22.822804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:22.823319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:22.824107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:22.824668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:22.825262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:22.965523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:22.975177 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48439aeb-7b8a-4071-ad92-fa68af29cac8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1202 microversion: 2.1 time: 0.172375 Oct 03 15:16:22.975977 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3406/6640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:22 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:23.361523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=24 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:23.365998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-739620e0-52bf-4322-96c0-ddc918c4bf90 req-4fee0f4c-1426-47a1-ba87-45bdb30aafa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb58eccf-d0d3-4c49-ae35-d164df556293", "name": "network-vif-plugged", "status": "completed", "tag": "8ab0bd83-1f3f-450d-9e49-f5ac4c654b72"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:23.376379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-739620e0-52bf-4322-96c0-ddc918c4bf90 req-4fee0f4c-1426-47a1-ba87-45bdb30aafa3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:23.376857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-739620e0-52bf-4322-96c0-ddc918c4bf90 req-4fee0f4c-1426-47a1-ba87-45bdb30aafa3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:23.377322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-739620e0-52bf-4322-96c0-ddc918c4bf90 req-4fee0f4c-1426-47a1-ba87-45bdb30aafa3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:23.388382 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-739620e0-52bf-4322-96c0-ddc918c4bf90 req-4fee0f4c-1426-47a1-ba87-45bdb30aafa3 service nova] Creating event network-vif-plugged:8ab0bd83-1f3f-450d-9e49-f5ac4c654b72 for instance eb58eccf-d0d3-4c49-ae35-d164df556293 on n-h1-781139-2 Oct 03 15:16:23.393326 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-739620e0-52bf-4322-96c0-ddc918c4bf90 req-4fee0f4c-1426-47a1-ba87-45bdb30aafa3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032407 Oct 03 15:16:23.393914 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3235/6641] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:23.567907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:23.569639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:23.581603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:23.582409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:23.583095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:23.584327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:23.584781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:23.585230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:23.720854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:23.732967 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ee3b59b-81cd-488e-bbf8-d7fbb24e36dc tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.172774 Oct 03 15:16:23.733795 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3407/6642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:23 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:23.827558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:23.828259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:23.834715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:23.835461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:23.835793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:23.836487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:23.836952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:23.837385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:23.972897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:23.981525 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b4a3b3b-d314-4901-ac0f-c8ad7447b9c9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.159094 Oct 03 15:16:23.982092 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3236/6643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:23 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:24.003057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:24.003839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:24.010863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.011391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.011829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.012541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.013029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.013461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.159332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:24.168643 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f7d5b04c-34d6-4bf3-ae8b-56372a76a41d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1388 microversion: 2.1 time: 0.169677 Oct 03 15:16:24.169270 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3408/6644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:23 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:24.190698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:24.191311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:24.197905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.198337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.198774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.199473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.199922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.200373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.369960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:24.378080 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ff5cb79-332e-4346-9197-3c3deb310ad2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1388 microversion: 2.1 time: 0.191252 Oct 03 15:16:24.378662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3237/6645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:24 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1388 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:24.400399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:24.401218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:24.407335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.407796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.408254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.408958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.409419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.409836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.551055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:24.558922 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89cc5e71-0cfd-4c3f-9bc9-44c9627ae8fa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1388 microversion: 2.1 time: 0.162723 Oct 03 15:16:24.569930 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3409/6646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:24 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:24.642419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:24.643107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:24.652940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.653551 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.654043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.654825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.655345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.655833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.684583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:16:24.740797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:24.759519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:24.760306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:24.779351 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6619d9e-1964-4367-9544-2382a4960aa4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 204 len: 0 microversion: 2.1 time: 0.140627 Oct 03 15:16:24.780316 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3238/6647] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:16:24 2022] DELETE /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:16:24.782332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.783039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.787200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.788066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.788544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.789002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.793193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:24.793988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:24.804840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.805838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.806722 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.807732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:24.808637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:24.809381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:24.980192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:24.980815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:24.989279 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c64eb97c-751f-4655-8fc5-74a4a6bfcb08 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.234377 Oct 03 15:16:24.989472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-69c87f1b-d963-44e2-b36a-7661550d03ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1394 microversion: 2.1 time: 0.204529 Oct 03 15:16:24.989883 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3239/6648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:24 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1394 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:24.994709 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3410/6649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:24 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:25.010725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:25.011457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:25.018284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:25.018779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:25.019220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:25.019931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:25.020391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:25.020814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:25.158916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:25.169362 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-622fa7d3-44db-4c82-bb99-ae6e3bdec65c tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.166007 Oct 03 15:16:25.172872 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3240/6650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:25 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:25.410021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-86290596-ffa0-4e68-bf72-ec3280a75465 req-2acccc44-2196-4c6e-bf3e-1e3869048e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71a648d-7a88-4e21-b7fe-d478caa68c9f", "name": "network-vif-plugged", "status": "completed", "tag": "99d78a82-5284-48b4-9bfa-cc490aa4d9bd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:25.419855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86290596-ffa0-4e68-bf72-ec3280a75465 req-2acccc44-2196-4c6e-bf3e-1e3869048e1d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:25.420328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86290596-ffa0-4e68-bf72-ec3280a75465 req-2acccc44-2196-4c6e-bf3e-1e3869048e1d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:25.420757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-86290596-ffa0-4e68-bf72-ec3280a75465 req-2acccc44-2196-4c6e-bf3e-1e3869048e1d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:25.432369 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-86290596-ffa0-4e68-bf72-ec3280a75465 req-2acccc44-2196-4c6e-bf3e-1e3869048e1d service nova] Creating event network-vif-plugged:99d78a82-5284-48b4-9bfa-cc490aa4d9bd for instance b71a648d-7a88-4e21-b7fe-d478caa68c9f on n-h1-781139-2 Oct 03 15:16:25.437553 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-86290596-ffa0-4e68-bf72-ec3280a75465 req-2acccc44-2196-4c6e-bf3e-1e3869048e1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031464 Oct 03 15:16:25.438185 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3411/6651] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:16:26.017532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:26.018101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:26.018457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:26.018553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:26.025357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:26.025824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:26.025926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:26.026316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:26.026412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:26.027032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:26.027419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:26.027512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:26.027950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:26.028152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:26.028610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:26.029069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:26.165471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:26.166945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:26.173654 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81e8dc7e-644d-45d3-953d-f5ec36e97b2a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1374 microversion: 2.1 time: 0.161536 Oct 03 15:16:26.174241 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3412/6652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:26 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:26.174990 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-06c9ae06-7988-4713-bad1-3ec4aded329d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1394 microversion: 2.1 time: 0.165025 Oct 03 15:16:26.175595 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3241/6653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:26 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1394 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:26.193537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:26.194284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:26.202276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:26.202839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:26.203274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:26.206499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:26.207058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:26.207568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:26.339189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:26.347425 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38a5bfd7-2cff-4caf-940e-e59272891bfe tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.157790 Oct 03 15:16:26.348205 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3413/6654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:26 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:27.115038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-68a4ca22-016c-4573-a619-304abbc6b72a req-622c6d39-a661-4bed-9ca8-d1cbfee2d8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1aa4baf-88ee-480f-aa1c-3eea570477bc", "name": "network-vif-deleted", "tag": "1e7f6db2-ad3a-4372-a65f-be3ef2da3ab3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:27.129709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-68a4ca22-016c-4573-a619-304abbc6b72a req-622c6d39-a661-4bed-9ca8-d1cbfee2d8af service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.131248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-68a4ca22-016c-4573-a619-304abbc6b72a req-622c6d39-a661-4bed-9ca8-d1cbfee2d8af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.132213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-68a4ca22-016c-4573-a619-304abbc6b72a req-622c6d39-a661-4bed-9ca8-d1cbfee2d8af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.145388 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-68a4ca22-016c-4573-a619-304abbc6b72a req-622c6d39-a661-4bed-9ca8-d1cbfee2d8af service nova] Creating event network-vif-deleted:1e7f6db2-ad3a-4372-a65f-be3ef2da3ab3 for instance e1aa4baf-88ee-480f-aa1c-3eea570477bc on n-h1-781139-2 Oct 03 15:16:27.152004 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-68a4ca22-016c-4573-a619-304abbc6b72a req-622c6d39-a661-4bed-9ca8-d1cbfee2d8af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041947 Oct 03 15:16:27.153402 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3242/6655] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:27.197593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:27.198776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:27.198924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:27.199577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:27.206322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.206808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.207246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.208447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.208907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.209677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.211832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.212432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.213132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.215402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.215402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.215402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.281623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:27.289492 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9b655431-ae7b-48da-b47c-7524406d07d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1187 microversion: 2.1 time: 0.095478 Oct 03 15:16:27.290265 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3243/6656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:27 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:27.346061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:27.355793 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-097fe68f-bd94-4613-8887-0e1c88721383 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1546 microversion: 2.1 time: 0.162872 Oct 03 15:16:27.356343 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3414/6657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:27 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:27.370706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:27.371493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:27.377882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.378377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.378776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:27.378880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.379394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:27.379645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.380104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.380531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.385795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.386253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.386691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.387412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:27.387865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:27.388289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:27.512602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:27.520591 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c4ffe818-4ff3-431d-a26b-8316bc3619d9 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1314 microversion: 2.1 time: 0.154169 Oct 03 15:16:27.521249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3244/6658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:27 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:27.523779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:27.531924 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a30efbd-0a0f-48fb-ae10-ab3c29cecc10 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1546 microversion: 2.1 time: 0.157272 Oct 03 15:16:27.532480 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3415/6659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:27 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:28.312266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:28.313307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:28.321178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.322051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.322742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.324546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.325383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.325947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.543658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:28.544635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:28.552342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.553028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.553571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.554703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.555293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.555829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.709363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:28.720863 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afba508a-0aa1-4e5d-8fc3-9478d7d0508a tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1501 microversion: 2.1 time: 0.181262 Oct 03 15:16:28.734492 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3416/6660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:28 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:28.746596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:28.747462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:28.754664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.755166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.755610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.756379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.757142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.757619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.788746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:28.812374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c8b85f42-4545-418c-9454-6d31d99e7f9f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1352 microversion: 2.1 time: 0.504461 Oct 03 15:16:28.813326 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3245/6661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:28 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1352 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:28.911274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:28.920661 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ce7d74f-3cb8-4167-90aa-f10165f03e8d tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1501 microversion: 2.1 time: 0.178573 Oct 03 15:16:28.921295 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3417/6662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:28 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:28.943445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:28.944211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:28.950653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.951134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.951565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.952393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:28.952848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:28.953297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:28.976141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lazy-loading 'flavor' on Instance uuid b71a648d-7a88-4e21-b7fe-d478caa68c9f {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:16:29.061846 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1afa193b-a867-4f28-9c6a-52274921d158 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action" status: 202 len: 0 microversion: 2.1 time: 0.122555 Oct 03 15:16:29.063213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3246/6663] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:16:28 2022] POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:16:29.072531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:29.073518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:29.080648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:29.081387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:29.081926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:29.082759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:29.083317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:29.083823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:29.239101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:29.248428 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-914a7c77-36a4-44b4-b8df-d614fcc258a8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1509 microversion: 2.1 time: 0.181095 Oct 03 15:16:29.249070 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3418/6664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:29 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:16:29.819170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-876cb8b8-5089-4413-999f-23f6a07be0f5 req-86305bd3-0c1e-4e6d-8a54-047332ffa894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb58eccf-d0d3-4c49-ae35-d164df556293", "tag": "8ab0bd83-1f3f-450d-9e49-f5ac4c654b72"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:29.835781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:29.837144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:29.842045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-876cb8b8-5089-4413-999f-23f6a07be0f5 req-86305bd3-0c1e-4e6d-8a54-047332ffa894 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:29.844043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-876cb8b8-5089-4413-999f-23f6a07be0f5 req-86305bd3-0c1e-4e6d-8a54-047332ffa894 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:29.846275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-876cb8b8-5089-4413-999f-23f6a07be0f5 req-86305bd3-0c1e-4e6d-8a54-047332ffa894 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:29.849249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:29.850634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:29.851909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:29.853211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:29.853820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:29.855131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:29.868112 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-876cb8b8-5089-4413-999f-23f6a07be0f5 req-86305bd3-0c1e-4e6d-8a54-047332ffa894 service nova] Creating event network-changed:8ab0bd83-1f3f-450d-9e49-f5ac4c654b72 for instance eb58eccf-d0d3-4c49-ae35-d164df556293 on n-h1-781139-2 Oct 03 15:16:29.875474 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-876cb8b8-5089-4413-999f-23f6a07be0f5 req-86305bd3-0c1e-4e6d-8a54-047332ffa894 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062347 Oct 03 15:16:29.876404 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3247/6665] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:29.928792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:29.937499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba7d8999-9150-4873-ac1d-7dd496bf6137 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1352 microversion: 2.1 time: 0.105888 Oct 03 15:16:29.938692 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3419/6666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:29 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:30.272675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:30.273643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:30.280679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.281374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.281950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:30.282798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.283412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.283973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:30.540700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:30.551111 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b3d3822e-5708-49b7-924d-22c8b12aa0fd tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1492 microversion: 2.1 time: 0.283005 Oct 03 15:16:30.553295 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3248/6667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:30 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1492 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:30.575348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:30.575890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:30.582207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.582685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.583296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:30.584005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.584505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.584948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:30.589030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:30.663437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e1135b8-e217-44bf-aa49-49f3ac1dc340 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action" status: 202 len: 0 microversion: 2.1 time: 0.091831 Oct 03 15:16:30.664235 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3420/6668] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:16:30 2022] POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:16:30.673028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:30.673652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:30.680269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.680769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.681236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:30.681979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.682435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.682868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:30.899397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:30.919237 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ef7b7ade-c761-43d0-9b3e-37fd0f402e43 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1498 microversion: 2.1 time: 0.249652 Oct 03 15:16:30.921618 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3249/6669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:30 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1498 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:30.964536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:30.965309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:30.982551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.983054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.983498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:30.984376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:30.984777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:30.985249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:31.072632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:31.082265 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0650c481-880a-4b6c-a142-3ab43958201d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1352 microversion: 2.1 time: 0.123339 Oct 03 15:16:31.082865 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3421/6670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:30 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:31.947818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:31.948453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:31.955466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:31.955959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:31.956403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:31.957152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:31.957591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:31.958128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:32.105835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:32.107321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:32.109440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:32.114994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:32.115561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:32.116237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:32.117173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:32.118574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e02a8bcc-8004-4193-9def-46f1c2b18e9b tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1498 microversion: 2.1 time: 0.174571 Oct 03 15:16:32.119458 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3250/6671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:31 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:32.125905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:32.126444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:32.158638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:32.159117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:32.159552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:32.159993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lazy-loading 'fault' on Instance uuid e1aa4baf-88ee-480f-aa1c-3eea570477bc {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:16:32.202804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:32.211078 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-35160b34-f5a2-464d-a6fe-7332e021e24b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 200 len: 1357 microversion: 2.1 time: 0.109945 Oct 03 15:16:32.211663 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3422/6672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:32 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 1357 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:33.143852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:33.144356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:33.152071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.152566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.153027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.153727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.154174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.154600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.235268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:33.236084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:33.244088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.244822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.245299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.245996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.246481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.246907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.262712 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc HTTP/1.1 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e1aa4baf-88ee-480f-aa1c-3eea570477bc'} Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:33.264371 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:33.267664 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:33.267664 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:33.267664 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:33.267664 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:16:33.267664 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:16:33.267664 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:33.267664 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:33.268980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:16:33.270034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88775ae9-5c76-4004-8a6f-9bb8a331626c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 404 len: 111 microversion: 2.1 time: 0.038840 Oct 03 15:16:33.270724 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3423/6673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:33 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:16:33.299770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:33.309220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5f3b68f-9f41-4425-aea1-46325b811343 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1501 microversion: 2.1 time: 0.169491 Oct 03 15:16:33.310248 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3251/6674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:33 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:33.333230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:33.333911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:33.340215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.340703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.341424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.342094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.342552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.342981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.368158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lazy-loading 'flavor' on Instance uuid b71a648d-7a88-4e21-b7fe-d478caa68c9f {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:16:33.445757 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc22e43c-68cc-4ecd-be31-ddffc4c530ba tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action" status: 202 len: 0 microversion: 2.1 time: 0.116297 Oct 03 15:16:33.446580 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3424/6675] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:16:33 2022] POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:16:33.458061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:33.458751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:33.468216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.469194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.469909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.470869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:33.471331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:33.471763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:33.607414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:33.615472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-55e404be-d7dc-4687-80e3-63a11882cc0f tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1509 microversion: 2.1 time: 0.164620 Oct 03 15:16:33.616058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3252/6676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:33 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:34.640447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:34.641117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:34.647972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:34.648541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:34.648944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:34.649694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:34.650148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:34.650601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:34.793774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:34.802560 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5ef51fa7-a814-4655-b9f1-fe52a6342979 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1492 microversion: 2.1 time: 0.167440 Oct 03 15:16:34.804952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3425/6677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:34 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1492 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:34.826124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:34.826677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:34.833948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:34.834536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:34.834981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:34.835688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:34.836144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:34.836571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:34.908032 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-057b3b47-a1a7-4a32-b018-3eb9c18ac222 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action" status: 202 len: 0 microversion: 2.1 time: 0.085584 Oct 03 15:16:34.908768 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3253/6678] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:16:34 2022] POST /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:16:34.917439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:34.918046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:34.925218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:34.925918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:34.926464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:34.927234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:34.927744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:34.928276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:35.067695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:35.076789 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c9e079c-d4c4-46eb-af5f-36a5e0cfb5a4 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1498 microversion: 2.1 time: 0.163569 Oct 03 15:16:35.080961 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3426/6679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:34 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:35.435437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:35.435966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:35.442375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:35.442867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:35.443502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:35.444824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:35.445331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:35.445769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:35.451176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:35.461691 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc HTTP/1.1 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'e1aa4baf-88ee-480f-aa1c-3eea570477bc'} Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:16:35.463530 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:16:35.467307 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd05c4d5-da66-4ba0-9230-86f226aeba47 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 404 len: 111 microversion: 2.1 time: 0.034024 Oct 03 15:16:35.473893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:35.474467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: e1aa4baf-88ee-480f-aa1c-3eea570477bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:35.479175 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3254/6680] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:16:35 2022] DELETE /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:16:35.483545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:35.484047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:35.484491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:35.485577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:35.485690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:35.486118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:35.503729 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc HTTP/1.1 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e1aa4baf-88ee-480f-aa1c-3eea570477bc'} Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:35.505471 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance e1aa4baf-88ee-480f-aa1c-3eea570477bc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c7c28bb4-b675-4067-b1d0-625b584e2e9a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc" status: 404 len: 111 microversion: 2.1 time: 0.038603 Oct 03 15:16:35.509316 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3427/6681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:35 2022] GET /compute/v2.1/servers/e1aa4baf-88ee-480f-aa1c-3eea570477bc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:16:36.100347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:36.100950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:36.109002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:36.109487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:36.109929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:36.110620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:36.111078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:36.111511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:36.246910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:36.255107 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-733b3b7e-2214-4489-b6cb-7f96a4c52377 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1498 microversion: 2.1 time: 0.159185 Oct 03 15:16:36.255691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3255/6682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:36 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:37.283628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:37.285231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:37.296380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:37.297288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:37.298080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:37.299202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:37.299807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:37.300357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:37.437545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:37.447294 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89439e18-49eb-4cc4-af16-aaa38dfc48ef tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1501 microversion: 2.1 time: 0.170951 Oct 03 15:16:37.447929 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3428/6683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:37 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:37.481299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:37.481828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:37.489003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:37.489558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:37.489969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:37.490671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:37.491105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:37.491580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:37.517582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:16:37.604724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f42ba02-b3c4-40d3-b372-8ceedf049501 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 204 len: 0 microversion: 2.1 time: 0.127736 Oct 03 15:16:37.605487 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3256/6684] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:16:37 2022] DELETE /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:16:37.615297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:37.615966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:37.622102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:37.622585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:37.623024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:37.623760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:37.624222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:37.624731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:37.768107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:37.777229 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-029b82a6-80f6-4e63-bdd6-26e2e70e7dd0 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1507 microversion: 2.1 time: 0.166230 Oct 03 15:16:37.777917 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3429/6685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:37 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:38.801132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:38.802155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:38.809214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:38.809694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:38.810136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:38.810845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:38.811277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:38.811717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:38.949339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:38.957438 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dce9c701-7cc3-4337-bdb5-a4e7a14d6155 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1507 microversion: 2.1 time: 0.161394 Oct 03 15:16:38.958067 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3257/6686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:38 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:39.981241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:39.982576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:39.990479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:39.991241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:39.991894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:39.992884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:39.993708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:39.994322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:40.159872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4aaf52744934a4c93ef5989b1fb3c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f641f1c8b7ba43baafc6b48402378ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:40.170557 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e07f4b4a-c8a4-4ff0-847b-3dbe1de4b16e tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 200 len: 1507 microversion: 2.1 time: 0.194473 Oct 03 15:16:40.172581 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3430/6687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:39 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:40.300468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0ed9c2b8-633c-4db2-8bfc-d886a87f706f req-b2df9c90-8722-4ae9-9744-2ba3771bb4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71a648d-7a88-4e21-b7fe-d478caa68c9f", "name": "network-vif-deleted", "tag": "99d78a82-5284-48b4-9bfa-cc490aa4d9bd"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:40.328858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0ed9c2b8-633c-4db2-8bfc-d886a87f706f req-b2df9c90-8722-4ae9-9744-2ba3771bb4a3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:40.331859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0ed9c2b8-633c-4db2-8bfc-d886a87f706f req-b2df9c90-8722-4ae9-9744-2ba3771bb4a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:40.332940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0ed9c2b8-633c-4db2-8bfc-d886a87f706f req-b2df9c90-8722-4ae9-9744-2ba3771bb4a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:40.373564 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0ed9c2b8-633c-4db2-8bfc-d886a87f706f req-b2df9c90-8722-4ae9-9744-2ba3771bb4a3 service nova] Creating event network-vif-deleted:99d78a82-5284-48b4-9bfa-cc490aa4d9bd for instance b71a648d-7a88-4e21-b7fe-d478caa68c9f on n-h1-781139-2 Oct 03 15:16:40.383304 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0ed9c2b8-633c-4db2-8bfc-d886a87f706f req-b2df9c90-8722-4ae9-9744-2ba3771bb4a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087992 Oct 03 15:16:40.384008 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3258/6688] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:41.196134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:41.196858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] [instance: b71a648d-7a88-4e21-b7fe-d478caa68c9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:41.204110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:41.204533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:41.204978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:41.205701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:41.206151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:41.206581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:41.221003 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] HTTP exception thrown: Instance b71a648d-7a88-4e21-b7fe-d478caa68c9f could not be found. Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Request method failure captured: Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f HTTP/1.1 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvy5_-U2Xw1G-cEzvowJC-6oky0DLX3JmHHjp-nRbKBmH-za84yFIF9yR2ycaatGO4igFN0Ozdz2xfjhUXAjUwB4WrBBOcyWkyOc-xo_1IS_MWgQBBs-xnKMa70BlAeLZH6Q_DKXsgz_26T5_N_N5lJKKjsW_8fjo650pjSHdKNTlm0 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f641f1c8b7ba43baafc6b48402378ffc Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestServerAdvancedOps-1452509312 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f641f1c8b7ba43baafc6b48402378ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f641f1c8b7ba43baafc6b48402378ffc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f641f1c8b7ba43baafc6b48402378ffc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f641f1c8b7ba43baafc6b48402378ffc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestServerAdvancedOps-1452509312 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f641f1c8b7ba43baafc6b48402378ffc Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestServerAdvancedOps-1452509312 Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestServerAdvancedOps-1452509312-project Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f4aaf52744934a4c93ef5989b1fb3c7c Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestServerAdvancedOps-1452509312-project Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance b71a648d-7a88-4e21-b7fe-d478caa68c9f could not be found. Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'b71a648d-7a88-4e21-b7fe-d478caa68c9f'} Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71a648d-7a88-4e21-b7fe-d478caa68c9f could not be found. Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71a648d-7a88-4e21-b7fe-d478caa68c9f could not be found. Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:16:41.222578 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71a648d-7a88-4e21-b7fe-d478caa68c9f could not be found. Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] Returning 404 to user: Instance b71a648d-7a88-4e21-b7fe-d478caa68c9f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e968c879-2bd2-4960-8666-d539502814e8 tempest-TestServerAdvancedOps-1452509312 tempest-TestServerAdvancedOps-1452509312-project] 10.222.0.20 "GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f" status: 404 len: 111 microversion: 2.1 time: 0.032069 Oct 03 15:16:41.226545 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3431/6689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:41 2022] GET /compute/v2.1/servers/b71a648d-7a88-4e21-b7fe-d478caa68c9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:16:50.619261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:50.620018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:50.625372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:50.626265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:50.634433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:50.635445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:50.636073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:50.637293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:50.637929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:50.638532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:50.665928 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fcf2b2a9-41be-4cbe-b9b7-fa45bd48cf59 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.048661 Oct 03 15:16:50.667177 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3259/6690] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 3 15:16:50 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e/os-server-password => generated 116 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:16:56.483643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1915324576", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4d2fd3ea-d7c7-40e9-bbbf-71e12c6eed14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:16:56.495158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=63 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:56.495828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:16:56.559921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:16:57.004707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:16:57.005197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:16:57.005842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:16:57.006321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:16:57.006773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:16:57.020278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:57.021072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:57.021773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:57.022980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:57.023691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:57.024395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:57.041762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:16:57.047202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:16:57.110431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:16:57.112580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d2fd3ea-d7c7-40e9-bbbf-71e12c6eed14',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:16:57.255624 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d29ae38c-01c8-43b4-b3ad-c146b8ebbe46 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775329 Oct 03 15:16:57.256289 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3432/6691] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:16:57.267800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3b82339e-9f18-4246-ae6a-29498b0ee06a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:57.268410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3b82339e-9f18-4246-ae6a-29498b0ee06a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:57.323118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3b82339e-9f18-4246-ae6a-29498b0ee06a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:57.330514 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3b82339e-9f18-4246-ae6a-29498b0ee06a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1071 microversion: 2.1 time: 0.066788 Oct 03 15:16:57.331100 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3260/6692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:57 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1071 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:58.356815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:58.357673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:58.366146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:58.366716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:58.367198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:58.368136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:58.368648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:58.369173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:58.440696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:16:58.451057 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a5f65f1-4c62-4735-8341-3a49169416f0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1187 microversion: 2.1 time: 0.100722 Oct 03 15:16:58.459429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3433/6693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:58 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:16:59.474373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:16:59.475296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:16:59.485393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:59.485968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:59.486402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:16:59.487294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:16:59.487746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:16:59.488167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:00.046079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:00.054618 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9e9227ee-606b-48cb-bf07-a81d5af6b42d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1229 microversion: 2.1 time: 0.584324 Oct 03 15:17:00.055198 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3261/6694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:16:59 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1229 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:00.132170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8845b280-44d5-4611-8c9c-cfb4f83d66a8 req-0af34562-6b56-4cd2-b91d-b321f12a9895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69871f9-cc35-4bef-8303-1fc5ae231175", "tag": "c2844852-4474-45a7-b8bc-abfc344fdcba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:00.147442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8845b280-44d5-4611-8c9c-cfb4f83d66a8 req-0af34562-6b56-4cd2-b91d-b321f12a9895 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:00.147919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8845b280-44d5-4611-8c9c-cfb4f83d66a8 req-0af34562-6b56-4cd2-b91d-b321f12a9895 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:00.148508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8845b280-44d5-4611-8c9c-cfb4f83d66a8 req-0af34562-6b56-4cd2-b91d-b321f12a9895 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:00.165805 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8845b280-44d5-4611-8c9c-cfb4f83d66a8 req-0af34562-6b56-4cd2-b91d-b321f12a9895 service nova] Creating event network-changed:c2844852-4474-45a7-b8bc-abfc344fdcba for instance d69871f9-cc35-4bef-8303-1fc5ae231175 on n-h2-781139-2 Oct 03 15:17:00.173142 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8845b280-44d5-4611-8c9c-cfb4f83d66a8 req-0af34562-6b56-4cd2-b91d-b321f12a9895 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044548 Oct 03 15:17:00.174010 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3434/6695] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:17:00.212742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:00.215653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:00.222290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:00.222989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:00.223876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:00.224954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:00.225553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:00.226175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:00.297677 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-23460aa4-b6d7-4b0f-9997-00003827775a tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293/action" status: 200 len: 24568 microversion: 2.1 time: 0.088503 Oct 03 15:17:00.298622 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3262/6696] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:17:00 2022] POST /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293/action => generated 24568 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:17:01.079456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:01.080169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:01.087189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:01.087919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:01.088358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:01.089102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:01.089551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:01.090271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:01.223796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:01.232444 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4cc1685b-048e-4a51-b819-bdccf7a1d69b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1229 microversion: 2.1 time: 0.157326 Oct 03 15:17:01.233038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3435/6697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:01 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1229 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:02.255641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:02.256390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:02.264915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:02.265353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:02.265803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:02.266543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:02.266976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:02.267434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:02.408100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:02.416501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d73238c2-d62e-4c56-b780-6bcae53a4111 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1229 microversion: 2.1 time: 0.165228 Oct 03 15:17:02.417252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3263/6698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:02 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:03.442083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:03.443752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:03.452750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:03.453272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:03.453710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:03.454490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:03.454885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:03.455311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:03.597517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:03.608129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81c82c91-c30d-44dd-ba75-5bef81d5438c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.171989 Oct 03 15:17:03.608729 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3436/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:03 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:04.635508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:04.636234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:04.649385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:04.650231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:04.650955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:04.652270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:04.652846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:04.653320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:04.803028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:04.813165 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70c93f2d-a945-4308-aaf1-fa7fabcaae02 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.184581 Oct 03 15:17:04.813751 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3264/6700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:04 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:05.840378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:05.841290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:05.853373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:05.854190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:05.854933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:05.856213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:05.856591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:05.857051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:06.001229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:06.009423 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1637861-fbfc-4453-a714-de660c516e3b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.175950 Oct 03 15:17:06.010005 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3437/6701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:05 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:07.039160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:07.039751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:07.047026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:07.047508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:07.047945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:07.048644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:07.049129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:07.049556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:07.187517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:07.195715 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d29afa1-3e6b-49a5-aadb-f5e94a5eeff7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.160546 Oct 03 15:17:07.196293 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3265/6702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:07 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:08.225585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:08.226567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:08.231553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:08.232750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:08.243855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:08.244674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:08.245466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:08.246678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:08.247444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:08.248149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:08.393749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:08.401908 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1d82f22-84ea-4710-b9a2-104a41be5397 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.183380 Oct 03 15:17:08.402626 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3438/6703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:08 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:09.427293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:09.428161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:09.430892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:09.439916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:09.440617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:09.441276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:09.442283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:09.442960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:09.443574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:09.603891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:09.611999 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e99d3789-4909-4f22-895e-f78b7973853c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.190303 Oct 03 15:17:09.612581 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3266/6704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:09 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:10.635457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:10.636026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:10.642833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:10.643352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:10.643838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:10.644476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:10.644956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:10.645367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:10.776177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:10.788048 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1246662a-f2c6-4bd6-b0b7-916d07fef214 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.156528 Oct 03 15:17:10.788910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3439/6705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:10 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:11.817868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:11.818877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:11.829678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:11.830158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:11.830592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:11.831282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:11.831756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:11.832198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:11.970996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:11.979637 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00ac5ca1-5b27-4b80-998b-0acd4e5e17cd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.168386 Oct 03 15:17:11.980234 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3267/6706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:11 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:12.640811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-293c3afd-032c-44db-b017-abdcf806abf0 req-98410104-aef2-4f9e-9785-252d56f6fa1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69871f9-cc35-4bef-8303-1fc5ae231175", "name": "network-vif-plugged", "status": "completed", "tag": "c2844852-4474-45a7-b8bc-abfc344fdcba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:12.652711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-293c3afd-032c-44db-b017-abdcf806abf0 req-98410104-aef2-4f9e-9785-252d56f6fa1d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:12.653231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-293c3afd-032c-44db-b017-abdcf806abf0 req-98410104-aef2-4f9e-9785-252d56f6fa1d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:12.653668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-293c3afd-032c-44db-b017-abdcf806abf0 req-98410104-aef2-4f9e-9785-252d56f6fa1d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:12.665634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-293c3afd-032c-44db-b017-abdcf806abf0 req-98410104-aef2-4f9e-9785-252d56f6fa1d service nova] Creating event network-vif-plugged:c2844852-4474-45a7-b8bc-abfc344fdcba for instance d69871f9-cc35-4bef-8303-1fc5ae231175 on n-h2-781139-2 Oct 03 15:17:12.670900 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-293c3afd-032c-44db-b017-abdcf806abf0 req-98410104-aef2-4f9e-9785-252d56f6fa1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034023 Oct 03 15:17:12.671518 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3440/6707] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:17:13.006505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:13.007939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:13.018487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:13.018991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:13.019431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:13.020149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:13.020602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:13.021049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:13.155095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:13.167781 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3a3566be-d350-4431-86b5-e0ad6c681b48 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1217 microversion: 2.1 time: 0.167716 Oct 03 15:17:13.168517 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3268/6708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:12 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:14.194343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:14.195048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:14.201579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:14.202072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:14.202505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:14.203203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:14.203662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:14.204090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:14.625754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:14.634126 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65d6c560-5945-475a-a090-97d67dac6bfa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1403 microversion: 2.1 time: 0.445320 Oct 03 15:17:14.634715 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3441/6709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:14 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1403 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:14.656330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:14.656957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:14.664066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:14.664653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:14.665161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:14.665850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:14.666299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:14.666723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:14.806853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:14.817348 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1ad5a4f9-c514-40f9-9e49-8f61f044130d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1403 microversion: 2.1 time: 0.164927 Oct 03 15:17:14.817935 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3269/6710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:14 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:14.839759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1783021968"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:14.842142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:14.848741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:14.849253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:14.849707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:14.850419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:14.850871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:14.851302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:14.952285 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Attempting to quiesce instance before volume snapshot. Oct 03 15:17:15.015190 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 03 15:17:15.089150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Creating snapshot from volume 4d2fd3ea-d7c7-40e9-bbbf-71e12c6eed14. {{(pid=128869) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 03 15:17:15.933931 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9a67e6f-9d6c-4fe0-ba34-6683cce1d02e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175/action" status: 202 len: 0 microversion: 2.1 time: 1.098144 Oct 03 15:17:15.934643 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3442/6711] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:17:14 2022] POST /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175/action => generated 0 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 15:17:17.103005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1233288602", "imageRef": "a944374a-3b7b-4a82-ba0e-e538e4be0f38", "flavorRef": "452", "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:17.171822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:17:17.583002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:17:17.583435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:17:17.583911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:17:17.585133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:17:17.585771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:17:17.599869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:17.600463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:17.600908 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:17.601692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:17.602597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:17.603038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:17.621268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:17:17.626792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:17:17.640356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:17:17.643010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c734b549-d02c-4e9b-8fa5-18b1cda42ee8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:17:17.731335 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4c44193b-ae81-4baa-b16a-96ca289f29ab tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632492 Oct 03 15:17:17.732186 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3270/6712] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:17:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:17:17.745050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99059a7a-248a-4d9b-acb4-7e7c271258a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:17.745769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99059a7a-248a-4d9b-acb4-7e7c271258a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:17.799178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99059a7a-248a-4d9b-acb4-7e7c271258a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:17.808330 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99059a7a-248a-4d9b-acb4-7e7c271258a0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1230 microversion: 2.1 time: 0.068517 Oct 03 15:17:17.808952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3443/6713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:17 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1230 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:18.832089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:18.832947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:18.839966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:18.840529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:18.841076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:18.841885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:18.842381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:18.842869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:18.915152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:18.924086 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d6ef922c-ef04-4107-8d1b-c388fb3bf5cf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1282 microversion: 2.1 time: 0.096868 Oct 03 15:17:18.924695 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3271/6714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:18 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:19.947930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:19.948560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:19.956404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:19.957486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:19.958158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:19.958878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:19.959495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:19.960116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:20.121842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:20.133170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e956a0fb-9e72-44d2-bc22-1a1f6bbceebf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.189138 Oct 03 15:17:20.141666 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3444/6715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:19 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:20.312865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-352338aa-0e49-475b-80fd-097d98b6cf88 req-7b399a6b-d751-4795-8877-bc2d37394e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde5d296-eae3-456c-9a86-af6f2e8ffdd8", "tag": "0f3fba42-aea0-45d5-9644-b13afd644b03"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:20.330405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-352338aa-0e49-475b-80fd-097d98b6cf88 req-7b399a6b-d751-4795-8877-bc2d37394e95 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:20.331327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-352338aa-0e49-475b-80fd-097d98b6cf88 req-7b399a6b-d751-4795-8877-bc2d37394e95 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:20.332190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-352338aa-0e49-475b-80fd-097d98b6cf88 req-7b399a6b-d751-4795-8877-bc2d37394e95 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:20.345304 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-352338aa-0e49-475b-80fd-097d98b6cf88 req-7b399a6b-d751-4795-8877-bc2d37394e95 service nova] Creating event network-changed:0f3fba42-aea0-45d5-9644-b13afd644b03 for instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 on n-h1-781139-2 Oct 03 15:17:20.350708 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-352338aa-0e49-475b-80fd-097d98b6cf88 req-7b399a6b-d751-4795-8877-bc2d37394e95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041863 Oct 03 15:17:20.351329 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3272/6716] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:17:21.156208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:21.156808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:21.164495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:21.165041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:21.165494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:21.166222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:21.166683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:21.167123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:21.301588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:21.310176 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7cc08e38-f9fa-4746-b744-c2d7f6995559 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.157995 Oct 03 15:17:21.310868 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3445/6717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:21 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:22.336091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:22.336898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:22.339626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:22.345368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:22.345923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:22.346431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:22.347437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:22.348228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:22.348879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:22.352837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=67 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:22.515608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:22.522970 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2410b5ff-4d4c-4339-96f5-0e2ee2e293e5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.193166 Oct 03 15:17:22.523578 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3273/6718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:22 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:23.554910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:23.556604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:23.568811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:23.569634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:23.570762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:23.571741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:23.572448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:23.573263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:23.758966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:23.779785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d29722d3-05cc-4bf5-add7-8dd2b9f3d7b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.232342 Oct 03 15:17:23.780630 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3446/6719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:23 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:24.804087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:24.804705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:24.812276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:24.812756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:24.813243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:24.813917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:24.814362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:24.814799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:24.972139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:24.989710 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c72feb1c-ac18-4310-a731-b5300a388639 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.187917 Oct 03 15:17:24.990873 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3274/6720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:24 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:17:26.013931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:26.014581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:26.021623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:26.022132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:26.022589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:26.023308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:26.023842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:26.024216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:26.174735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:26.182670 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e47b9d74-1abd-4f94-b044-20e4990ac46b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.172811 Oct 03 15:17:26.183324 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3447/6721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:26 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:27.205624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:27.206266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:27.213901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:27.214390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:27.214829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:27.215522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:27.215971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:27.216398 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:27.351483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:27.363937 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4d3f85a0-9297-4a86-a083-d7e69b30036b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.162385 Oct 03 15:17:27.364478 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3275/6722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:27 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:28.387416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:28.388234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:28.392542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:28.393237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:28.398067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:28.398567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:28.399016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:28.399731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:28.400194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:28.400626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:28.405573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:28.535777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:28.544229 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8860dd2e-8355-4544-b723-d8a595760a6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.161281 Oct 03 15:17:28.544822 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3448/6723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:28 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:29.567720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:29.568362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:29.570308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:29.571007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:29.578075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:29.578561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:29.579001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:29.579699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:29.580188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:29.581230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:29.720826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:29.729524 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-50747d10-d0bb-40d0-821d-5f0905277b0d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.165812 Oct 03 15:17:29.730084 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3276/6724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:29 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:30.623903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:30.626350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:30.634191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:30.634788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:30.635278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:30.635975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:30.636480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:30.636957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:30.712051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a3c7dce-986e-4404-8af0-383abc086927 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "POST /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293/action" status: 200 len: 32642 microversion: 2.1 time: 0.092020 Oct 03 15:17:30.712745 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3449/6725] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:17:30 2022] POST /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293/action => generated 32642 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:17:30.755347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:30.756072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:30.763284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:30.763828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:30.764363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:30.765217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:30.765676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:30.766101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:30.899851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:30.908142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-859aa423-5a69-47ed-a8c1-86a2891306fe tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.159019 Oct 03 15:17:30.909318 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3277/6726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:30 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:31.773481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:31.774070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:31.782870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:31.783551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:31.784163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:31.785076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:31.785722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:31.786382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:31.819677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:17:31.929447 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3591b1fd-8dbe-4408-ba4e-15d90b501e20 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 204 len: 0 microversion: 2.1 time: 0.159903 Oct 03 15:17:31.934215 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3450/6727] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:17:31 2022] DELETE /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:17:31.942889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:31.944377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:31.951860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-eaf54cf4-034f-4ef2-95cc-357b0c1cb1b9 req-0b45f34d-5702-4a62-9445-9f196b1ba8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb58eccf-d0d3-4c49-ae35-d164df556293", "tag": "8ab0bd83-1f3f-450d-9e49-f5ac4c654b72"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:31.953435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:31.954256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:31.955063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:31.956064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:31.956805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:31.957717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:31.977494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eaf54cf4-034f-4ef2-95cc-357b0c1cb1b9 req-0b45f34d-5702-4a62-9445-9f196b1ba8a6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:31.982680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eaf54cf4-034f-4ef2-95cc-357b0c1cb1b9 req-0b45f34d-5702-4a62-9445-9f196b1ba8a6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:31.983235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-eaf54cf4-034f-4ef2-95cc-357b0c1cb1b9 req-0b45f34d-5702-4a62-9445-9f196b1ba8a6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:31.996827 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-eaf54cf4-034f-4ef2-95cc-357b0c1cb1b9 req-0b45f34d-5702-4a62-9445-9f196b1ba8a6 service nova] Creating event network-changed:8ab0bd83-1f3f-450d-9e49-f5ac4c654b72 for instance eb58eccf-d0d3-4c49-ae35-d164df556293 on n-h1-781139-2 Oct 03 15:17:32.005107 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-eaf54cf4-034f-4ef2-95cc-357b0c1cb1b9 req-0b45f34d-5702-4a62-9445-9f196b1ba8a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231861 Oct 03 15:17:32.006350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3278/6728] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:17:32.013135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:32.014052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:32.026560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:32.027397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:32.028654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:32.029679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:32.030211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:32.030707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:32.153469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:32.163978 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-315cf368-e41e-4370-a5cb-1fd0e6cf4a8a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.227094 Oct 03 15:17:32.164576 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3451/6729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:31 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:32.210304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:32.218589 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-73c925d6-e48c-41fb-b371-70af30c0a380 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1671 microversion: 2.1 time: 0.210953 Oct 03 15:17:32.219167 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3279/6730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:32 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:33.187622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:33.188225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:33.195711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:33.196279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:33.196816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:33.197630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:33.198188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:33.198636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:33.243094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:33.243664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:33.250945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:33.251432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:33.252053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:33.252757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:33.253238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:33.253667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:33.347615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:33.358005 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-98e13347-431f-488c-b1fa-404961fa9762 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1342 microversion: 2.1 time: 0.174454 Oct 03 15:17:33.371085 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3452/6731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:33 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:33.426417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:33.434597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-786a8d6b-6ca3-4ac2-960e-95514655dbaa tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1671 microversion: 2.1 time: 0.195869 Oct 03 15:17:33.435225 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3280/6732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:33 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1671 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:17:34.165675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4bbfb665-0b29-4f5e-9fa5-f45ad26a5fa8 req-afa6bfa0-8923-4a6a-bf61-1e83033d2b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb58eccf-d0d3-4c49-ae35-d164df556293", "name": "network-vif-deleted", "tag": "8ab0bd83-1f3f-450d-9e49-f5ac4c654b72"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:34.176638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bbfb665-0b29-4f5e-9fa5-f45ad26a5fa8 req-afa6bfa0-8923-4a6a-bf61-1e83033d2b81 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:34.177358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bbfb665-0b29-4f5e-9fa5-f45ad26a5fa8 req-afa6bfa0-8923-4a6a-bf61-1e83033d2b81 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:34.177984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4bbfb665-0b29-4f5e-9fa5-f45ad26a5fa8 req-afa6bfa0-8923-4a6a-bf61-1e83033d2b81 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:34.190229 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4bbfb665-0b29-4f5e-9fa5-f45ad26a5fa8 req-afa6bfa0-8923-4a6a-bf61-1e83033d2b81 service nova] Creating event network-vif-deleted:8ab0bd83-1f3f-450d-9e49-f5ac4c654b72 for instance eb58eccf-d0d3-4c49-ae35-d164df556293 on n-h1-781139-2 Oct 03 15:17:34.195876 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4bbfb665-0b29-4f5e-9fa5-f45ad26a5fa8 req-afa6bfa0-8923-4a6a-bf61-1e83033d2b81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034068 Oct 03 15:17:34.196462 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3453/6733] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:17:34.382878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:34.383406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:34.390474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:34.390979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:34.391412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:34.392107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:34.392527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:34.393011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:34.459304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:34.460369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:34.467681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:34.468322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:34.468841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:34.469769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:34.470495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:34.471113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:34.555039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29afda2312af4c12b881f6c1da67ef79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911d9ea997ce4ab3ae91e1cfed1e64dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:34.566512 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3fb46ad4-67aa-4a9a-b63e-41408aad2526 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 200 len: 1485 microversion: 2.1 time: 0.111205 Oct 03 15:17:34.567766 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3454/6734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:34 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 1485 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:34.571667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:34.580426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1964dd31-06ac-4fca-bad2-714cef083423 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.202339 Oct 03 15:17:34.581357 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3281/6735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:34 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:35.595018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:35.595651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] [instance: eb58eccf-d0d3-4c49-ae35-d164df556293] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:35.603140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:35.603650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:35.604138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:35.604436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:35.604863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:35.605081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:35.605370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:35.605811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:35.612145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:35.612627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:35.613096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:35.613818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:35.614307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:35.614688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:35.620139 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] HTTP exception thrown: Instance eb58eccf-d0d3-4c49-ae35-d164df556293 could not be found. Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Request method failure captured: Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 HTTP/1.1 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvv_qDyAMEs2SKKqMfBltWvukrDvS5ZtSYOruGhcqaWrizWg5I79Y1E-dSlsmOVaY8leZIwZXEIg2XArepHtxy2X8UnX6gQkVdNlg6IcfMEd401adhJiKFXxgJRSIXTGou1kVK2TbQQbPHazVGK1BT389EsuIAi3MZAkQBVmgKIyWs4 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 911d9ea997ce4ab3ae91e1cfed1e64dc Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_911d9ea997ce4ab3ae91e1cfed1e64dc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/911d9ea997ce4ab3ae91e1cfed1e64dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 911d9ea997ce4ab3ae91e1cfed1e64dc Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkBasicOps-1862598995 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestNetworkBasicOps-1862598995-project Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 29afda2312af4c12b881f6c1da67ef79 Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkBasicOps-1862598995-project Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance eb58eccf-d0d3-4c49-ae35-d164df556293 could not be found. Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'eb58eccf-d0d3-4c49-ae35-d164df556293'} Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb58eccf-d0d3-4c49-ae35-d164df556293 could not be found. Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb58eccf-d0d3-4c49-ae35-d164df556293 could not be found. Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:17:35.621883 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb58eccf-d0d3-4c49-ae35-d164df556293 could not be found. Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Returning 404 to user: Instance eb58eccf-d0d3-4c49-ae35-d164df556293 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f81d4c71-b61e-4583-b912-03cdc0e7b452 tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293" status: 404 len: 111 microversion: 2.1 time: 0.032618 Oct 03 15:17:35.626105 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3455/6736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:35 2022] GET /compute/v2.1/servers/eb58eccf-d0d3-4c49-ae35-d164df556293 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:17:35.751406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:35.760358 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5bdc018a-ffaf-4a9a-af07-0035ce0ebb52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.160247 Oct 03 15:17:35.760961 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3282/6737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:35 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:17:35.790721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa637e8c-2949-4d4c-a7b6-3564f8498bac tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] Calling method '.version_select at 0x7fb2309d5d30>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:35.817760 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa637e8c-2949-4d4c-a7b6-3564f8498bac tempest-TestNetworkBasicOps-1862598995 tempest-TestNetworkBasicOps-1862598995-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1010783078" status: 202 len: 0 microversion: 2.1 time: 0.031061 Oct 03 15:17:35.818385 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3456/6738] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 15:17:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1010783078 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:17:36.784350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:36.785096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:36.795829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:36.796351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:36.796783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:36.797753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:36.798579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:36.799342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:36.954513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:36.963662 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-15dcf623-5bcc-4e84-a30a-c2b9413c8f0a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.184256 Oct 03 15:17:36.964266 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3283/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:36 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:37.989143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:37.990613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:37.998977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:37.999853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:38.000539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:38.001558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:38.002231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:38.002976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:38.282657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:38.304034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5852560f-14b0-4a35-86f1-49a35670745b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.319831 Oct 03 15:17:38.309322 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3457/6740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:37 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:39.332076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:39.332716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:39.341049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:39.341548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:39.342088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:39.342864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:39.343423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:39.343873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:39.600596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:39.609403 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8d519b3-a73b-447b-b8fd-eb6f332f7953 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.281583 Oct 03 15:17:39.609959 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3284/6741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:39 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:40.636997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:40.637623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:40.644972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:40.645439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:40.645890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:40.646617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:40.647208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:40.647852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:40.816162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:40.824497 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4292e19e-fc05-4d70-9c67-4999bb09e78d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.191581 Oct 03 15:17:40.825121 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3458/6742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:40 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:17:41.847902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:41.848512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:41.856202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:41.856700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:41.857171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:41.857944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:41.858362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:41.858791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:42.002251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:42.012242 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9913533b-20a5-42fb-adbc-7f670dea81bb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.167626 Oct 03 15:17:42.012242 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3285/6743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:41 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:43.034456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:43.035163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:43.042913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:43.043460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:43.043918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:43.044662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:43.045275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:43.045775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:43.186189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:43.194575 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd8b5a78-08f8-4770-a1be-c49adf9a07be tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.164206 Oct 03 15:17:43.195156 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3459/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:43 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:44.220940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:44.221654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:44.230486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:44.231144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:44.231581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:44.232287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:44.232736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:44.233195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:44.376414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:44.386243 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fd59d521-84d7-4763-8940-0df2288f40ac tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.170231 Oct 03 15:17:44.386885 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3286/6745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:44 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:45.273735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5f037ec5-ed57-401f-a464-d309be01d1bd req-7732d5f8-39e8-451a-b6f9-e02ebff6eede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde5d296-eae3-456c-9a86-af6f2e8ffdd8", "name": "network-vif-plugged", "status": "completed", "tag": "0f3fba42-aea0-45d5-9644-b13afd644b03"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:45.285562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5f037ec5-ed57-401f-a464-d309be01d1bd req-7732d5f8-39e8-451a-b6f9-e02ebff6eede service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:45.286139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5f037ec5-ed57-401f-a464-d309be01d1bd req-7732d5f8-39e8-451a-b6f9-e02ebff6eede service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:45.286536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5f037ec5-ed57-401f-a464-d309be01d1bd req-7732d5f8-39e8-451a-b6f9-e02ebff6eede service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:45.299017 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5f037ec5-ed57-401f-a464-d309be01d1bd req-7732d5f8-39e8-451a-b6f9-e02ebff6eede service nova] Creating event network-vif-plugged:0f3fba42-aea0-45d5-9644-b13afd644b03 for instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 on n-h1-781139-2 Oct 03 15:17:45.304433 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5f037ec5-ed57-401f-a464-d309be01d1bd req-7732d5f8-39e8-451a-b6f9-e02ebff6eede service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Oct 03 15:17:45.305368 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3460/6746] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:17:45.409502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:45.410775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:45.418098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:45.418558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:45.419002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:45.419714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:45.420198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:45.420622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:45.578054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:45.586151 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e4089fe9-d4d4-4c28-ac44-f6f4cae0ce2c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.180635 Oct 03 15:17:45.586742 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3287/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:45 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:46.615399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:46.616473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:46.624817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:46.625348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:46.625796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:46.626494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:46.626959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:46.627390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:46.765809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:46.774193 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9455d821-e012-4648-9fd7-95717568b662 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1376 microversion: 2.1 time: 0.166541 Oct 03 15:17:46.774830 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3461/6748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:46 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:47.800880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:47.801571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:47.809782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:47.810436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:47.810957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:47.811732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:47.812242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:47.812720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:47.956663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:47.964808 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-641161d7-6d9d-44e5-9b95-2811a09c6345 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1562 microversion: 2.1 time: 0.168445 Oct 03 15:17:47.965425 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3288/6749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:47 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:47.987667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:47.988312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:47.995371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:47.995875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:47.996330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:47.997079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:47.997646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:47.998110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:48.141302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:48.153614 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7f354c9b-5706-4bfc-9fec-fa25901e6cc6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1562 microversion: 2.1 time: 0.169512 Oct 03 15:17:48.154251 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3462/6750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:47 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:48.245548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:48.246113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:48.255200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:48.255852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:48.256450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:48.257565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:48.258217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:48.258862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:48.286427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:17:48.309796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=100 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:48.368635 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-663ed340-e09f-4b9f-a204-902077c9ebdd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 204 len: 0 microversion: 2.1 time: 0.128462 Oct 03 15:17:48.369408 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3289/6751] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:17:48 2022] DELETE /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:17:48.378734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:48.379367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:48.385652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:48.386153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:48.386633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:48.387343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:48.387839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:48.388664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:48.538636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:48.547458 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0db70127-cddb-4256-aeb6-9b20f5ffa4c4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1568 microversion: 2.1 time: 0.172735 Oct 03 15:17:48.548041 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3463/6752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:48 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:17:49.576380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:49.577558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:49.588809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:49.589654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:49.590383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:49.591532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:49.591980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:49.592404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:49.731208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:49.739562 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1cd1a9ef-ad46-4d9d-a020-3e052a902207 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1568 microversion: 2.1 time: 0.170651 Oct 03 15:17:49.740139 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3290/6753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:49 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:50.555295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-60d7d42d-792e-49a1-a675-7320d418d94f req-07444934-7940-400b-b61f-b5d01af3778e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde5d296-eae3-456c-9a86-af6f2e8ffdd8", "name": "network-vif-deleted", "tag": "0f3fba42-aea0-45d5-9644-b13afd644b03"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:17:50.568648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-60d7d42d-792e-49a1-a675-7320d418d94f req-07444934-7940-400b-b61f-b5d01af3778e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:50.569216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-60d7d42d-792e-49a1-a675-7320d418d94f req-07444934-7940-400b-b61f-b5d01af3778e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:50.570236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-60d7d42d-792e-49a1-a675-7320d418d94f req-07444934-7940-400b-b61f-b5d01af3778e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:50.587954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-60d7d42d-792e-49a1-a675-7320d418d94f req-07444934-7940-400b-b61f-b5d01af3778e service nova] Creating event network-vif-deleted:0f3fba42-aea0-45d5-9644-b13afd644b03 for instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 on n-h1-781139-2 Oct 03 15:17:50.595894 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-60d7d42d-792e-49a1-a675-7320d418d94f req-07444934-7940-400b-b61f-b5d01af3778e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044497 Oct 03 15:17:50.596722 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3464/6754] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:17:50.763932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:50.764718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:50.774194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:50.777237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:50.778014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:50.779029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:50.780470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:50.781315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:50.873298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:50.881374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dee76c98-21e1-41da-9375-443229b5c74f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1361 microversion: 2.1 time: 0.121727 Oct 03 15:17:50.881969 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3291/6755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:50 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1361 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:51.905890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:51.906605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:51.914369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:51.914865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:51.915297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:51.916019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:51.916481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:51.916912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:51.981636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:51.990821 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1d965c6-cea4-43b7-8cc0-34a99421467d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1361 microversion: 2.1 time: 0.090400 Oct 03 15:17:51.991412 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3465/6756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:51 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:53.013709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:53.014318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:53.018634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:53.022585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:53.023080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:53.023519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:53.024230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:53.024715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:53.025495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:53.102386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:53.112131 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-37ee74db-7a50-4937-b90d-609ecf67244a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1361 microversion: 2.1 time: 0.102396 Oct 03 15:17:53.112840 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3292/6757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:53 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1361 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:54.136877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:54.137651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:54.145697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:54.146228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:54.146714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:54.147588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:54.148171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:54.148673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:54.215423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:54.225483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1cc56580-2cee-423f-9f92-57e760bbe93a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1361 microversion: 2.1 time: 0.092904 Oct 03 15:17:54.241170 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3466/6758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:54 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:55.249428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:55.250104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:55.257376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:55.257864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:55.258384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:55.259073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:55.259518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:55.259944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:55.292656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:55.293165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:55.293622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:55.294155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lazy-loading 'fault' on Instance uuid fde5d296-eae3-456c-9a86-af6f2e8ffdd8 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:17:55.336865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:17:55.346375 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9a9a4d3-e7ce-47da-9adf-bd578cfd74e9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 200 len: 1366 microversion: 2.1 time: 0.101060 Oct 03 15:17:55.347348 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3293/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:55 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:17:56.371250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:17:56.372096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:17:56.386472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:56.386973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:56.387506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:56.388244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:17:56.388774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:17:56.389216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:17:56.392162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:17:56.404916 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 HTTP/1.1 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'fde5d296-eae3-456c-9a86-af6f2e8ffdd8'} Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:17:56.406589 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edbdba27-ad72-45fc-9a22-2dcf0babb8d8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 404 len: 111 microversion: 2.1 time: 0.041134 Oct 03 15:17:56.411722 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3467/6760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:17:56 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:18:00.723040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:00.723563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:00.731532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:00.732021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:00.732461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:00.733202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:00.733660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:00.734088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:00.759445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:18:00.847327 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5dc6a68d-6805-4bf7-a875-6b2d14c562d0 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 204 len: 0 microversion: 2.1 time: 0.127995 Oct 03 15:18:00.848455 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3294/6761] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:18:00 2022] DELETE /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:18:00.857275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:00.857937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:00.860872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:00.866951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:00.867457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:00.867902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:00.868623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:00.869160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:00.869609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:01.007465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:01.016054 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-188b04a8-2c56-4f4b-a11c-3d851614e261 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1409 microversion: 2.1 time: 0.163233 Oct 03 15:18:01.016625 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3468/6762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:00 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:02.042851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:02.043773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:02.051167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:02.051666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:02.052094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:02.052788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:02.053271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:02.053693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:02.198070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:02.211034 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1df68ad0-e972-4cf9-8b91-4aea8896b70a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1409 microversion: 2.1 time: 0.172978 Oct 03 15:18:02.211906 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3295/6763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:02 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1409 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:02.808580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-93332f7d-9482-41cc-9df6-50b7c443269b req-f63aa62e-8a56-4d7c-b46a-6bc826d5f249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69871f9-cc35-4bef-8303-1fc5ae231175", "name": "network-vif-deleted", "tag": "c2844852-4474-45a7-b8bc-abfc344fdcba"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:18:02.819360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93332f7d-9482-41cc-9df6-50b7c443269b req-f63aa62e-8a56-4d7c-b46a-6bc826d5f249 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:02.819845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93332f7d-9482-41cc-9df6-50b7c443269b req-f63aa62e-8a56-4d7c-b46a-6bc826d5f249 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:02.820288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-93332f7d-9482-41cc-9df6-50b7c443269b req-f63aa62e-8a56-4d7c-b46a-6bc826d5f249 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:02.832129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-93332f7d-9482-41cc-9df6-50b7c443269b req-f63aa62e-8a56-4d7c-b46a-6bc826d5f249 service nova] Creating event network-vif-deleted:c2844852-4474-45a7-b8bc-abfc344fdcba for instance d69871f9-cc35-4bef-8303-1fc5ae231175 on n-h2-781139-2 Oct 03 15:18:02.837126 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-93332f7d-9482-41cc-9df6-50b7c443269b req-f63aa62e-8a56-4d7c-b46a-6bc826d5f249 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032431 Oct 03 15:18:02.837729 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3469/6764] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:18:03.235984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:03.236677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:03.244042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:03.244529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:03.244957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:03.245685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:03.246136 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:03.246591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:03.315145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:03.323575 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e891bb85-ba88-4a77-8535-3bc5729b3636 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1202 microversion: 2.1 time: 0.091612 Oct 03 15:18:03.324264 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3296/6765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:03 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:04.348102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:04.348815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:04.355897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:04.356474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:04.356957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:04.357702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:04.358166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:04.358602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:04.430522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:04.439220 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dcccfe71-b418-4496-b8c7-a19186f1184a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1202 microversion: 2.1 time: 0.096264 Oct 03 15:18:04.439817 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3470/6766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:04 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:05.462857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:05.463431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:05.471110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:05.471607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:05.472060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:05.472780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:05.473293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:05.473723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:05.537483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:05.546218 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-427eff13-92f0-4c4c-a739-bfa8897297fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1202 microversion: 2.1 time: 0.087451 Oct 03 15:18:05.546804 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3297/6767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:05 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:06.569481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:06.570235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:06.577752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:06.578253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:06.578701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:06.579421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:06.579888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:06.580379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:06.644704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:06.653354 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d7727f7-b4ae-4fea-8838-82bbbc4153de tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 200 len: 1202 microversion: 2.1 time: 0.087837 Oct 03 15:18:06.653982 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3471/6768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:06 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:07.676246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:07.676835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:07.684654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:07.685219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:07.685672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:07.686414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:07.686912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:07.687493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:07.702642 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 HTTP/1.1 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'd69871f9-cc35-4bef-8303-1fc5ae231175'} Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:07.704380 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:18:07.708641 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-913fc739-2698-40ba-8741-ff54e05c23ba tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 404 len: 111 microversion: 2.1 time: 0.033816 Oct 03 15:18:07.709868 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3298/6769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:07 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:18:09.857491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:09.858097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:09.865274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:09.865787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:09.866226 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:09.866953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:09.867425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:09.867872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:09.882052 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 HTTP/1.1 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'fde5d296-eae3-456c-9a86-af6f2e8ffdd8'} Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:18:09.883826 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a744a31f-04cc-499c-9298-9c103f2b008b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 404 len: 111 microversion: 2.1 time: 0.032205 Oct 03 15:18:09.887051 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3472/6770] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:18:09 2022] DELETE /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:18:09.895147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:09.895765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: fde5d296-eae3-456c-9a86-af6f2e8ffdd8] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:09.903297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:09.903778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:09.904223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:09.904925 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:09.905410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:09.905840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:09.920110 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 HTTP/1.1 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'fde5d296-eae3-456c-9a86-af6f2e8ffdd8'} Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:09.921596 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance fde5d296-eae3-456c-9a86-af6f2e8ffdd8 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:18:09.925695 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc240689-3e7b-4414-a8b7-b24a95b9111b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8" status: 404 len: 111 microversion: 2.1 time: 0.032403 Oct 03 15:18:09.926510 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3299/6771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:09 2022] GET /compute/v2.1/servers/fde5d296-eae3-456c-9a86-af6f2e8ffdd8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:18:10.427818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:10.428262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:10.434615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:10.435318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:10.435954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:10.436832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:10.437337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:10.437805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:10.452183 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 HTTP/1.1 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd69871f9-cc35-4bef-8303-1fc5ae231175'} Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:18:10.453839 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:18:10.457278 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a511c83-9de8-4250-a43f-738360568ffa tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 404 len: 111 microversion: 2.1 time: 0.031465 Oct 03 15:18:10.459035 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3473/6772] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:18:10 2022] DELETE /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:18:10.464188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:10.464886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d69871f9-cc35-4bef-8303-1fc5ae231175] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:10.471336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:10.471824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:10.472261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:10.473000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:10.473435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:10.473835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:10.488391 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 HTTP/1.1 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'd69871f9-cc35-4bef-8303-1fc5ae231175'} Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:18:10.489996 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance d69871f9-cc35-4bef-8303-1fc5ae231175 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25b7a7ec-3608-406c-a38c-0d3d6938560f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175" status: 404 len: 111 microversion: 2.1 time: 0.031331 Oct 03 15:18:10.493368 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3300/6773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:10 2022] GET /compute/v2.1/servers/d69871f9-cc35-4bef-8303-1fc5ae231175 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:18:10.565987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-554dd6ce-be76-4bdd-af0c-03d2527ec193 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: .version_select at 0x7fb22b8a0040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-63741616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVNIdWygSvXHiduVVDJpDgMiN7YBShhMXS3LypPectjicyzOmIO353lnKHz6b25E5cHIB2RvgniY1BaPWB5yhTkhJ1NsMwFt3Cz6kKJQotyM0vsoipyit23NY/mMpjmnQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:18:10.584610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-554dd6ce-be76-4bdd-af0c-03d2527ec193 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:18:10.590756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-554dd6ce-be76-4bdd-af0c-03d2527ec193 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:18:10.614834 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-554dd6ce-be76-4bdd-af0c-03d2527ec193 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.053087 Oct 03 15:18:10.623624 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3474/6774] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:18:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:18:28.067503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1435642090", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63741616", "security_groups": [{"name": "tempest-secgroup-smoke-1984382964"}], "block_device_mapping_v2": [{"uuid": "4250d984-db67-40ff-a4b4-b962b3d9c38d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:18:28.079745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:28.080394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:28.372366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:18:28.897754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:18:28.898185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:18:28.898660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:18:28.899080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:18:28.899504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:18:28.912488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:28.913130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:28.913734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:28.914797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:28.915480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:28.916045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:28.934813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:18:28.940428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:18:29.001979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:18:29.004254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4250d984-db67-40ff-a4b4-b962b3d9c38d',volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:18:29.154667 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-41cac6dd-5763-4086-bb33-a133cd13538d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.091036 Oct 03 15:18:29.155794 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3301/6775] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:18:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:18:29.164578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=25 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:29.165469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:29.166034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:29.170137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-50647b7f-f15f-4324-9832-5a0ab6dd166e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:29.170769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-50647b7f-f15f-4324-9832-5a0ab6dd166e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:29.298976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-50647b7f-f15f-4324-9832-5a0ab6dd166e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:29.306842 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-50647b7f-f15f-4324-9832-5a0ab6dd166e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1093 microversion: 2.1 time: 0.144145 Oct 03 15:18:29.307432 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3475/6776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:29 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1093 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:30.330150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:30.330761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:30.337270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:30.338002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:30.338424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:30.339285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:30.339736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:30.340419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:30.405965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:30.413786 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f96edc73-1a8c-442f-abaf-5d3dc397e308 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1209 microversion: 2.1 time: 0.088621 Oct 03 15:18:30.414376 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3302/6777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:30 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:31.441722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:31.442535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:31.449599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:31.450244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:31.450800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:31.451698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:31.452272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:31.452808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:31.680632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:31.689739 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55f64d6a-7e9c-492e-ae08-33023c58aa19 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1277 microversion: 2.1 time: 0.252120 Oct 03 15:18:31.690410 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3476/6778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:31 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:31.821259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-321ed8e8-c727-423b-960a-5515cd71da58 req-635013be-e243-47b2-af8b-ff0ebcdfab6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db04b393-2ed9-4452-9bd6-8427992e19bc", "tag": "19a07364-127a-490b-8b07-dd5402ae0be3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:18:31.833957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-321ed8e8-c727-423b-960a-5515cd71da58 req-635013be-e243-47b2-af8b-ff0ebcdfab6b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:31.835653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-321ed8e8-c727-423b-960a-5515cd71da58 req-635013be-e243-47b2-af8b-ff0ebcdfab6b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:31.836414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-321ed8e8-c727-423b-960a-5515cd71da58 req-635013be-e243-47b2-af8b-ff0ebcdfab6b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:31.849981 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-321ed8e8-c727-423b-960a-5515cd71da58 req-635013be-e243-47b2-af8b-ff0ebcdfab6b service nova] Creating event network-changed:19a07364-127a-490b-8b07-dd5402ae0be3 for instance db04b393-2ed9-4452-9bd6-8427992e19bc on n-h1-781139-2 Oct 03 15:18:31.856190 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-321ed8e8-c727-423b-960a-5515cd71da58 req-635013be-e243-47b2-af8b-ff0ebcdfab6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038869 Oct 03 15:18:31.857173 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3303/6779] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:18:32.712860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:32.714321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:32.722313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:32.722818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:32.723266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:32.724017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:32.724638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:32.724883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:33.190724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:33.198847 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66fa746e-21d1-46b1-b453-7b049ee03ce1 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1277 microversion: 2.1 time: 0.490313 Oct 03 15:18:33.199487 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3477/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:32 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1277 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:34.223460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:34.224857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:34.232102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:34.232803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:34.233140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:34.234032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:34.234304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:34.234728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:34.382907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:34.390973 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49823f4c-3a8c-400c-9241-10188929e83a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1277 microversion: 2.1 time: 0.173111 Oct 03 15:18:34.391566 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3304/6781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:34 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:35.414617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:35.415160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:35.422862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:35.423368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:35.423821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:35.424509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:35.425017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:35.425464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:35.568859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:35.577467 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-53e0f732-bea5-4d55-b423-430c544b5573 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.166913 Oct 03 15:18:35.578062 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3478/6782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:35 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:36.614178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:36.615123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:36.625049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:36.625535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:36.625968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:36.626659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:36.627120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:36.627525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:36.764681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:36.776291 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b8cde16-85b4-45c2-b448-d5233c542ab2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.168443 Oct 03 15:18:36.777203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3305/6783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:36 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:37.803382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:37.804350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:37.818706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:37.819602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:37.820366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:37.821633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:37.822483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:37.823213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:37.965174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:37.973281 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ada3772a-c4a5-454e-a40a-4a50397fd80e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.176553 Oct 03 15:18:37.973864 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3479/6784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:37 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:38.999906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:39.000541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:39.004124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:39.005411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:39.013130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:39.013130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:39.013695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:39.014640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:39.015176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:39.015672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:39.168533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:39.180135 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-092685f5-6a6f-457c-b1df-43c787fc343e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.185847 Oct 03 15:18:39.180949 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3306/6785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:38 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:40.208727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:40.209697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:40.213563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:18:40.222935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:40.223761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:40.224474 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:40.226137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:40.226954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:40.227688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:40.372164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:40.382242 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf26a479-9236-4edc-831c-253c1261a403 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.180863 Oct 03 15:18:40.382812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3480/6786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:40 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:41.408002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:41.409616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:41.418683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:41.419297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:41.419856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:41.420763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:41.421489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:41.422005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:41.556674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:41.569609 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-440df968-27e0-493f-8bc5-b7f1e8a30c09 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.166919 Oct 03 15:18:41.570450 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3307/6787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:41 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:42.597366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:42.598132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:42.607088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:42.607664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:42.608191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:42.609057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:42.609586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:42.610077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:42.754363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:42.762724 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d53a2cd-ca76-4189-babd-eeb1384cb965 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.170943 Oct 03 15:18:42.763275 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3481/6788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:42 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:43.790102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:43.791148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:43.800284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:43.800765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:43.801241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:43.801931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:43.802390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:43.802813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:43.938456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:43.946652 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74f915f9-b2d6-4de7-ab78-c74a94addc6d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.163470 Oct 03 15:18:43.947256 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3308/6789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:43 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:44.973886 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:44.974945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:44.987249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:44.988083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:44.988836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:44.990022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:44.990860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:44.991607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:45.137357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:45.145752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-df6ad2a9-2e4c-4a16-b417-9f7f3a133623 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.178651 Oct 03 15:18:45.146333 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3482/6790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:44 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:45.508029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-4e6e865f-e0f3-4a0d-90bd-e390debe4b7b req-1e6dd169-270b-45f3-bca7-63ace60eba2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db04b393-2ed9-4452-9bd6-8427992e19bc", "name": "network-vif-plugged", "status": "completed", "tag": "19a07364-127a-490b-8b07-dd5402ae0be3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:18:45.519821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4e6e865f-e0f3-4a0d-90bd-e390debe4b7b req-1e6dd169-270b-45f3-bca7-63ace60eba2c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:45.520312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4e6e865f-e0f3-4a0d-90bd-e390debe4b7b req-1e6dd169-270b-45f3-bca7-63ace60eba2c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:45.520741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4e6e865f-e0f3-4a0d-90bd-e390debe4b7b req-1e6dd169-270b-45f3-bca7-63ace60eba2c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:45.532505 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4e6e865f-e0f3-4a0d-90bd-e390debe4b7b req-1e6dd169-270b-45f3-bca7-63ace60eba2c service nova] Creating event network-vif-plugged:19a07364-127a-490b-8b07-dd5402ae0be3 for instance db04b393-2ed9-4452-9bd6-8427992e19bc on n-h1-781139-2 Oct 03 15:18:45.537876 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-4e6e865f-e0f3-4a0d-90bd-e390debe4b7b req-1e6dd169-270b-45f3-bca7-63ace60eba2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 Oct 03 15:18:45.538432 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3309/6791] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:18:46.172558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:46.173390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:46.182430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:46.183058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:46.183634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:46.184522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:46.185155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:46.185711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:46.329601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:46.341292 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5b82be11-f74e-48a2-a80b-5509da93c673 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1265 microversion: 2.1 time: 0.175061 Oct 03 15:18:46.341915 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3483/6792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:46 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:47.370705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:47.372012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:47.380104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:47.380595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:47.381077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:47.381780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:47.382235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:47.382662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:47.536042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:47.548117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ebd41e66-5755-48c1-8855-dd2475b30f52 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1452 microversion: 2.1 time: 0.185663 Oct 03 15:18:47.548889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3310/6793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:47 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1452 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:47.575565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:18:47.576173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:18:47.583554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:47.584052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:47.584506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:47.585263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:47.585731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:47.586171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:47.725205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:18:47.733587 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a85d0055-2e9d-403d-8a3a-3012a4665ce5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1452 microversion: 2.1 time: 0.161954 Oct 03 15:18:47.734147 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3484/6794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:18:47 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:18:49.497264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-341d5647-a319-4a89-ab9e-1172135ea346 req-969d2df2-d26b-4726-a478-3f74d510adf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db04b393-2ed9-4452-9bd6-8427992e19bc", "tag": "19a07364-127a-490b-8b07-dd5402ae0be3"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:18:49.507752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-341d5647-a319-4a89-ab9e-1172135ea346 req-969d2df2-d26b-4726-a478-3f74d510adf3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:18:49.508226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-341d5647-a319-4a89-ab9e-1172135ea346 req-969d2df2-d26b-4726-a478-3f74d510adf3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:18:49.508650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-341d5647-a319-4a89-ab9e-1172135ea346 req-969d2df2-d26b-4726-a478-3f74d510adf3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:18:49.522939 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-341d5647-a319-4a89-ab9e-1172135ea346 req-969d2df2-d26b-4726-a478-3f74d510adf3 service nova] Creating event network-changed:19a07364-127a-490b-8b07-dd5402ae0be3 for instance db04b393-2ed9-4452-9bd6-8427992e19bc on n-h1-781139-2 Oct 03 15:18:49.528067 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-341d5647-a319-4a89-ab9e-1172135ea346 req-969d2df2-d26b-4726-a478-3f74d510adf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034579 Oct 03 15:18:49.528853 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3311/6795] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:20:46.876414 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 15:20:46.877608 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 15:20:46.878235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=22 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:20:46.879008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=54 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:20:46.880387 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 15:20:46.880546 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc (ip 10.222.0.20) !!! Oct 03 15:20:46.881644 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:20:46.881816 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc (ip 10.222.0.20) !!! Oct 03 15:20:46.882706 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:20:46.882829 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc (ip 10.222.0.20) !!! Oct 03 15:20:47.003605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:47.004134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:47.010759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:47.011270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:47.011745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:47.012418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:47.012895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:47.013369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:47.039729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:20:47.123588 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55aef484-184f-4501-ae26-f12a99a148ef tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 204 len: 0 microversion: 2.1 time: 0.248763 Oct 03 15:20:47.124202 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3485/6796] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:20:46 2022] DELETE /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:20:47.132373 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 15:20:47.136419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:47.137190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:47.139337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:20:47.140005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=50 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:20:47.147626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:47.148113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:47.148555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:47.149280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:47.149738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:47.150163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:47.292825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:47.301250 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce4aed69-00ca-4b8a-a05b-7811247ea8bf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1576 microversion: 2.1 time: 0.171557 Oct 03 15:20:47.301843 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3312/6797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:47 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:48.337267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:48.338192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:48.352844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:48.353608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:48.354187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:48.355081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:48.355664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:48.356208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:48.366583 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54710. Oct 03 15:20:48.377343 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54712. Oct 03 15:20:48.500820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:48.509233 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8b83c6f-3b70-4d81-a55d-84195c22fb7b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1576 microversion: 2.1 time: 0.178192 Oct 03 15:20:48.509813 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3486/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:48 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:49.532045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:49.532657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:49.541889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:49.542370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:49.542804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:49.543579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:49.544030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:49.544443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:49.564713 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54716. Oct 03 15:20:49.613893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:49.623532 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d0a052d6-676d-4533-b394-ae329622bd4d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1508 microversion: 2.1 time: 0.095450 Oct 03 15:20:49.624202 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3313/6799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:49 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1508 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:49.893240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-18268dba-f1a1-4154-8b49-fe53ed123707 req-92029c6b-1e6d-4e3c-8d0e-87753891e58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db04b393-2ed9-4452-9bd6-8427992e19bc", "name": "network-vif-deleted", "tag": "19a07364-127a-490b-8b07-dd5402ae0be3"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:20:49.905700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18268dba-f1a1-4154-8b49-fe53ed123707 req-92029c6b-1e6d-4e3c-8d0e-87753891e58e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:49.906199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18268dba-f1a1-4154-8b49-fe53ed123707 req-92029c6b-1e6d-4e3c-8d0e-87753891e58e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:49.906815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-18268dba-f1a1-4154-8b49-fe53ed123707 req-92029c6b-1e6d-4e3c-8d0e-87753891e58e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:49.919628 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-18268dba-f1a1-4154-8b49-fe53ed123707 req-92029c6b-1e6d-4e3c-8d0e-87753891e58e service nova] Creating event network-vif-deleted:19a07364-127a-490b-8b07-dd5402ae0be3 for instance db04b393-2ed9-4452-9bd6-8427992e19bc on n-h1-781139-2 Oct 03 15:20:49.928791 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-18268dba-f1a1-4154-8b49-fe53ed123707 req-92029c6b-1e6d-4e3c-8d0e-87753891e58e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Oct 03 15:20:49.932766 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3487/6800] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:20:50.649717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:50.651292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:50.660471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:50.661347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:50.663008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:50.664244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:50.665195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:50.665843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:50.735827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:50.744782 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bff0019c-2ea7-446a-a350-43aa7cd3499b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1224 microversion: 2.1 time: 0.101617 Oct 03 15:20:50.748350 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3314/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:50 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:51.769860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:51.770973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:51.778146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:51.778656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:51.779110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:51.779837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:51.780310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:51.780885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:51.845933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:51.855040 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2432350-73a5-4a1f-8d89-93ac14c3a0ff tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1224 microversion: 2.1 time: 0.090489 Oct 03 15:20:51.855625 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3488/6802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:51 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:52.878303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:52.878886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:52.887197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:52.887699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:52.888146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:52.888856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:52.889366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:52.889803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:52.959300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:52.968796 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-829af0c1-75f1-4464-981d-82191f8f4f43 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1224 microversion: 2.1 time: 0.094536 Oct 03 15:20:52.969429 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3315/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:52 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:53.992503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:53.993215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:54.001364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:54.001881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:54.002374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:54.003132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:54.003606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:54.004064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:54.078471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:54.087274 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d2ff16b-6522-4151-8c7e-1ff3eb195e70 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 200 len: 1224 microversion: 2.1 time: 0.099257 Oct 03 15:20:54.087871 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3489/6804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:53 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:54.214401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:54.215466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:54.222232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:54.222717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:54.223141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:54.224524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:54.225004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:54.225440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:54.253858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:20:54.337011 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8613ef3f-3ab6-44c4-b0f5-cbcd82a10ebb tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 204 len: 0 microversion: 2.1 time: 0.126338 Oct 03 15:20:54.337614 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3316/6805] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:20:54 2022] DELETE /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:20:54.345981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:54.346897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:54.353808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:54.354317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:54.354765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:54.355462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:54.356111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:54.356591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:54.503820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:54.512117 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-48709321-ee24-4f0b-9f5c-fe2d6375a1db tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1732 microversion: 2.1 time: 0.170101 Oct 03 15:20:54.512730 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3490/6806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:54 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:55.110542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:55.111280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:55.118145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:55.118636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:55.119073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:55.119770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:55.120340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:55.120651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:55.134598 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc HTTP/1.1 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'db04b393-2ed9-4452-9bd6-8427992e19bc'} Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:55.136249 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b583205-0f34-4daf-9c57-57eb0eab814d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 404 len: 111 microversion: 2.1 time: 0.031570 Oct 03 15:20:55.140462 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3317/6807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:55 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:20:55.191406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-396735115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63741616", "security_groups": [{"name": "tempest-secgroup-smoke-1984382964"}], "block_device_mapping_v2": [{"uuid": "4250d984-db67-40ff-a4b4-b962b3d9c38d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:20:55.341291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:20:55.535122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:55.535747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:55.543383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:55.543872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:55.544330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:55.545067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:55.545527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:55.545957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:55.732607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:20:55.733087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:20:55.733602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:20:55.734403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:20:55.734934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:20:55.747706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:55.748337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:55.748786 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:55.749581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:55.750049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:55.750490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:55.751499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:55.764077 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6614908f-e129-4fea-b75d-0b3f10c0887d tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1732 microversion: 2.1 time: 0.232681 Oct 03 15:20:55.765137 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3318/6808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:55 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1732 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:55.771039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:20:55.777266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:20:55.845380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:20:55.847661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4250d984-db67-40ff-a4b4-b962b3d9c38d',volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:20:56.005299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-86c30a61-85e3-44f2-97ed-7ab6c3dac3d7 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.817673 Oct 03 15:20:56.006258 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3491/6809] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:20:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:20:56.018381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac22274b-c7e7-4374-9f01-88f1428ef08f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:56.019585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac22274b-c7e7-4374-9f01-88f1428ef08f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:56.106521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ac22274b-c7e7-4374-9f01-88f1428ef08f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:56.118459 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac22274b-c7e7-4374-9f01-88f1428ef08f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1092 microversion: 2.1 time: 0.103880 Oct 03 15:20:56.119423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3319/6810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:56 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1092 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:20:56.799059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:56.801002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:56.803481 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a2a4cf90-d0a1-4b80-ae48-acb7e4e43735 req-3311b903-0c63-465a-bdb9-963d162b6c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e", "name": "network-vif-deleted", "tag": "352ab650-65a8-4ad8-903b-469ea0e2c18d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:20:56.816895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a2a4cf90-d0a1-4b80-ae48-acb7e4e43735 req-3311b903-0c63-465a-bdb9-963d162b6c00 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:56.817625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:56.818051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a2a4cf90-d0a1-4b80-ae48-acb7e4e43735 req-3311b903-0c63-465a-bdb9-963d162b6c00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:56.818168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:56.818564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:56.819396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a2a4cf90-d0a1-4b80-ae48-acb7e4e43735 req-3311b903-0c63-465a-bdb9-963d162b6c00 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:56.825131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:56.825627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:56.826075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:56.834057 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a2a4cf90-d0a1-4b80-ae48-acb7e4e43735 req-3311b903-0c63-465a-bdb9-963d162b6c00 service nova] Creating event network-vif-deleted:352ab650-65a8-4ad8-903b-469ea0e2c18d for instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e on n-h2-781139-2 Oct 03 15:20:56.840573 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a2a4cf90-d0a1-4b80-ae48-acb7e4e43735 req-3311b903-0c63-465a-bdb9-963d162b6c00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132278 Oct 03 15:20:56.842128 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3492/6811] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:20:56.937337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087977406f834c7ba3d5e7e2282457d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4031ae7f2bff48cbab24205ad577383e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:56.948548 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-681af321-5945-4984-8f15-17078c915341 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 200 len: 1384 microversion: 2.1 time: 0.164456 Oct 03 15:20:56.949542 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3320/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:56 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 1384 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:20:57.142837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:57.143928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:57.151557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:57.152076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:57.152536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:57.153305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:57.153777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:57.154222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:57.225395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:57.235383 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef008cea-3450-4533-affe-87e4d72574f5 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1190 microversion: 2.1 time: 0.096815 Oct 03 15:20:57.248979 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3493/6813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:57 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1190 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:57.974187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:57.975218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:57.982239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:57.982739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:57.983236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:57.984182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:57.984845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:57.985481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:58.006047 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] HTTP exception thrown: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Request method failure captured: Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e HTTP/1.1 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvyiZfz1zNZcqzkbA4F-0V522mFvKJulizj5dDxMqfXthsUWuOCvgR3ga1YqVTzT3CbhoTQhRSYtFis0wL6B7OmfmRLJ39DjaagR6d9z3atHvzMPVNEv4NKtxZ4SwN3uapxBkAQv3xPdmKOSb1YifQhL1usg8zeRaejJ2E8YzHfTMHk Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 4031ae7f2bff48cbab24205ad577383e Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4031ae7f2bff48cbab24205ad577383e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 4031ae7f2bff48cbab24205ad577383e Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestServerBasicOps-633134440-project Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 087977406f834c7ba3d5e7e2282457d2 Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestServerBasicOps-633134440-project Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e'} Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:58.008744 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.013435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.013435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:58.013435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:58.013435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:20:58.013435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:20:58.013435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.013435 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.015731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Returning 404 to user: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:20:58.016633 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c2a9f3c-1b99-4214-ae07-c1f155b1a906 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 404 len: 111 microversion: 2.1 time: 0.047190 Oct 03 15:20:58.017262 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3321/6814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:57 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:20:58.264065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:58.265694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:58.289881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:58.290428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:58.290893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:58.291642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:58.292110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:58.300787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:58.614678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:58.625141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72dab14d-b66e-40e8-8170-6d54ba5ee0ad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1276 microversion: 2.1 time: 0.365892 Oct 03 15:20:58.640847 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3494/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:58 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1276 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:58.663099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:58.663877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:58.671829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:58.672543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:58.673174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:58.675341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:58.675959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:58.676552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:58.692166 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] HTTP exception thrown: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Request method failure captured: Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e HTTP/1.1 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvyiZfz1zNZcqzkbA4F-0V522mFvKJulizj5dDxMqfXthsUWuOCvgR3ga1YqVTzT3CbhoTQhRSYtFis0wL6B7OmfmRLJ39DjaagR6d9z3atHvzMPVNEv4NKtxZ4SwN3uapxBkAQv3xPdmKOSb1YifQhL1usg8zeRaejJ2E8YzHfTMHk Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 4031ae7f2bff48cbab24205ad577383e Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4031ae7f2bff48cbab24205ad577383e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 4031ae7f2bff48cbab24205ad577383e Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestServerBasicOps-633134440-project Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 087977406f834c7ba3d5e7e2282457d2 Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestServerBasicOps-633134440-project Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e'} Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:20:58.694211 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Returning 404 to user: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:20:58.697699 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eaa23c15-7ccb-42a6-ba9d-996a75c3b76c tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 404 len: 111 microversion: 2.1 time: 0.170944 Oct 03 15:20:58.698507 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3322/6816] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:20:58 2022] DELETE /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:20:58.706490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:58.707297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [instance: c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:58.713765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:58.714273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:58.714725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:58.715444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:58.715909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:58.716344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:58.732523 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] HTTP exception thrown: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Request method failure captured: Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e HTTP/1.1 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvyiZfz1zNZcqzkbA4F-0V522mFvKJulizj5dDxMqfXthsUWuOCvgR3ga1YqVTzT3CbhoTQhRSYtFis0wL6B7OmfmRLJ39DjaagR6d9z3atHvzMPVNEv4NKtxZ4SwN3uapxBkAQv3xPdmKOSb1YifQhL1usg8zeRaejJ2E8YzHfTMHk Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 4031ae7f2bff48cbab24205ad577383e Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4031ae7f2bff48cbab24205ad577383e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4031ae7f2bff48cbab24205ad577383e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 4031ae7f2bff48cbab24205ad577383e Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestServerBasicOps-633134440 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestServerBasicOps-633134440-project Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 087977406f834c7ba3d5e7e2282457d2 Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestServerBasicOps-633134440-project Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e'} Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:20:58.734279 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Returning 404 to user: Instance c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d562d690-7b75-4d65-979c-88de385339ec tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e" status: 404 len: 111 microversion: 2.1 time: 0.033878 Oct 03 15:20:58.741502 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3495/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:58 2022] GET /compute/v2.1/servers/c13ff5ff-20eb-4d50-9d86-b782ac0cfc8e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:20:58.919372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90f385f5-c218-462e-8de6-0d2485444b16 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] Calling method '.version_select at 0x7fb230a1a8b0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:58.926338 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-90f385f5-c218-462e-8de6-0d2485444b16 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [d72cc83a-6e2e-45aa-bbb9-dc4cf8baa02a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:20:59.051838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-fc7c1372-13ce-43e5-80b9-8b3c05740a3f req-df1ba0d0-8e2a-4890-ace8-6f5a10bb9265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3250b36-4c4c-4e46-841f-889413d75df9", "tag": "ba337513-089e-4301-b4f0-fbd86554b067"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:20:59.070222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fc7c1372-13ce-43e5-80b9-8b3c05740a3f req-df1ba0d0-8e2a-4890-ace8-6f5a10bb9265 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:59.070959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fc7c1372-13ce-43e5-80b9-8b3c05740a3f req-df1ba0d0-8e2a-4890-ace8-6f5a10bb9265 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:59.071714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-fc7c1372-13ce-43e5-80b9-8b3c05740a3f req-df1ba0d0-8e2a-4890-ace8-6f5a10bb9265 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:59.086040 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-fc7c1372-13ce-43e5-80b9-8b3c05740a3f req-df1ba0d0-8e2a-4890-ace8-6f5a10bb9265 service nova] Creating event network-changed:ba337513-089e-4301-b4f0-fbd86554b067 for instance d3250b36-4c4c-4e46-841f-889413d75df9 on n-h1-781139-2 Oct 03 15:20:59.095366 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-fc7c1372-13ce-43e5-80b9-8b3c05740a3f req-df1ba0d0-8e2a-4890-ace8-6f5a10bb9265 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054756 Oct 03 15:20:59.096263 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3496/6818] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:20:59.648511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:20:59.650057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:20:59.657529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:59.658109 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:59.658677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:59.659411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:20:59.659947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:20:59.660435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:20:59.889582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:20:59.899828 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-beb231d6-aef2-4e0d-a5db-2e7a6234e52e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1276 microversion: 2.1 time: 0.255577 Oct 03 15:20:59.905589 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3497/6819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:20:59 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:20:59.935724 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [None req-90f385f5-c218-462e-8de6-0d2485444b16 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] [d72cc83a-6e2e-45aa-bbb9-dc4cf8baa02a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54792. Oct 03 15:20:59.959520 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90f385f5-c218-462e-8de6-0d2485444b16 tempest-TestServerBasicOps-633134440 tempest-TestServerBasicOps-633134440-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2100393831" status: 202 len: 0 microversion: 2.1 time: 1.043935 Oct 03 15:20:59.960231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3323/6820] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 3 15:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2100393831 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:21:00.924120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:00.925350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:00.933965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:00.934624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:00.935398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:00.936233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:00.936815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:00.937386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:01.083037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:01.093529 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cefb5ec5-c852-45d0-9c4f-93f56c12331d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1276 microversion: 2.1 time: 0.173416 Oct 03 15:21:01.094330 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3498/6821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:00 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:02.117253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:02.118731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:02.126103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:02.126885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:02.127550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:02.128624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:02.129332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:02.129965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:02.361697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:02.373529 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2a4f2a9-ba4b-42bd-8b90-11ef79646cad tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1276 microversion: 2.1 time: 0.260481 Oct 03 15:21:02.386860 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3324/6822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:02 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:03.409341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:03.410198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:03.423452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:03.424084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:03.424547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:03.425381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:03.425829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:03.426434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:03.670004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:03.679971 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a9e4dd1a-935f-4dc0-a8d8-29e134da6a0c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.284433 Oct 03 15:21:03.680743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3499/6823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:03 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:04.703198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:04.703814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:04.711260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:04.711723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:04.712355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:04.713081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:04.713533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:04.713953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:04.920958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:04.929817 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e3365225-b347-4a03-ae0e-0f80e8ff8fd3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.230554 Oct 03 15:21:04.930473 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3325/6824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:04 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:05.953946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:05.954577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:05.957908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:21:05.958651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:21:05.965598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:05.966118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:05.966580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:05.967318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:05.967794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:05.968257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:06.117044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:06.125606 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c21f523-dcab-456d-be63-0c6f48dd900c tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.175755 Oct 03 15:21:06.126203 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3500/6825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:05 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:07.149669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:07.150525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:07.153169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:21:07.158721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:07.159285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:07.159789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:07.160703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:07.161252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:07.161679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:07.312035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:07.326991 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-66776576-62e9-4fd2-b9fa-e0c8045c1a85 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.181403 Oct 03 15:21:07.328972 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3326/6826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:07 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:08.351021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:08.351651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:08.358715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:08.359236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:08.359691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:08.360405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:08.360865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:08.361352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:08.522991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:08.532891 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05b94077-f719-4fb3-a5be-a6b0273fb798 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.186412 Oct 03 15:21:08.533551 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3501/6827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:08 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:09.560299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:09.561292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:09.571872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:09.572362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:09.572797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:09.573536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:09.573969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:09.574502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:09.715036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:09.723686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8a274adc-c237-4c18-8cba-f50b9e0fd514 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.169818 Oct 03 15:21:09.724268 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3327/6828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:09 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:10.747271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:10.747854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:10.755183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:10.755686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:10.756135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:10.756847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:10.757345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:10.757787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:10.902765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:10.910831 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b11e39af-7e4d-4c4e-9dd8-bd587904dacf tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.167753 Oct 03 15:21:10.911416 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3502/6829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:10 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:11.935345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:11.935955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:11.943957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:11.944452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:11.944887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:11.945617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:11.946076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:11.946510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:12.089166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:12.097110 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6602ceb-dd3a-46fa-a465-08158eaf7831 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.166533 Oct 03 15:21:12.097913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3328/6830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:11 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:13.125138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:13.126193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:13.136335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:13.136874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:13.137368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:13.138089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:13.138559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:13.139002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:13.143138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:21:13.292594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:13.301299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aec1b580-6be7-4358-882d-abc6e6803264 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.183474 Oct 03 15:21:13.302090 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3503/6831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:13 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:14.260697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ef0d9b07-c355-4928-9598-1138ccf411eb req-680e0eb3-237f-44ae-979a-f169fb32066d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3250b36-4c4c-4e46-841f-889413d75df9", "name": "network-vif-plugged", "status": "completed", "tag": "ba337513-089e-4301-b4f0-fbd86554b067"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:21:14.271243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ef0d9b07-c355-4928-9598-1138ccf411eb req-680e0eb3-237f-44ae-979a-f169fb32066d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:14.271719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ef0d9b07-c355-4928-9598-1138ccf411eb req-680e0eb3-237f-44ae-979a-f169fb32066d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:14.272148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ef0d9b07-c355-4928-9598-1138ccf411eb req-680e0eb3-237f-44ae-979a-f169fb32066d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:14.283818 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ef0d9b07-c355-4928-9598-1138ccf411eb req-680e0eb3-237f-44ae-979a-f169fb32066d service nova] Creating event network-vif-plugged:ba337513-089e-4301-b4f0-fbd86554b067 for instance d3250b36-4c4c-4e46-841f-889413d75df9 on n-h1-781139-2 Oct 03 15:21:14.288819 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ef0d9b07-c355-4928-9598-1138ccf411eb req-680e0eb3-237f-44ae-979a-f169fb32066d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032006 Oct 03 15:21:14.290128 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3329/6832] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:21:14.325301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:14.326005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:14.333512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:14.334061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:14.334480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:14.335168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:14.335654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:14.336583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:14.564129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:14.572626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d364ace-9330-413d-b636-378c656d940d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.252391 Oct 03 15:21:14.573242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3504/6833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:14 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:15.600167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:15.601129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:15.608497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:15.609011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:15.609454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:15.610149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:15.610604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:15.611032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:15.752750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:15.761072 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-92915c57-0271-4658-9fb0-dc898c816f51 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1264 microversion: 2.1 time: 0.168242 Oct 03 15:21:15.761710 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3330/6834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:15 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:16.788138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:16.789190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:16.796844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:16.797383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:16.797843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:16.798555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:16.799027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:16.799468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:16.941622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:16.949822 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e432d17-e897-4288-ba73-f36dd1d3edb4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1450 microversion: 2.1 time: 0.168497 Oct 03 15:21:16.950411 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3505/6835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:16 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:16.974993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:21:16.975874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:21:16.983489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:16.983971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:16.984409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:16.985116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:16.985564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:16.985988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:17.005960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:21:17.130521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:21:17.139182 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fb2a7f38-972e-4894-b0dc-0944ecb6bbde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1450 microversion: 2.1 time: 0.171152 Oct 03 15:21:17.139750 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3331/6836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:21:16 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:21:19.026259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-21c7980d-3027-4779-8f3a-66f986d3d047 req-e62e0bd3-dd2e-49e8-87dc-35f1e5580e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3250b36-4c4c-4e46-841f-889413d75df9", "tag": "ba337513-089e-4301-b4f0-fbd86554b067"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:21:19.031504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:21:19.037017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-21c7980d-3027-4779-8f3a-66f986d3d047 req-e62e0bd3-dd2e-49e8-87dc-35f1e5580e3c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:21:19.037503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-21c7980d-3027-4779-8f3a-66f986d3d047 req-e62e0bd3-dd2e-49e8-87dc-35f1e5580e3c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:21:19.037945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-21c7980d-3027-4779-8f3a-66f986d3d047 req-e62e0bd3-dd2e-49e8-87dc-35f1e5580e3c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:21:19.050298 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-21c7980d-3027-4779-8f3a-66f986d3d047 req-e62e0bd3-dd2e-49e8-87dc-35f1e5580e3c service nova] Creating event network-changed:ba337513-089e-4301-b4f0-fbd86554b067 for instance d3250b36-4c4c-4e46-841f-889413d75df9 on n-h1-781139-2 Oct 03 15:21:19.055720 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-21c7980d-3027-4779-8f3a-66f986d3d047 req-e62e0bd3-dd2e-49e8-87dc-35f1e5580e3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033288 Oct 03 15:21:19.056497 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3506/6837] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:22:57.684017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:22:57.684817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:22:57.685960 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:22:57.686120 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:22:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 03 15:22:57.691984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-245296611", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63741616", "security_groups": [{"name": "tempest-secgroup-smoke-1984382964"}], "block_device_mapping_v2": [{"uuid": "fa9f2e0e-c266-446c-85eb-d2dee944d4c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "113f7d52-16b8-4d3e-9922-8c5dd7dbd078"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:22:57.835506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] validate_networks() for [('113f7d52-16b8-4d3e-9922-8c5dd7dbd078', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:22:58.271677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:22:58.272346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:22:58.273169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:22:58.273850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:22:58.274484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:22:58.288671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:22:58.289212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:22:58.289655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:22:58.290393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:22:58.290852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:22:58.291286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:22:58.321522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:22:58.330294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Getting quotas for user 2685972f5fbb4c79b21da68327424ace and project f5863d888cca460388952a60ec767545. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:22:58.392453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:22:58.394640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa9f2e0e-c266-446c-85eb-d2dee944d4c2',volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:22:58.543728 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-719ac36d-ba11-4b37-ae30-6a1d79064fd4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.862597 Oct 03 15:22:58.544596 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3332/6838] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:22:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:22:58.555769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=18 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:22:58.561623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5bbf074e-e952-414d-bec8-9de86e3e4a1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:22:58.562348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5bbf074e-e952-414d-bec8-9de86e3e4a1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:22:58.621744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5bbf074e-e952-414d-bec8-9de86e3e4a1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:22:58.629064 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5bbf074e-e952-414d-bec8-9de86e3e4a1b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1092 microversion: 2.1 time: 0.076117 Oct 03 15:22:58.629735 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3507/6839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:22:58 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1092 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:22:59.654859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:22:59.655465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:22:59.662785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:22:59.663277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:22:59.663717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:22:59.664433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:22:59.664890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:22:59.665355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:22:59.748394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:22:59.757530 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5e22f67-f028-45c2-a05d-3887fd62a30f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1190 microversion: 2.1 time: 0.108631 Oct 03 15:22:59.758344 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3333/6840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:22:59 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1190 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:00.780243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:00.781087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:00.789596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:00.790362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:00.790836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:00.791566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:00.792030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:00.792478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:00.933052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:00.941127 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69760204-4263-405f-8c78-bbefc9d84e71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1276 microversion: 2.1 time: 0.164818 Oct 03 15:23:00.941970 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3508/6841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:00 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:01.282807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-938422d4-6d52-4170-b6df-b06506200b2f req-2e7341aa-b588-46a4-968a-14a73614ed24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1", "tag": "72465985-2a49-424a-af27-f034ac8500b5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:23:01.297276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-938422d4-6d52-4170-b6df-b06506200b2f req-2e7341aa-b588-46a4-968a-14a73614ed24 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:01.298099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-938422d4-6d52-4170-b6df-b06506200b2f req-2e7341aa-b588-46a4-968a-14a73614ed24 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:01.298876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-938422d4-6d52-4170-b6df-b06506200b2f req-2e7341aa-b588-46a4-968a-14a73614ed24 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:01.314374 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-938422d4-6d52-4170-b6df-b06506200b2f req-2e7341aa-b588-46a4-968a-14a73614ed24 service nova] Creating event network-changed:72465985-2a49-424a-af27-f034ac8500b5 for instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 on n-h2-781139-2 Oct 03 15:23:01.320618 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-938422d4-6d52-4170-b6df-b06506200b2f req-2e7341aa-b588-46a4-968a-14a73614ed24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041918 Oct 03 15:23:01.321273 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3334/6842] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:23:01.964223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:01.964956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:01.972831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:01.973455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:01.973918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:01.974652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:01.975131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:01.975567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:02.124464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:02.133867 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c2f6e196-2ad6-4427-b55f-d6c0d05798b9 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1276 microversion: 2.1 time: 0.173664 Oct 03 15:23:02.143311 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3509/6843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:01 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:03.159430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:03.160237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:03.167307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:03.167789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:03.168223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:03.168913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:03.169399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:03.169821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:03.305874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:03.314035 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e9c3781-bf62-4867-837a-1132f72a0c6e tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1276 microversion: 2.1 time: 0.159910 Oct 03 15:23:03.314600 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3335/6844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:03 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:04.337077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:04.337818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:04.345225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:04.345846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:04.346882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:04.347599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:04.348076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:04.348516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:04.499403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:04.510697 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbd51a52-033b-47c7-b1ac-051fe57edc90 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1276 microversion: 2.1 time: 0.177476 Oct 03 15:23:04.511612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3510/6845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:04 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:05.538087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:05.538853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:05.548238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:05.548889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:05.549516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:05.550447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:05.551038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:05.551611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:05.701090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:05.710498 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5fa39555-b93c-42fa-8090-ae5ef85ff488 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.177726 Oct 03 15:23:05.711149 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3336/6846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:05 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:06.735876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:06.736524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:06.744280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:06.744804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:06.745282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:06.746070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:06.746619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:06.747081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:06.896804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:06.905218 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-955ce5eb-0973-4bcb-8be3-4c46df706cde tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.173605 Oct 03 15:23:06.905799 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3511/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:06 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:07.931736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:07.932447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:07.939667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:07.940219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:07.940681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:07.941495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:07.942019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:07.942454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:08.096354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:08.105518 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74f3981e-c04b-4e8f-a53c-ed8b3a4634fb tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.180363 Oct 03 15:23:08.106187 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3337/6848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:07 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:09.133443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:09.134083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:09.136898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:23:09.142394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:09.142888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:09.143366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:09.144066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:09.144529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:09.144991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:09.287118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:09.296786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ac4fc8f3-8cc2-4df0-a8c0-937809fadef3 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.167439 Oct 03 15:23:09.297429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3512/6849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:09 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:10.324352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:10.325512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:10.328459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:23:10.329838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:23:10.340025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:10.341158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:10.341641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:10.342461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:10.342957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:10.343502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:10.483102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:10.491311 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c712adee-3b89-4779-951e-07a15a60df53 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.173991 Oct 03 15:23:10.491896 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3338/6850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:10 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:11.515783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:11.516702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:11.527039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:11.527772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:11.528465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:11.529521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:11.530183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:11.530922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:11.670196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:11.681128 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ef5e7416-8bd7-4420-93ea-8f8c5f45502d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.170898 Oct 03 15:23:11.681696 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3513/6851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:11 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:12.704235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:12.704865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:12.712056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:12.712538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:12.712963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:12.714007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:12.714143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:12.714565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:12.856702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:12.864969 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1db12dab-136b-4004-b818-afa1c7416226 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.164747 Oct 03 15:23:12.865543 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3339/6852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:12 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:13.894997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:13.895636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:13.903157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:13.903650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:13.904099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:13.904806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:13.905306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:13.905750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:14.055214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:14.063304 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a3c5f867-9c60-4d47-87ff-a442edbdf674 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.172333 Oct 03 15:23:14.063862 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3514/6853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:13 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:14.493715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-cca77bf7-41b0-49ba-87f6-26acd8f00663 req-9ecfb894-d469-4c1a-a0e3-50fdcb5af3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1", "name": "network-vif-plugged", "status": "completed", "tag": "72465985-2a49-424a-af27-f034ac8500b5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:23:14.503855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cca77bf7-41b0-49ba-87f6-26acd8f00663 req-9ecfb894-d469-4c1a-a0e3-50fdcb5af3e6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:14.504331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cca77bf7-41b0-49ba-87f6-26acd8f00663 req-9ecfb894-d469-4c1a-a0e3-50fdcb5af3e6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:14.504767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cca77bf7-41b0-49ba-87f6-26acd8f00663 req-9ecfb894-d469-4c1a-a0e3-50fdcb5af3e6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:14.516362 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-cca77bf7-41b0-49ba-87f6-26acd8f00663 req-9ecfb894-d469-4c1a-a0e3-50fdcb5af3e6 service nova] Creating event network-vif-plugged:72465985-2a49-424a-af27-f034ac8500b5 for instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 on n-h2-781139-2 Oct 03 15:23:14.521895 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-cca77bf7-41b0-49ba-87f6-26acd8f00663 req-9ecfb894-d469-4c1a-a0e3-50fdcb5af3e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200227 Oct 03 15:23:14.522550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3340/6854] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:23:15.089962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:15.091010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:15.103009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:15.103841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:15.104711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:15.105613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:15.106091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:15.106531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:15.255464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:15.263732 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05257b76-4a89-46f6-9e22-fde4db59d6a6 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1264 microversion: 2.1 time: 0.180463 Oct 03 15:23:15.264271 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3515/6855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:15 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:16.296071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:16.297296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:16.308842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:16.309367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:16.309813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:16.310546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:16.311005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:16.311437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:16.455744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:16.466798 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43f01037-7785-4c96-86f1-27976200c596 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1451 microversion: 2.1 time: 0.177948 Oct 03 15:23:16.467654 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3341/6856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:16 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:16.493292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:23:16.493930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:23:16.501367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:16.501868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:16.502323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:16.503046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:16.503517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:16.503961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:16.663229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:23:16.672190 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-99a51329-21e9-4bb6-9464-0ad45b6c75b4 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1451 microversion: 2.1 time: 0.182903 Oct 03 15:23:16.672789 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3516/6857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:23:16 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:23:18.400261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-644ff87d-9c99-47f6-b2ec-ca5d59fbe66f req-d0d25276-4ee4-488a-a04e-c82024565263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1", "tag": "72465985-2a49-424a-af27-f034ac8500b5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:23:18.410856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-644ff87d-9c99-47f6-b2ec-ca5d59fbe66f req-d0d25276-4ee4-488a-a04e-c82024565263 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:23:18.411255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-644ff87d-9c99-47f6-b2ec-ca5d59fbe66f req-d0d25276-4ee4-488a-a04e-c82024565263 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:23:18.411681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-644ff87d-9c99-47f6-b2ec-ca5d59fbe66f req-d0d25276-4ee4-488a-a04e-c82024565263 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:23:18.422895 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-644ff87d-9c99-47f6-b2ec-ca5d59fbe66f req-d0d25276-4ee4-488a-a04e-c82024565263 service nova] Creating event network-changed:72465985-2a49-424a-af27-f034ac8500b5 for instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 on n-h2-781139-2 Oct 03 15:23:18.428092 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-644ff87d-9c99-47f6-b2ec-ca5d59fbe66f req-d0d25276-4ee4-488a-a04e-c82024565263 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098243 Oct 03 15:23:18.428725 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3342/6858] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:24:58.501175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:24:58.502054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=54 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:24:58.502987 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:24:58.503135 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 (ip 10.222.0.20) !!! Oct 03 15:24:58.504612 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:24:58.504835 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 (ip 10.222.0.20) !!! Oct 03 15:24:58.505325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:24:58.505769 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:24:58.505769 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 (ip 10.222.0.20) !!! Oct 03 15:24:58.506569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=50 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:24:58.507755 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:24:58.507906 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 03 15:24:58.512983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:24:58.513508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:24:58.513863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7c056eef-5067-47a8-b43b-d76ba3db0704 req-b4a1c163-aa69-4db5-9405-4ac4907fe3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1", "tag": "72465985-2a49-424a-af27-f034ac8500b5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:24:58.526629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7c056eef-5067-47a8-b43b-d76ba3db0704 req-b4a1c163-aa69-4db5-9405-4ac4907fe3af service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:24:58.527174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7c056eef-5067-47a8-b43b-d76ba3db0704 req-b4a1c163-aa69-4db5-9405-4ac4907fe3af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:24:58.527605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7c056eef-5067-47a8-b43b-d76ba3db0704 req-b4a1c163-aa69-4db5-9405-4ac4907fe3af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:24:58.540539 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7c056eef-5067-47a8-b43b-d76ba3db0704 req-b4a1c163-aa69-4db5-9405-4ac4907fe3af service nova] Creating event network-changed:72465985-2a49-424a-af27-f034ac8500b5 for instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 on n-h2-781139-2 Oct 03 15:24:58.544036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:24:58.544825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:24:58.545402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:24:58.545735 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7c056eef-5067-47a8-b43b-d76ba3db0704 req-b4a1c163-aa69-4db5-9405-4ac4907fe3af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043005 Oct 03 15:24:58.546397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:24:58.546738 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3343/6859] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:24:58.549843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:24:58.550383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:24:58.586120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:24:58.679323 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f7dfd59-b5d7-40a4-98cb-91cd61f8b5c8 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 204 len: 0 microversion: 2.1 time: 0.178375 Oct 03 15:24:58.680511 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3517/6860] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:24:58 2022] DELETE /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 15:24:58.690212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:24:58.692268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:24:58.698693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:24:58.699179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:24:58.699759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:24:58.700465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:24:58.700941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:24:58.701363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:24:58.891645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:24:58.900205 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-460fa777-7002-4a71-afa3-a9708e696375 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1575 microversion: 2.1 time: 0.215015 Oct 03 15:24:58.900793 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3344/6861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:24:58 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:24:59.924390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:24:59.925138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:24:59.932652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:24:59.933185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:24:59.933636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:24:59.934398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:24:59.934809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:24:59.935245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:00.131323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:00.139402 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9031802-d3f6-4452-b30f-01535ce2d553 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1575 microversion: 2.1 time: 0.219407 Oct 03 15:25:00.139966 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3518/6862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:24:59 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:00.648142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-2ed24b1a-6461-48a7-bb4a-9e00a87cd368 req-3ddd58cc-eb13-4956-9729-3a805333f124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1", "name": "network-vif-deleted", "tag": "72465985-2a49-424a-af27-f034ac8500b5"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:00.660296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2ed24b1a-6461-48a7-bb4a-9e00a87cd368 req-3ddd58cc-eb13-4956-9729-3a805333f124 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:00.660809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2ed24b1a-6461-48a7-bb4a-9e00a87cd368 req-3ddd58cc-eb13-4956-9729-3a805333f124 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:00.661266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-2ed24b1a-6461-48a7-bb4a-9e00a87cd368 req-3ddd58cc-eb13-4956-9729-3a805333f124 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:00.672982 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-2ed24b1a-6461-48a7-bb4a-9e00a87cd368 req-3ddd58cc-eb13-4956-9729-3a805333f124 service nova] Creating event network-vif-deleted:72465985-2a49-424a-af27-f034ac8500b5 for instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 on n-h2-781139-2 Oct 03 15:25:00.678516 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-2ed24b1a-6461-48a7-bb4a-9e00a87cd368 req-3ddd58cc-eb13-4956-9729-3a805333f124 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036536 Oct 03 15:25:00.681446 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3345/6863] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:01.163718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:01.164265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:01.171671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:01.172171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:01.172621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:01.173370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:01.173875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:01.174310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:01.237457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:01.246147 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f08978d-154f-41a8-a0cb-138553f3ea9d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1223 microversion: 2.1 time: 0.086846 Oct 03 15:25:01.246743 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3519/6864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:01 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:02.270436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:02.271004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:02.278182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:02.278679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:02.279123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:02.279840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:02.280293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:02.280714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:02.348229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:02.356618 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-102cf886-626e-4960-bdda-3d3e8c25d456 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1223 microversion: 2.1 time: 0.091838 Oct 03 15:25:02.357235 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3346/6865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:02 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:03.380332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:03.380882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:03.388728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:03.389256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:03.389706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:03.390425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:03.390890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:03.391323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:03.455526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:03.463944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-264d44b4-d541-47dc-9d20-98d07947db71 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1223 microversion: 2.1 time: 0.088265 Oct 03 15:25:03.464578 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3520/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:03 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:04.489347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:04.489927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:04.497432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:04.497938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:04.498359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:04.499057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:04.499509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:04.499933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:04.570289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:04.579244 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5984bb9-50d1-4ed9-9431-e857dd0bd179 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 200 len: 1223 microversion: 2.1 time: 0.094191 Oct 03 15:25:04.579827 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3347/6867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:04 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:05.603985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:05.604697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:05.613354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:05.613945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:05.614574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:05.615416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:05.615971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:05.616490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:05.632718 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 could not be found. Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 HTTP/1.1 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 could not be found. Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1'} Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 could not be found. Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 could not be found. Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:05.634446 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 could not be found. Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance 0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d1aa028-51a5-4aa6-9389-923f20c33c16 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1" status: 404 len: 111 microversion: 2.1 time: 0.036653 Oct 03 15:25:05.638537 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3521/6868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:05 2022] GET /compute/v2.1/servers/0bfd2ec9-e5c8-48e8-a3dc-0d876179d0b1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:25:11.913325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:11.913896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:11.916165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-51066787-31e3-410c-87ec-44024439ebd6 req-f4e8e9c7-d5be-4c9f-844a-598aecfa206a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3250b36-4c4c-4e46-841f-889413d75df9", "tag": "ba337513-089e-4301-b4f0-fbd86554b067"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:11.921053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:11.921775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:11.922296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:11.923067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:11.923585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:11.924185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:11.927298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-51066787-31e3-410c-87ec-44024439ebd6 req-f4e8e9c7-d5be-4c9f-844a-598aecfa206a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:11.927918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-51066787-31e3-410c-87ec-44024439ebd6 req-f4e8e9c7-d5be-4c9f-844a-598aecfa206a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:11.928596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-51066787-31e3-410c-87ec-44024439ebd6 req-f4e8e9c7-d5be-4c9f-844a-598aecfa206a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:11.941040 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-51066787-31e3-410c-87ec-44024439ebd6 req-f4e8e9c7-d5be-4c9f-844a-598aecfa206a service nova] Creating event network-changed:ba337513-089e-4301-b4f0-fbd86554b067 for instance d3250b36-4c4c-4e46-841f-889413d75df9 on n-h1-781139-2 Oct 03 15:25:11.947438 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-51066787-31e3-410c-87ec-44024439ebd6 req-f4e8e9c7-d5be-4c9f-844a-598aecfa206a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036080 Oct 03 15:25:11.948721 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3522/6869] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:11.952660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:25:12.044594 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80dd7b27-89aa-41cd-af68-349c9adec96d tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 204 len: 0 microversion: 2.1 time: 0.134945 Oct 03 15:25:12.049746 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3348/6870] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:25:11 2022] DELETE /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:25:12.056773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:12.057565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:12.064018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:12.064510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:12.065047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:12.065793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:12.066258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:12.066690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:12.201234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:12.209323 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c43bdee-33e1-4859-9628-c1cb47395660 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1575 microversion: 2.1 time: 0.157234 Oct 03 15:25:12.209871 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3523/6871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:12 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:13.233928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:13.234626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:13.242153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:13.242612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:13.243047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:13.243771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:13.244240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:13.244661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:13.384724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:13.393853 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5153e11c-42b6-4380-aa18-43303c2fbbfd tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1575 microversion: 2.1 time: 0.164366 Oct 03 15:25:13.394484 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3349/6872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:13 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:14.314147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-df92c741-679b-4055-80bf-3a343c5c948d req-2b4780a8-1520-4381-b009-9f9c9322c66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3250b36-4c4c-4e46-841f-889413d75df9", "name": "network-vif-deleted", "tag": "ba337513-089e-4301-b4f0-fbd86554b067"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:14.325051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-df92c741-679b-4055-80bf-3a343c5c948d req-2b4780a8-1520-4381-b009-9f9c9322c66e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:14.325546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-df92c741-679b-4055-80bf-3a343c5c948d req-2b4780a8-1520-4381-b009-9f9c9322c66e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:14.325981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-df92c741-679b-4055-80bf-3a343c5c948d req-2b4780a8-1520-4381-b009-9f9c9322c66e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:14.340947 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-df92c741-679b-4055-80bf-3a343c5c948d req-2b4780a8-1520-4381-b009-9f9c9322c66e service nova] Creating event network-vif-deleted:ba337513-089e-4301-b4f0-fbd86554b067 for instance d3250b36-4c4c-4e46-841f-889413d75df9 on n-h1-781139-2 Oct 03 15:25:14.347025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-df92c741-679b-4055-80bf-3a343c5c948d req-2b4780a8-1520-4381-b009-9f9c9322c66e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036625 Oct 03 15:25:14.347644 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3524/6873] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:14.417453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:14.418308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:14.425506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:14.425973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:14.426413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:14.427116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:14.427573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:14.428001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:14.492506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:14.501208 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cc5df1eb-59e4-4035-8b14-09d0db26a0a2 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1223 microversion: 2.1 time: 0.087792 Oct 03 15:25:14.501802 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3350/6874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:14 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:15.526144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:15.526741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:15.533845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:15.534343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:15.534799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:15.535509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:15.535965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:15.536435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:15.600152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:15.608647 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3129860b-9774-476d-8ed2-3b968adbfe14 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1223 microversion: 2.1 time: 0.088171 Oct 03 15:25:15.609270 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3525/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:15 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:16.632087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:16.632669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:16.640447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:16.640949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:16.641400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:16.642072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:16.642556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:16.642982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:16.720561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:16.729094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df43505c-e358-44da-a40d-c3926e58f793 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1223 microversion: 2.1 time: 0.100884 Oct 03 15:25:16.729678 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3351/6876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:16 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:17.752239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:17.752841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:17.760681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:17.761214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:17.761641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:17.762386 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:17.762850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:17.763289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:17.829368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:17.838087 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47aee1a5-fec7-47f1-8afc-3f8b3bca3222 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1223 microversion: 2.1 time: 0.089857 Oct 03 15:25:17.838602 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3526/6877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:17 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:18.861461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:18.862035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:18.869640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:18.870137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:18.870537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:18.871465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:18.871916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:18.872336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:18.908887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:18.909401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:18.909844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:18.910305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lazy-loading 'fault' on Instance uuid d3250b36-4c4c-4e46-841f-889413d75df9 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:25:18.955792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2685972f5fbb4c79b21da68327424ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5863d888cca460388952a60ec767545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:18.963901 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8d59a548-37cb-4939-8ac9-79e9bd3ac72b tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 200 len: 1228 microversion: 2.1 time: 0.106515 Oct 03 15:25:18.964727 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3352/6878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:18 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 1228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:19.992895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:19.993897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: d3250b36-4c4c-4e46-841f-889413d75df9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:20.000978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:20.001546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:20.002025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:20.002793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:20.003289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:20.003760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:20.018808 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance d3250b36-4c4c-4e46-841f-889413d75df9 could not be found. Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 HTTP/1.1 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance d3250b36-4c4c-4e46-841f-889413d75df9 could not be found. Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'd3250b36-4c4c-4e46-841f-889413d75df9'} Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3250b36-4c4c-4e46-841f-889413d75df9 could not be found. Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3250b36-4c4c-4e46-841f-889413d75df9 could not be found. Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:20.020755 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3250b36-4c4c-4e46-841f-889413d75df9 could not be found. Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance d3250b36-4c4c-4e46-841f-889413d75df9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-56121fea-1649-4284-a341-3d11dd5b0c75 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9" status: 404 len: 111 microversion: 2.1 time: 0.036680 Oct 03 15:25:20.025306 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3527/6879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:19 2022] GET /compute/v2.1/servers/d3250b36-4c4c-4e46-841f-889413d75df9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:25:20.494776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:20.495342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:20.502487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:20.502998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:20.503435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:20.504129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:20.504575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:20.505032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:20.518758 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc HTTP/1.1 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'db04b393-2ed9-4452-9bd6-8427992e19bc'} Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:25:20.520450 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8741b646-dac5-4001-839a-26f6ca01a42a tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 404 len: 111 microversion: 2.1 time: 0.031178 Oct 03 15:25:20.524814 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3353/6880] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:25:20 2022] DELETE /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:25:20.531106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:20.532053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] [instance: db04b393-2ed9-4452-9bd6-8427992e19bc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:20.538314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:20.538821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:20.539466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:20.540021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:20.540487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:20.540919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:20.555226 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] HTTP exception thrown: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Request method failure captured: Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc HTTP/1.1 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOvwnLWsuuJ4mFQ73Qd4O0d28FKKCKqGVRIVZPk0KcHlJj1sHQXmIrCE7LwFnCYTiHBQUBCUsFjCRgmcCfoch9TromrAqd59wvPwuWYlP5EB6MjLhKzNtVYVnQ8afF6PbbicL_oAFkIcv1rKpK8ucYyrNBG9BLra4Gv4dI9Is-ZI1jus Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f5863d888cca460388952a60ec767545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f5863d888cca460388952a60ec767545", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f5863d888cca460388952a60ec767545"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f5863d888cca460388952a60ec767545 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1724538481 Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 2685972f5fbb4c79b21da68327424ace Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestVolumeBootPattern-1724538481-project Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'db04b393-2ed9-4452-9bd6-8427992e19bc'} Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:20.556502 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Returning 404 to user: Instance db04b393-2ed9-4452-9bd6-8427992e19bc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7eea1609-f0f0-4248-a966-6d1cf389068f tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc" status: 404 len: 111 microversion: 2.1 time: 0.030786 Oct 03 15:25:20.560395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3528/6881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:20 2022] GET /compute/v2.1/servers/db04b393-2ed9-4452-9bd6-8427992e19bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:25:23.979079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f398ee84-6a7f-4eb5-bebd-b4b716cc9a13 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] Calling method '.version_select at 0x7fb2312ca820>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:24.029109 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f398ee84-6a7f-4eb5-bebd-b4b716cc9a13 tempest-TestVolumeBootPattern-1724538481 tempest-TestVolumeBootPattern-1724538481-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63741616" status: 202 len: 0 microversion: 2.1 time: 0.054117 Oct 03 15:25:24.029724 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3354/6882] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 15:25:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63741616 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:25:42.706076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:25:42.707158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:25:42.833503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1169357968", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:42.896215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] validate_networks() for None {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:25:43.172026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:25:43.172465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:25:43.172992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:25:43.173421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:25:43.173859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:25:43.183093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:43.183592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:43.184046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:43.184792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:43.185307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:43.185753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:43.203309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Getting quotas for project 5a7a266426554e76a85f768516e4d71a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:25:43.208719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Getting quotas for user aa42dc2e15c5448bb82ea899f15b3eb3 and project 5a7a266426554e76a85f768516e4d71a. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:25:43.221848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:25:43.224203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:25:43.271300 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-773eb884-c991-4c04-9521-31cff1857258 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572078 Oct 03 15:25:43.272219 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3529/6883] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:25:43.283089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:25:43.283956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:25:43.288045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c5672115-27f0-4229-891d-99affad9ff75 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:43.288650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c5672115-27f0-4229-891d-99affad9ff75 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:43.346646 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c5672115-27f0-4229-891d-99affad9ff75 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:43.353962 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c5672115-27f0-4229-891d-99affad9ff75 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1222 microversion: 2.1 time: 0.072747 Oct 03 15:25:43.354536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3355/6884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:43 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:44.377513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-76761a7c-2584-432e-84b8-3df3e9fe51af tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:44.378147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-76761a7c-2584-432e-84b8-3df3e9fe51af tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:44.435755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-76761a7c-2584-432e-84b8-3df3e9fe51af tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:44.443790 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-76761a7c-2584-432e-84b8-3df3e9fe51af tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1222 microversion: 2.1 time: 0.071149 Oct 03 15:25:44.444373 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3530/6885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:44 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:45.471693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6864dc7-f18c-400e-a2c6-d130b4f7c73a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:45.472775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6864dc7-f18c-400e-a2c6-d130b4f7c73a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:45.540613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6864dc7-f18c-400e-a2c6-d130b4f7c73a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:45.548289 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6864dc7-f18c-400e-a2c6-d130b4f7c73a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1222 microversion: 2.1 time: 0.083702 Oct 03 15:25:45.548875 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3356/6886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:45 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:46.574851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5beb95bf-c0b1-4a89-9f6f-64e904d62115 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:46.575497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5beb95bf-c0b1-4a89-9f6f-64e904d62115 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:46.631212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5beb95bf-c0b1-4a89-9f6f-64e904d62115 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:46.639176 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5beb95bf-c0b1-4a89-9f6f-64e904d62115 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1222 microversion: 2.1 time: 0.069887 Oct 03 15:25:46.639785 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3531/6887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:46 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:47.667186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:47.668052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:47.679733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:47.680548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:47.681445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:47.682146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:47.682602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:47.683030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:47.745390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:47.753731 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-25c83998-a041-4d29-b0a8-9ec2230ba2e8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1226 microversion: 2.1 time: 0.093782 Oct 03 15:25:47.754314 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3357/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:47 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:48.777244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:48.777875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:48.785171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:48.785673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:48.786128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:48.786831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:48.787295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:48.787729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:48.859755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:48.867821 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b8572c8-80a8-4eee-85f8-475c009aa3c9 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1280 microversion: 2.1 time: 0.094733 Oct 03 15:25:48.868407 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3532/6889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:48 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:49.891321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:49.892714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:49.899280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:49.899766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:49.900180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:49.901127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:49.901620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:49.902727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:50.038720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:50.047444 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-437fd2ef-de46-413d-a1e4-7b2be1166955 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1322 microversion: 2.1 time: 0.159999 Oct 03 15:25:50.050194 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3358/6890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:49 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:50.101282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cccab64a-5030-4e9f-aebe-3d0f43887098 req-72314aca-89d4-49f8-b4f5-48be1acf1ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3316140-ee50-4c80-8e83-95b647567703", "tag": "39f25f88-2baf-4731-abaf-9aa4151538ad"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:50.112204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cccab64a-5030-4e9f-aebe-3d0f43887098 req-72314aca-89d4-49f8-b4f5-48be1acf1ff5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:50.112694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cccab64a-5030-4e9f-aebe-3d0f43887098 req-72314aca-89d4-49f8-b4f5-48be1acf1ff5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:50.113221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cccab64a-5030-4e9f-aebe-3d0f43887098 req-72314aca-89d4-49f8-b4f5-48be1acf1ff5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:50.125521 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cccab64a-5030-4e9f-aebe-3d0f43887098 req-72314aca-89d4-49f8-b4f5-48be1acf1ff5 service nova] Creating event network-changed:39f25f88-2baf-4731-abaf-9aa4151538ad for instance a3316140-ee50-4c80-8e83-95b647567703 on n-h2-781139-2 Oct 03 15:25:50.131204 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cccab64a-5030-4e9f-aebe-3d0f43887098 req-72314aca-89d4-49f8-b4f5-48be1acf1ff5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033734 Oct 03 15:25:50.132022 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3533/6891] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:51.071696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:51.072298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:51.080231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:51.080723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:51.081195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:51.081909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:51.082362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:51.082781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:51.223979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:51.235996 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9da10c20-651e-4c79-aff1-01d81b517928 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1322 microversion: 2.1 time: 0.168033 Oct 03 15:25:51.236796 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3359/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:51 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:52.264576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:52.265320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:52.273463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:52.274051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:52.274576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:52.275399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:52.275952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:52.276702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:52.416317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:52.425216 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-613d0787-bfe6-48f8-99bb-c3ac3037981a tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1322 microversion: 2.1 time: 0.167839 Oct 03 15:25:52.425833 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3534/6893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:52 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:53.447971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:53.448547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:53.455687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:53.456182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:53.456624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:53.457353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:53.457807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:53.458232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:53.592020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:53.600858 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-31d13db7-62d1-4d12-8e29-69b28c938a0b tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1322 microversion: 2.1 time: 0.156987 Oct 03 15:25:53.601486 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3360/6894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:53 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:54.626937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:54.627557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:54.629782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:25:54.636423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:54.636917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:54.637519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:54.638253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:54.638675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:54.639283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:54.777273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:54.785377 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57660e69-b4fb-45d0-bf5b-d009f3208de0 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1322 microversion: 2.1 time: 0.163276 Oct 03 15:25:54.785957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3535/6895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:54 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:55.066039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-123bf1c7-f00a-41df-bcac-3d69315fa3ad req-a77af919-3956-40f5-804c-a5a6167d275f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3316140-ee50-4c80-8e83-95b647567703", "name": "network-vif-plugged", "status": "completed", "tag": "39f25f88-2baf-4731-abaf-9aa4151538ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:55.076325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-123bf1c7-f00a-41df-bcac-3d69315fa3ad req-a77af919-3956-40f5-804c-a5a6167d275f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:55.076914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-123bf1c7-f00a-41df-bcac-3d69315fa3ad req-a77af919-3956-40f5-804c-a5a6167d275f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:55.077366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-123bf1c7-f00a-41df-bcac-3d69315fa3ad req-a77af919-3956-40f5-804c-a5a6167d275f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:55.089079 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-123bf1c7-f00a-41df-bcac-3d69315fa3ad req-a77af919-3956-40f5-804c-a5a6167d275f service nova] Creating event network-vif-plugged:39f25f88-2baf-4731-abaf-9aa4151538ad for instance a3316140-ee50-4c80-8e83-95b647567703 on n-h2-781139-2 Oct 03 15:25:55.094582 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-123bf1c7-f00a-41df-bcac-3d69315fa3ad req-a77af919-3956-40f5-804c-a5a6167d275f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032891 Oct 03 15:25:55.095162 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3361/6896] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:55.812540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:55.813601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:55.825597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:55.826420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:55.827276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:55.827956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:55.828451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:55.828895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:55.975372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:55.983429 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fedb7da5-15de-494f-8f84-a78ff5aa73cd tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1322 microversion: 2.1 time: 0.177616 Oct 03 15:25:55.984069 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3536/6897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:55 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:57.006010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:25:57.015915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:57.017448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:57.028190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.029008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.029750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:57.030912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.031889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.032376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:57.181471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:57.189694 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6568f171-c358-427a-a4d5-52345b45d4a7 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1472 microversion: 2.1 time: 0.185425 Oct 03 15:25:57.190282 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3362/6898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:57 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1472 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:57.215356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:25:57.269982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-076b0206-acc6-4f8a-a9d0-73f948c59069 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Calling method '.version_select at 0x7fb230961e50>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:57.355147 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-076b0206-acc6-4f8a-a9d0-73f948c59069 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/7c89ac9e3cae4e9499a2278c3dbf7ec3" status: 200 len: 371 microversion: 2.1 time: 0.144364 Oct 03 15:25:57.355737 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3537/6899] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 15:25:57 2022] GET /compute/v2.1/os-quota-sets/7c89ac9e3cae4e9499a2278c3dbf7ec3 => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:57.368475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b24d037-335e-441b-a206-0e6c0095ab4c tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-845369360", "id": 395536170, "os-flavor-access:is_public": "True"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:57.392605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b24d037-335e-441b-a206-0e6c0095ab4c tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.027854 Oct 03 15:25:57.393216 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3363/6900] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:25:57 2022] POST /compute/v2.1/flavors => generated 434 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:57.405533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "395536170"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:57.408466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:57.415028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.415532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.415982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:57.416706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.417224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.417667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:57.640482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f2ea91f1cd584c8da27b26fb56009620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c89ac9e3cae4e9499a2278c3dbf7ec3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:57.647137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] [instance: a3316140-ee50-4c80-8e83-95b647567703] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-845369360 {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:25:57.654579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.655099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.655580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:57.657197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.657197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.657458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:57.685371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Getting quotas for project 5a7a266426554e76a85f768516e4d71a. Resources: {'ram', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:25:57.691204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Getting quotas for user aa42dc2e15c5448bb82ea899f15b3eb3 and project 5a7a266426554e76a85f768516e4d71a. Resources: {'ram', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:25:57.705886 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] ram quota exceeded for 7c89ac9e3cae4e9499a2278c3dbf7ec3, tried to resize instance. Oct 03 15:25:57.706579 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Request method failure captured: Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703/action HTTP/1.1 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 38 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv724A9v0Yqk3KigHj6QHx8oyFcArQQe300efXl1daVbPXPpINh3kRFD_fWLdbFyQ8rJn5ik4C57QPAwjNJyTrO35H474TKBwsuLysdZMAilDrRABnKNqur74XiVw3Mxwn2KiOLV_4E-pxgbvyyzWEzZ1psGuYzfPXVNtKv2NL4kZ9I Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 7c89ac9e3cae4e9499a2278c3dbf7ec3 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-551914007 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Role: admin,member,reader Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: admin,member,reader Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c89ac9e3cae4e9499a2278c3dbf7ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c89ac9e3cae4e9499a2278c3dbf7ec3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c89ac9e3cae4e9499a2278c3dbf7ec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c89ac9e3cae4e9499a2278c3dbf7ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminNegativeTestJSON-551914007 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 7c89ac9e3cae4e9499a2278c3dbf7ec3 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-551914007 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersAdminNegativeTestJSON-551914007-project-admin Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f2ea91f1cd584c8da27b26fb56009620 Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminNegativeTestJSON-551914007-project-admin Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: {"resize": {"flavorRef": "395536170"}} Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a3316140-ee50-4c80-8e83-95b647567703', 'body': {'resize': {'flavorRef': '395536170'}}} Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:25:57.708758 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b071958b-0a67-4eb1-a0f5-37f808c98788 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703/action" status: 403 len: 118 microversion: 2.1 time: 0.308602 Oct 03 15:25:57.717864 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3538/6901] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:25:57 2022] POST /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703/action => generated 118 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:25:57.721897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a4b1808-3766-49a1-a64a-e0b8aaea5201 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:57.746553 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a4b1808-3766-49a1-a64a-e0b8aaea5201 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/395536170" status: 202 len: 0 microversion: 2.1 time: 0.028582 Oct 03 15:25:57.747625 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3364/6902] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 3 15:25:57 2022] DELETE /compute/v2.1/flavors/395536170 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:25:57.755729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ee8e2c3-a083-4e22-aa1c-bbe64fad395b tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:57.780564 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ee8e2c3-a083-4e22-aa1c-bbe64fad395b tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028439 Oct 03 15:25:57.781205 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3539/6903] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 15:25:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:57.802488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-30d8e9d5-71e7-4ba8-a0b0-c5dc62e2a1cf tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Calling method '.version_select at 0x7fb230a01f70>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:57.903772 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-30d8e9d5-71e7-4ba8-a0b0-c5dc62e2a1cf tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/7c89ac9e3cae4e9499a2278c3dbf7ec3" status: 200 len: 371 microversion: 2.1 time: 0.105007 Oct 03 15:25:57.904241 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3365/6904] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 3 15:25:57 2022] GET /compute/v2.1/os-quota-sets/7c89ac9e3cae4e9499a2278c3dbf7ec3 => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:57.917461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58a0f08c-3517-409d-9baf-b1d7d5876dbe tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-139461738", "id": 1390768205, "os-flavor-access:is_public": "True"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:57.941871 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58a0f08c-3517-409d-9baf-b1d7d5876dbe tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.028630 Oct 03 15:25:57.943039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3540/6905] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:25:57 2022] POST /compute/v2.1/flavors => generated 436 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:25:57.960018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1390768205"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:25:57.962463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:57.969876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.970407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.970875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:57.971583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:57.972014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:57.972455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:58.149578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f2ea91f1cd584c8da27b26fb56009620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c89ac9e3cae4e9499a2278c3dbf7ec3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:58.159847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] [instance: a3316140-ee50-4c80-8e83-95b647567703] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-139461738 {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:25:58.169790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:58.170454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:58.171062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:58.172246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:58.173380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:58.173496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:58.195270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Getting quotas for project 5a7a266426554e76a85f768516e4d71a. Resources: {'ram', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:25:58.200953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Getting quotas for user aa42dc2e15c5448bb82ea899f15b3eb3 and project 5a7a266426554e76a85f768516e4d71a. Resources: {'ram', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:25:58.218158 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.compute.api [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] cores quota exceeded for 7c89ac9e3cae4e9499a2278c3dbf7ec3, tried to resize instance. Oct 03 15:25:58.219355 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Request method failure captured: Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703/action HTTP/1.1 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 39 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv724A9v0Yqk3KigHj6QHx8oyFcArQQe300efXl1daVbPXPpINh3kRFD_fWLdbFyQ8rJn5ik4C57QPAwjNJyTrO35H474TKBwsuLysdZMAilDrRABnKNqur74XiVw3Mxwn2KiOLV_4E-pxgbvyyzWEzZ1psGuYzfPXVNtKv2NL4kZ9I Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 7c89ac9e3cae4e9499a2278c3dbf7ec3 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-551914007 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Role: admin,member,reader Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: admin,member,reader Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7c89ac9e3cae4e9499a2278c3dbf7ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7c89ac9e3cae4e9499a2278c3dbf7ec3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c89ac9e3cae4e9499a2278c3dbf7ec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7c89ac9e3cae4e9499a2278c3dbf7ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersAdminNegativeTestJSON-551914007 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 7c89ac9e3cae4e9499a2278c3dbf7ec3 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-551914007 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersAdminNegativeTestJSON-551914007-project-admin Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: f2ea91f1cd584c8da27b26fb56009620 Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersAdminNegativeTestJSON-551914007-project-admin Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: {"resize": {"flavorRef": "1390768205"}} Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'a3316140-ee50-4c80-8e83-95b647567703', 'body': {'resize': {'flavorRef': '1390768205'}}} Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:25:58.223254 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-96b6c955-fdfe-4ef1-bd02-62c7bdd25af1 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703/action" status: 403 len: 113 microversion: 2.1 time: 0.270482 Oct 03 15:25:58.227062 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3366/6906] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:25:57 2022] POST /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703/action => generated 113 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:25:58.235476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4e545cfe-9c1b-4520-a283-69a5c61a299c tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:58.256672 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4e545cfe-9c1b-4520-a283-69a5c61a299c tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1390768205" status: 202 len: 0 microversion: 2.1 time: 0.025668 Oct 03 15:25:58.257345 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3541/6907] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 3 15:25:58 2022] DELETE /compute/v2.1/flavors/1390768205 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:25:58.267718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1fc9af1d-b902-47dc-b1a6-fe31c4d3cc07 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:58.298117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1fc9af1d-b902-47dc-b1a6-fe31c4d3cc07 tempest-ServersAdminNegativeTestJSON-551914007 tempest-ServersAdminNegativeTestJSON-551914007-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034187 Oct 03 15:25:58.299516 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3367/6908] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 3 15:25:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:58.329570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:58.330146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:58.339377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:58.339885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:58.340335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:58.341324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:58.343381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:58.344644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:58.372990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:25:58.457590 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6eceef58-2845-4fd8-a7f9-0a0633cb3d47 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 204 len: 0 microversion: 2.1 time: 0.134606 Oct 03 15:25:58.458224 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3542/6909] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:25:58 2022] DELETE /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:25:58.467715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:58.468331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:58.475427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:58.475902 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:58.476343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:58.477096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:58.477569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:58.477993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:58.623890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:58.632556 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-046d4ba5-1069-4a8b-b6eb-c8131e469fb5 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1478 microversion: 2.1 time: 0.169070 Oct 03 15:25:58.633205 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3368/6910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:58 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1478 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:25:59.661819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:25:59.662912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:25:59.673447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:59.673952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:59.674406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:59.675117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:25:59.675583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:25:59.676040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:25:59.890104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa42dc2e15c5448bb82ea899f15b3eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7a266426554e76a85f768516e4d71a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:25:59.898620 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-75257ed4-c9a0-45d9-b1b5-2adb9e624aad tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 200 len: 1478 microversion: 2.1 time: 0.243581 Oct 03 15:25:59.899211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3543/6911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:25:59 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 1478 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:00.222999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-cdbd4899-2c56-41f3-a4d9-4f624768e0ef req-7b8bf527-0f73-4a7f-b64a-89bac2204bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3316140-ee50-4c80-8e83-95b647567703", "name": "network-vif-deleted", "tag": "39f25f88-2baf-4731-abaf-9aa4151538ad"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:00.235433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cdbd4899-2c56-41f3-a4d9-4f624768e0ef req-7b8bf527-0f73-4a7f-b64a-89bac2204bc1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:00.236152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cdbd4899-2c56-41f3-a4d9-4f624768e0ef req-7b8bf527-0f73-4a7f-b64a-89bac2204bc1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:00.236753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-cdbd4899-2c56-41f3-a4d9-4f624768e0ef req-7b8bf527-0f73-4a7f-b64a-89bac2204bc1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:00.249766 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-cdbd4899-2c56-41f3-a4d9-4f624768e0ef req-7b8bf527-0f73-4a7f-b64a-89bac2204bc1 service nova] Creating event network-vif-deleted:39f25f88-2baf-4731-abaf-9aa4151538ad for instance a3316140-ee50-4c80-8e83-95b647567703 on n-h2-781139-2 Oct 03 15:26:00.255419 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-cdbd4899-2c56-41f3-a4d9-4f624768e0ef req-7b8bf527-0f73-4a7f-b64a-89bac2204bc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036723 Oct 03 15:26:00.256525 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3369/6912] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:26:00.925411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:00.926010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] [instance: a3316140-ee50-4c80-8e83-95b647567703] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:00.933811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:00.934313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:00.934795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:00.935561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:00.936046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:00.936554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:00.951298 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] HTTP exception thrown: Instance a3316140-ee50-4c80-8e83-95b647567703 could not be found. Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Request method failure captured: Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 HTTP/1.1 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv71boObF1HE9_bzmhFqH6_cTCPafsXIxc6UgjKhlvquG1NsFLcTzNVpd0FlfTHXnPD_iI7NtQWzXYJxfDIJTjNzDagHEgSFPBqdLLhQWQ-4JWLoXUhFx5JpRg397GMp5qFxrKs-ugm1vNbTeClGYknxYXmn4WFOa-g5V0kRP3YTOc8 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 5a7a266426554e76a85f768516e4d71a Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2122055531 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a7a266426554e76a85f768516e4d71a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a7a266426554e76a85f768516e4d71a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a7a266426554e76a85f768516e4d71a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a7a266426554e76a85f768516e4d71a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2122055531 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 5a7a266426554e76a85f768516e4d71a Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2122055531 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersAdminNegativeTestJSON-2122055531-project Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: aa42dc2e15c5448bb82ea899f15b3eb3 Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2122055531-project Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a3316140-ee50-4c80-8e83-95b647567703 could not be found. Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a3316140-ee50-4c80-8e83-95b647567703'} Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3316140-ee50-4c80-8e83-95b647567703 could not be found. Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3316140-ee50-4c80-8e83-95b647567703 could not be found. Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:00.953101 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3316140-ee50-4c80-8e83-95b647567703 could not be found. Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] Returning 404 to user: Instance a3316140-ee50-4c80-8e83-95b647567703 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb7fdea6-5326-40dd-aa4e-b16e65497ef8 tempest-ServersAdminNegativeTestJSON-2122055531 tempest-ServersAdminNegativeTestJSON-2122055531-project] 10.222.0.20 "GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703" status: 404 len: 111 microversion: 2.1 time: 0.035289 Oct 03 15:26:00.957202 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3544/6913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:00 2022] GET /compute/v2.1/servers/a3316140-ee50-4c80-8e83-95b647567703 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:26:07.598923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1027886559", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "e9d38213-b4ee-45ff-987e-c1a099eca400"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:07.654056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] validate_networks() for [('e9d38213-b4ee-45ff-987e-c1a099eca400', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:26:07.895670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:08.046922 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:26:08.047414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:26:08.048019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:26:08.048542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:26:08.049151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:26:08.062278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:08.062924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:08.063466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:08.064209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:08.064687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:08.065148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:08.082488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Getting quotas for project 14cec6f98c61478892effe3e311b0c1f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:26:08.087819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Getting quotas for user bf235ab52b534ffdb5230a8a9eea1362 and project 14cec6f98c61478892effe3e311b0c1f. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:26:08.101297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:26:08.103716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:26:08.154005 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [0fd0ca82-7e3b-4d62-a84a-caceb941d5d4] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:26:09.164447 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [0fd0ca82-7e3b-4d62-a84a-caceb941d5d4] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55446. Oct 03 15:26:09.169697 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e942a9e-0df4-435f-bed6-ce1a32826931 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698168 Oct 03 15:26:09.182457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7da5a044-f8ad-46ec-94e5-3d132171d419 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:09.183120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7da5a044-f8ad-46ec-94e5-3d132171d419 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:09.197012 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3370/6914] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:26:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:26:09.197935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:09.198854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:09.257479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7da5a044-f8ad-46ec-94e5-3d132171d419 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:09.265798 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7da5a044-f8ad-46ec-94e5-3d132171d419 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1215 microversion: 2.1 time: 0.087511 Oct 03 15:26:09.266550 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3545/6915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:09 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:10.289130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:10.289695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:10.302534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:10.303032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:10.303475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:10.304188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:10.304641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:10.305097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:10.396561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:10.407809 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb1c9c77-de69-4360-876c-aa2c4851f391 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1275 microversion: 2.1 time: 0.123246 Oct 03 15:26:10.409353 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3371/6916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:10 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:11.434200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:11.434932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:11.439243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:11.445251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:11.445845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:11.446367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:11.447148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:11.447681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:11.448209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:11.660113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:11.668297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-623c7e00-7eef-4314-bb3d-af9b57116651 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1315 microversion: 2.1 time: 0.238158 Oct 03 15:26:11.668874 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3546/6917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:11 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:11.800022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-4fca96b2-f585-4691-9ecd-274d4e14611c req-426663ec-dbbc-43eb-80c3-5102640bff6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8398cc7-2e19-409e-8887-a2e54a573335", "tag": "3422be90-069e-44e2-ae75-0d0d4376f4b8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:11.811899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4fca96b2-f585-4691-9ecd-274d4e14611c req-426663ec-dbbc-43eb-80c3-5102640bff6e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:11.812501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4fca96b2-f585-4691-9ecd-274d4e14611c req-426663ec-dbbc-43eb-80c3-5102640bff6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:11.813047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-4fca96b2-f585-4691-9ecd-274d4e14611c req-426663ec-dbbc-43eb-80c3-5102640bff6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:11.824892 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-4fca96b2-f585-4691-9ecd-274d4e14611c req-426663ec-dbbc-43eb-80c3-5102640bff6e service nova] Creating event network-changed:3422be90-069e-44e2-ae75-0d0d4376f4b8 for instance f8398cc7-2e19-409e-8887-a2e54a573335 on n-h2-781139-2 Oct 03 15:26:11.829722 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-4fca96b2-f585-4691-9ecd-274d4e14611c req-426663ec-dbbc-43eb-80c3-5102640bff6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034179 Oct 03 15:26:11.830333 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3372/6918] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:26:12.691808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:12.692570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:12.699905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:12.700415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:12.700867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:12.701618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:12.702096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:12.702510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:12.836903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:12.844721 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-320f8588-c9e7-4f8f-ae03-762932a9d342 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1315 microversion: 2.1 time: 0.157432 Oct 03 15:26:12.845335 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3547/6919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:12 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:13.874644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:13.875828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:13.878553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:13.884754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:13.885282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:13.885706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:13.886416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:13.886863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:13.887290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:13.890723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=64 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:14.036076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:14.048582 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f7718c33-4c62-4746-b8b7-662ceeec5685 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1315 microversion: 2.1 time: 0.182233 Oct 03 15:26:14.049933 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3373/6920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:13 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:15.072146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:15.072871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:15.075749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:15.081856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:15.082472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:15.082932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:15.083652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:15.084143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:15.084567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:15.228033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:15.236216 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05e36765-e05f-4cdd-b967-fa326354403b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1315 microversion: 2.1 time: 0.168173 Oct 03 15:26:15.236839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3548/6921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:15 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:16.264131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:16.264998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:16.273669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:16.274146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:16.274583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:16.275273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:16.275719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:16.276138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:16.421232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:16.430979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd63b1aa-debc-4bb5-867a-d613fd8a0da4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1315 microversion: 2.1 time: 0.174110 Oct 03 15:26:16.431916 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3374/6922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:16 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:17.198465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3aae26d6-f883-4c7a-b361-4b97f5eb09dd req-2d63cb11-a138-4e46-8f90-3b1788882d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8398cc7-2e19-409e-8887-a2e54a573335", "name": "network-vif-plugged", "status": "completed", "tag": "3422be90-069e-44e2-ae75-0d0d4376f4b8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:17.209615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3aae26d6-f883-4c7a-b361-4b97f5eb09dd req-2d63cb11-a138-4e46-8f90-3b1788882d2f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:17.210179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3aae26d6-f883-4c7a-b361-4b97f5eb09dd req-2d63cb11-a138-4e46-8f90-3b1788882d2f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:17.210617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3aae26d6-f883-4c7a-b361-4b97f5eb09dd req-2d63cb11-a138-4e46-8f90-3b1788882d2f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:17.224025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3aae26d6-f883-4c7a-b361-4b97f5eb09dd req-2d63cb11-a138-4e46-8f90-3b1788882d2f service nova] Creating event network-vif-plugged:3422be90-069e-44e2-ae75-0d0d4376f4b8 for instance f8398cc7-2e19-409e-8887-a2e54a573335 on n-h2-781139-2 Oct 03 15:26:17.229380 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3aae26d6-f883-4c7a-b361-4b97f5eb09dd req-2d63cb11-a138-4e46-8f90-3b1788882d2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034788 Oct 03 15:26:17.229964 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3549/6923] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:26:17.455774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:17.456547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:17.464671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:17.465198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:17.465696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:17.466510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:17.467052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:17.467556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:17.611949 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:17.620249 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-979815c1-d694-4a9e-b82b-f037512f8684 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1315 microversion: 2.1 time: 0.169162 Oct 03 15:26:17.620872 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3375/6924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:17 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:18.648384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:18.649137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:18.656203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:18.656703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:18.657206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:18.657919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:18.658389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:18.658796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:18.810920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:18.819177 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-954ba7e6-ca0b-4b40-9b51-d84bb3a92750 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1502 microversion: 2.1 time: 0.177310 Oct 03 15:26:18.819770 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3550/6925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:18 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:18.841714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:18.844475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:18.846595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:18.847274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:18.854823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:18.855302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:18.855736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:18.856430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:18.856872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:18.857320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:18.887691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:18.893638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Old instance type m1.heat2, new instance type m1.heat {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:26:18.900522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:26:18.900958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:26:18.901446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:26:18.901846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:26:18.902244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:26:18.976641 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-987061b9-db04-4961-847f-7bb88bc0fbb7 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "POST /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335/action" status: 202 len: 0 microversion: 2.1 time: 0.138870 Oct 03 15:26:18.977315 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3376/6926] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:26:18 2022] POST /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:26:18.985593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:18.986412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:18.992571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:18.993115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:18.993548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:18.994267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:18.994735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:18.995172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:19.170535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:19.179584 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a4b5fa8-4731-4d62-aa58-3c53a0371313 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1511 microversion: 2.1 time: 0.197900 Oct 03 15:26:19.180184 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3551/6927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:18 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:20.204128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:20.204736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:20.211258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:20.211746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:20.212181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:20.212879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:20.213370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:20.213831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:20.356544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:20.364721 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-02df9824-6e78-4880-86cb-eea8703e7012 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1511 microversion: 2.1 time: 0.165483 Oct 03 15:26:20.365322 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3377/6928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:20 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:21.388822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:21.389516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:21.391915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:21.399244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:21.399749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:21.400207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:21.400960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:21.401429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:21.401869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:21.548603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:21.557028 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba735937-db82-4fa2-a31e-75fb398aa6fa tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.172435 Oct 03 15:26:21.557651 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3552/6929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:21 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:22.588025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:22.588627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:22.596314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:22.596796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:22.597276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:22.597965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:22.598417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:22.598840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:22.745456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:22.753565 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e4531682-6ee4-44c9-a3cf-d6f7d41124f3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.169558 Oct 03 15:26:22.754130 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3378/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:22 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:23.781571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:23.782604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:23.794425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:23.795278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:23.796031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:23.797257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:23.798050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:23.798834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:23.940085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:23.949874 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d8cea2b-5717-410f-b51d-adfeacbcb025 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.174959 Oct 03 15:26:23.950461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3553/6931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:23 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:24.978088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:24.978663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:24.989228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:24.989757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:24.990217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:24.990946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:24.991418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:24.991866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:25.133013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:25.141404 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a676c108-8099-4b28-8a8e-99d24b092183 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.170141 Oct 03 15:26:25.141995 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3379/6932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:24 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:26.164618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:26.165220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:26.172788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:26.173312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:26.173763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:26.174471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:26.174931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:26.175362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:26.312020 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:26.319972 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09a19cc6-be39-41e4-9d88-5c7d97822bf5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.159449 Oct 03 15:26:26.320656 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3554/6933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:26 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:27.348098 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:27.349213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:27.357738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:27.358255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:27.358688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:27.359386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:27.359815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:27.360254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:27.500281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:27.512525 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72efe8d9-463b-424c-99b8-e62d01231e94 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.171159 Oct 03 15:26:27.513320 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3380/6934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:27 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:28.540180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:28.540904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:28.548557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:28.549076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:28.549526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:28.550229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:28.550689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:28.551123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:28.692521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:28.701240 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3f6906bf-d126-4a2c-bdf3-b625281553d4 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.164953 Oct 03 15:26:28.701834 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3555/6935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:28 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:29.728378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:29.729741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:29.741735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:29.742542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:29.743265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:29.744518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:29.745004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:29.745463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:29.885536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:29.894021 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd727008-482e-45e4-9d59-896e0ca330a9 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.172336 Oct 03 15:26:29.894576 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3381/6936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:29 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:30.923974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:30.924630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:30.934259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:30.934914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:30.935508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:30.936443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:30.937103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:30.937673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:31.073471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:31.081613 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-58d77ecc-5743-49bc-b094-a59602e1ef1f tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.165260 Oct 03 15:26:31.082168 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3556/6937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:30 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:32.109578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:32.110608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:32.121525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:32.122017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:32.122460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:32.123167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:32.123628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:32.124057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:32.267715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:32.279779 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5ef5f62a-1500-4745-b988-6bf7d9eb2b44 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.176895 Oct 03 15:26:32.280383 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3382/6938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:32 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:33.303925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:33.304551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:33.312446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:33.313004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:33.313451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:33.314279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:33.314602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:33.315045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:33.453070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:33.461067 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1be66a2-9f0f-415e-8280-44ab9bb11073 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.161134 Oct 03 15:26:33.461815 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3557/6939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:33 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:34.487592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:34.488441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:34.498454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:34.499100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:34.499683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:34.500592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:34.501231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:34.501805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:34.639813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:34.652419 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8fd02bd0-677a-4af5-a456-20f1445f06c2 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.169873 Oct 03 15:26:34.653269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3383/6940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:34 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:35.683472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:35.684248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:35.694443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:35.695200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:35.695775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:35.696844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:35.697529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:35.698156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:35.835872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:35.844661 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e64cfcb-c97b-4278-ba42-2a7a0c9fea4b tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.167413 Oct 03 15:26:35.845262 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3558/6941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:35 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:36.878675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:36.879507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:36.889323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:36.889816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:36.890362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:36.891066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:36.891519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:36.891965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:37.040488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:37.048951 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a14eb937-7ece-45cf-a94a-4eec2bee64df tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.177369 Oct 03 15:26:37.049563 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3384/6942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:36 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:38.075327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:38.075917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:38.086576 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:38.087249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:38.087855 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:38.088913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:38.089408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:38.089852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:38.228826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:38.236944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4303e9e9-2f7e-47ae-a19a-81befe601371 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.167932 Oct 03 15:26:38.237532 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3559/6943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:38 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:39.263890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:39.264620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:39.275003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:39.275644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:39.276280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:39.276973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:39.277455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:39.277876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:39.411043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:39.422058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9609cfbf-7e30-4876-9377-a11f205d8a39 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.163737 Oct 03 15:26:39.422831 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3385/6944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:39 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:40.451407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:40.452007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:40.460110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:40.460619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:40.461105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:40.461819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:40.462288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:40.462736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:40.597575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:40.606543 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc581460-88d9-4a51-9d61-bd8c343c24d1 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.159988 Oct 03 15:26:40.607132 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3560/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:40 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:41.634307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:41.635164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:41.647359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:41.648146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:41.648877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:41.650161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:41.650927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:41.651496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:41.801700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:41.810316 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-137e35fa-895a-460b-af2a-1581f63b97ee tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.182987 Oct 03 15:26:41.810932 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3386/6946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:41 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:42.838163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:42.839365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:42.851119 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:42.851949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:42.852677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:42.853893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:42.854546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:42.855134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:42.857716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=87 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:42.998316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:43.006540 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c9b8104-b079-4aaf-bb8e-810a5f2aa118 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.174994 Oct 03 15:26:43.007120 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3561/6947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:42 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:44.032255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:44.032950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:44.035656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=32 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:44.041329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:44.041827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:44.042261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:44.042954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:44.043391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:44.043804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:44.046898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:44.186142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:44.194232 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-739efb8c-31ab-4043-a8fc-a7fb3fd951a3 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.166872 Oct 03 15:26:44.194824 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3387/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:44 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:45.222157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:45.223249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:45.227698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=28 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:26:45.235127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:45.235627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:45.236082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:45.236785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:45.237289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:45.237738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:45.387809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:45.396451 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c0c00a4-f137-4b62-8d0d-933bfaa6bc4e tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.181818 Oct 03 15:26:45.397053 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3562/6949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:45 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:46.427193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:46.428322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:46.440108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:46.440598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:46.441075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:46.441781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:46.442239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:46.442660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:46.579289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:46.587308 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6253c199-9540-43fe-93e4-9f8f529e7204 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.167541 Oct 03 15:26:46.587883 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3388/6950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:46 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:47.615273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:47.616268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:47.627977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:47.628791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:47.629585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:47.630745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:47.631514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:47.632243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:47.764629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:47.773630 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97c9d413-9a53-48be-85ac-4c391b43ca88 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1516 microversion: 2.1 time: 0.165142 Oct 03 15:26:47.774222 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3563/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:47 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:48.666079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-28d71069-9b2d-4342-b68e-661a9728bd74 req-09590820-fe09-4eea-9978-2cfda0dc2fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8398cc7-2e19-409e-8887-a2e54a573335", "name": "network-vif-unplugged", "status": "completed", "tag": "3422be90-069e-44e2-ae75-0d0d4376f4b8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:48.676623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28d71069-9b2d-4342-b68e-661a9728bd74 req-09590820-fe09-4eea-9978-2cfda0dc2fb7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:48.677153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28d71069-9b2d-4342-b68e-661a9728bd74 req-09590820-fe09-4eea-9978-2cfda0dc2fb7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:48.677622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-28d71069-9b2d-4342-b68e-661a9728bd74 req-09590820-fe09-4eea-9978-2cfda0dc2fb7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:48.690532 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-28d71069-9b2d-4342-b68e-661a9728bd74 req-09590820-fe09-4eea-9978-2cfda0dc2fb7 service nova] Creating event network-vif-unplugged:3422be90-069e-44e2-ae75-0d0d4376f4b8 for instance f8398cc7-2e19-409e-8887-a2e54a573335 on n-h1-781139-2 Oct 03 15:26:48.696381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-28d71069-9b2d-4342-b68e-661a9728bd74 req-09590820-fe09-4eea-9978-2cfda0dc2fb7 service nova] Instance f8398cc7-2e19-409e-8887-a2e54a573335 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:26:48.708285 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-28d71069-9b2d-4342-b68e-661a9728bd74 req-09590820-fe09-4eea-9978-2cfda0dc2fb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111700 Oct 03 15:26:48.708956 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3389/6952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:26:48.800539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:48.801206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:48.807823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:48.808584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:48.809093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:48.809825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:48.810293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:48.810917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:48.949277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:48.957254 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e46798eb-e9df-40ed-92f2-11dc05c9ece5 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1515 microversion: 2.1 time: 0.161160 Oct 03 15:26:48.957845 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3564/6953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:48 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:49.983866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:49.984584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:49.991539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:49.992038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:49.992488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:49.993248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:49.993693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:49.994141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:50.132887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:50.141779 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd74177b-7aef-4ac9-a0a1-16868d8ba1f0 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1513 microversion: 2.1 time: 0.163930 Oct 03 15:26:50.142526 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3390/6954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:49 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:50.724015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2edc87ef-6a78-4f21-9878-36ae3deac295 req-8c172d55-a539-4c95-b658-76b2a8e1a7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8398cc7-2e19-409e-8887-a2e54a573335", "tag": "3422be90-069e-44e2-ae75-0d0d4376f4b8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:50.736683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2edc87ef-6a78-4f21-9878-36ae3deac295 req-8c172d55-a539-4c95-b658-76b2a8e1a7d6 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:50.737182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2edc87ef-6a78-4f21-9878-36ae3deac295 req-8c172d55-a539-4c95-b658-76b2a8e1a7d6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:50.737660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2edc87ef-6a78-4f21-9878-36ae3deac295 req-8c172d55-a539-4c95-b658-76b2a8e1a7d6 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:50.750307 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2edc87ef-6a78-4f21-9878-36ae3deac295 req-8c172d55-a539-4c95-b658-76b2a8e1a7d6 service nova] Creating event network-changed:3422be90-069e-44e2-ae75-0d0d4376f4b8 for instance f8398cc7-2e19-409e-8887-a2e54a573335 on n-h1-781139-2 Oct 03 15:26:50.756192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-2edc87ef-6a78-4f21-9878-36ae3deac295 req-8c172d55-a539-4c95-b658-76b2a8e1a7d6 service nova] Instance f8398cc7-2e19-409e-8887-a2e54a573335 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:26:50.767619 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2edc87ef-6a78-4f21-9878-36ae3deac295 req-8c172d55-a539-4c95-b658-76b2a8e1a7d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047513 Oct 03 15:26:50.768232 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3565/6955] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:26:51.165968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:51.166605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:51.173935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:51.174425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:51.174858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:51.175556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:51.175994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:51.176425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:51.311965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:51.320527 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2838376-5a53-415e-97b0-8a64e00c9744 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1513 microversion: 2.1 time: 0.158553 Oct 03 15:26:51.321150 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3391/6956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:51 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:52.345108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:52.346070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:52.353917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:52.354417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:52.354870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:52.355589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:52.356091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:52.356534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:52.496590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:52.507420 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2bf40ae-ddd5-4889-b52b-2bd6f981b742 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1513 microversion: 2.1 time: 0.167275 Oct 03 15:26:52.508023 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3566/6957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:52 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:53.535829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:53.536784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:53.548808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:53.549334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:53.549775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:53.550476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:53.550927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:53.551435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:53.696599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:53.704949 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f66ea566-19d5-4ae8-acbe-a053a1f0a3d6 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1510 microversion: 2.1 time: 0.176743 Oct 03 15:26:53.705545 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3392/6958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:53 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:53.727862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:53.728395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:53.735854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:53.736358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:53.736807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:53.737551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:53.738021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:53.738457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:53.767592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:26:53.824108 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Found an unconfirmed migration during delete, id: 16, status: finished Oct 03 15:26:55.252667 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ae7dae9-1474-4dd1-a28e-db8e287f6366 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 204 len: 0 microversion: 2.1 time: 1.528306 Oct 03 15:26:55.253382 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3567/6959] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:26:53 2022] DELETE /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 0 bytes in 1530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:26:55.261848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:55.262467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:55.269751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:55.270244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:55.270687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:55.271390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:55.271843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:55.272272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:55.410960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:55.419273 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-284a59dc-7506-403a-8420-e06d6cac1198 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1502 microversion: 2.1 time: 0.161385 Oct 03 15:26:55.419876 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3393/6960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:55 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:56.378905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-673649b7-830a-42b8-95c7-c57bdd84e129 req-decd36b6-87f0-4d67-9eeb-826696b68648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8398cc7-2e19-409e-8887-a2e54a573335", "name": "network-vif-plugged", "status": "completed", "tag": "3422be90-069e-44e2-ae75-0d0d4376f4b8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:56.389905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-673649b7-830a-42b8-95c7-c57bdd84e129 req-decd36b6-87f0-4d67-9eeb-826696b68648 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:56.390400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-673649b7-830a-42b8-95c7-c57bdd84e129 req-decd36b6-87f0-4d67-9eeb-826696b68648 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:56.390841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-673649b7-830a-42b8-95c7-c57bdd84e129 req-decd36b6-87f0-4d67-9eeb-826696b68648 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:56.402399 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-673649b7-830a-42b8-95c7-c57bdd84e129 req-decd36b6-87f0-4d67-9eeb-826696b68648 service nova] Creating event network-vif-plugged:3422be90-069e-44e2-ae75-0d0d4376f4b8 for instance f8398cc7-2e19-409e-8887-a2e54a573335 on n-h1-781139-2 Oct 03 15:26:56.407353 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-673649b7-830a-42b8-95c7-c57bdd84e129 req-decd36b6-87f0-4d67-9eeb-826696b68648 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032994 Oct 03 15:26:56.407957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3568/6961] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:26:56.444036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:56.444656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:56.451641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:56.452133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:56.452569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:56.453294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:56.453750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:56.454177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:56.597433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:56.605399 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-84889e23-169e-47a1-8855-f85f0b64cba8 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1502 microversion: 2.1 time: 0.165733 Oct 03 15:26:56.606037 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3394/6962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:56 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:57.310803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-47d63f17-9a6c-4dc2-8e0e-29e06b002155 req-b49d81dc-a1af-410e-8e31-489fa1e7e920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8398cc7-2e19-409e-8887-a2e54a573335", "name": "network-vif-deleted", "tag": "3422be90-069e-44e2-ae75-0d0d4376f4b8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:26:57.322506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-47d63f17-9a6c-4dc2-8e0e-29e06b002155 req-b49d81dc-a1af-410e-8e31-489fa1e7e920 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:57.323291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-47d63f17-9a6c-4dc2-8e0e-29e06b002155 req-b49d81dc-a1af-410e-8e31-489fa1e7e920 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:57.323817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-47d63f17-9a6c-4dc2-8e0e-29e06b002155 req-b49d81dc-a1af-410e-8e31-489fa1e7e920 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:57.335998 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-47d63f17-9a6c-4dc2-8e0e-29e06b002155 req-b49d81dc-a1af-410e-8e31-489fa1e7e920 service nova] Creating event network-vif-deleted:3422be90-069e-44e2-ae75-0d0d4376f4b8 for instance f8398cc7-2e19-409e-8887-a2e54a573335 on n-h1-781139-2 Oct 03 15:26:57.341076 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-47d63f17-9a6c-4dc2-8e0e-29e06b002155 req-b49d81dc-a1af-410e-8e31-489fa1e7e920 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Oct 03 15:26:57.341692 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3569/6963] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:26:57.631582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:57.632979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:57.640435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:57.640910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:57.641547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:57.642303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:57.642802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:57.643178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:57.677566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:57.678051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:57.678489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:57.678945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lazy-loading 'fault' on Instance uuid f8398cc7-2e19-409e-8887-a2e54a573335 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:26:57.723668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf235ab52b534ffdb5230a8a9eea1362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cec6f98c61478892effe3e311b0c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:26:57.731190 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eed86d68-76c3-46cd-ad2d-4c54dc1713fe tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 200 len: 1305 microversion: 2.1 time: 0.104153 Oct 03 15:26:57.732071 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3395/6964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:57 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:26:58.760547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:58.761456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:58.771759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:58.772740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:58.773501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:58.774644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:58.775379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:58.776031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:58.793272 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] HTTP exception thrown: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Request method failure captured: Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 HTTP/1.1 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv8PwUk8j9KnWi9CLkGx_Y1sbGGrNX9qwQZvTutRb4BVyd2DywQwC1Jvo4fSVPpglQ7pRhJiIWDKA0aQnfDTsQOSwHMmykb9yCXBa12nR097HjkfOjQEu2KTyjH9S-_Z1xo-VoRCBbzQy5vVwDEOSrVs7jZxGON7GBJnVGdVByzcnz8 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 14cec6f98c61478892effe3e311b0c1f Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14cec6f98c61478892effe3e311b0c1f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 14cec6f98c61478892effe3e311b0c1f Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-1341216762-project Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: bf235ab52b534ffdb5230a8a9eea1362 Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-1341216762-project Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f8398cc7-2e19-409e-8887-a2e54a573335'} Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:58.794935 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Returning 404 to user: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:26:58.799453 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f04a965-9e0c-497f-8fb1-c64b5a4ce063 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 404 len: 111 microversion: 2.1 time: 0.042892 Oct 03 15:26:58.800442 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3570/6965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:58 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:26:58.812003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:58.812494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:58.822321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:58.822940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:58.823529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:58.824605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:58.825275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:58.825872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:58.845879 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] HTTP exception thrown: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Request method failure captured: Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 HTTP/1.1 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv8PwUk8j9KnWi9CLkGx_Y1sbGGrNX9qwQZvTutRb4BVyd2DywQwC1Jvo4fSVPpglQ7pRhJiIWDKA0aQnfDTsQOSwHMmykb9yCXBa12nR097HjkfOjQEu2KTyjH9S-_Z1xo-VoRCBbzQy5vVwDEOSrVs7jZxGON7GBJnVGdVByzcnz8 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 14cec6f98c61478892effe3e311b0c1f Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14cec6f98c61478892effe3e311b0c1f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 14cec6f98c61478892effe3e311b0c1f Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-DeleteServersTestJSON-1341216762-project Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: bf235ab52b534ffdb5230a8a9eea1362 Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-DeleteServersTestJSON-1341216762-project Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'f8398cc7-2e19-409e-8887-a2e54a573335'} Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:26:58.847812 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Returning 404 to user: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-576189f4-5b9e-4197-8e8e-cbe2a755f568 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 404 len: 111 microversion: 2.1 time: 0.041260 Oct 03 15:26:58.851966 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3396/6966] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:26:58 2022] DELETE /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:26:58.857929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:26:58.858555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] [instance: f8398cc7-2e19-409e-8887-a2e54a573335] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:26:58.865050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:58.865554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:58.866004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:58.866706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:26:58.867139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:26:58.867572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:26:58.881546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] HTTP exception thrown: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Request method failure captured: Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 HTTP/1.1 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv8PwUk8j9KnWi9CLkGx_Y1sbGGrNX9qwQZvTutRb4BVyd2DywQwC1Jvo4fSVPpglQ7pRhJiIWDKA0aQnfDTsQOSwHMmykb9yCXBa12nR097HjkfOjQEu2KTyjH9S-_Z1xo-VoRCBbzQy5vVwDEOSrVs7jZxGON7GBJnVGdVByzcnz8 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 14cec6f98c61478892effe3e311b0c1f Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14cec6f98c61478892effe3e311b0c1f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14cec6f98c61478892effe3e311b0c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 14cec6f98c61478892effe3e311b0c1f Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1341216762 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-DeleteServersTestJSON-1341216762-project Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: bf235ab52b534ffdb5230a8a9eea1362 Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-DeleteServersTestJSON-1341216762-project Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f8398cc7-2e19-409e-8887-a2e54a573335'} Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:26:58.883104 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] Returning 404 to user: Instance f8398cc7-2e19-409e-8887-a2e54a573335 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-97a801b5-cdb7-4343-95c3-2add44d2e308 tempest-DeleteServersTestJSON-1341216762 tempest-DeleteServersTestJSON-1341216762-project] 10.222.0.20 "GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335" status: 404 len: 111 microversion: 2.1 time: 0.030536 Oct 03 15:26:58.887244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3571/6967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:26:58 2022] GET /compute/v2.1/servers/f8398cc7-2e19-409e-8887-a2e54a573335 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:27:07.577323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-602741285", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "7ddd9a9c-5ff9-48b7-9427-4bde36c9c82c"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:07.634696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] validate_networks() for [('7ddd9a9c-5ff9-48b7-9427-4bde36c9c82c', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:27:08.007153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:27:08.007573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:27:08.008075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:27:08.008478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:27:08.008917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:27:08.019061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:08.019542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:08.020078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:08.020844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:08.021355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:08.021788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:08.039069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Getting quotas for project 4b73acf783bf40d89689f86ab6b5fb92. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:27:08.044572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Getting quotas for user 7596f2228e0d4d778d095af51ce7ea8d and project 4b73acf783bf40d89689f86ab6b5fb92. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:27:08.058991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:27:08.061300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:27:08.111076 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7b7ccd55-6f5e-401a-90a8-86e68164a437 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663275 Oct 03 15:27:08.111756 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3397/6968] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:27:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:27:08.123241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a573d936-b965-43b7-aff3-49720bba608b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:08.123905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a573d936-b965-43b7-aff3-49720bba608b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:08.180323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a573d936-b965-43b7-aff3-49720bba608b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:08.187826 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a573d936-b965-43b7-aff3-49720bba608b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1217 microversion: 2.1 time: 0.068499 Oct 03 15:27:08.191783 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3572/6969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:08 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:09.212513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:09.213367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:09.221981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:09.222891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:09.223350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:09.224204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:09.225017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:09.225450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:09.311235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:09.320440 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe746608-3700-4fee-9dd5-e8f1bd143a25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1277 microversion: 2.1 time: 0.113032 Oct 03 15:27:09.321842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3398/6970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:09 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:10.344478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:10.345754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:10.348508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:10.355734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:10.356222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:10.356711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:10.357469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:10.357939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:10.358380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:10.507512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:10.516697 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2894988-a747-4b70-b4f2-ff9fb0b4f4cc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1317 microversion: 2.1 time: 0.176599 Oct 03 15:27:10.517424 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3573/6971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:10 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:10.847436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f07eab0b-f296-4ecc-a5b2-7ca9a5417ed2 req-527b6812-fd97-4e99-920a-c786dfb04476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6998f66a-d0ff-4b17-87a4-a0d52473c686", "tag": "3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:10.859985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f07eab0b-f296-4ecc-a5b2-7ca9a5417ed2 req-527b6812-fd97-4e99-920a-c786dfb04476 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:10.860758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f07eab0b-f296-4ecc-a5b2-7ca9a5417ed2 req-527b6812-fd97-4e99-920a-c786dfb04476 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:10.861220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f07eab0b-f296-4ecc-a5b2-7ca9a5417ed2 req-527b6812-fd97-4e99-920a-c786dfb04476 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:10.883147 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f07eab0b-f296-4ecc-a5b2-7ca9a5417ed2 req-527b6812-fd97-4e99-920a-c786dfb04476 service nova] Creating event network-changed:3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd for instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 on n-h1-781139-2 Oct 03 15:27:10.889361 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f07eab0b-f296-4ecc-a5b2-7ca9a5417ed2 req-527b6812-fd97-4e99-920a-c786dfb04476 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046617 Oct 03 15:27:10.890536 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3399/6972] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:27:11.547480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:11.548347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:11.558256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:11.558928 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:11.559554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:11.560502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:11.561172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:11.561751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:11.712821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:11.724016 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17715285-3fbd-43cf-bc39-4e444768c660 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1317 microversion: 2.1 time: 0.181823 Oct 03 15:27:11.724603 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3574/6973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:11 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:12.749004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:12.750325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:12.756918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:12.757445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:12.757897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:12.758607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:12.759060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:12.759488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:12.895317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:12.903603 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9dac733e-34fb-4bd6-8cc5-8ccc1ec9a998 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1317 microversion: 2.1 time: 0.159925 Oct 03 15:27:12.904196 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3400/6974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:12 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:13.927750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:13.928397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:13.935610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:13.936120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:13.936577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:13.937330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:13.937802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:13.938220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:14.072603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:14.080580 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae6f6cc2-6754-489d-bfbb-3ff1fd8c2750 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1317 microversion: 2.1 time: 0.156996 Oct 03 15:27:14.081175 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3575/6975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:13 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:15.104834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:15.105397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:15.108194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:15.114066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:15.114543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:15.114976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:15.115665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:15.116110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:15.116525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:15.120954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=72 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:15.251268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:15.259271 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce769928-0c17-41e6-81fa-f112b7c651a9 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1317 microversion: 2.1 time: 0.158579 Oct 03 15:27:15.259857 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3401/6976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:15 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:16.286671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:16.287592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:16.291904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:16.301218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:16.301972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:16.302427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:16.303241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:16.303613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:16.304060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:16.440330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:16.448671 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bcc8c62c-b182-4310-83e9-8699ff41166c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1317 microversion: 2.1 time: 0.168788 Oct 03 15:27:16.449739 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3576/6977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:16 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:16.470125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b375eb09-2a15-4807-89c7-8626dabe5e42 req-0528ce44-5c10-46d3-b550-b4f40bb3289e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6998f66a-d0ff-4b17-87a4-a0d52473c686", "name": "network-vif-plugged", "status": "completed", "tag": "3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:16.481151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b375eb09-2a15-4807-89c7-8626dabe5e42 req-0528ce44-5c10-46d3-b550-b4f40bb3289e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:16.481633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b375eb09-2a15-4807-89c7-8626dabe5e42 req-0528ce44-5c10-46d3-b550-b4f40bb3289e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:16.482062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b375eb09-2a15-4807-89c7-8626dabe5e42 req-0528ce44-5c10-46d3-b550-b4f40bb3289e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:16.496169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b375eb09-2a15-4807-89c7-8626dabe5e42 req-0528ce44-5c10-46d3-b550-b4f40bb3289e service nova] Creating event network-vif-plugged:3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd for instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 on n-h1-781139-2 Oct 03 15:27:16.501221 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b375eb09-2a15-4807-89c7-8626dabe5e42 req-0528ce44-5c10-46d3-b550-b4f40bb3289e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035293 Oct 03 15:27:16.502129 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3402/6978] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:27:17.473311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:17.473973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:17.481249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:17.481743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:17.482196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:17.482902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:17.483363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:17.483794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:17.627523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:17.636331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d10529ec-f565-4fb6-adf4-456b9f680ad0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1317 microversion: 2.1 time: 0.167131 Oct 03 15:27:17.636943 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3577/6979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:17 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:18.659793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:18.660856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:18.666705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:18.667696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:18.677485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:18.677965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:18.678400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:18.679083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:18.679529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:18.679948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:18.823927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:18.832169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f662c37-02a5-48f2-b4a1-2ca78faa9b06 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1506 microversion: 2.1 time: 0.175072 Oct 03 15:27:18.832731 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3403/6980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:18 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:18.855259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:18.855900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:18.857903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:18.865091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:18.865224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:18.865771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:18.866587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:18.867097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:18.867536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:18.999815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:19.008371 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4d129c9a-bb02-449e-a131-19dac2ada59e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1506 microversion: 2.1 time: 0.157225 Oct 03 15:27:19.008975 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3578/6981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:18 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:19.030789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:19.033308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:19.039911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.040410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.040855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.041585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.042044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.042470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.108401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4bf3c8b6-350b-4529-9fac-70f2b632d534 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "PUT /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1078 microversion: 2.1 time: 0.081583 Oct 03 15:27:19.109062 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3404/6982] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 3 15:27:19 2022] PUT /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1078 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:19.130366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:19.130995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:19.137496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.137994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.138447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.139153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.139615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.140050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.278365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:19.290141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c0abd39-2c08-4cb2-9672-03484eeffaec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1504 microversion: 2.1 time: 0.165952 Oct 03 15:27:19.290836 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3579/6983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:19 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:19.316556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:19.317237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:19.323828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.324320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.324759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.325502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.325953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.326382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.461448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:19.469993 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-814139d9-e88b-4b98-b0ca-aa665577b44c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1504 microversion: 2.1 time: 0.157472 Oct 03 15:27:19.470591 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3405/6984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:19 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:19.492248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:19.494766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:19.501016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.501516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.501963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.502657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.503116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.503546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.532965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:19.539239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:27:19.546036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:27:19.546404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:27:19.546890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:27:19.547315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:27:19.547740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:27:19.622080 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d71c4ce8-f8a0-479e-a9ce-ea7eef1b8076 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "POST /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686/action" status: 202 len: 0 microversion: 2.1 time: 0.133905 Oct 03 15:27:19.622927 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3580/6985] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:27:19 2022] POST /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:27:19.631471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:19.632489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:19.639539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.640027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.640466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.641218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:19.641675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:19.642156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:19.774652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:19.783037 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-58543b53-17fc-4b88-9185-1cb9d795afb4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1515 microversion: 2.1 time: 0.155705 Oct 03 15:27:19.783912 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3406/6986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:19 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:20.809621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:20.810244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:20.818896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:20.819430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:20.819965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:20.820775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:20.821276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:20.821703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:20.964145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:20.972734 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d833cbb8-762b-496a-8c96-2708f6ba65d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1515 microversion: 2.1 time: 0.167193 Oct 03 15:27:20.973396 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3581/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:20 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:22.000130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:22.001192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:22.010172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:22.010662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:22.011112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:22.012003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:22.012250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:22.012678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:22.148180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:22.156629 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b8551823-a6d6-4f3b-88d5-541ca94d7d13 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.163183 Oct 03 15:27:22.157245 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3407/6988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:21 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:23.184915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:23.185978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:23.197547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:23.198373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:23.199112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:23.200274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:23.201093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:23.201823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:23.344447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:23.352906 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8c56716-6dad-4965-abe2-c769753a66f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.174732 Oct 03 15:27:23.353524 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3582/6989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:23 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:24.380639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:24.381320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:24.388622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:24.389148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:24.389591 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:24.390290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:24.390744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:24.391175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:24.529877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:24.541797 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ab5d60be-93a6-42f0-b69f-94a37ff33485 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.167752 Oct 03 15:27:24.542483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3408/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:24 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:25.570385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:25.571028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:25.579056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:25.579754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:25.580328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:25.581275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:25.581874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:25.582432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:25.720382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:25.728613 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e23a644-2f2c-4a65-a9d8-7f141797eb4f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.164693 Oct 03 15:27:25.729203 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3583/6991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:25 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:26.756326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:26.758412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:26.770414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:26.771231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:26.771973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:26.773435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:26.773905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:26.774341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:26.918056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:26.930453 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c15730c-7f94-4bec-bfe6-a51202a40589 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.180748 Oct 03 15:27:26.931045 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3409/6992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:26 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:27.960466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:27.961554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:27.973718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:27.974537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:27.975383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:27.976100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:27.976560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:27.977014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:28.111878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:28.121069 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0023d79-f80b-4932-96dc-fa0e87ba6110 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.167388 Oct 03 15:27:28.121689 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3584/6993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:27 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:29.148131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:29.148755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:29.156283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:29.156779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:29.157241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:29.157942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:29.158401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:29.158824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:29.299587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:29.307871 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-93ec8b85-7635-40a8-8a46-a0ee2bbc522e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.166028 Oct 03 15:27:29.308433 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3410/6994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:29 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:30.332532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:30.333267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:30.340800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:30.341344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:30.341788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:30.342905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:30.343369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:30.343815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:30.477370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:30.485566 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6fe1850-c853-4ff3-93d6-c6a048afcae1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.158007 Oct 03 15:27:30.486136 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3585/6995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:30 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:31.509774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:31.510404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:31.517546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:31.518041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:31.518482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:31.519195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:31.519649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:31.520078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:31.657160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:31.665641 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2f2a394-fccb-445b-b163-2f6d71c9521c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.160674 Oct 03 15:27:31.666236 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3411/6996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:31 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:32.700587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:32.701378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:32.711064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:32.711557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:32.712011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:32.712719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:32.713210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:32.713658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:32.849217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:32.861167 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60c3499f-4c54-4b1c-be56-b80500834624 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.166209 Oct 03 15:27:32.862042 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3586/6997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:32 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:33.890326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:33.891107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:33.900817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:33.901496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:33.902736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:33.903728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:33.904332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:33.904917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:34.123634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:34.132348 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-03813b98-09be-48e7-856a-dad81a2f5ec1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.248585 Oct 03 15:27:34.132914 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3412/6998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:33 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:35.160169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:35.161232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:35.173094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:35.173953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:35.174714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:35.175879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:35.176682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:35.177473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:35.320829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:35.329655 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a129df03-8ef6-479e-b09a-a82bacd72ddf tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.176027 Oct 03 15:27:35.330229 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3587/6999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:35 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:36.358124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:36.359217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:36.370162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:36.370644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:36.371079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:36.371774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:36.372223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:36.372645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:36.529718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:36.541706 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-099c6ce3-276c-402a-8858-c1b313fcbb25 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.189718 Oct 03 15:27:36.542441 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3413/7000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:36 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:37.573563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:37.574236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:37.581607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:37.582125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:37.582575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:37.583295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:37.583760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:37.584206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:37.588412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:37.727642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:37.736254 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-feda4b08-780b-4a29-9e84-3ba709b89b4e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.168670 Oct 03 15:27:37.736829 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3588/7001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:37 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:38.764067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:38.765162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:38.776047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:38.776528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:38.777071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:38.777757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:38.778206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:38.778629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:38.913034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:38.921648 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9a85235-0146-47c8-bb6e-3352aa155259 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.164071 Oct 03 15:27:38.922252 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3414/7002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:38 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:39.948350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:39.949047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:39.956714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:39.957270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:39.957743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:39.958486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:39.958975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:39.959455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:40.427444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:40.439689 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e588f8ee-852d-4d82-9c94-2d1b6c5df433 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.497180 Oct 03 15:27:40.440676 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3589/7003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:39 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:41.465695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:41.466292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:41.474124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:41.474602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:41.475037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:41.475721 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:41.476164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:41.476583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:41.611010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:41.619383 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-493ef55b-351f-4508-8fba-2d5d989665f0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.157768 Oct 03 15:27:41.619966 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3415/7004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:41 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:42.642860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:42.643593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:42.651967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:42.652472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:42.653012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:42.653740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:42.654205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:42.654644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:42.800569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:42.809161 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c15feb9a-7d17-4b7c-8428-5c4bcbac5eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.170293 Oct 03 15:27:42.809786 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3590/7005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:42 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:43.837007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:43.837856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:43.845588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:43.846075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:43.846512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:43.847201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:43.847648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:43.848073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:43.981324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:43.992086 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c0797d57-31fe-426b-9cd0-80e3e0128be5 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.161626 Oct 03 15:27:43.992662 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3416/7006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:43 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:45.019977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:45.021143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:45.029844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:45.030339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:45.030785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:45.031493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:45.031954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:45.032388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:45.175415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:45.185242 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13cbe91a-dd90-43e8-a6e8-acb00e133331 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.171885 Oct 03 15:27:45.185790 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3591/7007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:45 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:46.222215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:46.223202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:46.227438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=32 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:46.233989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:46.234474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:46.234907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:46.235602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:46.236052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:46.236449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:46.239277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:46.384510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:46.393123 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-71870fc9-b050-4428-b859-6b20c99ea9d7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.178065 Oct 03 15:27:46.393710 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3417/7008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:46 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:47.420195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:47.421275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:47.425657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:27:47.433464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:47.433963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:47.434410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:47.435156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:47.435601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:47.436042 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:47.566598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:47.575131 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bf8531a-51a5-4ee8-af85-39edf2be3122 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1520 microversion: 2.1 time: 0.161731 Oct 03 15:27:47.575744 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3592/7009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:47 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:48.598837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:48.599450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:48.606815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:48.607298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:48.607743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:48.608538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:48.609052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:48.609469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:48.742520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:48.750874 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-814db804-09c4-4f1e-880b-b4fe792acf47 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1519 microversion: 2.1 time: 0.156053 Oct 03 15:27:48.751470 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3418/7010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:48 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:49.088393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a99a2197-f8bf-4e4a-bc27-468c99906a35 req-7f98e7ba-d8be-405f-9cd6-42e924dad394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6998f66a-d0ff-4b17-87a4-a0d52473c686", "name": "network-vif-unplugged", "status": "completed", "tag": "3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:49.098641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a99a2197-f8bf-4e4a-bc27-468c99906a35 req-7f98e7ba-d8be-405f-9cd6-42e924dad394 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:49.099122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a99a2197-f8bf-4e4a-bc27-468c99906a35 req-7f98e7ba-d8be-405f-9cd6-42e924dad394 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:49.099558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a99a2197-f8bf-4e4a-bc27-468c99906a35 req-7f98e7ba-d8be-405f-9cd6-42e924dad394 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:49.112014 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a99a2197-f8bf-4e4a-bc27-468c99906a35 req-7f98e7ba-d8be-405f-9cd6-42e924dad394 service nova] Creating event network-vif-unplugged:3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd for instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 on n-h2-781139-2 Oct 03 15:27:49.117963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-a99a2197-f8bf-4e4a-bc27-468c99906a35 req-7f98e7ba-d8be-405f-9cd6-42e924dad394 service nova] Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:27:49.129592 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a99a2197-f8bf-4e4a-bc27-468c99906a35 req-7f98e7ba-d8be-405f-9cd6-42e924dad394 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044899 Oct 03 15:27:49.130176 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3593/7011] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:27:49.775615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:49.777496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:49.785892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:49.786672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:49.787452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:49.788170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:49.788630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:49.789073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:49.934535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:49.951963 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90fa10ef-f5fe-4b8b-bda5-a9164608a140 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1519 microversion: 2.1 time: 0.180560 Oct 03 15:27:49.968140 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3419/7012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:49 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:50.990941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:50.991658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:50.999051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:50.999530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:51.000010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:51.000746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:51.001909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:51.002366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:51.157628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d10f8aaa-f9ce-4e55-a084-e3f228cb87a5 req-ea8e81a2-09aa-483f-b49d-2e788f0585de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6998f66a-d0ff-4b17-87a4-a0d52473c686", "tag": "3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:51.162561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:51.168584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d10f8aaa-f9ce-4e55-a084-e3f228cb87a5 req-ea8e81a2-09aa-483f-b49d-2e788f0585de service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:51.169072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d10f8aaa-f9ce-4e55-a084-e3f228cb87a5 req-ea8e81a2-09aa-483f-b49d-2e788f0585de service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:51.169526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d10f8aaa-f9ce-4e55-a084-e3f228cb87a5 req-ea8e81a2-09aa-483f-b49d-2e788f0585de service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:51.171830 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13a4d6a1-19fc-423d-978c-e97bc36e4c48 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1517 microversion: 2.1 time: 0.186455 Oct 03 15:27:51.172430 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3594/7013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:50 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:51.181645 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d10f8aaa-f9ce-4e55-a084-e3f228cb87a5 req-ea8e81a2-09aa-483f-b49d-2e788f0585de service nova] Creating event network-changed:3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd for instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 on n-h2-781139-2 Oct 03 15:27:51.187480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-d10f8aaa-f9ce-4e55-a084-e3f228cb87a5 req-ea8e81a2-09aa-483f-b49d-2e788f0585de service nova] Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:27:51.198825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d10f8aaa-f9ce-4e55-a084-e3f228cb87a5 req-ea8e81a2-09aa-483f-b49d-2e788f0585de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044743 Oct 03 15:27:51.199527 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3420/7014] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:27:52.200112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:52.200757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:52.209243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:52.209850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:52.210456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:52.211296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:52.211845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:52.212396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:52.364755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:52.373222 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c34bf9f1-b9fb-4a70-8970-4fbf62b76567 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1514 microversion: 2.1 time: 0.179649 Oct 03 15:27:52.373828 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3595/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:52 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:52.397325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:52.397920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:52.404478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:52.404962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:52.405424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:52.406116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:52.406573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:52.406999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:52.474276 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8190b06b-4311-4f67-9d86-8bf7f5e18b4c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "POST /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686/action" status: 204 len: 0 microversion: 2.1 time: 0.082095 Oct 03 15:27:52.474960 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3421/7016] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:27:52 2022] POST /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:27:52.483982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:52.484608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:52.491092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:52.491650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:52.492167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:52.492980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:52.493549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:52.494064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:52.639478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:52.652451 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fd6a220-663f-4361-81ef-937d98a6b629 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1514 microversion: 2.1 time: 0.172283 Oct 03 15:27:52.653081 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3596/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:52 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:53.676621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:53.677368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:53.683763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:53.684226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:53.684671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:53.685405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:53.685861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:53.686293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:53.828428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:53.836291 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7280364a-d11e-474d-a878-0b2b26ff99e6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1514 microversion: 2.1 time: 0.164879 Oct 03 15:27:53.836864 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3422/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:53 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:54.860803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:54.861529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:54.869973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:54.870563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:54.871046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:54.871900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:54.872393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:54.872827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:55.015899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:55.024215 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-adc12701-7352-4147-b536-463e590b3cff tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1506 microversion: 2.1 time: 0.167920 Oct 03 15:27:55.024779 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3597/7019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:54 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:55.046964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:55.047578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:55.054664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:55.055155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:55.055601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:55.056338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:55.056792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:55.057240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:55.207539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:55.216247 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f0773fbc-e4e0-4562-aa14-9bf8d13838a8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1506 microversion: 2.1 time: 0.173213 Oct 03 15:27:55.216835 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3423/7020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:55 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:55.247139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7036cd61-2011-4249-8f01-8ef096594588 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'create', calling method: .version_select at 0x7fb2302035e0>, body: {"keypair": {"name": "tempest-keypair-820769384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbAqLuIK+0EVB3E0JQPZRa/Tee5ovdvGZjcMoTa7lEXlRcbhTZZ9Eo7ew1WD3aeO7wn8NQaipx4fx0h4glyLP8pZTh6YyX7A4r6OQzTvI8ckbJni+K3wu0zMESVAOYPvQ=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:55.264135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7036cd61-2011-4249-8f01-8ef096594588 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Getting quotas for project 4b73acf783bf40d89689f86ab6b5fb92. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:27:55.269914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-7036cd61-2011-4249-8f01-8ef096594588 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Getting quotas for user 7596f2228e0d4d778d095af51ce7ea8d and project 4b73acf783bf40d89689f86ab6b5fb92. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:27:55.304497 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7036cd61-2011-4249-8f01-8ef096594588 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061266 Oct 03 15:27:55.305196 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3598/7021] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:27:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:27:55.717875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-423cd73c-389d-4e04-b778-0eb590ce7357 req-f967f77c-8577-433c-94ae-28906188406d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6998f66a-d0ff-4b17-87a4-a0d52473c686", "name": "network-vif-plugged", "status": "completed", "tag": "3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:55.727060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-423cd73c-389d-4e04-b778-0eb590ce7357 req-f967f77c-8577-433c-94ae-28906188406d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:55.727805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-423cd73c-389d-4e04-b778-0eb590ce7357 req-f967f77c-8577-433c-94ae-28906188406d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:55.728892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-423cd73c-389d-4e04-b778-0eb590ce7357 req-f967f77c-8577-433c-94ae-28906188406d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:55.741680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-423cd73c-389d-4e04-b778-0eb590ce7357 req-f967f77c-8577-433c-94ae-28906188406d service nova] Creating event network-vif-plugged:3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd for instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 on n-h2-781139-2 Oct 03 15:27:55.746970 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-423cd73c-389d-4e04-b778-0eb590ce7357 req-f967f77c-8577-433c-94ae-28906188406d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038165 Oct 03 15:27:55.747832 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3424/7022] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:27:56.522495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:56.523149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:56.530030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:56.530523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:56.530965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:56.531668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:56.532125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:56.532561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:56.666774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:56.675368 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4115c48d-4ca1-43e0-bbaf-6ff4069fb949 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 200 len: 1506 microversion: 2.1 time: 0.157829 Oct 03 15:27:56.675952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3599/7023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:56 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:56.699898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:56.700437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:56.707363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:56.707850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:56.708287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:56.709006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:56.709464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:56.709888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:56.735589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:27:56.816450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f12fbe47-2d10-4299-bc2c-5144c379210a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 204 len: 0 microversion: 2.1 time: 0.121325 Oct 03 15:27:56.817123 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3425/7024] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:27:56 2022] DELETE /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:27:56.880296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1086745354", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "7ddd9a9c-5ff9-48b7-9427-4bde36c9c82c"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:56.939829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] validate_networks() for [('7ddd9a9c-5ff9-48b7-9427-4bde36c9c82c', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:27:57.362402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:27:57.362836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:27:57.363319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:27:57.363737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:27:57.364157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:27:57.374056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:57.374574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:57.374988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:57.375706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:57.376164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:57.376600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:57.394006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Getting quotas for project 4b73acf783bf40d89689f86ab6b5fb92. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:27:57.399686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Getting quotas for user 7596f2228e0d4d778d095af51ce7ea8d and project 4b73acf783bf40d89689f86ab6b5fb92. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:27:57.412672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:27:57.415051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:27:57.460951 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8913414-af71-44a7-a8f4-c29922d74474 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586944 Oct 03 15:27:57.461630 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3600/7025] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:27:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:27:57.474285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec11d96b-2f49-4275-bb1e-dbe2d4b0ba6e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:57.475000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ec11d96b-2f49-4275-bb1e-dbe2d4b0ba6e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:57.533853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ec11d96b-2f49-4275-bb1e-dbe2d4b0ba6e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:57.540949 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec11d96b-2f49-4275-bb1e-dbe2d4b0ba6e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1218 microversion: 2.1 time: 0.071373 Oct 03 15:27:57.541758 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3426/7026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:57 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:58.565816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:58.567030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:58.574874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:58.575676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:58.576124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:58.576960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:58.577456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:58.578532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:58.610443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-98ab814f-5680-4cb5-8700-68b67bd0c6dd req-7e1b706d-c3c4-4097-aae0-de4986b34ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6998f66a-d0ff-4b17-87a4-a0d52473c686", "name": "network-vif-deleted", "tag": "3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:27:58.638727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-98ab814f-5680-4cb5-8700-68b67bd0c6dd req-7e1b706d-c3c4-4097-aae0-de4986b34ea7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:58.639225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-98ab814f-5680-4cb5-8700-68b67bd0c6dd req-7e1b706d-c3c4-4097-aae0-de4986b34ea7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:58.642109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-98ab814f-5680-4cb5-8700-68b67bd0c6dd req-7e1b706d-c3c4-4097-aae0-de4986b34ea7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:58.655169 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-98ab814f-5680-4cb5-8700-68b67bd0c6dd req-7e1b706d-c3c4-4097-aae0-de4986b34ea7 service nova] Creating event network-vif-deleted:3b4f6cbd-76f3-4ec7-b61e-a49f6ddac6dd for instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 on n-h2-781139-2 Oct 03 15:27:58.660461 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-98ab814f-5680-4cb5-8700-68b67bd0c6dd req-7e1b706d-c3c4-4097-aae0-de4986b34ea7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054030 Oct 03 15:27:58.661427 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3427/7027] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:27:58.725382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:58.737354 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9f7995e6-f774-49aa-afbe-41a3d5600c49 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1270 microversion: 2.1 time: 0.176724 Oct 03 15:27:58.737952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3601/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:58 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:27:59.763564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:27:59.764357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:27:59.771610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:59.772084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:59.772521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:59.773263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:27:59.773719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:27:59.774148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:27:59.922588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:27:59.930946 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4d7baad8-8a07-4e5f-baef-9a9f3eeee7d6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1318 microversion: 2.1 time: 0.173284 Oct 03 15:27:59.931540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3428/7029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:27:59 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:00.710118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-ba18ceaa-8298-4371-97fc-ce8e83c0e730 req-256eef1a-9731-4be9-87f2-0fa7f1a18530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac7746d-5490-401c-a13c-b84431a90e54", "tag": "75d0acf4-d09e-49aa-97a0-7ae1ff21850d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:00.722153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ba18ceaa-8298-4371-97fc-ce8e83c0e730 req-256eef1a-9731-4be9-87f2-0fa7f1a18530 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:00.722641 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ba18ceaa-8298-4371-97fc-ce8e83c0e730 req-256eef1a-9731-4be9-87f2-0fa7f1a18530 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:00.723080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-ba18ceaa-8298-4371-97fc-ce8e83c0e730 req-256eef1a-9731-4be9-87f2-0fa7f1a18530 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:00.734882 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-ba18ceaa-8298-4371-97fc-ce8e83c0e730 req-256eef1a-9731-4be9-87f2-0fa7f1a18530 service nova] Creating event network-changed:75d0acf4-d09e-49aa-97a0-7ae1ff21850d for instance 4ac7746d-5490-401c-a13c-b84431a90e54 on n-h2-781139-2 Oct 03 15:28:00.740133 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-ba18ceaa-8298-4371-97fc-ce8e83c0e730 req-256eef1a-9731-4be9-87f2-0fa7f1a18530 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035986 Oct 03 15:28:00.740744 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3602/7030] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:28:00.958988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:00.959798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:00.969452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:00.969937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:00.970393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:00.971067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:00.971516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:00.971937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:01.106243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:01.114690 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56199a5f-eef9-4110-977f-8826d5785c4b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1318 microversion: 2.1 time: 0.162455 Oct 03 15:28:01.115277 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3429/7031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:00 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:02.152944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:02.153662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:02.160787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:02.161316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:02.161745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:02.162478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:02.162941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:02.163375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:02.302869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:02.311091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bbe4d7ce-628b-452a-90a1-bf8739982b1c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1318 microversion: 2.1 time: 0.166373 Oct 03 15:28:02.311661 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3603/7032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:02 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:03.338795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:03.340186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:03.352727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:03.353631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:03.354412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:03.355450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:03.355894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:03.356318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:03.495891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:03.504372 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0316ce60-0a64-4014-99e6-b63cede498bb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1318 microversion: 2.1 time: 0.172312 Oct 03 15:28:03.504972 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3430/7033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:03 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:04.528418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:04.529112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:04.536661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:04.537223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:04.537676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:04.538405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:04.538865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:04.539301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:04.672479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:04.685570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c12c7487-7f27-4553-b8d6-9d3cd1af6971 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1318 microversion: 2.1 time: 0.161262 Oct 03 15:28:04.686156 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3604/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:04 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:05.708616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:05.709289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:05.716601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:05.717702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:05.718232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:05.719007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:05.719423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:05.719856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:05.772107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-085af5c0-01ee-40d7-a12a-db5f078f0ee8 req-244468bc-b01d-412c-9ef4-50257b75fdce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac7746d-5490-401c-a13c-b84431a90e54", "name": "network-vif-plugged", "status": "completed", "tag": "75d0acf4-d09e-49aa-97a0-7ae1ff21850d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:05.783977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-085af5c0-01ee-40d7-a12a-db5f078f0ee8 req-244468bc-b01d-412c-9ef4-50257b75fdce service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:05.784503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-085af5c0-01ee-40d7-a12a-db5f078f0ee8 req-244468bc-b01d-412c-9ef4-50257b75fdce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:05.784976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-085af5c0-01ee-40d7-a12a-db5f078f0ee8 req-244468bc-b01d-412c-9ef4-50257b75fdce service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:05.796974 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-085af5c0-01ee-40d7-a12a-db5f078f0ee8 req-244468bc-b01d-412c-9ef4-50257b75fdce service nova] Creating event network-vif-plugged:75d0acf4-d09e-49aa-97a0-7ae1ff21850d for instance 4ac7746d-5490-401c-a13c-b84431a90e54 on n-h2-781139-2 Oct 03 15:28:05.802215 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-085af5c0-01ee-40d7-a12a-db5f078f0ee8 req-244468bc-b01d-412c-9ef4-50257b75fdce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034334 Oct 03 15:28:05.805160 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3605/7035] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:28:05.858856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:05.867052 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1fdc171f-5bfc-423f-bced-d3660193abc2 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1318 microversion: 2.1 time: 0.162349 Oct 03 15:28:05.867667 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3431/7036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:05 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:06.891867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:06.892471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:06.899165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:06.899808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:06.900244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:06.900956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:06.901438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:06.901875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:07.038492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:07.046576 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb7a53a7-07e9-4198-9a5d-141947d9e959 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1318 microversion: 2.1 time: 0.160100 Oct 03 15:28:07.047148 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3606/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:06 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:08.069640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:08.070231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:08.072798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:08.078622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.079112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.079550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.080255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.080702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.081152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.222597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:08.234786 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba7adcd6-b593-446f-b1c3-f3840f828c63 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1507 microversion: 2.1 time: 0.168936 Oct 03 15:28:08.235483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3432/7038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:08 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:08.262196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:08.262822 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:08.265112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:08.265821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=10 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:08.272759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.273289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.273743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.274458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.274924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.275366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.278178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=93 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:08.411245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:08.421516 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f9a882f0-2c95-495c-b450-e30d78b7ed7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1507 microversion: 2.1 time: 0.163210 Oct 03 15:28:08.422038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3607/7039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:08 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:08.444805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:08.447280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:08.453727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.454203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.454637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.455327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.455775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.456194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.476141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:08.485888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:08.492049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Old instance type m1.heat2, new instance type m1.heat {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:28:08.498926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:28:08.499341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:28:08.499805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:28:08.500209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:28:08.500606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:28:08.569160 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8a2b9f92-3434-412b-9555-766dfef95552 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "POST /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54/action" status: 202 len: 0 microversion: 2.1 time: 0.128310 Oct 03 15:28:08.570003 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3433/7040] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:28:08 2022] POST /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:28:08.578181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:08.578804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:08.584817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.585342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.585789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.586501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:08.586957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:08.587389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:08.745309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:08.753583 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eba95518-93b0-41ab-8049-644b2bd6589c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1514 microversion: 2.1 time: 0.179366 Oct 03 15:28:08.754174 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3608/7041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:08 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:09.781324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:09.781937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:09.792751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:09.793286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:09.793728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:09.794428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:09.794882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:09.795283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:09.939149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:09.947310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1626ab78-da15-400a-8b47-662ba23ef96c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1514 microversion: 2.1 time: 0.173187 Oct 03 15:28:09.948192 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3434/7042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:09 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:10.975740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:10.976596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:10.986337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:10.986830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:10.987275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:10.987981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:10.988440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:10.988875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:11.138215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:11.146331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-135fea68-8edd-4976-984d-8184bf73c50d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.177299 Oct 03 15:28:11.146926 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3609/7043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:10 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:12.173572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:12.174219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:12.181850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:12.182343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:12.182786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:12.183490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:12.183951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:12.184383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:12.325897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:12.334354 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b9990541-5a85-4c49-bdb0-5614e566379b tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.166111 Oct 03 15:28:12.334937 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3435/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:12 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:13.363959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:13.364984 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:13.375813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:13.376307 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:13.376757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:13.377632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:13.378083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:13.378527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:13.522498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:13.530985 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af928297-88fc-46a4-b567-99d40fc5a091 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.175074 Oct 03 15:28:13.531572 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3610/7045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:13 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:14.556990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:14.557885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:14.567876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:14.568552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:14.569264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:14.570243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:14.570897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:14.571497 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:14.710599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:14.723058 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d595d59b-34da-46a1-a7d2-d794061c0b66 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.171232 Oct 03 15:28:14.723904 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3436/7046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:14 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:15.752192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:15.752801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:15.760561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:15.761088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:15.761531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:15.762240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:15.762701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:15.763135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:15.902181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:15.911801 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81d362dc-a0b7-45d3-b855-e39dbf38d99a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.164333 Oct 03 15:28:15.912389 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3611/7047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:15 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:16.939743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:16.940624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:16.944989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:16.953423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:16.953905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:16.954339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:16.955030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:16.955478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:16.955896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:17.095729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:17.104135 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4d1ad9aa-9cf2-47e7-8505-db578cfc459d tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.171057 Oct 03 15:28:17.104698 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3437/7048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:16 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:18.133920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:18.134962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:18.140015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:18.147235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:18.147729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:18.148178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:18.148969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:18.149456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:18.149893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:18.282379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:18.290779 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a88818f6-fb3c-44d8-9fb8-46ac2daee49f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.163668 Oct 03 15:28:18.291393 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3612/7049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:18 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:19.314423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:19.315071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:19.318418 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:28:19.318574 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 (ip 10.222.0.20) !!! Oct 03 15:28:19.325849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:19.326330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:19.326766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:19.327468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:19.327918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:19.328345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:19.466525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:19.475233 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dc3c1618-a02d-419b-a75f-3a52e719854a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.164822 Oct 03 15:28:19.475816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3438/7050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:19 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:20.501341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:20.502228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:20.512142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:20.512852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:20.513549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:20.514551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:20.515233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:20.515826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:20.664906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:20.676765 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3940e24c-34f3-4b16-a4c8-a7b2f438521e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.181164 Oct 03 15:28:20.677553 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3613/7051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:20 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:21.709632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:21.710575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:21.722105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:21.722584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:21.723006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:21.723727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:21.724196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:21.724619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:21.855856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:21.864308 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-60712da3-1d5c-46ea-bbde-8529265cff58 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.161852 Oct 03 15:28:21.864893 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3439/7052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:21 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:22.892325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:22.893276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:22.904989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:22.905802 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:22.906559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:22.907713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:22.908490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:22.909263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:23.046503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:23.054943 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b8c1e45-d8a9-4259-a9f1-53de192c7364 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.169636 Oct 03 15:28:23.055525 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3614/7053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:22 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:24.078210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:24.078827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:24.087015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:24.087499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:24.087956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:24.088644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:24.089137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:24.089563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:24.237563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:24.245634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c34131c-0469-4385-aa50-4e41cb99284f tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.171469 Oct 03 15:28:24.246211 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3440/7054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:24 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:25.269746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:25.270293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:25.277443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:25.278037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:25.278491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:25.279209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:25.279830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:25.280274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:25.501893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:25.510464 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e676883-7fc4-41e7-849e-fb7ef5429e7c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.244478 Oct 03 15:28:25.511267 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3615/7055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:25 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:26.540329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:26.541324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:26.553517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:26.554008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:26.554454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:26.555155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:26.555620 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:26.556049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:26.694861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:26.703201 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-74e0c1b1-c953-4e18-9b82-c2498108d5e8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.170316 Oct 03 15:28:26.703765 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3441/7056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:26 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:27.738869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:27.739869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:27.748024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:27.748526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:27.749005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:27.749721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:27.750186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:27.750628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:27.886485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:27.894561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-454e3cfd-8e1b-4547-bead-b1a01cea74f7 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.162438 Oct 03 15:28:27.895153 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3616/7057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:27 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:28.922412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:28.923378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:28.935247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:28.936057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:28.936787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:28.937986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:28.938777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:28.939466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:29.084400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:29.096378 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd17e51b-eec5-4e85-9182-0623caec1cf6 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.180550 Oct 03 15:28:29.097247 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3442/7058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:28 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:30.124209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:30.125406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:30.137724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:30.138451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:30.139200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:30.140361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:30.141187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:30.141918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:30.279438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:30.288318 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c810fc1-cd2b-422a-a216-3f40240a2705 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.170765 Oct 03 15:28:30.289064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3617/7059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:30 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:31.316942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:31.317977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:31.326217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:31.326702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:31.327140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:31.327838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:31.328288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:31.328716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:31.463135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:31.471420 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70070767-ee9b-4f1f-a7bc-0b37a19984d8 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.161045 Oct 03 15:28:31.472001 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3443/7060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:31 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:32.497087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:32.497712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:32.505062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:32.505556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:32.506002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:32.506709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:32.507167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:32.507656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:32.656875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:32.670856 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0694ff92-fa10-468c-bbc4-d9862c9391f3 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.177690 Oct 03 15:28:32.671448 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3618/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:32 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:33.697725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:33.698733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:33.710548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:33.711113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:33.711542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:33.712230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:33.712683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:33.713114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:33.856789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:33.869249 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f83abf4-0855-481d-a13b-dd1fdb8ddb61 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.177772 Oct 03 15:28:33.870148 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3444/7062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:33 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:34.895305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:34.896111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:34.905893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:34.906542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:34.907151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:34.908105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:34.908815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:34.909391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:35.043977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:35.052202 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9162fa44-0446-452a-a9b8-ac02ba707bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.162377 Oct 03 15:28:35.052781 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3619/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:34 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:36.079835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:36.080816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:36.090241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:36.090729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:36.091162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:36.092596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:36.093157 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:36.093583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:36.224360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:36.232262 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-175297d6-92c8-4d2a-afe6-19f81f505709 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.159227 Oct 03 15:28:36.232851 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3445/7064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:36 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:37.264214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:37.265427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:37.277171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:37.278002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:37.278755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:37.279924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:37.280711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:37.281496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:37.425450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:37.433719 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce9bfe7d-22c2-417e-a313-21101bacbb5a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.176307 Oct 03 15:28:37.434313 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3620/7065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:37 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:38.463459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:38.464042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:38.471324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:38.471804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:38.472237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:38.473227 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:38.473679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:38.474104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:38.495769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:38.616706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:38.624882 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d54d89fd-ea27-4ab0-84cd-e2f0f67dfb16 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.170396 Oct 03 15:28:38.625471 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3446/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:38 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:39.652105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:39.652879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:39.662350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:39.663002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:39.663598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:39.664527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:39.665194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:39.665815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:39.669212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=84 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:39.806188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:39.814351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f3c333e-f14c-4ea7-bde5-1c943e16a882 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.168645 Oct 03 15:28:39.814940 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3621/7067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:39 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:40.842243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:40.843073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:40.854184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:40.854666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:40.855101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:40.855789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:40.856242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:40.856651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:41.004538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:41.012958 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-326c036c-9237-4bd8-968d-1d04f6839beb tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.177795 Oct 03 15:28:41.013555 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3447/7068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:40 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:42.036956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:42.037627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:42.045592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:42.046090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:42.046543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:42.047263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:42.047732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:42.048175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:42.191883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:42.200038 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dd66ead6-14fb-4a7a-9261-ee0291a36ab0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1519 microversion: 2.1 time: 0.167119 Oct 03 15:28:42.200614 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3622/7069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:42 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:43.155143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-566de02d-1a30-4de0-a4a5-726038fa2147 req-4e66a878-d9a6-49de-80d8-0def5378f5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac7746d-5490-401c-a13c-b84431a90e54", "name": "network-vif-unplugged", "status": "completed", "tag": "75d0acf4-d09e-49aa-97a0-7ae1ff21850d"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:43.166268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-566de02d-1a30-4de0-a4a5-726038fa2147 req-4e66a878-d9a6-49de-80d8-0def5378f5c2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:43.166709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-566de02d-1a30-4de0-a4a5-726038fa2147 req-4e66a878-d9a6-49de-80d8-0def5378f5c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:43.167141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-566de02d-1a30-4de0-a4a5-726038fa2147 req-4e66a878-d9a6-49de-80d8-0def5378f5c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:43.184038 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-566de02d-1a30-4de0-a4a5-726038fa2147 req-4e66a878-d9a6-49de-80d8-0def5378f5c2 service nova] Creating event network-vif-unplugged:75d0acf4-d09e-49aa-97a0-7ae1ff21850d for instance 4ac7746d-5490-401c-a13c-b84431a90e54 on n-h1-781139-2 Oct 03 15:28:43.192469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-566de02d-1a30-4de0-a4a5-726038fa2147 req-4e66a878-d9a6-49de-80d8-0def5378f5c2 service nova] Instance 4ac7746d-5490-401c-a13c-b84431a90e54 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:28:43.206128 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-566de02d-1a30-4de0-a4a5-726038fa2147 req-4e66a878-d9a6-49de-80d8-0def5378f5c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054767 Oct 03 15:28:43.206776 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3448/7070] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:28:43.224241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:43.224874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:43.232053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:43.232553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:43.233051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:43.233761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:43.234212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:43.234654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:43.366305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:43.374406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-03c5d0e3-2b19-4faa-aaca-26dea20ffd44 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1518 microversion: 2.1 time: 0.154315 Oct 03 15:28:43.375300 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3623/7071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:43 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:44.403541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:44.404276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:44.411068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:44.411546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:44.411977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:44.412664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:44.413159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:44.413578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:44.551748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:44.560254 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0dfa83e0-9936-41ab-98cf-09365c4c1148 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1516 microversion: 2.1 time: 0.164247 Oct 03 15:28:44.560835 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3449/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:44 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:45.238211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-839e1bf0-1edc-4e78-9cf1-65c3ddb7ee31 req-4b79d60c-aca2-46d7-887f-bee4542c0e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ac7746d-5490-401c-a13c-b84431a90e54", "tag": "75d0acf4-d09e-49aa-97a0-7ae1ff21850d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:45.249941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-839e1bf0-1edc-4e78-9cf1-65c3ddb7ee31 req-4b79d60c-aca2-46d7-887f-bee4542c0e3f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:45.250456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-839e1bf0-1edc-4e78-9cf1-65c3ddb7ee31 req-4b79d60c-aca2-46d7-887f-bee4542c0e3f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:45.250921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-839e1bf0-1edc-4e78-9cf1-65c3ddb7ee31 req-4b79d60c-aca2-46d7-887f-bee4542c0e3f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:45.263545 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-839e1bf0-1edc-4e78-9cf1-65c3ddb7ee31 req-4b79d60c-aca2-46d7-887f-bee4542c0e3f service nova] Creating event network-changed:75d0acf4-d09e-49aa-97a0-7ae1ff21850d for instance 4ac7746d-5490-401c-a13c-b84431a90e54 on n-h1-781139-2 Oct 03 15:28:45.271248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-839e1bf0-1edc-4e78-9cf1-65c3ddb7ee31 req-4b79d60c-aca2-46d7-887f-bee4542c0e3f service nova] Instance 4ac7746d-5490-401c-a13c-b84431a90e54 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:28:45.288850 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-839e1bf0-1edc-4e78-9cf1-65c3ddb7ee31 req-4b79d60c-aca2-46d7-887f-bee4542c0e3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054289 Oct 03 15:28:45.289661 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3624/7073] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:28:45.584154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:45.584782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:45.594028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:45.594517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:45.594954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:45.595664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:45.596118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:45.596547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:45.728956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:45.736989 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0a452efa-73b6-454d-a622-94e0133ddedc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1516 microversion: 2.1 time: 0.157001 Oct 03 15:28:45.737588 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3450/7074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:45 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:46.761731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:46.762572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:46.769416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:46.769916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:46.770355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:46.771071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:46.771541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:46.771981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:46.908215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:46.917053 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-531f49a9-49d6-4c55-8db6-99f121dba60e tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1516 microversion: 2.1 time: 0.160521 Oct 03 15:28:46.917703 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3625/7075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:46 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:47.943668 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:47.944475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:47.948465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=28 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:47.956579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:47.957312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:47.957940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:47.958928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:47.959573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:47.960176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:48.098482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:48.107201 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13686181-6043-4fac-86eb-bc4566706809 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1513 microversion: 2.1 time: 0.169288 Oct 03 15:28:48.107772 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3451/7076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:47 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:48.130176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:48.130818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:48.138427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:48.138940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:48.139394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:48.140115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:48.140582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:48.141058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:48.206167 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4405a399-b3a5-4bfb-b20d-5deb9c52e16c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "POST /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54/action" status: 204 len: 0 microversion: 2.1 time: 0.079756 Oct 03 15:28:48.206726 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3626/7077] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:28:48 2022] POST /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:28:48.216063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:48.216988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:48.223061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:48.223539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:48.223971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:48.224666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:48.225151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:48.225619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:48.366767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:48.374981 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-951ac64c-78a1-4014-8229-530f906c5cfc tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1513 microversion: 2.1 time: 0.163947 Oct 03 15:28:48.375571 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3452/7078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:48 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:49.399605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:49.400362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:49.402753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=30 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:28:49.408672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.409333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.409783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.410498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.410965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.411402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.561463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:49.570358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-55eec68e-5134-4205-b003-df38b6c9efda tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1505 microversion: 2.1 time: 0.175241 Oct 03 15:28:49.571244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3627/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:49 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:49.593495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:49.594106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:49.600974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.601456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.601889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.602580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.603023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.603442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.736666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:49.744958 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99d3f10c-20b1-4b1f-ba54-ee23e9cb1eec tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1505 microversion: 2.1 time: 0.155900 Oct 03 15:28:49.745550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3453/7080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:49 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:49.768975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:49.769600 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:49.776228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.776728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.777188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.777963 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.778420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.779073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.916736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:49.925459 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e30ca492-73b2-4196-8565-87edb3888c6c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1505 microversion: 2.1 time: 0.160422 Oct 03 15:28:49.926149 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3628/7081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:49 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:49.947909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:49.948331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:49.954828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.955308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.955734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.956420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:49.956868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:49.957322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:49.982831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:28:50.066635 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52c2ba7a-dd60-4ccb-8bcb-90f63a0f331c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 204 len: 0 microversion: 2.1 time: 0.122499 Oct 03 15:28:50.067541 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3454/7082] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:28:49 2022] DELETE /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:28:50.088749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:50.089292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:50.096449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:50.096955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:50.097422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:50.098130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:50.098597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:50.099029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:50.125033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:28:50.169493 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.compute.api [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Instance is already in deleting state, ignoring this request Oct 03 15:28:50.170329 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8d7659f-da49-40e7-a0bb-ea67401f478c tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 204 len: 0 microversion: 2.1 time: 0.085739 Oct 03 15:28:50.171106 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3629/7083] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:28:50 2022] DELETE /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:28:50.180047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:50.180849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:50.187563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:50.188038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:50.188470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:50.189224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:50.189673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:50.190095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:50.325252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:50.334854 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-38fe361d-6166-4874-8bad-16c4f4041bc1 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1511 microversion: 2.1 time: 0.159050 Oct 03 15:28:50.335564 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3455/7084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:50 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:51.173888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0d6d4f76-cee6-4941-ab4a-54ed54a21be9 req-a0aab09e-b8d6-428e-a52a-524795b2e9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac7746d-5490-401c-a13c-b84431a90e54", "name": "network-vif-plugged", "status": "completed", "tag": "75d0acf4-d09e-49aa-97a0-7ae1ff21850d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:51.184107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0d6d4f76-cee6-4941-ab4a-54ed54a21be9 req-a0aab09e-b8d6-428e-a52a-524795b2e9fa service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:51.184514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0d6d4f76-cee6-4941-ab4a-54ed54a21be9 req-a0aab09e-b8d6-428e-a52a-524795b2e9fa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:51.184973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0d6d4f76-cee6-4941-ab4a-54ed54a21be9 req-a0aab09e-b8d6-428e-a52a-524795b2e9fa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:51.197786 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0d6d4f76-cee6-4941-ab4a-54ed54a21be9 req-a0aab09e-b8d6-428e-a52a-524795b2e9fa service nova] Creating event network-vif-plugged:75d0acf4-d09e-49aa-97a0-7ae1ff21850d for instance 4ac7746d-5490-401c-a13c-b84431a90e54 on n-h1-781139-2 Oct 03 15:28:51.203256 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0d6d4f76-cee6-4941-ab4a-54ed54a21be9 req-a0aab09e-b8d6-428e-a52a-524795b2e9fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106848 Oct 03 15:28:51.203896 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3630/7085] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:28:51.360587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:51.361260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:51.368677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:51.369225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:51.369664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:51.370360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:51.370810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:51.371250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:51.511734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7596f2228e0d4d778d095af51ce7ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b73acf783bf40d89689f86ab6b5fb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:28:51.521034 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63667147-ead5-4ee0-a973-bf6805b8e393 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 200 len: 1511 microversion: 2.1 time: 0.165040 Oct 03 15:28:51.521614 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3456/7086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:51 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:28:51.974510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cbcaf21b-f401-473a-a8db-a663ca90361b req-f9469ea7-3dd6-45cf-89c2-c2ff7197b3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ac7746d-5490-401c-a13c-b84431a90e54", "name": "network-vif-deleted", "tag": "75d0acf4-d09e-49aa-97a0-7ae1ff21850d"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:28:51.984721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cbcaf21b-f401-473a-a8db-a663ca90361b req-f9469ea7-3dd6-45cf-89c2-c2ff7197b3d2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:51.985236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cbcaf21b-f401-473a-a8db-a663ca90361b req-f9469ea7-3dd6-45cf-89c2-c2ff7197b3d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:51.985672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cbcaf21b-f401-473a-a8db-a663ca90361b req-f9469ea7-3dd6-45cf-89c2-c2ff7197b3d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:51.997712 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cbcaf21b-f401-473a-a8db-a663ca90361b req-f9469ea7-3dd6-45cf-89c2-c2ff7197b3d2 service nova] Creating event network-vif-deleted:75d0acf4-d09e-49aa-97a0-7ae1ff21850d for instance 4ac7746d-5490-401c-a13c-b84431a90e54 on n-h1-781139-2 Oct 03 15:28:52.004020 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cbcaf21b-f401-473a-a8db-a663ca90361b req-f9469ea7-3dd6-45cf-89c2-c2ff7197b3d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033515 Oct 03 15:28:52.008330 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3631/7087] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:28:52.548689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:52.549502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 4ac7746d-5490-401c-a13c-b84431a90e54] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:52.558976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:52.559622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:52.560205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:52.561285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:52.561749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:52.562179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:52.575702 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] HTTP exception thrown: Instance 4ac7746d-5490-401c-a13c-b84431a90e54 could not be found. Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Request method failure captured: Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 HTTP/1.1 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv9LOwzvBDHrHdEZIMqd4vhOcJvjCAOOkwf04xEFyAiy0c0t9Fl-5ABraOfjJW_RPuPARMsXyC1QjBimJ2D93Dxem-0cZWTjz8jie8MlSLEMkmPcvPdi7b2iGkCCljP8oQnN38J0yZrbW1C2-080ZV6y59I6IwtRAlDcqPwen9yAysI Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 4b73acf783bf40d89689f86ab6b5fb92 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b73acf783bf40d89689f86ab6b5fb92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 4b73acf783bf40d89689f86ab6b5fb92 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerDiskConfigTestJSON-359263903-project Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 7596f2228e0d4d778d095af51ce7ea8d Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerDiskConfigTestJSON-359263903-project Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 4ac7746d-5490-401c-a13c-b84431a90e54 could not be found. Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '4ac7746d-5490-401c-a13c-b84431a90e54'} Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac7746d-5490-401c-a13c-b84431a90e54 could not be found. Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac7746d-5490-401c-a13c-b84431a90e54 could not be found. Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:28:52.577374 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac7746d-5490-401c-a13c-b84431a90e54 could not be found. Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Returning 404 to user: Instance 4ac7746d-5490-401c-a13c-b84431a90e54 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9586ec6-57ac-488e-90d8-9815fd683fd0 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54" status: 404 len: 111 microversion: 2.1 time: 0.037462 Oct 03 15:28:52.581605 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3457/7088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:52 2022] GET /compute/v2.1/servers/4ac7746d-5490-401c-a13c-b84431a90e54 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:28:52.589322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7ad9dc8-2948-4929-a172-a45384e4c508 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '.version_select at 0x7fb230203040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:52.613470 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7ad9dc8-2948-4929-a172-a45384e4c508 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-820769384" status: 202 len: 0 microversion: 2.1 time: 0.029217 Oct 03 15:28:52.614059 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3632/7089] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 3 15:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-820769384 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:28:53.262444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:53.262977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:53.269973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:53.270485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:53.270930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:53.271624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:53.272108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:53.272564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:53.287031 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] HTTP exception thrown: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Request method failure captured: Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 HTTP/1.1 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv9LOwzvBDHrHdEZIMqd4vhOcJvjCAOOkwf04xEFyAiy0c0t9Fl-5ABraOfjJW_RPuPARMsXyC1QjBimJ2D93Dxem-0cZWTjz8jie8MlSLEMkmPcvPdi7b2iGkCCljP8oQnN38J0yZrbW1C2-080ZV6y59I6IwtRAlDcqPwen9yAysI Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 4b73acf783bf40d89689f86ab6b5fb92 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b73acf783bf40d89689f86ab6b5fb92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 4b73acf783bf40d89689f86ab6b5fb92 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerDiskConfigTestJSON-359263903-project Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 7596f2228e0d4d778d095af51ce7ea8d Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerDiskConfigTestJSON-359263903-project Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '6998f66a-d0ff-4b17-87a4-a0d52473c686'} Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:28:53.288586 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Returning 404 to user: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-932c983c-c03a-4c01-ba31-ea885307ddf4 tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 404 len: 111 microversion: 2.1 time: 0.031811 Oct 03 15:28:53.292735 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3458/7090] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:28:53 2022] DELETE /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:28:53.299366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:28:53.300123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] [instance: 6998f66a-d0ff-4b17-87a4-a0d52473c686] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:28:53.307083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:53.307531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:53.307982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:53.308691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:28:53.309181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:28:53.309622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:28:53.323623 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] HTTP exception thrown: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Request method failure captured: Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 HTTP/1.1 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv9LOwzvBDHrHdEZIMqd4vhOcJvjCAOOkwf04xEFyAiy0c0t9Fl-5ABraOfjJW_RPuPARMsXyC1QjBimJ2D93Dxem-0cZWTjz8jie8MlSLEMkmPcvPdi7b2iGkCCljP8oQnN38J0yZrbW1C2-080ZV6y59I6IwtRAlDcqPwen9yAysI Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 4b73acf783bf40d89689f86ab6b5fb92 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b73acf783bf40d89689f86ab6b5fb92", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b73acf783bf40d89689f86ab6b5fb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 4b73acf783bf40d89689f86ab6b5fb92 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-359263903 Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerDiskConfigTestJSON-359263903-project Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 7596f2228e0d4d778d095af51ce7ea8d Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerDiskConfigTestJSON-359263903-project Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '6998f66a-d0ff-4b17-87a4-a0d52473c686'} Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:28:53.325303 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] Returning 404 to user: Instance 6998f66a-d0ff-4b17-87a4-a0d52473c686 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dfd8106c-fc6a-40fe-911e-b72d765f841a tempest-ServerDiskConfigTestJSON-359263903 tempest-ServerDiskConfigTestJSON-359263903-project] 10.222.0.20 "GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686" status: 404 len: 111 microversion: 2.1 time: 0.031931 Oct 03 15:28:53.329461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3633/7091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:28:53 2022] GET /compute/v2.1/servers/6998f66a-d0ff-4b17-87a4-a0d52473c686 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:29:02.158152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-087abe41-736b-498e-966a-3ed7d882fd6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'create', calling method: .version_select at 0x7fb2304a9160>, body: {"keypair": {"name": "tempest-keypair-2077950262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGcSAixlaa/E5K9RwcLIpdqGCbjYcV7frn5ivHz1V7kCRDeYFBD9ERFLOhXQyABych/ybXH80V7uJ+dZf1SCKaiZ8JHz4q91/TC7scK75gv2Ox8/NCtNaNTH8vcqm7/9Q=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:29:02.174893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-087abe41-736b-498e-966a-3ed7d882fd6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:29:02.180572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-087abe41-736b-498e-966a-3ed7d882fd6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for user 3b4ae280b3f74215bc3c19771f6a15bd and project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:29:02.211239 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-087abe41-736b-498e-966a-3ed7d882fd6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183510 Oct 03 15:29:02.211781 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3459/7092] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:29:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:29:03.554879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-456216472", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e05d5a63-fc25-4511-9c18-4c732f19fd1b"}], "security_groups": [{"name": "tempest-securitygroup--1246444998"}], "key_name": "tempest-keypair-2077950262", "user_data": "}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:29:03.567015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:29:03.567813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:29:03.666155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] validate_networks() for [('e05d5a63-fc25-4511-9c18-4c732f19fd1b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:29:04.061366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:29:04.062343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:29:04.062850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:29:04.063322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:29:04.063749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:29:04.073167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:04.073668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:04.074123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:04.074859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:04.075329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:04.075763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:04.094118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:29:04.099692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for user 3b4ae280b3f74215bc3c19771f6a15bd and project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:29:04.112971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:29:04.115318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:29:04.166695 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aab24003-7d5d-4f5d-8d24-953d7b3be338 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.616175 Oct 03 15:29:04.167678 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3634/7093] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:29:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:29:04.178803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cf4595f7-608f-4de8-8119-bca4afa5a111 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:04.179411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cf4595f7-608f-4de8-8119-bca4afa5a111 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:04.183258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:29:04.245933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cf4595f7-608f-4de8-8119-bca4afa5a111 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:04.253780 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cf4595f7-608f-4de8-8119-bca4afa5a111 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1238 microversion: 2.1 time: 0.078890 Oct 03 15:29:04.264619 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3460/7094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:04 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:05.278125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:05.278773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:05.286712 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:05.287249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:05.287700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:05.288436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:05.288906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:05.289422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:05.356365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:05.364723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e1352306-9a1c-42fe-8daa-88109415f5d8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1290 microversion: 2.1 time: 0.091471 Oct 03 15:29:05.365514 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3635/7095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:05 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:06.388172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:06.389578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:06.398071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:06.398629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:06.399135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:06.399992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:06.400602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:06.401216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:06.608947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:06.618144 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56e403a6-8e85-4153-8a5c-bee1872bb8fa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1364 microversion: 2.1 time: 0.234124 Oct 03 15:29:06.618742 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3461/7096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:06 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:07.001206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-77491e39-1dc8-4cd4-b907-2784527c4133 req-46024115-18c9-4392-ae3d-b656a9f3ce0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ddc6b5-dfb9-4bd2-a6f7-00834fd28139", "tag": "142fc211-1911-4d4c-8b94-0ccc347a2e24"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:29:07.012630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77491e39-1dc8-4cd4-b907-2784527c4133 req-46024115-18c9-4392-ae3d-b656a9f3ce0c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:07.013395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77491e39-1dc8-4cd4-b907-2784527c4133 req-46024115-18c9-4392-ae3d-b656a9f3ce0c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:07.014037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-77491e39-1dc8-4cd4-b907-2784527c4133 req-46024115-18c9-4392-ae3d-b656a9f3ce0c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:07.026065 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-77491e39-1dc8-4cd4-b907-2784527c4133 req-46024115-18c9-4392-ae3d-b656a9f3ce0c service nova] Creating event network-changed:142fc211-1911-4d4c-8b94-0ccc347a2e24 for instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 on n-h1-781139-2 Oct 03 15:29:07.031095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-77491e39-1dc8-4cd4-b907-2784527c4133 req-46024115-18c9-4392-ae3d-b656a9f3ce0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033671 Oct 03 15:29:07.031727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3636/7097] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:29:07.647110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:07.648087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:07.659493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:07.660296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:07.661015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:07.662186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:07.662931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:07.663605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:07.795236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:07.803381 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9017f9ea-82b3-4cfe-b480-973a71f882a1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1364 microversion: 2.1 time: 0.163082 Oct 03 15:29:07.803978 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3462/7098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:07 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:08.828789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:08.829550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:08.836173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:08.836678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:08.837170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:08.837947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:08.838420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:08.838871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:08.975248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:08.983912 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-64de4130-a9db-4814-85f3-5d34895d1d6b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1364 microversion: 2.1 time: 0.160482 Oct 03 15:29:08.984211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3637/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:08 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:10.006017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:10.006731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:10.014510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:10.015018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:10.015465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:10.016189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:10.016651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:10.017086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:10.161167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:10.173586 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-313b22f0-ad29-4183-9000-5f51f45b0b22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1364 microversion: 2.1 time: 0.171271 Oct 03 15:29:10.174482 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3463/7100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:10 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:11.202053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:11.202798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:11.210136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:11.210647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:11.211134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:11.211875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:11.217766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:11.218702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:11.368181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:11.376590 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c3706a3-14dd-4ba6-8278-e7bae2c7ac22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1364 microversion: 2.1 time: 0.179081 Oct 03 15:29:11.377210 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3638/7101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:11 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:12.403864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:12.404983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:12.416843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:12.417710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:12.418449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:12.419603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:12.420373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:12.421127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:12.564304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:12.572239 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b6213ed-f163-4e94-8c1a-96719d0c8910 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1364 microversion: 2.1 time: 0.175023 Oct 03 15:29:12.572834 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3464/7102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:12 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:13.149507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f94abb16-39a5-4552-8a7b-3664c4d213cd req-fd2ac671-1f4f-4820-91b6-bb17e19bd96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ddc6b5-dfb9-4bd2-a6f7-00834fd28139", "name": "network-vif-plugged", "status": "completed", "tag": "142fc211-1911-4d4c-8b94-0ccc347a2e24"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:29:13.160338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f94abb16-39a5-4552-8a7b-3664c4d213cd req-fd2ac671-1f4f-4820-91b6-bb17e19bd96b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:13.160837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f94abb16-39a5-4552-8a7b-3664c4d213cd req-fd2ac671-1f4f-4820-91b6-bb17e19bd96b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:13.161305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f94abb16-39a5-4552-8a7b-3664c4d213cd req-fd2ac671-1f4f-4820-91b6-bb17e19bd96b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:13.172645 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f94abb16-39a5-4552-8a7b-3664c4d213cd req-fd2ac671-1f4f-4820-91b6-bb17e19bd96b service nova] Creating event network-vif-plugged:142fc211-1911-4d4c-8b94-0ccc347a2e24 for instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 on n-h1-781139-2 Oct 03 15:29:13.177846 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f94abb16-39a5-4552-8a7b-3664c4d213cd req-fd2ac671-1f4f-4820-91b6-bb17e19bd96b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032151 Oct 03 15:29:13.178471 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3639/7103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:29:13.600383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:13.601447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:13.612092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:13.612576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:13.613042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:13.613743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:13.614217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:13.614640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:13.751521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:13.761561 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-117d85a9-df20-4c72-a92c-59794d4e3461 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1364 microversion: 2.1 time: 0.168130 Oct 03 15:29:13.762308 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3465/7104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:13 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:14.782794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:29:14.783682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:29:14.789221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:14.790003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:14.799697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:14.800498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:14.800959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:14.801726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:14.802198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:14.802647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:14.945260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:29:14.953257 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bc98d394-d87e-4595-9d6a-3af58718aaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1552 microversion: 2.1 time: 0.172294 Oct 03 15:29:14.953854 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3640/7105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:29:14 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:29:14.978389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:29:14.978919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:29:14.981724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:29:14.991821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:14.992504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:14.993155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:14.994213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:14.994872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:14.995385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:15.082067 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-28c7e974-50f6-4c4c-b7af-395215f4efd3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109588 Oct 03 15:29:15.082913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3466/7106] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:29:14 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:29:16.395789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-42ed9a86-c117-4cfa-a3e0-10351f7e4766 req-7f461dad-13e3-4e48-a2aa-1482a6193046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ddc6b5-dfb9-4bd2-a6f7-00834fd28139", "tag": "142fc211-1911-4d4c-8b94-0ccc347a2e24"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:29:16.406253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42ed9a86-c117-4cfa-a3e0-10351f7e4766 req-7f461dad-13e3-4e48-a2aa-1482a6193046 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:29:16.406741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42ed9a86-c117-4cfa-a3e0-10351f7e4766 req-7f461dad-13e3-4e48-a2aa-1482a6193046 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:29:16.407252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-42ed9a86-c117-4cfa-a3e0-10351f7e4766 req-7f461dad-13e3-4e48-a2aa-1482a6193046 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:29:16.418636 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-42ed9a86-c117-4cfa-a3e0-10351f7e4766 req-7f461dad-13e3-4e48-a2aa-1482a6193046 service nova] Creating event network-changed:142fc211-1911-4d4c-8b94-0ccc347a2e24 for instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 on n-h1-781139-2 Oct 03 15:29:16.423540 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-42ed9a86-c117-4cfa-a3e0-10351f7e4766 req-7f461dad-13e3-4e48-a2aa-1482a6193046 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031585 Oct 03 15:29:16.424473 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3641/7107] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:30:21.241092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:21.241919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=34 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:21.243054 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:30:21.243224 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 (ip 10.222.0.20) !!! Oct 03 15:30:21.249558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:21.250166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:21.260538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.261095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.261515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.262211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.262696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.263062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.474053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:21.482599 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d723b44e-a639-47db-84b4-59eb8b8e0d89 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1671 microversion: 2.1 time: 0.243903 Oct 03 15:30:21.483201 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3467/7108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:21 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1671 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:21.508880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:21.509763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=32 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:21.515212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:21.515863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:21.523609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.524163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.524586 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.525325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.525817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.526246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.728275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:21.736406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ec84e82-d2a4-413c-9556-22e281fe7091 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1671 microversion: 2.1 time: 0.230332 Oct 03 15:30:21.737043 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3642/7109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:21 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1671 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:21.759149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:21.759760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:21.766044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.766444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.766905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.767585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.768003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.768418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.909216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:21.918359 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33455c3e-1a60-4f88-a4c2-437375f85f43 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1671 microversion: 2.1 time: 0.163239 Oct 03 15:30:21.919314 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3468/7110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:21 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:21.940717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:21.943048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:21.949357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.949853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.950333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.951046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:21.951507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:21.951948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:21.980236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:21.985762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:30:21.992325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:30:21.992763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:30:21.993280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:30:21.993703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:30:21.994126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:30:22.065414 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f36c733b-2c1b-405d-b4e6-22cd24beea2f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139/action" status: 202 len: 0 microversion: 2.1 time: 0.128575 Oct 03 15:30:22.066045 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3643/7111] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:30:21 2022] POST /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:30:22.074481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:22.075084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:22.081374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:22.081831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:22.082267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:22.082965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:22.083419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:22.083841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:22.221652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:22.229751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-22c36399-54d2-4f94-a9d6-30ac9d11f261 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1680 microversion: 2.1 time: 0.159350 Oct 03 15:30:22.230356 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3469/7112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:22 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:23.254580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:23.255176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:23.261813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:23.262290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:23.262742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:23.263514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:23.264162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:23.264753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:23.406620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:23.414814 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21580208-efe1-46b6-8bb0-9a5134cf1b7d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1680 microversion: 2.1 time: 0.165388 Oct 03 15:30:23.415399 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3644/7113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:23 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:24.444679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:24.445810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:24.455409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:24.456049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:24.456600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:24.457434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:24.457966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:24.458453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:24.605241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:24.613379 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-efdc62a6-8bc1-4c01-b67f-0b101c49305c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.175992 Oct 03 15:30:24.613963 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3470/7114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:24 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:25.640751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:25.641384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:25.648639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:25.649200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:25.649653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:25.650374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:25.650845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:25.651287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:25.794998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:25.803462 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39654aa7-897b-47c7-81ec-81d5134b8e81 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.168924 Oct 03 15:30:25.804046 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3645/7115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:25 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:26.840245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:26.841482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:26.849119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:26.849612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:26.850052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:26.850749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:26.851206 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:26.851632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:26.994140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:27.002637 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98ab5ac6-3963-4965-9d31-f9f35f988f0f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.169373 Oct 03 15:30:27.003336 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3471/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:26 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:28.026640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:28.027305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:28.034907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:28.035336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:28.035788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:28.036499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:28.037041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:28.037482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:28.166662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:28.175042 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1c56ce9b-fa08-4e68-8b97-7912d73a0e75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.152478 Oct 03 15:30:28.175627 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3646/7117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:28 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:29.202658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:29.203663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:29.216780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:29.216968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:29.217419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:29.218126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:29.218579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:29.219003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:29.357600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:29.367220 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-956d6e22-5af3-4c1f-9ff4-111afb8c8b76 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.171394 Oct 03 15:30:29.367841 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3472/7118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:29 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:30.396872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:30.398053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:30.409750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:30.410569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:30.411310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:30.412464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:30.413302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:30.414028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:30.551023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:30.559674 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2097b9f2-44bf-4caf-ba69-c12cccdbaaa9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.169459 Oct 03 15:30:30.560299 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3647/7119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:30 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:31.583417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:31.584020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:31.592342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:31.592837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:31.593305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:31.594012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:31.594460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:31.594883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:31.736588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:31.746475 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a0857172-9062-42f8-b9e9-d31bb74b4c14 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.167097 Oct 03 15:30:31.747980 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3473/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:31 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:32.773187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:32.773906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:32.783460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:32.783961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:32.784411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:32.785147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:32.785634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:32.786073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:32.930523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:32.938620 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e92b117-9d36-41f6-92b0-fbd6167cc699 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.171780 Oct 03 15:30:32.939223 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3648/7121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:32 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:33.967068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:33.967947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:33.979690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:33.980512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:33.981275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:33.982526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:33.982974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:33.983401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:34.121881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:34.130111 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5fb33147-4d25-4038-b3b7-b470d3afb734 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.170254 Oct 03 15:30:34.130701 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3474/7122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:33 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:35.157288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:35.158071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:35.167117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:35.167739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:35.168300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:35.169229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:35.169811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:35.170417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:35.310624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:35.319244 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-678ea105-672d-4e4e-bb73-9c45c11eb931 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1685 microversion: 2.1 time: 0.168240 Oct 03 15:30:35.319843 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3649/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:35 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:36.345022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:36.345630 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:36.352855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:36.353388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:36.353823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:36.354540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:36.354995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:36.355422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:36.495742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-92711e3f-08af-4373-878c-30afff68ee33 req-fd66648e-ea22-4858-96ea-ba8a46fc25af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ddc6b5-dfb9-4bd2-a6f7-00834fd28139", "name": "network-vif-unplugged", "status": "completed", "tag": "142fc211-1911-4d4c-8b94-0ccc347a2e24"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:36.506914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92711e3f-08af-4373-878c-30afff68ee33 req-fd66648e-ea22-4858-96ea-ba8a46fc25af service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:36.507686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92711e3f-08af-4373-878c-30afff68ee33 req-fd66648e-ea22-4858-96ea-ba8a46fc25af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:36.508488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-92711e3f-08af-4373-878c-30afff68ee33 req-fd66648e-ea22-4858-96ea-ba8a46fc25af service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:36.521508 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-92711e3f-08af-4373-878c-30afff68ee33 req-fd66648e-ea22-4858-96ea-ba8a46fc25af service nova] Creating event network-vif-unplugged:142fc211-1911-4d4c-8b94-0ccc347a2e24 for instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 on n-h2-781139-2 Oct 03 15:30:36.527794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-92711e3f-08af-4373-878c-30afff68ee33 req-fd66648e-ea22-4858-96ea-ba8a46fc25af service nova] Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:30:36.540098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-92711e3f-08af-4373-878c-30afff68ee33 req-fd66648e-ea22-4858-96ea-ba8a46fc25af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129295 Oct 03 15:30:36.541405 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3650/7124] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:30:36.572816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:36.581272 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6a79828-1376-46fc-bd4b-4ccda8cefacd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1684 microversion: 2.1 time: 0.241452 Oct 03 15:30:36.592540 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3475/7125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:36 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1684 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:37.605996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:37.606705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:37.613284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:37.613785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:37.614228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:37.614944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:37.615405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:37.615842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:37.821493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:37.830290 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-89256131-ebfc-409b-9492-481d0190355d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1684 microversion: 2.1 time: 0.229466 Oct 03 15:30:37.830878 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3651/7126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:37 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1684 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:38.561593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-a7dcb4ed-db59-4f97-8fb2-89cfab287be1 req-8b81b718-bc75-48b6-88f9-2113338a0358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ddc6b5-dfb9-4bd2-a6f7-00834fd28139", "tag": "142fc211-1911-4d4c-8b94-0ccc347a2e24"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:38.577638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a7dcb4ed-db59-4f97-8fb2-89cfab287be1 req-8b81b718-bc75-48b6-88f9-2113338a0358 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:38.578463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a7dcb4ed-db59-4f97-8fb2-89cfab287be1 req-8b81b718-bc75-48b6-88f9-2113338a0358 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:38.578904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-a7dcb4ed-db59-4f97-8fb2-89cfab287be1 req-8b81b718-bc75-48b6-88f9-2113338a0358 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:38.591508 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-a7dcb4ed-db59-4f97-8fb2-89cfab287be1 req-8b81b718-bc75-48b6-88f9-2113338a0358 service nova] Creating event network-changed:142fc211-1911-4d4c-8b94-0ccc347a2e24 for instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 on n-h2-781139-2 Oct 03 15:30:38.597461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-a7dcb4ed-db59-4f97-8fb2-89cfab287be1 req-8b81b718-bc75-48b6-88f9-2113338a0358 service nova] Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:30:38.609339 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-a7dcb4ed-db59-4f97-8fb2-89cfab287be1 req-8b81b718-bc75-48b6-88f9-2113338a0358 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053591 Oct 03 15:30:38.609964 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3476/7127] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:30:38.854860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:38.855578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:38.863260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:38.863759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:38.864193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:38.864902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:38.865391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:38.865823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:39.001509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:39.010140 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-42a21c46-5bdd-4ac5-8ba0-bb7712de31cf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1682 microversion: 2.1 time: 0.159063 Oct 03 15:30:39.010588 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3652/7128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:38 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:40.036442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:40.037179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:40.044045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:40.044532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:40.044974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:40.045692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:40.046194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:40.046622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:40.183359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:40.195472 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-55011b7d-cada-46d2-a518-55cece51f60b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1679 microversion: 2.1 time: 0.163964 Oct 03 15:30:40.196256 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3477/7129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:40 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:40.221070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:40.221631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:40.228523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:40.229055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:40.229510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:40.230227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:40.230696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:40.231150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:40.292570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c1bdfdda-cd1d-45e3-8af5-672c5625da5a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139/action" status: 204 len: 0 microversion: 2.1 time: 0.075451 Oct 03 15:30:40.293260 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3653/7130] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:30:40 2022] POST /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:30:40.301889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:40.302514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:40.308543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:40.309094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:40.309507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:40.310216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:40.310671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:40.311092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:40.528334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:40.536837 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5782f38a-939c-4c7f-b70c-eaf50afd95bb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1679 microversion: 2.1 time: 0.238852 Oct 03 15:30:40.537437 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3478/7131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:40 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:30:41.562622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:41.563338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:41.569931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:41.571008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:41.571461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:41.572347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:41.572815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:41.573285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:41.712747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:41.721374 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0009048f-f8ae-453d-967e-c12ddea5bace tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1679 microversion: 2.1 time: 0.164815 Oct 03 15:30:41.721951 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3654/7132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:41 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:42.400576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-8dbbea17-0d17-4a15-9679-f50693a44c84 req-82104ee2-e601-4906-b7a0-ce8e0b5b66d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ddc6b5-dfb9-4bd2-a6f7-00834fd28139", "name": "network-vif-plugged", "status": "completed", "tag": "142fc211-1911-4d4c-8b94-0ccc347a2e24"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:42.411905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8dbbea17-0d17-4a15-9679-f50693a44c84 req-82104ee2-e601-4906-b7a0-ce8e0b5b66d5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:42.412396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8dbbea17-0d17-4a15-9679-f50693a44c84 req-82104ee2-e601-4906-b7a0-ce8e0b5b66d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:42.412828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8dbbea17-0d17-4a15-9679-f50693a44c84 req-82104ee2-e601-4906-b7a0-ce8e0b5b66d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:42.424342 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-8dbbea17-0d17-4a15-9679-f50693a44c84 req-82104ee2-e601-4906-b7a0-ce8e0b5b66d5 service nova] Creating event network-vif-plugged:142fc211-1911-4d4c-8b94-0ccc347a2e24 for instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 on n-h2-781139-2 Oct 03 15:30:42.429494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-8dbbea17-0d17-4a15-9679-f50693a44c84 req-82104ee2-e601-4906-b7a0-ce8e0b5b66d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Oct 03 15:30:42.430286 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3479/7133] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:30:42.745912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:42.746544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:42.754693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:42.755191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:42.755644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:42.756354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:42.756821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:42.757291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:42.891131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:42.899356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b8e42a9e-6578-4a25-8743-f59d53e7fa0d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1671 microversion: 2.1 time: 0.157492 Oct 03 15:30:42.899940 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3655/7134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:42 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:42.927368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:42.928071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:42.934711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:42.935178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:42.935643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:42.936334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:42.936818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:42.937275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:43.069736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:43.077785 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5aa7f0d1-4904-47a6-939a-146ae9a59bf5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1671 microversion: 2.1 time: 0.154591 Oct 03 15:30:43.078352 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3480/7135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:42 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:43.100992 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:43.101646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:43.108092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:43.108711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:43.109212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:43.109921 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:43.110390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:43.110832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:43.129704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:43.256511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:43.268524 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0bf80bb7-5a7e-4ae2-891f-551a7c3d7594 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1671 microversion: 2.1 time: 0.171147 Oct 03 15:30:43.269311 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3656/7136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:43 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:43.291505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:43.292011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:43.298797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:43.299284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:43.299697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:43.300412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:43.300863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:43.301321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:43.329019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:30:43.412439 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f550ffc4-c272-4706-b8f9-6b1b482a55a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 204 len: 0 microversion: 2.1 time: 0.124524 Oct 03 15:30:43.413481 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3481/7137] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:30:43 2022] DELETE /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:30:43.421811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:43.422471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:43.430862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:43.431360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:43.431810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:43.432523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:43.433053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:43.433496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:43.567362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:43.575284 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3177b9a-8c7e-4653-b759-2c49e8a298a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1677 microversion: 2.1 time: 0.157695 Oct 03 15:30:43.575833 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3657/7138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:43 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:44.604782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:44.605930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:44.616478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:44.617088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:44.617606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:44.618423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:44.618957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:44.619462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:44.821373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:44.825047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:44.830344 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-126dd7f5-feec-410b-b4f7-6ce4a1b26a85 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 200 len: 1677 microversion: 2.1 time: 0.232927 Oct 03 15:30:44.831222 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3482/7139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:44 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:45.579617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-61c3d09e-20d6-4bc0-9e1f-f77aa0245774 req-d0bd92c3-6cdf-4aeb-a44b-b9393979b702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ddc6b5-dfb9-4bd2-a6f7-00834fd28139", "name": "network-vif-deleted", "tag": "142fc211-1911-4d4c-8b94-0ccc347a2e24"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:45.590499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-61c3d09e-20d6-4bc0-9e1f-f77aa0245774 req-d0bd92c3-6cdf-4aeb-a44b-b9393979b702 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:45.591001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-61c3d09e-20d6-4bc0-9e1f-f77aa0245774 req-d0bd92c3-6cdf-4aeb-a44b-b9393979b702 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:45.591465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-61c3d09e-20d6-4bc0-9e1f-f77aa0245774 req-d0bd92c3-6cdf-4aeb-a44b-b9393979b702 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:45.603928 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-61c3d09e-20d6-4bc0-9e1f-f77aa0245774 req-d0bd92c3-6cdf-4aeb-a44b-b9393979b702 service nova] Creating event network-vif-deleted:142fc211-1911-4d4c-8b94-0ccc347a2e24 for instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 on n-h2-781139-2 Oct 03 15:30:45.609589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-61c3d09e-20d6-4bc0-9e1f-f77aa0245774 req-d0bd92c3-6cdf-4aeb-a44b-b9393979b702 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034021 Oct 03 15:30:45.610411 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3658/7140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:30:45.854303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:45.855033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:45.863277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:45.863899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:45.864406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:45.865198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:45.865692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:45.866198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:45.881283 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 HTTP/1.1 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '07ddc6b5-dfb9-4bd2-a6f7-00834fd28139'} Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:30:45.883072 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-680707bd-c522-477d-8688-6cd5d2ceb7e7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 404 len: 111 microversion: 2.1 time: 0.034188 Oct 03 15:30:45.887790 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3483/7141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:45 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:30:45.900105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:45.900831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:45.907355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:45.907859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:45.908305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:45.909032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:45.909497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:45.909932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:45.923457 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 HTTP/1.1 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '07ddc6b5-dfb9-4bd2-a6f7-00834fd28139'} Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:30:45.925192 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:30:45.928861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ccbfd920-eb3b-494e-a80e-92b6a70ca875 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 404 len: 111 microversion: 2.1 time: 0.030916 Oct 03 15:30:45.930201 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3659/7142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:45 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:30:45.978977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1229003558", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "e05d5a63-fc25-4511-9c18-4c732f19fd1b"}], "security_groups": [{"name": "tempest-securitygroup--1246444998"}], "key_name": "tempest-keypair-2077950262", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:46.095382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] validate_networks() for [('e05d5a63-fc25-4511-9c18-4c732f19fd1b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:30:46.494597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:30:46.495014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:30:46.495817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:30:46.496224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:30:46.496633 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:30:46.506162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:46.506641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:46.507075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:46.507793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:46.508244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:46.508703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:46.526346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:30:46.532055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for user 3b4ae280b3f74215bc3c19771f6a15bd and project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:30:46.545465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:30:46.548012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:30:46.597657 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f669032d-bf20-45a2-b2d2-f90306729a95 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.622663 Oct 03 15:30:46.598326 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3484/7143] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:30:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:30:46.610413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af53541e-d14e-470f-afb8-7b9749e8b18c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:46.610930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af53541e-d14e-470f-afb8-7b9749e8b18c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:46.716903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af53541e-d14e-470f-afb8-7b9749e8b18c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:46.725350 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af53541e-d14e-470f-afb8-7b9749e8b18c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1239 microversion: 2.1 time: 0.119501 Oct 03 15:30:46.726877 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3660/7144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:46 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:47.749523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:47.750232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:47.758878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:47.759660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:47.760100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:47.760854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:47.761321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:47.761963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:47.824451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:47.832745 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2f9cd2de-adfb-41e8-a37b-400dcc89f115 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1309 microversion: 2.1 time: 0.088393 Oct 03 15:30:47.833319 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3485/7145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:47 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:48.857816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:48.858555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:48.865837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:48.866465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:48.866981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:48.867776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:48.868251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:48.868693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:49.049711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:49.058821 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8af9a92a-b239-4d38-b842-721180414022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1365 microversion: 2.1 time: 0.205236 Oct 03 15:30:49.059412 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3661/7146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:48 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:49.145209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ac6e65e3-8eef-4db2-97ae-a9528f13f675 req-238193b7-5eaf-44ad-be35-0726f98bce8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e35735-03dc-449a-a1bb-2fcfcc07f33c", "tag": "51fb695c-eb1d-4eed-8dea-28c818d531b7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:49.158869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ac6e65e3-8eef-4db2-97ae-a9528f13f675 req-238193b7-5eaf-44ad-be35-0726f98bce8f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:49.159467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ac6e65e3-8eef-4db2-97ae-a9528f13f675 req-238193b7-5eaf-44ad-be35-0726f98bce8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:49.159966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ac6e65e3-8eef-4db2-97ae-a9528f13f675 req-238193b7-5eaf-44ad-be35-0726f98bce8f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:49.172839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ac6e65e3-8eef-4db2-97ae-a9528f13f675 req-238193b7-5eaf-44ad-be35-0726f98bce8f service nova] Creating event network-changed:51fb695c-eb1d-4eed-8dea-28c818d531b7 for instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c on n-h2-781139-2 Oct 03 15:30:49.178180 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ac6e65e3-8eef-4db2-97ae-a9528f13f675 req-238193b7-5eaf-44ad-be35-0726f98bce8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037587 Oct 03 15:30:49.178794 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3486/7147] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:30:50.083374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:50.084052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:50.091991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:50.092506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:50.092957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:50.094271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:50.094780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:50.095212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:50.406951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:50.416138 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1b23dce6-5a97-4313-979e-b6ce79c76d83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1365 microversion: 2.1 time: 0.336815 Oct 03 15:30:50.416812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3662/7148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:50 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:51.447867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:51.449079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:51.452143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:51.462441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:51.463246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:51.463962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:51.465593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:51.466347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:51.467050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:51.607933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:51.619293 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c002172c-52eb-4856-8b59-438b23b3b04b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1365 microversion: 2.1 time: 0.180264 Oct 03 15:30:51.619884 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3487/7149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:51 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:52.644343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:52.644955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:52.647861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=49 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:52.654203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:52.654706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:52.655153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:52.655861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:52.656587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:52.657124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:52.790320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:52.800334 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f49307ff-f44d-4c24-b9c2-fe5520e8d4e8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1365 microversion: 2.1 time: 0.160337 Oct 03 15:30:52.800885 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3663/7150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:52 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:53.828316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:53.829312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:53.841510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:53.842319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:53.843053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:53.844163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:53.844611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:53.845068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:54.075871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:54.085341 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f4715873-6407-479f-9cc4-5601f302155a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1365 microversion: 2.1 time: 0.263660 Oct 03 15:30:54.085874 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3488/7151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:53 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:54.442764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a0482ef0-4b6e-44b7-aee1-53fef935a61e req-b499f989-3c86-40ce-84a9-e399aa317afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e35735-03dc-449a-a1bb-2fcfcc07f33c", "name": "network-vif-plugged", "status": "completed", "tag": "51fb695c-eb1d-4eed-8dea-28c818d531b7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:54.454438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0482ef0-4b6e-44b7-aee1-53fef935a61e req-b499f989-3c86-40ce-84a9-e399aa317afd service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:54.454937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0482ef0-4b6e-44b7-aee1-53fef935a61e req-b499f989-3c86-40ce-84a9-e399aa317afd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:54.455379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a0482ef0-4b6e-44b7-aee1-53fef935a61e req-b499f989-3c86-40ce-84a9-e399aa317afd service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:54.467581 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a0482ef0-4b6e-44b7-aee1-53fef935a61e req-b499f989-3c86-40ce-84a9-e399aa317afd service nova] Creating event network-vif-plugged:51fb695c-eb1d-4eed-8dea-28c818d531b7 for instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c on n-h2-781139-2 Oct 03 15:30:54.472798 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a0482ef0-4b6e-44b7-aee1-53fef935a61e req-b499f989-3c86-40ce-84a9-e399aa317afd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Oct 03 15:30:54.473445 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3664/7152] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:30:55.111768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:55.112376 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:55.120163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:55.120679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:55.121185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:55.121915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:55.122396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:55.122845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:55.261785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:55.270323 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b2d01d99-8331-42ad-9363-f883a0941930 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1365 microversion: 2.1 time: 0.163330 Oct 03 15:30:55.270839 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3489/7153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:55 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:56.299504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:56.300222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:56.307331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:56.307820 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:56.308260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:56.308961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:56.309457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:56.309889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:56.449389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:30:56.458013 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3c7271bc-20b9-4a1b-9d4c-92ee947c39b6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1553 microversion: 2.1 time: 0.166291 Oct 03 15:30:56.458667 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3665/7154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:30:56 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:30:56.485604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:30:56.486139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:30:56.493624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:56.494107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:56.494540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:56.495229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:56.495680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:56.496102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:56.517657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:56.540217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:56.576776 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ba8eb7c-5a66-4f98-8aea-c0db6eb6c962 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097748 Oct 03 15:30:56.577427 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3490/7155] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:30:56 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:30:57.912508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b4e40911-3015-41ba-808e-6bd5e2335555 req-e73972d5-948c-4c36-a03a-fb37784f2a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e35735-03dc-449a-a1bb-2fcfcc07f33c", "tag": "51fb695c-eb1d-4eed-8dea-28c818d531b7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:30:57.917713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:30:57.924362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b4e40911-3015-41ba-808e-6bd5e2335555 req-e73972d5-948c-4c36-a03a-fb37784f2a03 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:30:57.924850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b4e40911-3015-41ba-808e-6bd5e2335555 req-e73972d5-948c-4c36-a03a-fb37784f2a03 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:30:57.925321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b4e40911-3015-41ba-808e-6bd5e2335555 req-e73972d5-948c-4c36-a03a-fb37784f2a03 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:30:57.936541 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b4e40911-3015-41ba-808e-6bd5e2335555 req-e73972d5-948c-4c36-a03a-fb37784f2a03 service nova] Creating event network-changed:51fb695c-eb1d-4eed-8dea-28c818d531b7 for instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c on n-h2-781139-2 Oct 03 15:30:57.941772 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b4e40911-3015-41ba-808e-6bd5e2335555 req-e73972d5-948c-4c36-a03a-fb37784f2a03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032993 Oct 03 15:30:57.942756 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3666/7156] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:31:31.793417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=7 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:31:31.794327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=34 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:31:31.799600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99b56112-5d0a-422b-b00a-bd04929bc220 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:31:31.810176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99b56112-5d0a-422b-b00a-bd04929bc220 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:31.810755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99b56112-5d0a-422b-b00a-bd04929bc220 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:31.811284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99b56112-5d0a-422b-b00a-bd04929bc220 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:31.835995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99b56112-5d0a-422b-b00a-bd04929bc220 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Going to try to stop instance {{(pid=128868) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 15:31:31.882634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99b56112-5d0a-422b-b00a-bd04929bc220 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action" status: 202 len: 0 microversion: 2.1 time: 0.091351 Oct 03 15:31:31.883230 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3491/7157] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:31:31 2022] POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:31:31.890635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:31:31.891446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=41 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:31:31.895823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:31.896540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:31.906182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:31.907977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:31.910385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:31.914780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:31.915456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:31.915909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:32.055502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:32.064026 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-248b55e2-3697-4ba5-a430-b24b3af0308b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.175649 Oct 03 15:31:32.064612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3667/7158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:31 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:33.093317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:33.094135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:33.102036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:33.102602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:33.103114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:33.103924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:33.104451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:33.104971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:33.247244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:33.259462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f0a2880-e410-455c-9927-719ac4fa538e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.173668 Oct 03 15:31:33.260267 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3492/7159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:33 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:34.284078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:34.284646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:34.291870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:34.292363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:34.292810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:34.293618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:34.294088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:34.294517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:34.427946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:34.436208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-631ab6d2-1292-4d05-bfea-90040f8f9fed tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.156158 Oct 03 15:31:34.436902 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3668/7160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:34 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:35.464611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:35.466017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:35.478583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:35.479389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:35.480106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:35.481102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:35.481539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:35.481968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:35.614297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:35.623041 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53c8fb58-09ab-458c-802c-47b224b28b42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.165826 Oct 03 15:31:35.623621 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3493/7161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:35 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:36.652919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:36.653632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:36.661477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:36.662003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:36.662471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:36.663214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:36.663705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:36.664159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:36.803454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:36.812125 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6c179938-c490-4ee9-90e2-d4626bfb8c75 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.165651 Oct 03 15:31:36.812681 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3669/7162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:36 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:37.839911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:37.841394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:37.852380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:37.853259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:37.854000 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:37.857173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:37.857173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:37.857173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:38.000304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:38.010822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e0aec51e-f970-43cb-aed0-8361d6d5dbf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.178014 Oct 03 15:31:38.011425 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3494/7163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:37 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:39.034368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:39.035004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:39.042379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:39.042852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:39.043387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:39.044097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:39.044560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:39.045022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:39.180603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:39.189072 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d4a501e-d1c8-4cde-a87f-46896e9e26c9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.158616 Oct 03 15:31:39.189639 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3670/7164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:39 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:40.217754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:40.218743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:40.230669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:40.231195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:40.231631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:40.232326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:40.232770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:40.233217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:40.375450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:40.387283 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d5e85e33-29ad-462a-87d2-9fb90d23dfcc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.176477 Oct 03 15:31:40.388055 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3495/7165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:40 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:41.415552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:41.416521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:41.424853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:41.425389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:41.425838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:41.426557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:41.427024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:41.427478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:41.563782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:41.575252 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69a8a880-061a-4751-a901-9cbef51722a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.166412 Oct 03 15:31:41.575837 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3671/7166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:41 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:42.603357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:42.604372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:42.616124 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:42.616919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:42.617703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:42.618837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:42.619581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:42.620273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:42.755628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:42.763873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-df8fa093-e6e7-4834-96b4-01cfc7bb11a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.167183 Oct 03 15:31:42.764465 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3496/7167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:42 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:43.794073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:43.794688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:43.801245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:43.801744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:43.802197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:43.802904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:43.803379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:43.803815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:43.950541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:43.958593 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fd1d886-21eb-46a0-8fe5-4cef7887aa2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.172836 Oct 03 15:31:43.959185 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3672/7168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:43 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:44.986745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:44.987834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:44.999250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:44.999741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:45.000181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:45.000889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:45.001378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:45.001869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:45.137520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:45.145579 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cdd0ae0c-08ef-46e3-82c7-711dd5cb96ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.165522 Oct 03 15:31:45.146168 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3497/7169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:44 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:46.173428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:46.174247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:46.183100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:46.183719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:46.184279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:46.185200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:46.185852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:46.186343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:46.317041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:46.325597 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b135ba87-4282-48e7-8519-b7f1a05b9845 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.158249 Oct 03 15:31:46.326453 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3673/7170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:46 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:47.353057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:47.354063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:47.362917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:47.363406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:47.363848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:47.364580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:47.365070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:47.365508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:47.504400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:47.512544 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49558b79-27a1-4e0f-b024-6a197660202c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1659 microversion: 2.1 time: 0.165943 Oct 03 15:31:47.513164 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3498/7171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:47 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1659 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:47.535546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:31:47.537898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:47.545267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:47.545913 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:47.546360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:47.547067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:47.547531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:47.547961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:47.576545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:47.582158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128869) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:31:47.589146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:31:47.589583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:31:47.590061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:31:47.590475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:31:47.590893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:31:47.658730 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3dcd2771-217d-43e0-b0b2-e607aab9c52a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action" status: 202 len: 0 microversion: 2.1 time: 0.127018 Oct 03 15:31:47.659483 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3674/7172] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:31:47 2022] POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:31:47.667510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:47.668127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:47.674534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:47.675023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:47.675492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:47.676190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:47.676640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:47.677093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:47.813499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:47.821412 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b895d1f8-dde7-40ec-86a2-551f4283040d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.157836 Oct 03 15:31:47.822007 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3499/7173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:47 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:48.846887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:48.847513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:48.855082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:48.855591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:48.856078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:48.856778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:48.857273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:48.857785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:48.996993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:49.005477 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af27c484-3a30-411e-938d-ff079bb32126 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1682 microversion: 2.1 time: 0.163594 Oct 03 15:31:49.006030 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3675/7174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:48 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:50.028719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:50.029369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:50.036597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:50.037108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:50.037543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:50.038273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:50.038692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:50.039111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:50.171615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:50.179790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-924da420-4065-4681-81ad-50f8bc89c45e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1687 microversion: 2.1 time: 0.155229 Oct 03 15:31:50.180379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3500/7175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:50 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:51.206250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:51.206904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:51.214524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:51.215024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:51.215472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:51.216187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:51.216651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:51.217121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:51.355544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:51.364044 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8da085b6-8355-4f6e-bb0f-0949d9ad6aa1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1687 microversion: 2.1 time: 0.162394 Oct 03 15:31:51.364632 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3676/7176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:51 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:52.300651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-821d1ced-f89e-488a-b982-1857c8166da6 req-ad07dda0-3c8f-4cff-90c4-ed963465d7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e35735-03dc-449a-a1bb-2fcfcc07f33c", "name": "network-vif-unplugged", "status": "completed", "tag": "51fb695c-eb1d-4eed-8dea-28c818d531b7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:31:52.310955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-821d1ced-f89e-488a-b982-1857c8166da6 req-ad07dda0-3c8f-4cff-90c4-ed963465d7f7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:52.311432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-821d1ced-f89e-488a-b982-1857c8166da6 req-ad07dda0-3c8f-4cff-90c4-ed963465d7f7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:52.311864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-821d1ced-f89e-488a-b982-1857c8166da6 req-ad07dda0-3c8f-4cff-90c4-ed963465d7f7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:52.326945 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-821d1ced-f89e-488a-b982-1857c8166da6 req-ad07dda0-3c8f-4cff-90c4-ed963465d7f7 service nova] Creating event network-vif-unplugged:51fb695c-eb1d-4eed-8dea-28c818d531b7 for instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c on n-h1-781139-2 Oct 03 15:31:52.332482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-821d1ced-f89e-488a-b982-1857c8166da6 req-ad07dda0-3c8f-4cff-90c4-ed963465d7f7 service nova] Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:31:52.343900 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-821d1ced-f89e-488a-b982-1857c8166da6 req-ad07dda0-3c8f-4cff-90c4-ed963465d7f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099302 Oct 03 15:31:52.344712 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3501/7177] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:31:52.388317 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:52.389242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:52.396414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:52.396937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:52.397399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:52.398104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:52.398564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:52.399153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:52.540606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:52.549058 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0cf926bf-1d7e-43b9-8a6c-92ce6bd6f7ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1686 microversion: 2.1 time: 0.164742 Oct 03 15:31:52.549839 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3677/7178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:52 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:53.578982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:53.579682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:53.586612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:53.587088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:53.587525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:53.588245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:53.589087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:53.589505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:53.728447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:53.736547 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b32750f3-5a8d-4fc4-9b52-6a6200182607 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1684 microversion: 2.1 time: 0.165620 Oct 03 15:31:53.737140 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3502/7179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:53 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:54.365697 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b7b62147-997d-4969-925d-ad5ece40068b req-1e956ef9-0882-4205-b0e8-9e476aebdccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e35735-03dc-449a-a1bb-2fcfcc07f33c", "tag": "51fb695c-eb1d-4eed-8dea-28c818d531b7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:31:54.376059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7b62147-997d-4969-925d-ad5ece40068b req-1e956ef9-0882-4205-b0e8-9e476aebdccf service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:54.376535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7b62147-997d-4969-925d-ad5ece40068b req-1e956ef9-0882-4205-b0e8-9e476aebdccf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:54.376955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b7b62147-997d-4969-925d-ad5ece40068b req-1e956ef9-0882-4205-b0e8-9e476aebdccf service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:54.388738 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b7b62147-997d-4969-925d-ad5ece40068b req-1e956ef9-0882-4205-b0e8-9e476aebdccf service nova] Creating event network-changed:51fb695c-eb1d-4eed-8dea-28c818d531b7 for instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c on n-h1-781139-2 Oct 03 15:31:54.394473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-b7b62147-997d-4969-925d-ad5ece40068b req-1e956ef9-0882-4205-b0e8-9e476aebdccf service nova] Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:31:54.405936 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b7b62147-997d-4969-925d-ad5ece40068b req-1e956ef9-0882-4205-b0e8-9e476aebdccf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044014 Oct 03 15:31:54.406942 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3678/7180] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:31:54.760433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:54.761190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:54.769249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:54.769838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:54.770307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:54.771083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:54.771632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:54.772119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:54.909424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:54.917315 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fba0a34-e75b-4259-993f-a20d41379bf9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1684 microversion: 2.1 time: 0.160863 Oct 03 15:31:54.917909 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3503/7181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:54 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:55.942830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:55.950080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:55.962904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:55.963878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:55.964377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:55.965354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:55.966023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:55.966690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:56.103734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:56.112165 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-109fcd79-d4ad-4a80-b64c-06a9a7ae7d2b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1680 microversion: 2.1 time: 0.174528 Oct 03 15:31:56.112727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3679/7182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:55 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:56.135499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:31:56.136130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:56.143615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:56.144079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:56.144514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:56.145277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:56.145703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:56.146145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:56.210116 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ad42e9a-04f6-41ca-8b53-ade7715c1822 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action" status: 204 len: 0 microversion: 2.1 time: 0.078534 Oct 03 15:31:56.210788 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3504/7183] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:31:56 2022] POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:31:56.219615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:56.220244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:56.226653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:56.227158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:56.227645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:56.228322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:56.228823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:56.229395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:56.444207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:56.452344 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d07c12be-8ae2-47b5-b9db-efb0625099c6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1680 microversion: 2.1 time: 0.236806 Oct 03 15:31:56.452932 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3680/7184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:56 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:31:57.476760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:57.477485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:57.485434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:57.486115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:57.486626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:57.487325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:57.487778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:57.488522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:57.625794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:57.628197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:31:57.635072 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-236dad31-cae6-42db-b707-aa4eec3dfb78 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1659 microversion: 2.1 time: 0.162563 Oct 03 15:31:57.635683 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3505/7185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:57 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1659 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:57.658509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:57.659062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:57.666197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:57.666689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:57.667140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:57.667846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:57.668313 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:57.668748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:57.807776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:57.816441 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f1d943d2-3969-451b-b606-1451e9525d96 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1659 microversion: 2.1 time: 0.162408 Oct 03 15:31:57.817050 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3681/7186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:57 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1659 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:31:57.840243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c90a24d-60eb-4f6c-8857-e60db67c276f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:31:57.847858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c90a24d-60eb-4f6c-8857-e60db67c276f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:57.848341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c90a24d-60eb-4f6c-8857-e60db67c276f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:57.848773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c90a24d-60eb-4f6c-8857-e60db67c276f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:57.871886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1c90a24d-60eb-4f6c-8857-e60db67c276f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Going to try to start instance {{(pid=128868) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 15:31:57.916686 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c90a24d-60eb-4f6c-8857-e60db67c276f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action" status: 202 len: 0 microversion: 2.1 time: 0.081300 Oct 03 15:31:57.917411 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3506/7187] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:31:57 2022] POST /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:31:57.927721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:57.928704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:57.936072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:57.936738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:57.937308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:57.938150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:57.938629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:57.939215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:57.974991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:31:58.110749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:58.119153 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b3226762-d161-4004-8b93-3a70124d227b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1668 microversion: 2.1 time: 0.196681 Oct 03 15:31:58.119751 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3682/7188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:57 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1668 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:31:59.148819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:31:59.150056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:31:59.163187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:59.163993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:59.164734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:59.165974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:31:59.166739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:31:59.167455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:31:59.313402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:31:59.322415 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fda5c24-97f6-4ea4-9d43-b9477613e953 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1668 microversion: 2.1 time: 0.181411 Oct 03 15:31:59.329100 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3507/7189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:31:59 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1668 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:00.044136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-45d7e587-bd9a-42dd-8461-c39b1f5747cf req-48ca48e7-7eec-4912-bb02-3b065fff1399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e35735-03dc-449a-a1bb-2fcfcc07f33c", "name": "network-vif-plugged", "status": "completed", "tag": "51fb695c-eb1d-4eed-8dea-28c818d531b7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:00.054864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45d7e587-bd9a-42dd-8461-c39b1f5747cf req-48ca48e7-7eec-4912-bb02-3b065fff1399 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:00.055351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45d7e587-bd9a-42dd-8461-c39b1f5747cf req-48ca48e7-7eec-4912-bb02-3b065fff1399 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:00.055803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-45d7e587-bd9a-42dd-8461-c39b1f5747cf req-48ca48e7-7eec-4912-bb02-3b065fff1399 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:00.068117 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-45d7e587-bd9a-42dd-8461-c39b1f5747cf req-48ca48e7-7eec-4912-bb02-3b065fff1399 service nova] Creating event network-vif-plugged:51fb695c-eb1d-4eed-8dea-28c818d531b7 for instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c on n-h1-781139-2 Oct 03 15:32:00.073351 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-45d7e587-bd9a-42dd-8461-c39b1f5747cf req-48ca48e7-7eec-4912-bb02-3b065fff1399 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094259 Oct 03 15:32:00.074016 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3683/7190] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:32:00.349536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:00.350375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:00.359972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:00.360619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:00.361263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:00.362189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:00.362741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:00.363189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:00.503553 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:00.511792 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e236f91b-f62e-4123-977a-57d02d71b4f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1672 microversion: 2.1 time: 0.168446 Oct 03 15:32:00.512405 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3508/7191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:00 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:00.535735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:00.536306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:00.543070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:00.543696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:00.544143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:00.544857 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:00.545356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:00.545794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:00.571509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:32:00.668525 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-beb38469-c0f5-4a78-ad00-bb90cd6e3e38 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 204 len: 0 microversion: 2.1 time: 0.136971 Oct 03 15:32:00.669265 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3684/7192] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:32:00 2022] DELETE /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:32:00.678682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:00.679309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:00.685538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:00.686027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:00.686464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:00.687163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:00.687619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:00.688043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:00.825231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:00.833561 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d1947db-9290-4061-a608-465c8af6d56f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1678 microversion: 2.1 time: 0.159216 Oct 03 15:32:00.834143 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3509/7193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:00 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:01.862687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:01.863410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:01.866636 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:32:01.866799 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:32:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c (ip 10.222.0.20) !!! Oct 03 15:32:01.876187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:01.876690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:01.877174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:01.877892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:01.878356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:01.878785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:02.018658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:02.026768 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f5dde65-4e7f-4850-b498-641ac3833955 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1678 microversion: 2.1 time: 0.171256 Oct 03 15:32:02.027357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3685/7194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:01 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:03.050815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:03.051415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:03.054892 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:32:03.055060 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:32:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c (ip 10.222.0.20) !!! Oct 03 15:32:03.058174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=39 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:03.069256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:03.070063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:03.070688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:03.071410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:03.071863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:03.072307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:03.144471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:03.157195 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0f62d6f9-54ad-445d-a3c0-71f4c5177e47 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 200 len: 1610 microversion: 2.1 time: 0.109535 Oct 03 15:32:03.157816 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3510/7195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:03 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 1610 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:03.215486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2c7b6181-4cc9-4128-a901-388a5d0b6194 req-289ef7f8-3756-4cb6-85a9-857bfe319dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e35735-03dc-449a-a1bb-2fcfcc07f33c", "name": "network-vif-deleted", "tag": "51fb695c-eb1d-4eed-8dea-28c818d531b7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:03.224639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:03.231509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2c7b6181-4cc9-4128-a901-388a5d0b6194 req-289ef7f8-3756-4cb6-85a9-857bfe319dd3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:03.231999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2c7b6181-4cc9-4128-a901-388a5d0b6194 req-289ef7f8-3756-4cb6-85a9-857bfe319dd3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:03.232446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2c7b6181-4cc9-4128-a901-388a5d0b6194 req-289ef7f8-3756-4cb6-85a9-857bfe319dd3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:03.255264 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2c7b6181-4cc9-4128-a901-388a5d0b6194 req-289ef7f8-3756-4cb6-85a9-857bfe319dd3 service nova] Creating event network-vif-deleted:51fb695c-eb1d-4eed-8dea-28c818d531b7 for instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c on n-h1-781139-2 Oct 03 15:32:03.261438 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2c7b6181-4cc9-4128-a901-388a5d0b6194 req-289ef7f8-3756-4cb6-85a9-857bfe319dd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051828 Oct 03 15:32:03.262075 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3686/7196] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:32:04.182088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:04.182660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:04.190069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:04.190603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:04.190955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:04.191676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:04.192142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:04.192568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:04.214862 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c HTTP/1.1 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '82e35735-03dc-449a-a1bb-2fcfcc07f33c'} Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:32:04.216570 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-90533ee5-ecec-4d06-b0cf-52f49c1e43de tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 404 len: 111 microversion: 2.1 time: 0.040361 Oct 03 15:32:04.221203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3511/7197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:04 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:32:04.233714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:04.234571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:04.241316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:04.241823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:04.242289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:04.243299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:04.243775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:04.244208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:04.259268 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c HTTP/1.1 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '82e35735-03dc-449a-a1bb-2fcfcc07f33c'} Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:32:04.261003 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7d13cb97-fa67-4d54-8860-eaee64466a7f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 404 len: 111 microversion: 2.1 time: 0.034079 Oct 03 15:32:04.265582 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3687/7198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:04 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:32:04.311911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-350628046", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "e05d5a63-fc25-4511-9c18-4c732f19fd1b"}], "security_groups": [{"name": "tempest-securitygroup--1246444998"}], "key_name": "tempest-keypair-2077950262", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:04.419784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] validate_networks() for [('e05d5a63-fc25-4511-9c18-4c732f19fd1b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:32:04.879727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:32:04.880156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:32:04.880694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:32:04.881129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:32:04.881529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:32:04.894120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:04.894606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:04.895042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:04.895770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:04.896230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:04.896645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:04.916714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:32:04.922340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for user 3b4ae280b3f74215bc3c19771f6a15bd and project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:32:04.935967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:32:04.938371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:32:04.989927 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c6eac004-40e9-44b9-b88f-e0e3a6168918 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.681915 Oct 03 15:32:04.990593 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3512/7199] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:32:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:32:05.002372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c34665d2-40c1-4e2d-afd6-fe3864f1d418 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:05.003034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c34665d2-40c1-4e2d-afd6-fe3864f1d418 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:05.069388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c34665d2-40c1-4e2d-afd6-fe3864f1d418 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:05.078928 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c34665d2-40c1-4e2d-afd6-fe3864f1d418 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1238 microversion: 2.1 time: 0.080611 Oct 03 15:32:05.088959 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3688/7200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:04 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:06.104727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:06.105533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:06.113534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:06.114177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:06.114822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:06.115598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:06.116027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:06.116458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:06.182450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:06.190153 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-332df40f-6ed4-428a-9e54-604969209d6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1298 microversion: 2.1 time: 0.090345 Oct 03 15:32:06.190729 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3513/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:06 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:07.215609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:07.216229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:07.224768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:07.225304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:07.225762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:07.226554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:07.226960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:07.227404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:07.448164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:07.456591 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-81b6bac9-b514-495c-a25c-95126d04038d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1364 microversion: 2.1 time: 0.245375 Oct 03 15:32:07.457207 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3689/7202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:07 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:07.736442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d8a92b9f-714d-4ff9-9c51-fa6288804175 req-4a485bf7-96d0-4314-b98f-f95790bdf3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:07.746770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d8a92b9f-714d-4ff9-9c51-fa6288804175 req-4a485bf7-96d0-4314-b98f-f95790bdf3ff service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:07.747249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d8a92b9f-714d-4ff9-9c51-fa6288804175 req-4a485bf7-96d0-4314-b98f-f95790bdf3ff service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:07.747680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d8a92b9f-714d-4ff9-9c51-fa6288804175 req-4a485bf7-96d0-4314-b98f-f95790bdf3ff service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:07.760142 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d8a92b9f-714d-4ff9-9c51-fa6288804175 req-4a485bf7-96d0-4314-b98f-f95790bdf3ff service nova] Creating event network-changed:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h2-781139-2 Oct 03 15:32:07.765377 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d8a92b9f-714d-4ff9-9c51-fa6288804175 req-4a485bf7-96d0-4314-b98f-f95790bdf3ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085623 Oct 03 15:32:07.765993 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3514/7203] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:32:08.485579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:08.486284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:08.496829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:08.497530 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:08.498157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:08.499204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:08.499885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:08.500467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:08.641365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:08.649640 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8ae30b5b-baa1-4290-a8b6-cb3af98b3457 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1364 microversion: 2.1 time: 0.170487 Oct 03 15:32:08.650216 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3690/7204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:08 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:09.678285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:09.679318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:09.691394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:09.692188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:09.693041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:09.693751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:09.694224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:09.694653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:09.844111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:09.852364 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-52703892-45b1-4da3-a7d3-1370ccae04d7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1364 microversion: 2.1 time: 0.181360 Oct 03 15:32:09.853119 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3515/7205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:09 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:10.876056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:10.876675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:10.884340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:10.884840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:10.885328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:10.886084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:10.886525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:10.886964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:11.026049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:11.034570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ca7e485-dbed-4a3e-9f14-7004f204be3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1364 microversion: 2.1 time: 0.162560 Oct 03 15:32:11.035135 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3691/7206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:10 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:12.062518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:12.063147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:12.071217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:12.071717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:12.072162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:12.072870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:12.073360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:12.073794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:12.547814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:12.558929 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-384de90e-4ef9-478b-8181-2b7bae3e9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1364 microversion: 2.1 time: 0.500197 Oct 03 15:32:12.559601 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3516/7207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:12 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1364 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:12.882825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-149eddbe-1152-47a7-a15b-5e8ec9cc3c36 req-393ee2ed-e618-4356-9ee9-cad82502356d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "name": "network-vif-plugged", "status": "completed", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:12.893567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-149eddbe-1152-47a7-a15b-5e8ec9cc3c36 req-393ee2ed-e618-4356-9ee9-cad82502356d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:12.894074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-149eddbe-1152-47a7-a15b-5e8ec9cc3c36 req-393ee2ed-e618-4356-9ee9-cad82502356d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:12.894499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-149eddbe-1152-47a7-a15b-5e8ec9cc3c36 req-393ee2ed-e618-4356-9ee9-cad82502356d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:12.905954 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-149eddbe-1152-47a7-a15b-5e8ec9cc3c36 req-393ee2ed-e618-4356-9ee9-cad82502356d service nova] Creating event network-vif-plugged:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h2-781139-2 Oct 03 15:32:12.911077 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-149eddbe-1152-47a7-a15b-5e8ec9cc3c36 req-393ee2ed-e618-4356-9ee9-cad82502356d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032205 Oct 03 15:32:12.911863 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3692/7208] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:32:13.583365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:13.583976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:13.591512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:13.591994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:13.592424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:13.593166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:13.593621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:13.594037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:13.745314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:13.753628 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a34f0982-6344-4aab-9e7f-da413db11d41 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1364 microversion: 2.1 time: 0.174267 Oct 03 15:32:13.754216 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3517/7209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:13 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:14.779506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:14.780347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:14.787792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:14.788339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:14.788840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:14.789654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:14.790183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:14.790666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:14.937933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:14.947960 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9aa6c91a-0ed7-4c55-b4a1-6970e64acd90 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1552 microversion: 2.1 time: 0.174204 Oct 03 15:32:14.948561 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3693/7210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:14 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:14.971882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:14.972433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:14.975461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:14.976166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:14.982087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:14.982570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:14.983005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:14.983695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:14.984144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:14.984563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:15.074023 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-caa3b7ed-8e63-4258-bc84-5b6f3b2ec6f5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105891 Oct 03 15:32:15.074947 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3518/7211] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:32:14 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:32:16.030334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0f19f3b4-6c52-4e09-b991-7b40c3a5e0fc req-afb64d90-e041-4ac7-b78f-4d5eb706aaad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:16.035512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:16.042249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0f19f3b4-6c52-4e09-b991-7b40c3a5e0fc req-afb64d90-e041-4ac7-b78f-4d5eb706aaad service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:16.042980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0f19f3b4-6c52-4e09-b991-7b40c3a5e0fc req-afb64d90-e041-4ac7-b78f-4d5eb706aaad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:16.043730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0f19f3b4-6c52-4e09-b991-7b40c3a5e0fc req-afb64d90-e041-4ac7-b78f-4d5eb706aaad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:16.055206 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0f19f3b4-6c52-4e09-b991-7b40c3a5e0fc req-afb64d90-e041-4ac7-b78f-4d5eb706aaad service nova] Creating event network-changed:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h2-781139-2 Oct 03 15:32:16.060405 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0f19f3b4-6c52-4e09-b991-7b40c3a5e0fc req-afb64d90-e041-4ac7-b78f-4d5eb706aaad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033911 Oct 03 15:32:16.061027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3694/7212] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:32:44.570980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:44.572371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:44.579487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:44.583319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:44.596069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:44.596523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:44.597006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:44.597695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:44.598142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:44.598564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:44.628412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:44.634493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Old instance type m1.heat2, new instance type m1.heat {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:32:44.641276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:32:44.641697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:32:44.642166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:32:44.642575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:32:44.642983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:32:44.711105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-04ce657b-429f-44fa-9051-dca7d7bb8328 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431/action" status: 202 len: 0 microversion: 2.1 time: 0.143967 Oct 03 15:32:44.711920 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3519/7213] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:32:44 2022] POST /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:32:44.718789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=19 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:44.720037 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:32:44.724296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:44.725111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:44.732811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:44.733368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:44.733803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:44.734711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:44.735191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:44.735630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:44.910711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:44.918895 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36c0d080-4c1f-4e90-8590-94809e0c4d5f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1680 microversion: 2.1 time: 0.202294 Oct 03 15:32:44.919461 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3695/7214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:44 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:45.947230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:45.948096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:45.958458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:45.959134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:45.959746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:45.960694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:45.961422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:45.962027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:46.107886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:46.118094 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d80e82e8-496b-454d-bb37-b5b41ef69e40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1680 microversion: 2.1 time: 0.177666 Oct 03 15:32:46.118691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3520/7215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:45 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:47.148163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:47.149243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:47.165865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:47.166699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:47.167448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:47.168615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:47.169443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:47.170171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:47.310472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:47.319091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8e7dc001-7f25-4fe3-8e9b-8eb793aa816f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.177845 Oct 03 15:32:47.319674 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3696/7216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:47 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:48.347307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:48.348001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:48.356413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:48.357060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:48.357569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:48.358381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:48.358909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:48.359399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:48.514904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:48.523501 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0e598d7c-12db-419a-b458-0b6f77c3d8e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.182475 Oct 03 15:32:48.524097 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3521/7217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:48 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:49.554012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:49.555087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:49.565505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:49.566017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:49.566475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:49.567191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:49.567665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:49.568111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:49.710823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:49.722692 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a0735c6-3c41-4a57-84e9-98805558f103 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.175638 Oct 03 15:32:49.723291 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3697/7218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:49 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:50.747317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:50.747856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:50.755278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:50.755767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:50.756208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:50.756901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:50.757407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:50.757833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:50.895840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:50.906506 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7bf7ddc-2097-47bd-9e57-7a5e1285a3f2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.163119 Oct 03 15:32:50.907340 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3522/7219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:50 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:51.931106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:51.931828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:51.940840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:51.941364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:51.941811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:51.942511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:51.942966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:51.943371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:52.085725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:52.094365 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-263bc2b7-c9d2-411e-9fdd-8234e001724e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.167659 Oct 03 15:32:52.094957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3698/7220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:51 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:53.122086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:53.123079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:53.138944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:53.139703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:53.140427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:53.141660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:53.142369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:53.143067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:53.280603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:53.288614 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-81d43ce8-6c65-4a17-a147-23b91149b8ac tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.173259 Oct 03 15:32:53.289231 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3523/7221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:53 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:54.312437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:54.313215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:54.320411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:54.320907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:54.321383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:54.322126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:54.322568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:54.323003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:54.458737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:54.469752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-350fc998-bbe8-4a8c-93bc-55ebee54cd3c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.161322 Oct 03 15:32:54.470370 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3699/7222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:54 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:55.494239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:55.494859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:55.502147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:55.502638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:55.503076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:55.503773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:55.504225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:55.504652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:55.649914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:55.662310 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-955a70cd-3a41-4cc2-9837-f6fe3dc9cdff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.172150 Oct 03 15:32:55.663118 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3524/7223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:55 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:56.686278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:56.686919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:56.697858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:56.698359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:56.698807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:56.699520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:56.700009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:56.700445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:56.840844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:56.849329 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5beca06-df63-44cf-9349-7dfcd41a948b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.166955 Oct 03 15:32:56.849919 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3700/7224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:56 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:57.882957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:57.883687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:57.895456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:57.896259 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:57.896998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:57.898109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:57.898881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:57.899592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:58.041801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:58.049901 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4afcbf0c-0d16-4b9e-8bdd-3ba33a60b3a5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1685 microversion: 2.1 time: 0.173605 Oct 03 15:32:58.050483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3525/7225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:57 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:32:58.994187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-abda1953-9233-4587-b56b-4a888bac48cd req-894eaf4e-2489-4907-a3b3-9af964da570b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "name": "network-vif-unplugged", "status": "completed", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:32:59.005571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-abda1953-9233-4587-b56b-4a888bac48cd req-894eaf4e-2489-4907-a3b3-9af964da570b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:59.006197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-abda1953-9233-4587-b56b-4a888bac48cd req-894eaf4e-2489-4907-a3b3-9af964da570b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:59.006678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-abda1953-9233-4587-b56b-4a888bac48cd req-894eaf4e-2489-4907-a3b3-9af964da570b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:59.020650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-abda1953-9233-4587-b56b-4a888bac48cd req-894eaf4e-2489-4907-a3b3-9af964da570b service nova] Creating event network-vif-unplugged:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h1-781139-2 Oct 03 15:32:59.026924 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-abda1953-9233-4587-b56b-4a888bac48cd req-894eaf4e-2489-4907-a3b3-9af964da570b service nova] Instance edac07ee-6d97-45d3-beb3-74a5d2121431 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:32:59.037902 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-abda1953-9233-4587-b56b-4a888bac48cd req-894eaf4e-2489-4907-a3b3-9af964da570b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048367 Oct 03 15:32:59.038671 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3701/7226] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:32:59.074662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:32:59.075921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:32:59.082179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:59.082865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:59.083511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:59.084212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:32:59.084666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:32:59.085126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:32:59.319225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:32:59.327640 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c58e55cd-bf7d-4f88-9362-6b7dd73a9c37 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1684 microversion: 2.1 time: 0.257876 Oct 03 15:32:59.328223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3526/7227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:32:59 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1684 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:00.358613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:00.359720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:00.369738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:00.370244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:00.370701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:00.371422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:00.371895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:00.372363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:00.527361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:00.540326 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edf52166-492c-4fe6-8ff2-d0c1eca3147f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1682 microversion: 2.1 time: 0.190430 Oct 03 15:33:00.541140 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3702/7228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:00 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:01.056687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5f1ce43c-24ae-4c56-964b-3324803eb94d req-1a3b7f47-4cd9-40dc-a618-f7444ddf226b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:01.067468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f1ce43c-24ae-4c56-964b-3324803eb94d req-1a3b7f47-4cd9-40dc-a618-f7444ddf226b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:01.067946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f1ce43c-24ae-4c56-964b-3324803eb94d req-1a3b7f47-4cd9-40dc-a618-f7444ddf226b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:01.068378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f1ce43c-24ae-4c56-964b-3324803eb94d req-1a3b7f47-4cd9-40dc-a618-f7444ddf226b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:01.080757 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5f1ce43c-24ae-4c56-964b-3324803eb94d req-1a3b7f47-4cd9-40dc-a618-f7444ddf226b service nova] Creating event network-changed:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h1-781139-2 Oct 03 15:33:01.086650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-5f1ce43c-24ae-4c56-964b-3324803eb94d req-1a3b7f47-4cd9-40dc-a618-f7444ddf226b service nova] Instance edac07ee-6d97-45d3-beb3-74a5d2121431 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:33:01.098609 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5f1ce43c-24ae-4c56-964b-3324803eb94d req-1a3b7f47-4cd9-40dc-a618-f7444ddf226b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046874 Oct 03 15:33:01.099203 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3527/7229] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:01.568571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:01.569236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:01.576789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:01.577405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:01.577785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:01.578501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:01.578970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:01.579409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:01.724049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:01.732415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d030fb39-249d-4faa-a5c0-d5a61670b851 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1682 microversion: 2.1 time: 0.167802 Oct 03 15:33:01.733027 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3703/7230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:01 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:02.757901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:02.758617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:02.766162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:02.767545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:02.767545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:02.767957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:02.768414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:02.768843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:03.009906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:03.018636 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9732eded-1abf-46ea-9e10-a6aab6fc2e11 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1682 microversion: 2.1 time: 0.266201 Oct 03 15:33:03.019378 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3528/7231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:02 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:04.044587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:04.045262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:04.053933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.054491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.054937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.055651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.056114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.056546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.190960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:04.199435 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d22fe477-0966-4178-95fc-24625345cb88 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1679 microversion: 2.1 time: 0.159153 Oct 03 15:33:04.200003 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3704/7232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:04 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:04.222869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:04.223538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:04.230895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.231482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.231996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.232773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.233319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.233815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.276854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.277280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.277738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.278499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.278954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.279405 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.301815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:33:04.307776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for user 3b4ae280b3f74215bc3c19771f6a15bd and project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:33:04.417143 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d900a89-0d0c-4830-b885-a73b76384cf0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431/action" status: 202 len: 0 microversion: 2.1 time: 0.198039 Oct 03 15:33:04.417765 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3529/7233] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:33:04 2022] POST /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:33:04.429861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:04.430766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:04.437720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.438224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.438673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.439425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:04.439895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:04.440336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:04.584627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:04.594030 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fac3e481-c083-4437-ae34-893280ce82b0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1678 microversion: 2.1 time: 0.170286 Oct 03 15:33:04.594952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3705/7234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:04 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:05.620183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:05.620898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:05.628735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:05.629317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:05.629690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:05.630387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:05.630839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:05.631265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:05.768938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:05.777092 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9ad75d05-ef6e-425a-ad94-d0f0f6d3ab27 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1678 microversion: 2.1 time: 0.162430 Oct 03 15:33:05.777681 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3530/7235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:05 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:06.218898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-f137083a-67ed-4820-8eaa-0ff04c1d3220 req-ba686a43-233c-45bd-a962-d68018aaa653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "name": "network-vif-plugged", "status": "completed", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:06.231100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f137083a-67ed-4820-8eaa-0ff04c1d3220 req-ba686a43-233c-45bd-a962-d68018aaa653 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:06.231596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f137083a-67ed-4820-8eaa-0ff04c1d3220 req-ba686a43-233c-45bd-a962-d68018aaa653 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:06.232046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-f137083a-67ed-4820-8eaa-0ff04c1d3220 req-ba686a43-233c-45bd-a962-d68018aaa653 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:06.249748 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-f137083a-67ed-4820-8eaa-0ff04c1d3220 req-ba686a43-233c-45bd-a962-d68018aaa653 service nova] Creating event network-vif-plugged:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h1-781139-2 Oct 03 15:33:06.255624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-f137083a-67ed-4820-8eaa-0ff04c1d3220 req-ba686a43-233c-45bd-a962-d68018aaa653 service nova] Instance edac07ee-6d97-45d3-beb3-74a5d2121431 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:33:06.267247 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-f137083a-67ed-4820-8eaa-0ff04c1d3220 req-ba686a43-233c-45bd-a962-d68018aaa653 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052092 Oct 03 15:33:06.268074 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3706/7236] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:06.805638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:06.806223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:06.813579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:06.814074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:06.814507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:06.815201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:06.815648 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:06.816066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:06.834532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:06.962063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:06.970491 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb8ef687-0d76-4f89-9ed3-42b96811c022 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1678 microversion: 2.1 time: 0.171172 Oct 03 15:33:06.971086 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3531/7237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:06 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:07.996103 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:07.996959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:08.003720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:08.004525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:08.004981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:08.005705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:08.006361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:08.007001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:08.193071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-14736523-2de1-4046-803f-80bf0d970051 req-4144e5d0-ebc5-4e34-88f5-a4af2d35bcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "name": "network-vif-unplugged", "status": "completed", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:08.204212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-14736523-2de1-4046-803f-80bf0d970051 req-4144e5d0-ebc5-4e34-88f5-a4af2d35bcda service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:08.204743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-14736523-2de1-4046-803f-80bf0d970051 req-4144e5d0-ebc5-4e34-88f5-a4af2d35bcda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:08.205193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-14736523-2de1-4046-803f-80bf0d970051 req-4144e5d0-ebc5-4e34-88f5-a4af2d35bcda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:08.214136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:08.218449 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-14736523-2de1-4046-803f-80bf0d970051 req-4144e5d0-ebc5-4e34-88f5-a4af2d35bcda service nova] Creating event network-vif-unplugged:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h2-781139-2 Oct 03 15:33:08.224054 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-88cbdff6-c980-4fee-87f6-8a10a0e0a4ec tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1678 microversion: 2.1 time: 0.233400 Oct 03 15:33:08.236951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-14736523-2de1-4046-803f-80bf0d970051 req-4144e5d0-ebc5-4e34-88f5-a4af2d35bcda service nova] Instance edac07ee-6d97-45d3-beb3-74a5d2121431 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:33:08.237351 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-14736523-2de1-4046-803f-80bf0d970051 req-4144e5d0-ebc5-4e34-88f5-a4af2d35bcda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048000 Oct 03 15:33:08.238322 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3532/7239] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:08.238458 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3707/7239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:07 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:09.251189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:09.251890 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:09.258753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:09.259238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:09.259676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:09.260370 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:09.260821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:09.261280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:09.395873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:09.407756 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43e214d6-3a22-447d-9062-0e3f58dbf3e4 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1678 microversion: 2.1 time: 0.161616 Oct 03 15:33:09.408568 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3533/7240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:09 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:10.270696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-775d69fc-7f7b-4015-bd69-1644b3e0b199 req-ad3eaf76-33fc-4c19-9252-5f29f03b35be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:10.287957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-775d69fc-7f7b-4015-bd69-1644b3e0b199 req-ad3eaf76-33fc-4c19-9252-5f29f03b35be service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:10.288764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-775d69fc-7f7b-4015-bd69-1644b3e0b199 req-ad3eaf76-33fc-4c19-9252-5f29f03b35be service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:10.289835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-775d69fc-7f7b-4015-bd69-1644b3e0b199 req-ad3eaf76-33fc-4c19-9252-5f29f03b35be service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:10.301816 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-775d69fc-7f7b-4015-bd69-1644b3e0b199 req-ad3eaf76-33fc-4c19-9252-5f29f03b35be service nova] Creating event network-changed:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h2-781139-2 Oct 03 15:33:10.307587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-775d69fc-7f7b-4015-bd69-1644b3e0b199 req-ad3eaf76-33fc-4c19-9252-5f29f03b35be service nova] Instance edac07ee-6d97-45d3-beb3-74a5d2121431 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:33:10.318406 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-775d69fc-7f7b-4015-bd69-1644b3e0b199 req-ad3eaf76-33fc-4c19-9252-5f29f03b35be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054209 Oct 03 15:33:10.319039 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3708/7241] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:10.433662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:10.434279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:10.441727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:10.442226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:10.442657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:10.443391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:10.443860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:10.444294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:10.677920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:10.686822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d384de5b-b3c9-4d9e-84f7-904a22912647 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1678 microversion: 2.1 time: 0.256845 Oct 03 15:33:10.687946 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3534/7242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:10 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1678 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:11.719256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:11.720235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:11.730425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:11.730927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:11.731375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:11.732098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:11.732556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:11.733018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:11.871604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:11.881319 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8b6e917b-ba9e-4781-8232-ceb8e296dfaa tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1671 microversion: 2.1 time: 0.172266 Oct 03 15:33:11.881919 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3709/7243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:11 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:11.904415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:11.905050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:11.912104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:11.912579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:11.913050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:11.913725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:11.914168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:11.914622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:12.053006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:12.061460 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6c886884-5690-4e51-9a67-2289c4b87f9d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1671 microversion: 2.1 time: 0.160955 Oct 03 15:33:12.062057 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3535/7244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:11 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:12.084076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:12.084705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:12.091957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:12.092459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:12.092908 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:12.093658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:12.094123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:12.094552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:12.231945 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:12.240395 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ab093893-055c-4d90-8b22-05007e0fce91 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1671 microversion: 2.1 time: 0.160248 Oct 03 15:33:12.240979 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3710/7245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:12 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:12.263114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:12.263548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:12.269680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:12.270159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:12.270587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:12.271267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:12.271717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:12.272135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:12.298309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:33:12.377218 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c2fc88e-8e94-4c80-9bbd-fe0183ae8f39 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 204 len: 0 microversion: 2.1 time: 0.117837 Oct 03 15:33:12.378153 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3536/7246] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:33:12 2022] DELETE /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:33:12.387116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:12.387760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:12.394056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:12.394566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:12.395022 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:12.395743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:12.396214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:12.396656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:12.530619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:12.538887 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce0f5f89-f9e2-4417-8fbb-4e4b983d984b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1677 microversion: 2.1 time: 0.155843 Oct 03 15:33:12.539666 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3711/7247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:12 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:33:13.162087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-765f4bf9-50f8-44d0-bdfb-71e62b9baca8 req-441c7166-af28-4d41-b510-59e9a4390b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "name": "network-vif-plugged", "status": "completed", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:13.173330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-765f4bf9-50f8-44d0-bdfb-71e62b9baca8 req-441c7166-af28-4d41-b510-59e9a4390b38 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:13.173864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-765f4bf9-50f8-44d0-bdfb-71e62b9baca8 req-441c7166-af28-4d41-b510-59e9a4390b38 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:13.174306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-765f4bf9-50f8-44d0-bdfb-71e62b9baca8 req-441c7166-af28-4d41-b510-59e9a4390b38 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:13.185866 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-765f4bf9-50f8-44d0-bdfb-71e62b9baca8 req-441c7166-af28-4d41-b510-59e9a4390b38 service nova] Creating event network-vif-plugged:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h2-781139-2 Oct 03 15:33:13.190687 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-765f4bf9-50f8-44d0-bdfb-71e62b9baca8 req-441c7166-af28-4d41-b510-59e9a4390b38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032867 Oct 03 15:33:13.191300 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3537/7248] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:13.567380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:13.568418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:13.579970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:13.580783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:13.581573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:13.582741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:13.583496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:13.584221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:13.603768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=100 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:13.801195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:13.809649 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78e8d399-89d9-4222-a006-532f8e6a1dcb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1677 microversion: 2.1 time: 0.248947 Oct 03 15:33:13.810267 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3712/7249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:13 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:14.517843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:14.522495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6e39786c-0a8a-46c1-9d3a-83e541b728a9 req-131a7997-b1a2-46ac-bae2-861526c449d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edac07ee-6d97-45d3-beb3-74a5d2121431", "name": "network-vif-deleted", "tag": "42dfbed4-5eee-473e-a31f-3e648a46d553"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:14.533588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6e39786c-0a8a-46c1-9d3a-83e541b728a9 req-131a7997-b1a2-46ac-bae2-861526c449d2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:14.534953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6e39786c-0a8a-46c1-9d3a-83e541b728a9 req-131a7997-b1a2-46ac-bae2-861526c449d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:14.535391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6e39786c-0a8a-46c1-9d3a-83e541b728a9 req-131a7997-b1a2-46ac-bae2-861526c449d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:14.547822 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6e39786c-0a8a-46c1-9d3a-83e541b728a9 req-131a7997-b1a2-46ac-bae2-861526c449d2 service nova] Creating event network-vif-deleted:42dfbed4-5eee-473e-a31f-3e648a46d553 for instance edac07ee-6d97-45d3-beb3-74a5d2121431 on n-h2-781139-2 Oct 03 15:33:14.553315 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6e39786c-0a8a-46c1-9d3a-83e541b728a9 req-131a7997-b1a2-46ac-bae2-861526c449d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037076 Oct 03 15:33:14.557070 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3538/7250] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:14.835189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:14.835948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:14.840815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:14.844693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:14.845224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:14.845676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:14.846403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:14.846858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:14.847294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:14.885235 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:14.885739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:14.886189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:14.886659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lazy-loading 'fault' on Instance uuid edac07ee-6d97-45d3-beb3-74a5d2121431 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:33:14.936114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:14.945921 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cb8aed6b-3959-46be-96be-8e99e58fef22 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 200 len: 1328 microversion: 2.1 time: 0.114745 Oct 03 15:33:14.946600 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3713/7251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:14 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:15.977389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:15.978433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:15.980752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:15.986374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:15.986858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:15.987296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:15.987997 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:15.988452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:15.988872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:16.003493 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 HTTP/1.1 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'edac07ee-6d97-45d3-beb3-74a5d2121431'} Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:33:16.005219 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4b15dae0-65d7-44da-bfa7-c81775a987ff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 404 len: 111 microversion: 2.1 time: 0.038297 Oct 03 15:33:16.010091 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3539/7252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:15 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:33:16.020953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:16.021604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:16.028419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:16.028906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:16.029381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:16.030075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:16.030536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:16.030974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:16.044326 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 HTTP/1.1 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'edac07ee-6d97-45d3-beb3-74a5d2121431'} Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:33:16.046006 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65dbcb2b-ad47-480b-9d37-40a953bfd09c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 404 len: 111 microversion: 2.1 time: 0.030391 Oct 03 15:33:16.050682 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3714/7253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:16 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:33:16.101260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1646693924", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "e05d5a63-fc25-4511-9c18-4c732f19fd1b"}], "security_groups": [{"name": "tempest-securitygroup--1246444998"}], "key_name": "tempest-keypair-2077950262", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:16.220726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] validate_networks() for [('e05d5a63-fc25-4511-9c18-4c732f19fd1b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:33:16.609879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:33:16.610330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:33:16.610803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:33:16.611215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:33:16.611629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:33:16.621586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:16.622074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:16.622524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:16.623252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:16.623705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:16.624132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:16.642469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:33:16.648066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for user 3b4ae280b3f74215bc3c19771f6a15bd and project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:33:16.662265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:33:16.664603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:33:16.714043 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a37e08b1-e8f1-4e22-97f4-f1d4f0fd374d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.619053 Oct 03 15:33:16.714682 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3540/7254] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:33:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:33:16.726079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ced1b26-1887-42a3-8c36-77a4cf94affb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:16.726665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ced1b26-1887-42a3-8c36-77a4cf94affb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:16.779001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ced1b26-1887-42a3-8c36-77a4cf94affb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:16.786207 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ced1b26-1887-42a3-8c36-77a4cf94affb tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1239 microversion: 2.1 time: 0.064002 Oct 03 15:33:16.786780 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3715/7255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:16 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:33:17.811438 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:17.812025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:17.819158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:17.819651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:17.820079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:17.820803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:17.821560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:17.821765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:17.929880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:17.938428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-21693db9-cc17-45d8-ba53-1a5897732c10 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1299 microversion: 2.1 time: 0.132506 Oct 03 15:33:17.938993 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3541/7256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:17 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:18.967360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:18.967936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:18.974096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:18.974593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:18.975036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:18.975741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:18.976200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:18.976634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:19.120626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:19.129088 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-91b578c0-52bb-499e-b881-7746136b8586 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.166074 Oct 03 15:33:19.129709 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3716/7257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:18 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:19.384651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f8d4203b-5719-4abf-b2ae-d4316cf10889 req-efc88687-5bf0-4ad3-b475-f63a4aefe97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:19.398524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f8d4203b-5719-4abf-b2ae-d4316cf10889 req-efc88687-5bf0-4ad3-b475-f63a4aefe97f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:19.399137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f8d4203b-5719-4abf-b2ae-d4316cf10889 req-efc88687-5bf0-4ad3-b475-f63a4aefe97f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:19.399689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f8d4203b-5719-4abf-b2ae-d4316cf10889 req-efc88687-5bf0-4ad3-b475-f63a4aefe97f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:19.414992 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f8d4203b-5719-4abf-b2ae-d4316cf10889 req-efc88687-5bf0-4ad3-b475-f63a4aefe97f service nova] Creating event network-changed:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h1-781139-2 Oct 03 15:33:19.430774 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f8d4203b-5719-4abf-b2ae-d4316cf10889 req-efc88687-5bf0-4ad3-b475-f63a4aefe97f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054923 Oct 03 15:33:19.431486 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3542/7258] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:20.159994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:20.160851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:20.174021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:20.174838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:20.175584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:20.176750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:20.177570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:20.178290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:20.315728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:20.325496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2312ba74-c917-41a8-9968-5e2932672d04 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.173909 Oct 03 15:33:20.326088 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3717/7259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:20 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:21.360162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:21.360980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:21.369300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:21.369910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:21.370450 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:21.371309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:21.371875 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:21.372518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:21.515331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:21.527358 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29305888-4127-40dd-a5ab-39effeace83c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.174580 Oct 03 15:33:21.528136 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3543/7260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:21 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:22.551545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:22.552180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:22.559625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:22.560122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:22.560569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:22.561322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:22.561783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:22.562199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:22.715504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:22.723914 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ff27b58-abf4-495d-bcce-e23d280dc92b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.176397 Oct 03 15:33:22.724718 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3718/7261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:22 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:23.750047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:23.750696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:23.758044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:23.758544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:23.758975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:23.759667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:23.760114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:23.760534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:23.903010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:23.911124 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5335aa93-f1a5-413c-8f23-f9b926cdf61f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.165857 Oct 03 15:33:23.911703 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3544/7262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:23 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:24.939278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:24.940575 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:24.951296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:24.951796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:24.952248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:24.952959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:24.953457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:24.953898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:25.091899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:25.100208 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a3eb91b-ac77-498f-9e29-a677b4fec484 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.167651 Oct 03 15:33:25.100760 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3719/7263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:24 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:26.127385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:26.128311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:26.139209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:26.139954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:26.140617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:26.141728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:26.142425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:26.143078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:26.280296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:26.288288 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3c49d60b-7b72-4e54-a73b-e4f4a29cf0cd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.166943 Oct 03 15:33:26.291058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3545/7264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:26 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:26.337360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c3c52c26-81ad-46b9-abb8-4c6c5813b83b req-856778cf-92fa-4b5b-86b2-d6d14c0b6cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "name": "network-vif-plugged", "status": "completed", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:26.349703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c3c52c26-81ad-46b9-abb8-4c6c5813b83b req-856778cf-92fa-4b5b-86b2-d6d14c0b6cda service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:26.350247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c3c52c26-81ad-46b9-abb8-4c6c5813b83b req-856778cf-92fa-4b5b-86b2-d6d14c0b6cda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:26.350674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c3c52c26-81ad-46b9-abb8-4c6c5813b83b req-856778cf-92fa-4b5b-86b2-d6d14c0b6cda service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:26.362639 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c3c52c26-81ad-46b9-abb8-4c6c5813b83b req-856778cf-92fa-4b5b-86b2-d6d14c0b6cda service nova] Creating event network-vif-plugged:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h1-781139-2 Oct 03 15:33:26.368320 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c3c52c26-81ad-46b9-abb8-4c6c5813b83b req-856778cf-92fa-4b5b-86b2-d6d14c0b6cda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035073 Oct 03 15:33:26.368910 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3720/7265] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:27.315725 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:27.316785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:27.319715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:27.320739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:27.329295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:27.329778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:27.330214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:27.330896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:27.331341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:27.331763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:27.463217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:27.471961 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2bf57ad7-8822-45fd-8999-d4c28620e052 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1365 microversion: 2.1 time: 0.162261 Oct 03 15:33:27.472555 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3546/7266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:27 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:28.501318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:28.501999 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:28.504185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:33:28.511011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:28.511504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:28.511952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:28.512683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:28.513172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:28.513652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:28.653690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:33:28.662000 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fe469942-70ce-4dd7-8964-98deab362a6f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1553 microversion: 2.1 time: 0.165745 Oct 03 15:33:28.662577 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3721/7267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:33:28 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:33:28.685155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:33:28.685672 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:33:28.693213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:28.693697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:28.694131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:28.694856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:28.695329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:28.695754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:28.778066 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a842f37c-bdf1-4c93-92cb-1d86bcaded83 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096864 Oct 03 15:33:28.778685 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3547/7268] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:33:28 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:33:29.992847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4f3b82c7-26c9-4ee5-846c-3ea1625d2e21 req-32b84d02-d51e-42d3-9c3b-2b60a40964d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:33:30.007812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f3b82c7-26c9-4ee5-846c-3ea1625d2e21 req-32b84d02-d51e-42d3-9c3b-2b60a40964d2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:33:30.007812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f3b82c7-26c9-4ee5-846c-3ea1625d2e21 req-32b84d02-d51e-42d3-9c3b-2b60a40964d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:33:30.007812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4f3b82c7-26c9-4ee5-846c-3ea1625d2e21 req-32b84d02-d51e-42d3-9c3b-2b60a40964d2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:33:30.017012 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4f3b82c7-26c9-4ee5-846c-3ea1625d2e21 req-32b84d02-d51e-42d3-9c3b-2b60a40964d2 service nova] Creating event network-changed:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h1-781139-2 Oct 03 15:33:30.022098 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4f3b82c7-26c9-4ee5-846c-3ea1625d2e21 req-32b84d02-d51e-42d3-9c3b-2b60a40964d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033002 Oct 03 15:33:30.022715 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3722/7269] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:34:42.419303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:42.420006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:42.425952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:34:42.426561 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:42.434499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:42.435013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:42.435525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:42.436297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:42.436749 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:42.437193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:42.576683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:42.584858 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed360f09-1ea6-4170-9df2-3e18a3392e87 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1672 microversion: 2.1 time: 0.168301 Oct 03 15:34:42.585394 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3548/7270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:34:42 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:34:42.606964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:42.607607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=46 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:42.608632 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:34:42.608802 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-volume_attachments (ip 10.222.0.20) !!! Oct 03 15:34:42.615292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d580114-4951-4686-abbd-51f4934ea06d"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:34:42.617755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:42.625875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:42.626334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:42.626806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:42.627509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:42.627970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:42.628402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:42.912527 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d694932c-9e2a-4a9d-ac74-e59c6962f93a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308414 Oct 03 15:34:42.913188 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3723/7271] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:34:42 2022] POST /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:34:53.693755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:34:53.696104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:53.698713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:53.699397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:53.707886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:53.708601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:53.709205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:53.710300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:53.711270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:53.711715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:53.749590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:53.755414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Old instance type m1.heat2, new instance type m1.heat {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:34:53.763214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:34:53.763641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:34:53.764121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:34:53.764532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:34:53.764955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:34:53.842055 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fd41ecb-8ef1-4bcf-af4d-e367fcb26471 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/action" status: 202 len: 0 microversion: 2.1 time: 0.151501 Oct 03 15:34:53.842839 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3549/7272] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:34:53 2022] POST /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:34:53.849178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:53.850552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:34:53.854739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:34:53.855464 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:53.863650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:53.864157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:53.864608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:53.865364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:53.865833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:53.866268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:54.034077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:54.042773 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-711e1570-507b-42d5-bb52-741c5cc602d9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1727 microversion: 2.1 time: 0.195559 Oct 03 15:34:54.043358 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3724/7273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:34:53 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:34:55.071072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:34:55.072073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:55.081823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:55.082308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:55.082738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:55.083425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:55.083881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:55.084301 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:55.229043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:55.238349 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b202f30e-7eae-4903-bcc8-d31ccf4d541d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1727 microversion: 2.1 time: 0.173959 Oct 03 15:34:55.238950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3550/7274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:34:55 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:34:56.267499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:34:56.268378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:56.279669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:56.280166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:56.280612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:56.281382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:56.281846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:56.282276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:56.418172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:56.427262 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd62ad10-44f6-4460-b72f-20d3d83d7a40 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.167012 Oct 03 15:34:56.427820 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3725/7275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:34:56 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:34:57.454001 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:34:57.454647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:57.463070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:57.463608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:57.464091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:57.464896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:57.465441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:57.465952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:57.599924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:57.608670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ce0f67e-e5ae-463e-ad99-ece18a3f76bd tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.159800 Oct 03 15:34:57.609287 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3551/7276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:34:57 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:34:58.636739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:34:58.637501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:58.645093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:58.645593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:58.646041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:58.646755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:58.647219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:58.647652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:58.785367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:58.793925 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b35476be-5383-4f7b-9689-f0a48d4d7cab tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.163858 Oct 03 15:34:58.794691 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3726/7277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:34:58 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:34:59.818611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:34:59.819219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:34:59.827036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:59.827544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:59.827999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:59.828718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:34:59.829222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:34:59.829661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:34:59.961629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:34:59.970102 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-693c1ef2-882e-4a49-b847-e9e2e604478c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.155709 Oct 03 15:34:59.970654 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3552/7278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:34:59 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:00.997541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:00.998592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:01.010692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:01.013230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:01.014051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:01.014808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:01.015479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:01.015707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:01.169685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:01.178707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a649ed1-6539-4bb7-9eac-967d216186b8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.187777 Oct 03 15:35:01.179311 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3727/7279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:00 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:02.204115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:02.204917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:02.214412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:02.215018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:02.215565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:02.216431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:02.217199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:02.217664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:02.364444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:02.373010 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a45a1ad2-4969-4cc5-beda-5693a5b962bc tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.173907 Oct 03 15:35:02.373609 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3553/7280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:02 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:03.397444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:03.398094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:03.405330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:03.405825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:03.406298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:03.407091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:03.407547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:03.407985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:03.556405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:03.565297 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ee8623ab-7c84-4d99-8925-166fed45f509 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.171731 Oct 03 15:35:03.565884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3728/7281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:03 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:04.589622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:04.590319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:04.598186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:04.598670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:04.599104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:04.599806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:04.600253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:04.600675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:04.754608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:04.766312 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4986bc08-c741-439e-abfb-4f03d49d009f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.180462 Oct 03 15:35:04.766921 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3554/7282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:04 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:05.794264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:05.794933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:05.802422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:05.802917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:05.803374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:05.804137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:05.804602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:05.805173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:05.951162 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:05.959796 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ee2fd99-3d1e-47a2-8f19-af97653e089c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.169559 Oct 03 15:35:05.961052 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3729/7283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:05 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:06.985379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:06.985955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:06.993080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:06.993590 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:06.994020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:06.994714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:06.995166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:06.995588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:07.137998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:07.147710 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-766e49ad-3ae5-40c1-b150-d51fbc430140 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.166989 Oct 03 15:35:07.148302 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3555/7284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:06 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:08.171240 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:08.171906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:08.179002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:08.179500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:08.179949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:08.180661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:08.181159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:08.181587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:08.320065 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:08.329489 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fcabd19-f9d0-4ae6-91c2-377ea5c3ee58 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.162095 Oct 03 15:35:08.330064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3730/7285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:08 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:09.354043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:09.354617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:09.362706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:09.363204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:09.363645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:09.364353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:09.364815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:09.365288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:09.502595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:09.511057 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14d7df89-28ae-4d1e-a066-38d2268d9163 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1732 microversion: 2.1 time: 0.161039 Oct 03 15:35:09.511665 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3556/7286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:09 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:10.535239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:10.535941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:10.543371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:10.543849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:10.544295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:10.545041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:10.546623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:10.547104 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:10.801746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:10.810428 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ea6ab421-dc84-408b-9caf-93e13976eefe tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1731 microversion: 2.1 time: 0.279636 Oct 03 15:35:10.811003 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3731/7287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:10 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:10.926256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-60e3b639-eed8-410e-bc97-986b2eb28d8c req-6f1db12b-34ed-410d-9a9d-6b806a1a0300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "name": "network-vif-unplugged", "status": "completed", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:35:10.937895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-60e3b639-eed8-410e-bc97-986b2eb28d8c req-6f1db12b-34ed-410d-9a9d-6b806a1a0300 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:10.938360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-60e3b639-eed8-410e-bc97-986b2eb28d8c req-6f1db12b-34ed-410d-9a9d-6b806a1a0300 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:10.938778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-60e3b639-eed8-410e-bc97-986b2eb28d8c req-6f1db12b-34ed-410d-9a9d-6b806a1a0300 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:10.950829 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-60e3b639-eed8-410e-bc97-986b2eb28d8c req-6f1db12b-34ed-410d-9a9d-6b806a1a0300 service nova] Creating event network-vif-unplugged:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h2-781139-2 Oct 03 15:35:10.956150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-60e3b639-eed8-410e-bc97-986b2eb28d8c req-6f1db12b-34ed-410d-9a9d-6b806a1a0300 service nova] Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:35:10.968384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-60e3b639-eed8-410e-bc97-986b2eb28d8c req-6f1db12b-34ed-410d-9a9d-6b806a1a0300 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046071 Oct 03 15:35:10.969409 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3557/7288] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:35:11.836143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:11.836747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:11.844273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:11.844778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:11.845249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:11.845954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:11.846411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:11.846900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:11.996815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:12.007185 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e1038a1-b4eb-465b-90bd-801601c9c506 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1731 microversion: 2.1 time: 0.175266 Oct 03 15:35:12.007957 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3732/7289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:11 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:13.010797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-72cd132e-e841-4bd9-a7b4-cff1267da6bd req-b300f7f4-7c0e-44ca-943b-cdc9ff69d0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:35:13.022306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72cd132e-e841-4bd9-a7b4-cff1267da6bd req-b300f7f4-7c0e-44ca-943b-cdc9ff69d0da service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:13.022754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72cd132e-e841-4bd9-a7b4-cff1267da6bd req-b300f7f4-7c0e-44ca-943b-cdc9ff69d0da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:13.023171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-72cd132e-e841-4bd9-a7b4-cff1267da6bd req-b300f7f4-7c0e-44ca-943b-cdc9ff69d0da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:13.032302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:13.032967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:13.035852 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-72cd132e-e841-4bd9-a7b4-cff1267da6bd req-b300f7f4-7c0e-44ca-943b-cdc9ff69d0da service nova] Creating event network-changed:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h2-781139-2 Oct 03 15:35:13.040676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:13.041472 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:13.041795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-72cd132e-e841-4bd9-a7b4-cff1267da6bd req-b300f7f4-7c0e-44ca-943b-cdc9ff69d0da service nova] Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:35:13.042267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:13.042989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:13.043710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:13.044640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:13.053161 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-72cd132e-e841-4bd9-a7b4-cff1267da6bd req-b300f7f4-7c0e-44ca-943b-cdc9ff69d0da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046362 Oct 03 15:35:13.053774 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3558/7290] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:35:13.274815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:13.286837 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a0064b76-e607-4102-b94d-b7530e857a73 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.258893 Oct 03 15:35:13.288372 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3733/7291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:13 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:14.313340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:14.314118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:14.320814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:14.321347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:14.321780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:14.322489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:14.322944 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:14.323524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:14.468127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:14.476747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3a1185d-ddd1-49b5-8f8b-6921d7f889ce tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.168937 Oct 03 15:35:14.477355 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3559/7292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:14 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:15.500224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:15.500815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:15.507840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:15.508334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:15.508781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:15.509522 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:15.509985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:15.510423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:15.642627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:15.651487 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-670d0321-7ff6-4b6f-99bd-8f32c2adb287 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.155512 Oct 03 15:35:15.652038 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3734/7293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:15 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:16.675662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:16.676292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:16.684166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:16.684658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:16.685139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:16.685857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:16.686300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:16.686720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:16.822940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:16.831496 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6bafc61c-2835-4615-9583-42b3486b216e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.160016 Oct 03 15:35:16.832075 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3560/7294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:16 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:17.859063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:17.859823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:17.870682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:17.871314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:17.871950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:17.873088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:17.873694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:17.874215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:18.014631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:18.023225 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f3f925c-3ad1-4f62-9639-dc8c434c15b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.170627 Oct 03 15:35:18.023800 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3735/7295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:17 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:19.047578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:19.048203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:19.055552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:19.056044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:19.056484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:19.057217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:19.057671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:19.058094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:19.199108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:19.212597 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76bb2204-a810-4298-9474-3ad46a306adf tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.169031 Oct 03 15:35:19.213568 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3561/7296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:19 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:20.242366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:20.243460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:20.252407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:20.252956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:20.253551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:20.254266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:20.254736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:20.255188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:20.391095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:20.399975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3bfb6c43-306a-4800-bc0e-c6da5987a23a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.164582 Oct 03 15:35:20.400560 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3736/7297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:20 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:21.427696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:21.428787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:21.439086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:21.439576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:21.440009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:21.440704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:21.441179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:21.441607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:21.580660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:21.589609 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ff3867b2-75a0-4f7c-97b7-e5094f671340 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.168940 Oct 03 15:35:21.590197 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3562/7298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:21 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:22.618723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:22.619791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:22.631548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:22.632389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:22.633199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:22.635466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:22.636354 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:22.637177 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:22.792815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:22.801335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4e0f371-b6e9-4680-8d57-5503bad14a9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1729 microversion: 2.1 time: 0.189306 Oct 03 15:35:22.801933 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3737/7299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:22 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:23.824274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:23.825237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:23.829679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=33 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:23.836028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:23.836521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:23.836985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:23.837698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:23.838155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:23.838585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:23.843803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:23.987425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:23.998858 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c59e8b94-3963-454d-a5eb-9173fdaca3a7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1726 microversion: 2.1 time: 0.178891 Oct 03 15:35:23.999432 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3563/7300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:23 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:24.022224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:35:24.022780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:24.025516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=29 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:24.031392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:24.031867 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:24.032340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:24.033071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:24.033536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:24.033966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:24.036510 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=85 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:24.072544 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:24.073072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:24.073514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:24.074250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:24.074713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:24.075172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:24.099448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:35:24.104840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Getting quotas for user 3b4ae280b3f74215bc3c19771f6a15bd and project 57d0a3ee6f3c4b9eb6b703d189337f75. Resources: {'ram', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:35:24.220218 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2db8a3e-fdb4-4dfc-a03a-d66a333d34e6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "POST /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/action" status: 202 len: 0 microversion: 2.1 time: 0.201816 Oct 03 15:35:24.220976 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3738/7301] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:35:24 2022] POST /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:35:24.229339 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:24.230047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:24.236509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:24.237060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:24.237498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:24.238205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:24.238744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:24.239086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:24.390035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:24.398807 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5d8fd70-2d0f-4710-8b9f-7710436bb66d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.173476 Oct 03 15:35:24.399389 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3564/7302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:24 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:35:25.424328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:25.425266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:25.438519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:25.438767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:25.439221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:25.439936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:25.440404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:25.440846 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:25.576986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:25.586227 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f6015d3-f718-484d-b569-53cdd801d432 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.166981 Oct 03 15:35:25.586812 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3739/7303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:25 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:26.610103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:26.610963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:26.618280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:26.618703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:26.619142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:26.619891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:26.620340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:26.620759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:26.756096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:26.764615 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d1498f6-b214-442e-9948-1478c15e67af tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.158620 Oct 03 15:35:26.765235 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3565/7304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:26 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:27.788113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:27.788947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:27.796080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:27.796659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:27.797367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:27.798151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:27.798678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:27.799202 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:27.934105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:27.942745 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-997d1cc1-b2df-4fc3-a631-2a5f73e78481 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.158685 Oct 03 15:35:27.943328 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3740/7305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:27 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:28.967308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:28.967895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:28.975948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:28.976550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:28.976987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:28.977717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:28.978170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:28.978719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:29.239737 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:29.250824 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2416e2a4-adbc-434b-a16a-ad53b63bf9f7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.287331 Oct 03 15:35:29.251866 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3566/7306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:28 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:29.819878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e3006217-2485-4472-b0b3-45da5cb12949 req-ff80f7b2-796b-485f-bfea-e42745662a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:35:29.833492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e3006217-2485-4472-b0b3-45da5cb12949 req-ff80f7b2-796b-485f-bfea-e42745662a74 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:29.833985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e3006217-2485-4472-b0b3-45da5cb12949 req-ff80f7b2-796b-485f-bfea-e42745662a74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:29.834421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e3006217-2485-4472-b0b3-45da5cb12949 req-ff80f7b2-796b-485f-bfea-e42745662a74 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:29.847792 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e3006217-2485-4472-b0b3-45da5cb12949 req-ff80f7b2-796b-485f-bfea-e42745662a74 service nova] Creating event network-changed:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h1-781139-2 Oct 03 15:35:29.853323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-e3006217-2485-4472-b0b3-45da5cb12949 req-ff80f7b2-796b-485f-bfea-e42745662a74 service nova] Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:35:29.864775 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e3006217-2485-4472-b0b3-45da5cb12949 req-ff80f7b2-796b-485f-bfea-e42745662a74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049983 Oct 03 15:35:29.865386 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3741/7307] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:35:30.275056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:30.276409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:30.283746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:30.284631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:30.285317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:30.286041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:30.286495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:30.287105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:30.484170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:30.496272 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-325e2efd-a773-4b54-af4c-b81b260f9184 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.225022 Oct 03 15:35:30.497052 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3567/7308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:30 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:31.524538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:31.525274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:31.532204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:31.532683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:31.533191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:31.533884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:31.534355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:31.534778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:31.669069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:31.677967 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bafe8152-cbc1-4015-b351-64e850c5e9c2 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.158587 Oct 03 15:35:31.678562 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3742/7309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:31 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:32.701390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:32.702026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:32.709645 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:32.710504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:32.710945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:32.711745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:32.712197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:32.712617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:32.850338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:32.858816 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a7ab5f3c-7ee5-4a30-832e-e0c8c9c17c72 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.161468 Oct 03 15:35:32.859423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3568/7310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:32 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:33.881994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:33.882593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:33.890003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:33.890480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:33.891040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:33.891842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:33.892311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:33.892752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:34.032411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:34.041039 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a517fee-6beb-49c2-a6a9-b48cc805d4a8 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.163131 Oct 03 15:35:34.041597 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3743/7311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:33 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:35.064306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:35.064993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:35.072463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:35.073147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:35.073583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:35.074296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:35.074766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:35.075743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:35.207455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:35.216562 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d95ab933-ac0a-4085-8499-0de17daa253b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.156490 Oct 03 15:35:35.217182 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3569/7312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:35 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:36.244334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:36.245461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:36.248660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:36.258989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:36.259904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:36.260559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:36.261762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:36.262545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:36.263272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:36.399624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:36.410349 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59408381-2800-4c8f-819a-12bd1b004092 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.172552 Oct 03 15:35:36.410927 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3744/7313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:36 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:37.438475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:37.439154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:37.447348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:37.447913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:37.448423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:37.449268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:37.449765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:37.450295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:37.593284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:37.601757 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d92d38d9-c8f7-43d5-b1b3-08d4c7e77bc7 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.170404 Oct 03 15:35:37.602343 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3570/7314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:37 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:38.626571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:38.627224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:38.635255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:38.635829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:38.636277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:38.637259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:38.637840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:38.638310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:38.776137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:38.785127 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43cde40e-c1a5-4731-b694-f585916b4bb3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.162551 Oct 03 15:35:38.785733 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3745/7315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:38 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:39.810223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:39.810992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:39.820364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:39.820983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:39.821534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:39.822392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:39.822948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:39.823474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:39.961180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:39.969658 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db922e0a-746f-485b-b9a3-950af91d550a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.164462 Oct 03 15:35:39.970260 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3571/7316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:39 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:41.002582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:41.003174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:41.011208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:41.011208 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:41.013630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:41.014376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:41.014826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:41.015260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:41.157506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:41.166114 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b0084eb5-8ce9-4b80-aaeb-7484ada1627d tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.169128 Oct 03 15:35:41.166697 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3746/7317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:40 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:42.193996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:42.195041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:42.205454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:42.205937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:42.206372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:42.207061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:42.207513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:42.207931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:42.353258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:42.362038 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6695851b-da7f-43cd-b176-77a113972325 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.174809 Oct 03 15:35:42.363000 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3572/7318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:42 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:43.388209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:43.388799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:43.400031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:43.400666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:43.401353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:43.402407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:43.403102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:43.403677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:43.544841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:43.553875 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b9d1e87-0660-4f31-9f80-c18b22fb708e tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1725 microversion: 2.1 time: 0.171761 Oct 03 15:35:43.554459 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3747/7319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:43 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:44.582264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:44.583278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:44.595453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:44.596555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:44.597357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:44.598070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:44.598527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:44.598956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:44.744031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:44.752960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3c3be01-0c00-4e8f-936f-9e9ed836f162 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1718 microversion: 2.1 time: 0.178015 Oct 03 15:35:44.753593 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3573/7320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:44 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:44.776129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:44.776763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:44.784039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:44.784529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:44.785006 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:44.785720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:44.786185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:44.786624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:44.920957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:44.930079 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-36193b99-494e-40d1-8469-1b9063777c9a tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1718 microversion: 2.1 time: 0.157800 Oct 03 15:35:44.930677 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3748/7321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:44 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:44.953209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:44.953818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:44.960657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:44.961179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:44.961632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:44.962337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:44.962776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:44.963269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:45.097937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:45.106656 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-41b18be0-fc5f-47f7-ba13-5a1b59665762 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1718 microversion: 2.1 time: 0.157358 Oct 03 15:35:45.107176 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3574/7322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:44 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:45.129525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:45.130089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:45.137704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:45.138200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:45.138648 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:45.139359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:45.139814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:45.140247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:45.165629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:35:45.248590 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbf7b6b2-3676-4ae9-96c2-97ea1bdfd7a3 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 204 len: 0 microversion: 2.1 time: 0.122805 Oct 03 15:35:45.249232 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3749/7323] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:35:45 2022] DELETE /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:35:45.258392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:45.259067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:45.265212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:45.265696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:45.266130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:45.266820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:45.267268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:45.267952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:45.406174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:45.414980 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-36eddd2a-22c8-4063-bcb1-5fb9083e935f tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1724 microversion: 2.1 time: 0.160497 Oct 03 15:35:45.415563 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3575/7324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:45 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:46.442424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:46.443229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:46.451351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:46.451887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:46.452413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:46.453245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:46.453770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:46.454255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:46.470064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:46.592248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:46.600947 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-34bda133-80cd-4795-b45e-c6cedb789f42 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1724 microversion: 2.1 time: 0.164803 Oct 03 15:35:46.601549 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3750/7325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:46 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:47.089167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3a7a89ce-ad3a-4648-be21-b1ed15137496 req-3e104db1-3d81-4566-97f7-c21d339784a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "name": "network-vif-plugged", "status": "completed", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:35:47.102223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3a7a89ce-ad3a-4648-be21-b1ed15137496 req-3e104db1-3d81-4566-97f7-c21d339784a8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:47.103005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3a7a89ce-ad3a-4648-be21-b1ed15137496 req-3e104db1-3d81-4566-97f7-c21d339784a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:47.103266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3a7a89ce-ad3a-4648-be21-b1ed15137496 req-3e104db1-3d81-4566-97f7-c21d339784a8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:47.115226 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3a7a89ce-ad3a-4648-be21-b1ed15137496 req-3e104db1-3d81-4566-97f7-c21d339784a8 service nova] Creating event network-vif-plugged:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h1-781139-2 Oct 03 15:35:47.120422 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3a7a89ce-ad3a-4648-be21-b1ed15137496 req-3e104db1-3d81-4566-97f7-c21d339784a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035452 Oct 03 15:35:47.121048 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3576/7326] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:35:47.683827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:47.684431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:47.691894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:47.692394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:47.692837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:47.693579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:47.694043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:47.694471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:47.843284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:47.854088 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d4b0d826-2eaf-49c0-bc1b-c243d55d8556 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1724 microversion: 2.1 time: 0.174256 Oct 03 15:35:47.854793 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3751/7327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:47 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:48.078824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-16c42f41-f3f8-4395-998b-b6b5cdbc82ef req-1881c6e5-e048-4872-babf-df7f02c9b03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c30654-d62d-451d-ac4c-c6a9d443ce08", "name": "network-vif-deleted", "tag": "807a42d5-6beb-463e-9427-8a827cfc28c7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:35:48.089032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-16c42f41-f3f8-4395-998b-b6b5cdbc82ef req-1881c6e5-e048-4872-babf-df7f02c9b03a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:48.089517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-16c42f41-f3f8-4395-998b-b6b5cdbc82ef req-1881c6e5-e048-4872-babf-df7f02c9b03a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:48.090081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-16c42f41-f3f8-4395-998b-b6b5cdbc82ef req-1881c6e5-e048-4872-babf-df7f02c9b03a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:48.102038 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-16c42f41-f3f8-4395-998b-b6b5cdbc82ef req-1881c6e5-e048-4872-babf-df7f02c9b03a service nova] Creating event network-vif-deleted:807a42d5-6beb-463e-9427-8a827cfc28c7 for instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 on n-h1-781139-2 Oct 03 15:35:48.106775 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-16c42f41-f3f8-4395-998b-b6b5cdbc82ef req-1881c6e5-e048-4872-babf-df7f02c9b03a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Oct 03 15:35:48.107608 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3577/7328] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:35:48.879178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:48.879943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:48.887112 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:48.887624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:48.888068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:48.889033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:48.889717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:48.890158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:48.959585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:48.969707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ebfda99d-debc-4abb-a614-67a3c5bb768b tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1370 microversion: 2.1 time: 0.095075 Oct 03 15:35:48.970693 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3752/7329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:48 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:49.995351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:49.996651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:50.004573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:50.005430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:50.006132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:50.007066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:50.007738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:50.008386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:50.080141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:50.090370 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c040e0ac-7ed3-4238-a469-aa5fe7706aff tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1370 microversion: 2.1 time: 0.100307 Oct 03 15:35:50.091163 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3578/7330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:49 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:51.117488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:51.118097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:51.125502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:51.126008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:51.126459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:51.127179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:51.127645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:51.128087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:51.240396 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:51.253079 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0e0ef179-e25a-43f9-b9b8-3f2b616078a6 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1370 microversion: 2.1 time: 0.139406 Oct 03 15:35:51.253659 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3753/7331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:51 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1370 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:52.277588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:52.278126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:52.286340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:52.286921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:52.287360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:52.288061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:52.288513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:52.289180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:52.351993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b4ae280b3f74215bc3c19771f6a15bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57d0a3ee6f3c4b9eb6b703d189337f75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:35:52.360873 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da078afa-ae05-45c9-a85e-60a3e464e769 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 200 len: 1370 microversion: 2.1 time: 0.087369 Oct 03 15:35:52.361523 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3579/7332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:52 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:35:53.389192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:53.390215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:53.398581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:53.399080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:53.399524 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:53.400236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:53.400698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:53.401164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:53.414765 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 HTTP/1.1 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '06c30654-d62d-451d-ac4c-c6a9d443ce08'} Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:53.416423 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62ed72ee-f4d5-462e-879e-19386172c1e9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 404 len: 111 microversion: 2.1 time: 0.035363 Oct 03 15:35:53.421025 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3754/7333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:53 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:53.489830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:53.492166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:53.499640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:53.500123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:53.500557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:53.501289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:53.501739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:53.502163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:53.515245 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-volume_attachments HTTP/1.1 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': '06c30654-d62d-451d-ac4c-c6a9d443ce08'} Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:53.516973 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0399b496-b35e-4d0a-9aea-6f5708229076 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032756 Oct 03 15:35:53.523393 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3580/7334] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:35:53 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:56.851079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:56.851650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:56.854665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:56.860632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.861174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.861631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.862427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.862896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.863339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.877899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 HTTP/1.1 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '06c30654-d62d-451d-ac4c-c6a9d443ce08'} Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:56.879476 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ce49dcd-ef8a-4159-8ca3-460a432cfdc1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 404 len: 111 microversion: 2.1 time: 0.033787 Oct 03 15:35:56.883442 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3755/7335] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:35:56 2022] DELETE /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:56.890049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:56.890664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 06c30654-d62d-451d-ac4c-c6a9d443ce08] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:56.895085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=36 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:56.899587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.899990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.900426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.901147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.901597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.902016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.904884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=96 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:35:56.917458 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 HTTP/1.1 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '06c30654-d62d-451d-ac4c-c6a9d443ce08'} Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.919286 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 06c30654-d62d-451d-ac4c-c6a9d443ce08 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e332d9aa-dc53-4174-ad99-496878e70935 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08" status: 404 len: 111 microversion: 2.1 time: 0.034636 Oct 03 15:35:56.923824 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3581/7336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:56 2022] GET /compute/v2.1/servers/06c30654-d62d-451d-ac4c-c6a9d443ce08 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:56.929644 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:56.930155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:56.936363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.936863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.937334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.938056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.938516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.938948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.953972 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 HTTP/1.1 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'edac07ee-6d97-45d3-beb3-74a5d2121431'} Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:56.955733 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6ce44fb9-a959-4cac-b724-8684edacf6c0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 404 len: 111 microversion: 2.1 time: 0.031714 Oct 03 15:35:56.960811 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3756/7337] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:35:56 2022] DELETE /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:56.967028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:56.967678 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: edac07ee-6d97-45d3-beb3-74a5d2121431] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:56.974819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.975311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.975754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.976475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:56.976915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:56.977360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:56.993454 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 HTTP/1.1 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'edac07ee-6d97-45d3-beb3-74a5d2121431'} Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:56.995064 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance edac07ee-6d97-45d3-beb3-74a5d2121431 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ba6fdc2-e167-4399-a6df-ffecefffd2b1 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431" status: 404 len: 111 microversion: 2.1 time: 0.033997 Oct 03 15:35:57.003330 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3582/7338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:56 2022] GET /compute/v2.1/servers/edac07ee-6d97-45d3-beb3-74a5d2121431 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:57.010959 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:57.011504 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:57.018447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.019026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.019409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.020130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.021030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.021160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.036095 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c HTTP/1.1 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '82e35735-03dc-449a-a1bb-2fcfcc07f33c'} Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:57.037732 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:57.042421 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6fad606e-1ea8-4bea-b075-108e8ba1e04c tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 404 len: 111 microversion: 2.1 time: 0.033251 Oct 03 15:35:57.043506 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3757/7339] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:35:57 2022] DELETE /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:57.047763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:57.048389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 82e35735-03dc-449a-a1bb-2fcfcc07f33c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:57.055173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.055661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.056107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.056811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.057300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.057735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.072079 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c HTTP/1.1 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '82e35735-03dc-449a-a1bb-2fcfcc07f33c'} Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.073695 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 82e35735-03dc-449a-a1bb-2fcfcc07f33c could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-13db1861-d908-4971-904e-2b4d93b74ce5 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c" status: 404 len: 111 microversion: 2.1 time: 0.031267 Oct 03 15:35:57.081733 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3583/7340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:57 2022] GET /compute/v2.1/servers/82e35735-03dc-449a-a1bb-2fcfcc07f33c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:35:57.084366 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:57.085400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:57.091827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.092359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.092813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.093565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.094023 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.094471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.113629 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 HTTP/1.1 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '07ddc6b5-dfb9-4bd2-a6f7-00834fd28139'} Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:57.115283 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f3354cd5-60ba-4a89-ae5b-182eb5b9c006 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 404 len: 111 microversion: 2.1 time: 0.036749 Oct 03 15:35:57.119299 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3758/7341] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:35:57 2022] DELETE /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:57.125681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:57.126293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [instance: 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:35:57.133035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.133514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.133946 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.134637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:35:57.135080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:35:57.135473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:35:57.151563 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] HTTP exception thrown: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Request method failure captured: Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 HTTP/1.1 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOv-9hMgf1T436GknkC4jJk_qphRA-4OkUMPJ3kXYPHPD1SaansQSawvVRzpqWw0-h50ojrindCioc4vUzSsS1uj9cuuFDncHBtVeG1sopPHXw-Oabixrl5f50kC9SpgKMD-31IpJoWhdoPgBxLAI3ySWYVYFjk2XgMKqwnDlEt4ajRY Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_57d0a3ee6f3c4b9eb6b703d189337f75", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/57d0a3ee6f3c4b9eb6b703d189337f75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 57d0a3ee6f3c4b9eb6b703d189337f75 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServerActionsTestJSON-6400677 Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 3b4ae280b3f74215bc3c19771f6a15bd Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServerActionsTestJSON-6400677-project Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '07ddc6b5-dfb9-4bd2-a6f7-00834fd28139'} Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:35:57.153151 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Returning 404 to user: Instance 07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3ca0fd10-22de-4e43-a015-634960d2c7a0 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139" status: 404 len: 111 microversion: 2.1 time: 0.032898 Oct 03 15:35:57.157283 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3584/7342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:35:57 2022] GET /compute/v2.1/servers/07ddc6b5-dfb9-4bd2-a6f7-00834fd28139 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:35:57.163581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ae69169-61b6-47a1-af1d-863a3ecc9cd9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] Calling method '.version_select at 0x7fb22b5bb670>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:35:57.168142 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ae69169-61b6-47a1-af1d-863a3ecc9cd9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [872bb6e8-db13-48b6-8058-7944b349ec71] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:35:58.180995 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ae69169-61b6-47a1-af1d-863a3ecc9cd9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] [872bb6e8-db13-48b6-8058-7944b349ec71] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57000. Oct 03 15:35:58.211312 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ae69169-61b6-47a1-af1d-863a3ecc9cd9 tempest-ServerActionsTestJSON-6400677 tempest-ServerActionsTestJSON-6400677-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077950262" status: 202 len: 0 microversion: 2.1 time: 1.051376 Oct 03 15:35:58.212055 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3759/7343] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 3 15:35:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077950262 => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:36:07.960885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=7 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:07.961942 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=7 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:08.082175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-795931497", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "0dfb6e55-13e1-4317-b97c-25cec6b08c95"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:08.325079 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] validate_networks() for [('0dfb6e55-13e1-4317-b97c-25cec6b08c95', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:36:08.700917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:36:08.701671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:36:08.702180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:36:08.702589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:36:08.703002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:36:08.713382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:08.713870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:08.714308 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:08.715037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:08.715490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:08.715912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:08.732696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Getting quotas for project 3e07b24536104d549880287b34654b99. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:36:08.738529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Getting quotas for user e370f6088e8c4f7e8477e41fd5d9e182 and project 3e07b24536104d549880287b34654b99. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:36:08.751572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:36:08.754305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:36:08.801684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-680d2efa-60e8-4c30-990b-ccab10868100 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846650 Oct 03 15:36:08.802369 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3585/7344] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:36:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 15:36:08.811901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=31 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:08.812783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:08.820630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-61306844-523e-457b-adc5-8dbf5ab52be8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:08.821302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-61306844-523e-457b-adc5-8dbf5ab52be8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:08.876609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-61306844-523e-457b-adc5-8dbf5ab52be8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:08.883940 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-61306844-523e-457b-adc5-8dbf5ab52be8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1216 microversion: 2.1 time: 0.074099 Oct 03 15:36:08.884620 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3760/7345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:08 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:09.910320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01c78550-7157-49c1-b89f-1eee708b57ce tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:09.910919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01c78550-7157-49c1-b89f-1eee708b57ce tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:09.967277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-01c78550-7157-49c1-b89f-1eee708b57ce tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:09.978125 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-01c78550-7157-49c1-b89f-1eee708b57ce tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1216 microversion: 2.1 time: 0.074561 Oct 03 15:36:09.978700 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3586/7346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:09 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:11.001671 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e060e0a-c512-4b4a-abb5-7dabe7f29aba tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:11.002452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e060e0a-c512-4b4a-abb5-7dabe7f29aba tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:11.065811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e060e0a-c512-4b4a-abb5-7dabe7f29aba tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:11.075536 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e060e0a-c512-4b4a-abb5-7dabe7f29aba tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1216 microversion: 2.1 time: 0.077765 Oct 03 15:36:11.092610 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3761/7347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:10 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:12.104082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8affdb4f-4745-49e4-82ee-4ebc30b4b1ed tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:12.104915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8affdb4f-4745-49e4-82ee-4ebc30b4b1ed tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:12.164504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8affdb4f-4745-49e4-82ee-4ebc30b4b1ed tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:12.175284 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8affdb4f-4745-49e4-82ee-4ebc30b4b1ed tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1216 microversion: 2.1 time: 0.077945 Oct 03 15:36:12.175910 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3587/7348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:12 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:13.199337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:13.199990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:13.207865 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:13.208388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:13.208861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:13.210064 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:13.210552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:13.211016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:13.278200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:13.286685 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc5a7823-d3b5-4491-97cc-36e939ac5d43 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1220 microversion: 2.1 time: 0.091502 Oct 03 15:36:13.287242 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3762/7349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:13 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:14.309323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:14.310711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:14.318427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:14.318913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:14.319357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:14.320057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:14.320543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:14.320983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:14.383671 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:14.392540 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e60e8930-8488-4529-967a-ba941ca8f335 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1274 microversion: 2.1 time: 0.087197 Oct 03 15:36:14.408956 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3588/7350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:14 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:15.416030 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:15.416607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:15.423450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:15.423972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:15.424445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:15.425191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:15.425652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:15.426113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:15.549689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f457f164-93bb-4346-805d-22dfec7fe453 req-f0e9cc2d-26f2-45b2-8516-b049978acac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd6cd3c2-3b70-4d7d-b0e4-564b75321356", "tag": "8d74a33a-32fd-441b-9886-35ca2037b4d0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:15.561433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f457f164-93bb-4346-805d-22dfec7fe453 req-f0e9cc2d-26f2-45b2-8516-b049978acac2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:15.561945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f457f164-93bb-4346-805d-22dfec7fe453 req-f0e9cc2d-26f2-45b2-8516-b049978acac2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:15.562354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f457f164-93bb-4346-805d-22dfec7fe453 req-f0e9cc2d-26f2-45b2-8516-b049978acac2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:15.574948 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f457f164-93bb-4346-805d-22dfec7fe453 req-f0e9cc2d-26f2-45b2-8516-b049978acac2 service nova] Creating event network-changed:8d74a33a-32fd-441b-9886-35ca2037b4d0 for instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 on n-h2-781139-2 Oct 03 15:36:15.580526 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f457f164-93bb-4346-805d-22dfec7fe453 req-f0e9cc2d-26f2-45b2-8516-b049978acac2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034704 Oct 03 15:36:15.581577 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3589/7351] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:36:15.667915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:15.676342 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2ec1f8d7-0ff8-4aa4-879b-189c4ef5a7a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1316 microversion: 2.1 time: 0.264303 Oct 03 15:36:15.677200 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3763/7352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:15 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:16.706218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:16.706822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:16.713918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:16.714399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:16.714840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:16.715533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:16.715981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:16.716406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:16.852514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:16.860704 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-eadb0617-c148-4679-a698-997dec6aa250 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1316 microversion: 2.1 time: 0.162735 Oct 03 15:36:16.861422 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3590/7353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:16 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:17.883993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:17.884788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:17.892190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:17.893201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:17.893702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:17.894439 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:17.894910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:17.895320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:18.031424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:18.039607 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9434b10-b56c-4332-a03e-0d2ad71ccbf7 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1316 microversion: 2.1 time: 0.159583 Oct 03 15:36:18.040170 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3764/7354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:17 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:19.066564 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:19.067183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:19.070027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:19.075650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:19.076143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:19.076606 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:19.077329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:19.077782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:19.078202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:19.215719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:19.224060 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e82b27c7-d132-4661-91f6-ff8a0a689cee tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1316 microversion: 2.1 time: 0.163100 Oct 03 15:36:19.224650 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3591/7355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:19 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:20.154458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-76b9847a-386d-4fc4-8497-0b2949fc2cd1 req-99abc61b-77b3-422b-a095-a63ce73ec8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6cd3c2-3b70-4d7d-b0e4-564b75321356", "name": "network-vif-plugged", "status": "completed", "tag": "8d74a33a-32fd-441b-9886-35ca2037b4d0"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:20.165731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76b9847a-386d-4fc4-8497-0b2949fc2cd1 req-99abc61b-77b3-422b-a095-a63ce73ec8fb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:20.166232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76b9847a-386d-4fc4-8497-0b2949fc2cd1 req-99abc61b-77b3-422b-a095-a63ce73ec8fb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:20.166784 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-76b9847a-386d-4fc4-8497-0b2949fc2cd1 req-99abc61b-77b3-422b-a095-a63ce73ec8fb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:20.178699 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-76b9847a-386d-4fc4-8497-0b2949fc2cd1 req-99abc61b-77b3-422b-a095-a63ce73ec8fb service nova] Creating event network-vif-plugged:8d74a33a-32fd-441b-9886-35ca2037b4d0 for instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 on n-h2-781139-2 Oct 03 15:36:20.183789 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-76b9847a-386d-4fc4-8497-0b2949fc2cd1 req-99abc61b-77b3-422b-a095-a63ce73ec8fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033409 Oct 03 15:36:20.184363 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3765/7356] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:36:20.247423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:20.248655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:20.255658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:20.256167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:20.256614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:20.257349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:20.257793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:20.258226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:20.391443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:20.399625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-79db1de4-2956-4c93-add5-5bd72ef8d8b6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1316 microversion: 2.1 time: 0.156519 Oct 03 15:36:20.400281 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3592/7357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:20 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:21.420525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:21.425744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:21.426704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:21.435618 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:21.436380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:21.437268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:21.438401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:21.438864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:21.439293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:21.576388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:21.587246 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00b65b93-2639-4f6b-98f8-84ca51a0c7e4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1506 microversion: 2.1 time: 0.167724 Oct 03 15:36:21.587852 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3766/7358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:21 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:36:21.665815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2030975506", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "0dfb6e55-13e1-4317-b97c-25cec6b08c95"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:21.727194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] validate_networks() for [('0dfb6e55-13e1-4317-b97c-25cec6b08c95', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:36:22.129172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:36:22.129719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:36:22.130194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:36:22.130605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:36:22.131055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:36:22.140684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:22.141211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:22.141655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:22.142380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:22.142837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:22.143242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:22.160468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Getting quotas for project 3e07b24536104d549880287b34654b99. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:36:22.166252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Getting quotas for user e370f6088e8c4f7e8477e41fd5d9e182 and project 3e07b24536104d549880287b34654b99. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:36:22.179223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:36:22.181571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:36:22.227747 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-897ca500-6397-4a59-a2f0-f5bf3b7da1fe tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568022 Oct 03 15:36:22.228417 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3593/7359] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:36:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:36:22.240417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a32c1360-05bf-4e18-94b1-e6cedfdbdd13 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:22.241093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a32c1360-05bf-4e18-94b1-e6cedfdbdd13 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:22.296691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a32c1360-05bf-4e18-94b1-e6cedfdbdd13 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:22.304028 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a32c1360-05bf-4e18-94b1-e6cedfdbdd13 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1217 microversion: 2.1 time: 0.068229 Oct 03 15:36:22.305374 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3767/7360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:22 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:23.326958 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:36:23.327856 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 (ip 10.222.0.20) !!! Oct 03 15:36:23.336636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:23.337286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:23.346778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:23.347363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:23.348539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:23.349269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:23.349776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:23.350250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:23.440344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:23.449438 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f9eacfc3-33bb-4cf0-a27d-e152b5898d85 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1277 microversion: 2.1 time: 0.124545 Oct 03 15:36:23.450237 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3594/7361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:23 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:24.473665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:24.474277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:24.483556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:24.484338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:24.484979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:24.485916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:24.486388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:24.486829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:24.628188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:24.637084 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a822c55-3cb7-4e08-bb5c-54a479dd6ce0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.167433 Oct 03 15:36:24.648953 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3768/7362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:24 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:25.089039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f75fc93f-cec2-49d2-830f-c0b43422d874 req-93336d2a-828e-4524-bd8f-c678ebac9a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97010ad-eb06-47e2-9a47-dfeb03b37f17", "tag": "dd398ef3-c833-4707-aa7b-e278ccb3bc2c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:25.101329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f75fc93f-cec2-49d2-830f-c0b43422d874 req-93336d2a-828e-4524-bd8f-c678ebac9a85 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:25.102039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f75fc93f-cec2-49d2-830f-c0b43422d874 req-93336d2a-828e-4524-bd8f-c678ebac9a85 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:25.102477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f75fc93f-cec2-49d2-830f-c0b43422d874 req-93336d2a-828e-4524-bd8f-c678ebac9a85 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:25.113979 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f75fc93f-cec2-49d2-830f-c0b43422d874 req-93336d2a-828e-4524-bd8f-c678ebac9a85 service nova] Creating event network-changed:dd398ef3-c833-4707-aa7b-e278ccb3bc2c for instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 on n-h1-781139-2 Oct 03 15:36:25.121874 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f75fc93f-cec2-49d2-830f-c0b43422d874 req-93336d2a-828e-4524-bd8f-c678ebac9a85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037794 Oct 03 15:36:25.122723 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3595/7363] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:36:25.665686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:25.666608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:25.678495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:25.678980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:25.679432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:25.680148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:25.680613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:25.681081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:25.820183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:25.828359 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4dda8370-38f9-40e7-ade1-df209e67d8c6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.169853 Oct 03 15:36:25.828959 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3769/7364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:25 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:26.856972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:26.857926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:26.866543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:26.867147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:26.867696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:26.868555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:26.869167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:26.869694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:27.004503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:27.013465 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f78df883-a2c3-4ab6-8ac2-7d576d98c3a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.163547 Oct 03 15:36:27.014062 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3596/7365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:26 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:28.035955 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:28.036559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:28.043788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:28.044294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:28.044730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:28.045517 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:28.045987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:28.046436 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:28.184879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:28.193301 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9a656a02-2f18-4f7a-880f-386556a5d64a tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.161299 Oct 03 15:36:28.193884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3770/7366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:28 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:29.216794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:29.217417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:29.224751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:29.225263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:29.225704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:29.226844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:29.227298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:29.227716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:29.367724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:29.375575 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-18db5632-d778-4acd-b8d0-ab311e6d431f tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.163017 Oct 03 15:36:29.376169 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3597/7367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:29 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:30.402135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:30.402803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:30.410970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:30.411528 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:30.412031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:30.412827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:30.413399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:30.413893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:30.550876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:30.558994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8c2a49f5-5eb1-4726-9266-cc5fcd1d4e0b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.161712 Oct 03 15:36:30.559918 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3771/7368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:30 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:31.375304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ff0f0167-e27d-4bd1-83bf-746e483c9644 req-ae5f47ff-efd6-4e5a-9f2c-da0f3a4938d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97010ad-eb06-47e2-9a47-dfeb03b37f17", "name": "network-vif-plugged", "status": "completed", "tag": "dd398ef3-c833-4707-aa7b-e278ccb3bc2c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:31.386390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ff0f0167-e27d-4bd1-83bf-746e483c9644 req-ae5f47ff-efd6-4e5a-9f2c-da0f3a4938d1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:31.386876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ff0f0167-e27d-4bd1-83bf-746e483c9644 req-ae5f47ff-efd6-4e5a-9f2c-da0f3a4938d1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:31.387310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ff0f0167-e27d-4bd1-83bf-746e483c9644 req-ae5f47ff-efd6-4e5a-9f2c-da0f3a4938d1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:31.398969 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ff0f0167-e27d-4bd1-83bf-746e483c9644 req-ae5f47ff-efd6-4e5a-9f2c-da0f3a4938d1 service nova] Creating event network-vif-plugged:dd398ef3-c833-4707-aa7b-e278ccb3bc2c for instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 on n-h1-781139-2 Oct 03 15:36:31.404446 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ff0f0167-e27d-4bd1-83bf-746e483c9644 req-ae5f47ff-efd6-4e5a-9f2c-da0f3a4938d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032840 Oct 03 15:36:31.405085 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3598/7369] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:36:31.582438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:31.583115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:31.591117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:31.591628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:31.592069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:31.592798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:31.593300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:31.593751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:31.728244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:31.736370 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-682229bf-5176-40ba-8274-d91b0a2de1cd tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.158056 Oct 03 15:36:31.736956 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3772/7370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:31 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:32.760341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:32.761217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=16 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:32.766345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:32.767058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:32.774286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:32.774939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:32.775530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:32.776390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:32.777151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:32.777898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:32.927407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:32.935696 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6381fe3d-0f5a-4e41-b415-4af8b351c7e6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1317 microversion: 2.1 time: 0.176660 Oct 03 15:36:32.936278 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3599/7371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:32 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:33.963407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:33.964078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:33.966089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:33.972611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:33.973127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:33.973582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:33.974305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:33.974764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:33.975194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:34.156421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:34.167345 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f9ada4d-66b9-43a2-9794-ecb66e6f55b5 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1507 microversion: 2.1 time: 0.211849 Oct 03 15:36:34.167954 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3773/7372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:33 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:34.189583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:34.190169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:34.197169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:34.197653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:34.198088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:34.198785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:34.199237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:34.199656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:34.228775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:36:34.311126 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4e3bba05-daf3-4a1a-a1cb-80e9af8352a6 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 204 len: 0 microversion: 2.1 time: 0.125110 Oct 03 15:36:34.314956 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3600/7373] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:36:34 2022] DELETE /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:36:34.320046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:34.320694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:34.327258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:34.327761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:34.328215 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:34.328957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:34.329456 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:34.329922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:34.556519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:34.564861 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7cced50-61be-467f-8d21-d5640b6e7ca2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1513 microversion: 2.1 time: 0.248735 Oct 03 15:36:34.580758 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3774/7374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:34 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:35.591611 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:35.592314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:35.599654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:35.600140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:35.600581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:35.601315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:35.601766 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:35.602192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:35.742801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:35.751041 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e230bc2b-caad-40ca-af55-d9b6e6408960 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1513 microversion: 2.1 time: 0.165105 Oct 03 15:36:35.751636 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3601/7375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:35 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:36.337117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1a98f90c-cac9-4f63-8b98-2a08ad8212e9 req-6155509c-7e60-489c-942e-f00e1d222a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97010ad-eb06-47e2-9a47-dfeb03b37f17", "name": "network-vif-deleted", "tag": "dd398ef3-c833-4707-aa7b-e278ccb3bc2c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:36.367217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1a98f90c-cac9-4f63-8b98-2a08ad8212e9 req-6155509c-7e60-489c-942e-f00e1d222a7a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:36.368214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1a98f90c-cac9-4f63-8b98-2a08ad8212e9 req-6155509c-7e60-489c-942e-f00e1d222a7a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:36.369428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1a98f90c-cac9-4f63-8b98-2a08ad8212e9 req-6155509c-7e60-489c-942e-f00e1d222a7a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:36.383317 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1a98f90c-cac9-4f63-8b98-2a08ad8212e9 req-6155509c-7e60-489c-942e-f00e1d222a7a service nova] Creating event network-vif-deleted:dd398ef3-c833-4707-aa7b-e278ccb3bc2c for instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 on n-h1-781139-2 Oct 03 15:36:36.390204 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1a98f90c-cac9-4f63-8b98-2a08ad8212e9 req-6155509c-7e60-489c-942e-f00e1d222a7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056684 Oct 03 15:36:36.391153 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3775/7376] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:36:36.778243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:36.778833 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:36.787220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:36.787707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:36.788141 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:36.788839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:36.789320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:36.789754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:36.823359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:36.823840 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:36.824279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:36.824739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lazy-loading 'fault' on Instance uuid e97010ad-eb06-47e2-9a47-dfeb03b37f17 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:36:36.867465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:36.875886 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba420503-0fdb-4e6d-9786-d5a73d8221aa tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 200 len: 1307 microversion: 2.1 time: 0.103909 Oct 03 15:36:36.876632 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3602/7377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:36 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:37.903048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:37.903762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:37.911796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:37.912290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:37.912740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:37.913478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:37.913940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:37.914369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:37.928413 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] HTTP exception thrown: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Request method failure captured: Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 HTTP/1.1 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwFn9IC9tAV2-ASgfnbo6gS6GCLLEcuT1YtyA-gHiA4edEN80qHp5eRmNvD8k0PcTKy7VZPiE-iyqZeAzmXfF4ga0JspId3m8dgExOCD9sS7H4ZycrHdpLp3NfG9slU11W_yBwZQPP6tX8jCCAHxMWIupUxD0raBJg67eh9QrSV5VW4 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e07b24536104d549880287b34654b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e07b24536104d549880287b34654b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e370f6088e8c4f7e8477e41fd5d9e182 Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e97010ad-eb06-47e2-9a47-dfeb03b37f17'} Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:37.930127 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Returning 404 to user: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d1af89fe-59ca-46e8-9bab-77c6a5f0d8d0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 404 len: 111 microversion: 2.1 time: 0.034594 Oct 03 15:36:37.934882 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3776/7378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:37 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:36:37.941075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:37.941688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:37.948742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:37.949273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:37.949706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:37.950381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:37.950829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:37.951243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:37.967807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:38.086327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:38.095117 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac68c8b3-2904-4a2b-b762-30cbb4a13e68 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1506 microversion: 2.1 time: 0.157923 Oct 03 15:36:38.095680 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3603/7379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:37 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:36:38.118389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd0544af-ca51-47ec-b944-cc1491efb333 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:38.120804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd0544af-ca51-47ec-b944-cc1491efb333 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: 34212092-1e4c-4d1c-b130-558d57a36161] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:38.126686 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-bd0544af-ca51-47ec-b944-cc1491efb333 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] HTTP exception thrown: Instance 34212092-1e4c-4d1c-b130-558d57a36161 could not be found. Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd0544af-ca51-47ec-b944-cc1491efb333 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Request method failure captured: Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/34212092-1e4c-4d1c-b130-558d57a36161/action HTTP/1.1 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 32 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwFn9IC9tAV2-ASgfnbo6gS6GCLLEcuT1YtyA-gHiA4edEN80qHp5eRmNvD8k0PcTKy7VZPiE-iyqZeAzmXfF4ga0JspId3m8dgExOCD9sS7H4ZycrHdpLp3NfG9slU11W_yBwZQPP6tX8jCCAHxMWIupUxD0raBJg67eh9QrSV5VW4 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e07b24536104d549880287b34654b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e07b24536104d549880287b34654b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e370f6088e8c4f7e8477e41fd5d9e182 Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: {"resize": {"flavorRef": "452"}} Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 34212092-1e4c-4d1c-b130-558d57a36161 could not be found. Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '34212092-1e4c-4d1c-b130-558d57a36161', 'body': {'resize': {'flavorRef': '452'}}} Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34212092-1e4c-4d1c-b130-558d57a36161 could not be found. Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:36:38.128220 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34212092-1e4c-4d1c-b130-558d57a36161 could not be found. Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34212092-1e4c-4d1c-b130-558d57a36161 could not be found. Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd0544af-ca51-47ec-b944-cc1491efb333 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Returning 404 to user: Instance 34212092-1e4c-4d1c-b130-558d57a36161 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd0544af-ca51-47ec-b944-cc1491efb333 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "POST /compute/v2.1/servers/34212092-1e4c-4d1c-b130-558d57a36161/action" status: 404 len: 111 microversion: 2.1 time: 0.015310 Oct 03 15:36:38.133091 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3777/7380] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:36:38 2022] POST /compute/v2.1/servers/34212092-1e4c-4d1c-b130-558d57a36161/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:36:38.138597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:38.139236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:38.141130 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:38.146542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.147031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.147472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.148167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.148631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.149081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.292892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:38.304642 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-83b9f1e8-305b-4291-8d45-f5b505feea4d tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1506 microversion: 2.1 time: 0.170272 Oct 03 15:36:38.305503 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3604/7381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:38 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:38.334411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:38.338824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:38.345216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.345744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.346158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.347074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.347537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.347969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.483665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:38.492085 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-05db17ab-d2ec-4722-ae09-897398baefc8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1506 microversion: 2.1 time: 0.161995 Oct 03 15:36:38.492660 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3778/7382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:38 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:38.515105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d8c7fd6d-167b-49e1-9bf1-b289ac9593ee"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:38.517346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:38.523588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.524053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.524478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.525195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.525756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.526103 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.566977 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:38.572809 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] HTTP exception thrown: Flavor d8c7fd6d-167b-49e1-9bf1-b289ac9593ee could not be found. Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Request method failure captured: Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: request: POST /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356/action HTTP/1.1 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 65 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwFn9IC9tAV2-ASgfnbo6gS6GCLLEcuT1YtyA-gHiA4edEN80qHp5eRmNvD8k0PcTKy7VZPiE-iyqZeAzmXfF4ga0JspId3m8dgExOCD9sS7H4ZycrHdpLp3NfG9slU11W_yBwZQPP6tX8jCCAHxMWIupUxD0raBJg67eh9QrSV5VW4 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e07b24536104d549880287b34654b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e07b24536104d549880287b34654b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e370f6088e8c4f7e8477e41fd5d9e182 Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: {"resize": {"flavorRef": "d8c7fd6d-167b-49e1-9bf1-b289ac9593ee"}} Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: exception: Flavor d8c7fd6d-167b-49e1-9bf1-b289ac9593ee could not be found. Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'bd6cd3c2-3b70-4d7d-b0e4-564b75321356', 'body': {'resize': {'flavorRef': 'd8c7fd6d-167b-49e1-9bf1-b289ac9593ee'}}} Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:38.574777 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d8c7fd6d-167b-49e1-9bf1-b289ac9593ee could not be found. Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d8c7fd6d-167b-49e1-9bf1-b289ac9593ee could not be found. Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d8c7fd6d-167b-49e1-9bf1-b289ac9593ee could not be found. Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Returning 400 to user: Flavor d8c7fd6d-167b-49e1-9bf1-b289ac9593ee could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9c900b20-eeaf-4787-b32b-10ff539ef8a0 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "POST /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356/action" status: 400 len: 107 microversion: 2.1 time: 0.065161 Oct 03 15:36:38.579222 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3605/7383] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:36:38 2022] POST /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:36:38.585769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:38.586407 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:38.593525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.594031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.594490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.595211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.595684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.596137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.739604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:38.748295 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6e76391f-1f2f-4040-ae47-7e25402eebae tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1506 microversion: 2.1 time: 0.167051 Oct 03 15:36:38.748879 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3779/7384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:38 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:38.772069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:38.772670 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:38.779361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.779869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.780295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.781026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.781502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.781947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.931034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:38.943625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9bb119ad-84ee-4496-92cf-6687e684a96b tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1506 microversion: 2.1 time: 0.175216 Oct 03 15:36:38.944244 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3606/7385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:38 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:38.967613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5cfb6bd-269d-4bd7-81d5-3b4d2a1b4cf2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5cfb6bd-269d-4bd7-81d5-3b4d2a1b4cf2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Request method failure captured: Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: request: POST /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356/action HTTP/1.1 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 29 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwFn9IC9tAV2-ASgfnbo6gS6GCLLEcuT1YtyA-gHiA4edEN80qHp5eRmNvD8k0PcTKy7VZPiE-iyqZeAzmXfF4ga0JspId3m8dgExOCD9sS7H4ZycrHdpLp3NfG9slU11W_yBwZQPP6tX8jCCAHxMWIupUxD0raBJg67eh9QrSV5VW4 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e07b24536104d549880287b34654b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e07b24536104d549880287b34654b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e370f6088e8c4f7e8477e41fd5d9e182 Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: {"resize": {"flavorRef": ""}} Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'bd6cd3c2-3b70-4d7d-b0e4-564b75321356', 'body': {'resize': {'flavorRef': ''}}} Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise error Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi '' Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.971241 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d5cfb6bd-269d-4bd7-81d5-3b4d2a1b4cf2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d5cfb6bd-269d-4bd7-81d5-3b4d2a1b4cf2 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "POST /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356/action" status: 400 len: 113 microversion: 2.1 time: 0.009053 Oct 03 15:36:38.976367 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3780/7386] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:36:38 2022] POST /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 15:36:38.981477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:38.982097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:38.989502 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.989898 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.990341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:38.991041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:38.991544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:38.991967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.150207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:39.159384 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c552b7c2-62d6-4d86-b74d-af0a419ac2f9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1506 microversion: 2.1 time: 0.182368 Oct 03 15:36:39.159966 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3607/7387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:38 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:39.185876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:39.186383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:39.189499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=47 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:39.194768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.195264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.195716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.196434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.196881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.197357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.200303 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=85 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:36:39.212733 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] HTTP exception thrown: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Request method failure captured: Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 HTTP/1.1 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwFn9IC9tAV2-ASgfnbo6gS6GCLLEcuT1YtyA-gHiA4edEN80qHp5eRmNvD8k0PcTKy7VZPiE-iyqZeAzmXfF4ga0JspId3m8dgExOCD9sS7H4ZycrHdpLp3NfG9slU11W_yBwZQPP6tX8jCCAHxMWIupUxD0raBJg67eh9QrSV5VW4 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e07b24536104d549880287b34654b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e07b24536104d549880287b34654b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e370f6088e8c4f7e8477e41fd5d9e182 Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'e97010ad-eb06-47e2-9a47-dfeb03b37f17'} Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:36:39.214425 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Returning 404 to user: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c07b22f2-3435-4aa5-8a0a-9afe8d3c03c4 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 404 len: 111 microversion: 2.1 time: 0.034961 Oct 03 15:36:39.218570 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3781/7388] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:36:39 2022] DELETE /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:36:39.224639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:39.225285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: e97010ad-eb06-47e2-9a47-dfeb03b37f17] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:39.231812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.232290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.232727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.233535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.233992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.234403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.249856 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] HTTP exception thrown: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Request method failure captured: Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 HTTP/1.1 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwFn9IC9tAV2-ASgfnbo6gS6GCLLEcuT1YtyA-gHiA4edEN80qHp5eRmNvD8k0PcTKy7VZPiE-iyqZeAzmXfF4ga0JspId3m8dgExOCD9sS7H4ZycrHdpLp3NfG9slU11W_yBwZQPP6tX8jCCAHxMWIupUxD0raBJg67eh9QrSV5VW4 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e07b24536104d549880287b34654b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e07b24536104d549880287b34654b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e370f6088e8c4f7e8477e41fd5d9e182 Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'e97010ad-eb06-47e2-9a47-dfeb03b37f17'} Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:39.251426 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Returning 404 to user: Instance e97010ad-eb06-47e2-9a47-dfeb03b37f17 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-55ce701b-e9a6-40cc-b519-36014cfce8b9 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17" status: 404 len: 111 microversion: 2.1 time: 0.032091 Oct 03 15:36:39.259069 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3608/7389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:39 2022] GET /compute/v2.1/servers/e97010ad-eb06-47e2-9a47-dfeb03b37f17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:36:39.261729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:39.262249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:39.268591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.269154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.269611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.270325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.270799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.271246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.302401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:36:39.385723 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ce3ca7a2-44f8-4c16-800d-ee390bab7e16 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 204 len: 0 microversion: 2.1 time: 0.127650 Oct 03 15:36:39.388593 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3782/7390] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:36:39 2022] DELETE /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:36:39.395870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:39.396731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:39.404063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.404636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.405351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.406474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:39.407150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:39.407768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:39.549421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:39.559008 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e425c5e4-8917-45dc-8d79-469c63339e10 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1512 microversion: 2.1 time: 0.167156 Oct 03 15:36:39.559692 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3609/7391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:39 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:40.592430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:40.593186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:40.600485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:40.601008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:40.601462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:40.602171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:40.602639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:40.603076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:40.784024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:40.792471 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25cf82e7-2b1c-4cec-8c32-223ca4553bd8 tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1512 microversion: 2.1 time: 0.206437 Oct 03 15:36:40.793240 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3783/7392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:40 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:41.211041 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-79bf96d5-cc29-4b1a-9870-978926af6078 req-de63da53-710b-4b80-965d-e559c946a13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd6cd3c2-3b70-4d7d-b0e4-564b75321356", "name": "network-vif-deleted", "tag": "8d74a33a-32fd-441b-9886-35ca2037b4d0"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:36:41.223112 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79bf96d5-cc29-4b1a-9870-978926af6078 req-de63da53-710b-4b80-965d-e559c946a13f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:41.223598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79bf96d5-cc29-4b1a-9870-978926af6078 req-de63da53-710b-4b80-965d-e559c946a13f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:41.224056 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79bf96d5-cc29-4b1a-9870-978926af6078 req-de63da53-710b-4b80-965d-e559c946a13f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:41.237754 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-79bf96d5-cc29-4b1a-9870-978926af6078 req-de63da53-710b-4b80-965d-e559c946a13f service nova] Creating event network-vif-deleted:8d74a33a-32fd-441b-9886-35ca2037b4d0 for instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 on n-h2-781139-2 Oct 03 15:36:41.243601 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-79bf96d5-cc29-4b1a-9870-978926af6078 req-de63da53-710b-4b80-965d-e559c946a13f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036442 Oct 03 15:36:41.244648 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3610/7393] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:36:41.815688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:41.816339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:41.824552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:41.825063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:41.825508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:41.826532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:41.827025 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:41.827488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:41.859369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:41.859850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:41.860289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:41.860757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lazy-loading 'fault' on Instance uuid bd6cd3c2-3b70-4d7d-b0e4-564b75321356 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:36:41.901437 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e370f6088e8c4f7e8477e41fd5d9e182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e07b24536104d549880287b34654b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:36:41.909488 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60a5ec40-136c-4f8a-aef3-a678083dbc7c tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 200 len: 1306 microversion: 2.1 time: 0.097749 Oct 03 15:36:41.910060 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3784/7394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:41 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:36:42.936078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:36:42.936785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] [instance: bd6cd3c2-3b70-4d7d-b0e4-564b75321356] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:36:42.943471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:42.943936 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:42.944378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:42.945198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:36:42.945660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:36:42.946088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:36:42.960074 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] HTTP exception thrown: Instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 could not be found. Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Request method failure captured: Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 HTTP/1.1 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwFn9IC9tAV2-ASgfnbo6gS6GCLLEcuT1YtyA-gHiA4edEN80qHp5eRmNvD8k0PcTKy7VZPiE-iyqZeAzmXfF4ga0JspId3m8dgExOCD9sS7H4ZycrHdpLp3NfG9slU11W_yBwZQPP6tX8jCCAHxMWIupUxD0raBJg67eh9QrSV5VW4 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3e07b24536104d549880287b34654b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3e07b24536104d549880287b34654b99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3e07b24536104d549880287b34654b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 3e07b24536104d549880287b34654b99 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1963623249 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e370f6088e8c4f7e8477e41fd5d9e182 Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-ServersNegativeTestJSON-1963623249-project Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 could not be found. Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'bd6cd3c2-3b70-4d7d-b0e4-564b75321356'} Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 could not be found. Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 could not be found. Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:36:42.961760 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 could not be found. Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] Returning 404 to user: Instance bd6cd3c2-3b70-4d7d-b0e4-564b75321356 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dfca5b70-e6c1-4e85-8a7a-3f1e5e5f16ea tempest-ServersNegativeTestJSON-1963623249 tempest-ServersNegativeTestJSON-1963623249-project] 10.222.0.20 "GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356" status: 404 len: 111 microversion: 2.1 time: 0.034203 Oct 03 15:36:42.966483 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3611/7395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:36:42 2022] GET /compute/v2.1/servers/bd6cd3c2-3b70-4d7d-b0e4-564b75321356 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:37:14.086918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:14.087833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:14.260691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-25b218fd-319f-4a7d-9fa3-9eaec86bb6b8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: .version_select at 0x7fb22b55ce50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-298742237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfKo7l88DaiBMYbqgIKEHPxf/DswwPpd6aKEObn8svEnOfEg65m3wjsLXySmPsrnVUNC9EtCTVPOgmAzO/2KwyKhb5W3vPGlQTG0yvMMzkmLcke69yp0PnKV7HGT7FMJg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:14.279613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-25b218fd-319f-4a7d-9fa3-9eaec86bb6b8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:37:14.287550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-25b218fd-319f-4a7d-9fa3-9eaec86bb6b8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for user e869c9e024bc452a8bc0081188ee79d9 and project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:37:14.318081 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-25b218fd-319f-4a7d-9fa3-9eaec86bb6b8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.236803 Oct 03 15:37:14.318733 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3785/7396] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:37:14 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:14.373325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-182458816", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-298742237", "networks": [{"uuid": "360f165f-fe00-4b4c-88e5-a74993ea130b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:14.382909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=17 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:14.383695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=37 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:14.436440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] validate_networks() for [('360f165f-fe00-4b4c-88e5-a74993ea130b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:37:14.949705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:37:14.950350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:37:14.950954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:37:14.951517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:37:14.951933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:37:14.962650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:14.962650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:14.963222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:14.964023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:14.964164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:14.964605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:14.983572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:37:14.989379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for user e869c9e024bc452a8bc0081188ee79d9 and project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:37:15.003288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:37:15.005779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:37:15.055816 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a2dbfff3-cbf6-451b-9043-ec2eb7ef5f9b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686688 Oct 03 15:37:15.056686 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3612/7397] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:37:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:37:15.068138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d646fcb0-d750-41f9-870c-08b5d8956b8b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:15.068798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d646fcb0-d750-41f9-870c-08b5d8956b8b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:15.128685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d646fcb0-d750-41f9-870c-08b5d8956b8b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:15.140404 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d646fcb0-d750-41f9-870c-08b5d8956b8b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1261 microversion: 2.1 time: 0.076459 Oct 03 15:37:15.141109 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3786/7398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:15 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:16.168180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:16.169466 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:16.179805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:16.180779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:16.181914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:16.183039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:16.183762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:16.184399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:16.258344 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:16.267211 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a1f1482c-4851-45da-a775-4dcb5174a4c0 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1331 microversion: 2.1 time: 0.107542 Oct 03 15:37:16.268336 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3613/7399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:16 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:17.291370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:17.292205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:17.300856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:17.301412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:17.301861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:17.302597 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:17.303097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:17.303536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:17.502749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:17.511074 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2e08abe5-a559-40a4-9973-46e4e5f2cca2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1361 microversion: 2.1 time: 0.224277 Oct 03 15:37:17.512088 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3787/7400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:17 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:37:17.752297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-764570d3-e796-483e-af95-6054470cb6bf req-eaa3562a-2369-4370-a240-d1b0d44ad46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66a8774-df6c-4b73-b617-f60a1abd591c", "tag": "9cba77eb-a23e-43c3-b2a6-54e3ba3740db"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:17.771838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-764570d3-e796-483e-af95-6054470cb6bf req-eaa3562a-2369-4370-a240-d1b0d44ad46c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:17.772300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-764570d3-e796-483e-af95-6054470cb6bf req-eaa3562a-2369-4370-a240-d1b0d44ad46c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:17.772732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-764570d3-e796-483e-af95-6054470cb6bf req-eaa3562a-2369-4370-a240-d1b0d44ad46c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:17.787738 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-764570d3-e796-483e-af95-6054470cb6bf req-eaa3562a-2369-4370-a240-d1b0d44ad46c service nova] Creating event network-changed:9cba77eb-a23e-43c3-b2a6-54e3ba3740db for instance a66a8774-df6c-4b73-b617-f60a1abd591c on n-h2-781139-2 Oct 03 15:37:17.793540 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-764570d3-e796-483e-af95-6054470cb6bf req-eaa3562a-2369-4370-a240-d1b0d44ad46c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128085 Oct 03 15:37:17.794706 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3614/7401] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:18.538358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:18.538951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:18.546896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:18.547393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:18.547848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:18.548562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:18.549067 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:18.549511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:18.684537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:18.692877 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83b5579a-d421-4d72-8c84-7327d93f68b3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1361 microversion: 2.1 time: 0.161165 Oct 03 15:37:18.693513 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3788/7402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:18 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:19.720999 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:19.721799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:19.730324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:19.730870 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:19.731363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:19.732156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:19.732652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:19.733162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:19.873556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:19.882044 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2422bc9c-a036-4294-9b75-abf156d80d63 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1361 microversion: 2.1 time: 0.165787 Oct 03 15:37:19.882626 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3615/7403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:19 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:20.908244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:20.909133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:20.919369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:20.919878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:20.920330 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:20.921074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:20.921551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:20.921983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:21.064919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:21.072806 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d1d5935-ff94-4645-b2ce-f72b98808281 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1361 microversion: 2.1 time: 0.170372 Oct 03 15:37:21.073732 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3789/7404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:20 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:22.099689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:22.100616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:22.112718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:22.113506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:22.114181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:22.115229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:22.115929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:22.116554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:22.253869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:22.262650 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-49d3c5c2-a321-4bdc-bfa6-da77339aa415 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1361 microversion: 2.1 time: 0.168896 Oct 03 15:37:22.263249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3616/7405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:22 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:22.329862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-c331f182-5ccf-4116-a233-a7ebe33b252f req-e01ec92f-fe9f-46f7-a911-5f344407ba27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66a8774-df6c-4b73-b617-f60a1abd591c", "name": "network-vif-plugged", "status": "completed", "tag": "9cba77eb-a23e-43c3-b2a6-54e3ba3740db"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:22.340028 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c331f182-5ccf-4116-a233-a7ebe33b252f req-e01ec92f-fe9f-46f7-a911-5f344407ba27 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:22.341346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c331f182-5ccf-4116-a233-a7ebe33b252f req-e01ec92f-fe9f-46f7-a911-5f344407ba27 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:22.341461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-c331f182-5ccf-4116-a233-a7ebe33b252f req-e01ec92f-fe9f-46f7-a911-5f344407ba27 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:22.352711 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-c331f182-5ccf-4116-a233-a7ebe33b252f req-e01ec92f-fe9f-46f7-a911-5f344407ba27 service nova] Creating event network-vif-plugged:9cba77eb-a23e-43c3-b2a6-54e3ba3740db for instance a66a8774-df6c-4b73-b617-f60a1abd591c on n-h2-781139-2 Oct 03 15:37:22.357898 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-c331f182-5ccf-4116-a233-a7ebe33b252f req-e01ec92f-fe9f-46f7-a911-5f344407ba27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090488 Oct 03 15:37:22.358528 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3790/7406] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:23.286262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:23.286897 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:23.294379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:23.294864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:23.295300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:23.296011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:23.296465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:23.296887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:23.433915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:23.446306 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1ec8d10-472d-4e73-b31c-82edeaf30940 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1361 microversion: 2.1 time: 0.163877 Oct 03 15:37:23.447115 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3617/7407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:23 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:24.476731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:24.478021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:24.486296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:24.486835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:24.487338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:24.488093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:24.488558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:24.489007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:24.622268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:24.630759 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b65c1edd-4221-40ab-945c-845219e6e528 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1553 microversion: 2.1 time: 0.162757 Oct 03 15:37:24.631657 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3791/7408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:24 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:24.654219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:24.654829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:24.661790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:24.662273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:24.662704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:24.663387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:24.663836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:24.664255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:24.808047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:24.816396 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-036a3049-0086-4f5f-8d98-e3fec68f171b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1553 microversion: 2.1 time: 0.166075 Oct 03 15:37:24.816969 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3618/7409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:24 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:26.469750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9dd3f61-8514-47f2-99a1-380395820149"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:26.472334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:26.474489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:26.481300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:26.482074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:26.482885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:26.483673 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:26.484271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:26.484743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:26.749642 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5f1ec296-c9e6-4962-b182-05b6d8d7a75d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287636 Oct 03 15:37:26.750269 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3792/7410] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:37:26 2022] POST /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:37.542448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:37.542973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:37.545106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:37.545789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:37.546932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:37.547594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=34 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:37.554026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:37.554503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:37.554932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:37.555624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:37.556071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:37.556491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:37.641178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lazy-loading 'services' on Instance uuid a66a8774-df6c-4b73-b617-f60a1abd591c {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:37:37.715775 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2abd2b9-949a-44e7-a59a-e45c74f342fc tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments/a9dd3f61-8514-47f2-99a1-380395820149" status: 202 len: 0 microversion: 2.1 time: 0.177150 Oct 03 15:37:37.716392 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3619/7411] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:37:37 2022] DELETE /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments/a9dd3f61-8514-47f2-99a1-380395820149 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:37:37.723270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:37.724175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:37:37.728633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:37.731111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:37.739197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:37.739747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:37.740175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:37.741043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:37.741513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:37.741957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:37.779141 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-22e81911-e3dc-49b5-9ec4-4bdd71c25af1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057732 Oct 03 15:37:37.780031 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3793/7412] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:37:37 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:38.793666 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:38.796899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:38.804465 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:38.804959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:38.805420 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:38.806127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:38.806584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:38.807009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:38.842179 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b976a0c7-38f6-43d4-ab9e-b42f74d1f14e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053848 Oct 03 15:37:38.847266 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3620/7413] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:37:38 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:39.855461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:39.857686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:39.865061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:39.865563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:39.866008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:39.866721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:39.867184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:39.867619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:39.898553 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9d6e06a5-d2af-43a4-afd5-bdca495584d5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Oct 03 15:37:39.899396 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3794/7414] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:37:39 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:40.911087 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:40.913296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:40.920599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:40.921123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:40.921562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:40.922265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:40.922718 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:40.923453 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:40.953908 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7f473845-d8b6-411f-a2ef-445a14f8e92b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047305 Oct 03 15:37:40.954757 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3621/7415] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:37:40 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:41.966787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:41.968976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:41.976459 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:41.976969 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:41.977444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:41.978156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:41.978619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:41.979055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:42.010739 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b305161-e760-4ee9-8216-be6070d4698d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048065 Oct 03 15:37:42.011560 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3795/7416] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:37:41 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:43.024307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:43.026554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:43.033998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:43.034485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:43.034924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:43.035626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:43.036081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:43.036505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:43.066232 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2bbe049-5b9b-4f5d-a6eb-a9c326e2cc8c tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045984 Oct 03 15:37:43.066837 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3622/7417] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:37:43 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:37:43.077852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:43.078372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:43.085875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:43.086369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:43.086810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:43.087519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:43.087986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:43.088422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:43.165624 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] HTTP exception thrown: Instance a66a8774-df6c-4b73-b617-f60a1abd591c is not attached to volume a9dd3f61-8514-47f2-99a1-380395820149 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Request method failure captured: Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments/a9dd3f61-8514-47f2-99a1-380395820149 HTTP/1.1 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwGkyYM_Ce6HY4DDBU38sVuHGr_uG2n_96kljkUzb8I2NB66hg0T9m2Xb462kbwgcPT0kc70f94k5UItEygUJvcP8z3yf7h26HMgNLXPDTG_p3swcG49997BjOYEzYRuy_v1pCtLk3aukYnynaHIgxMhzsNn7gOo5hC_nXZxhHtyLOA Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c604bd80b041e985cc12dd4f1d4b60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e869c9e024bc452a8bc0081188ee79d9 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a66a8774-df6c-4b73-b617-f60a1abd591c is not attached to volume a9dd3f61-8514-47f2-99a1-380395820149 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': 'a66a8774-df6c-4b73-b617-f60a1abd591c', 'id': 'a9dd3f61-8514-47f2-99a1-380395820149'} Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9dd3f61-8514-47f2-99a1-380395820149. Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66a8774-df6c-4b73-b617-f60a1abd591c is not attached to volume a9dd3f61-8514-47f2-99a1-380395820149 Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:37:43.185051 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:37:43.189848 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:37:43.189848 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:37:43.189848 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66a8774-df6c-4b73-b617-f60a1abd591c is not attached to volume a9dd3f61-8514-47f2-99a1-380395820149 Oct 03 15:37:43.189848 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:43.189848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Returning 404 to user: Instance a66a8774-df6c-4b73-b617-f60a1abd591c is not attached to volume a9dd3f61-8514-47f2-99a1-380395820149 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:37:43.189848 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59a87a62-d2e6-48c4-a8e6-c00a9ebaa02f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments/a9dd3f61-8514-47f2-99a1-380395820149" status: 404 len: 154 microversion: 2.1 time: 0.112804 Oct 03 15:37:43.189848 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3796/7418] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:37:43 2022] DELETE /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c/os-volume_attachments/a9dd3f61-8514-47f2-99a1-380395820149 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:37:46.549149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:46.549647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:46.556485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:46.556993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:46.557428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:46.558106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:46.558556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:46.558972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:46.584166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:37:46.671514 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-01ac14fc-817b-48fe-a382-5e9d37bf6fc3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 204 len: 0 microversion: 2.1 time: 0.126036 Oct 03 15:37:46.673034 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3623/7419] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:37:46 2022] DELETE /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:37:46.682046 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:46.682471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:46.690631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:46.691213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:46.691665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:46.692380 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:46.692843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:46.693310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:46.836088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:46.844234 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b68630ca-4e1d-40b5-baa9-743485c33056 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1559 microversion: 2.1 time: 0.166812 Oct 03 15:37:46.844821 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3797/7420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:46 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:37:47.873490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:47.874723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:47.883117 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:47.883603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:47.884040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:47.884739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:47.885221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:47.885650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:48.032229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:48.040712 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5eeb91a2-cd4d-473b-bcc7-faa84ce2b9c2 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1559 microversion: 2.1 time: 0.174612 Oct 03 15:37:48.041374 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3624/7421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:47 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:48.632665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3d71e2a6-803d-4ea0-87f6-e543283331ed req-95de83ea-069c-4d9b-a1f8-6fa5c4f34f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66a8774-df6c-4b73-b617-f60a1abd591c", "name": "network-vif-deleted", "tag": "9cba77eb-a23e-43c3-b2a6-54e3ba3740db"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:48.643080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3d71e2a6-803d-4ea0-87f6-e543283331ed req-95de83ea-069c-4d9b-a1f8-6fa5c4f34f7f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:48.643682 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3d71e2a6-803d-4ea0-87f6-e543283331ed req-95de83ea-069c-4d9b-a1f8-6fa5c4f34f7f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:48.644128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3d71e2a6-803d-4ea0-87f6-e543283331ed req-95de83ea-069c-4d9b-a1f8-6fa5c4f34f7f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:48.656433 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3d71e2a6-803d-4ea0-87f6-e543283331ed req-95de83ea-069c-4d9b-a1f8-6fa5c4f34f7f service nova] Creating event network-vif-deleted:9cba77eb-a23e-43c3-b2a6-54e3ba3740db for instance a66a8774-df6c-4b73-b617-f60a1abd591c on n-h2-781139-2 Oct 03 15:37:48.663231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3d71e2a6-803d-4ea0-87f6-e543283331ed req-95de83ea-069c-4d9b-a1f8-6fa5c4f34f7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033829 Oct 03 15:37:48.663838 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3798/7422] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:49.065626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:49.066288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:49.073784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:49.074281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:49.074831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:49.075544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:49.075974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:49.076406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:49.111533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:49.112028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:49.112460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:49.112943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lazy-loading 'fault' on Instance uuid a66a8774-df6c-4b73-b617-f60a1abd591c {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:37:49.161572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:49.168974 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5b927be6-06dd-48d1-a5ab-12f10469a5db tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 200 len: 1351 microversion: 2.1 time: 0.108408 Oct 03 15:37:49.169722 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3625/7423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:49 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:37:50.193448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:50.194158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a66a8774-df6c-4b73-b617-f60a1abd591c] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:50.201832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:50.202334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:50.202813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:50.203523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:50.203988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:50.204434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:50.218975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] HTTP exception thrown: Instance a66a8774-df6c-4b73-b617-f60a1abd591c could not be found. Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Request method failure captured: Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c HTTP/1.1 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwGkyYM_Ce6HY4DDBU38sVuHGr_uG2n_96kljkUzb8I2NB66hg0T9m2Xb462kbwgcPT0kc70f94k5UItEygUJvcP8z3yf7h26HMgNLXPDTG_p3swcG49997BjOYEzYRuy_v1pCtLk3aukYnynaHIgxMhzsNn7gOo5hC_nXZxhHtyLOA Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c604bd80b041e985cc12dd4f1d4b60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e869c9e024bc452a8bc0081188ee79d9 Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance a66a8774-df6c-4b73-b617-f60a1abd591c could not be found. Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'a66a8774-df6c-4b73-b617-f60a1abd591c'} Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66a8774-df6c-4b73-b617-f60a1abd591c could not be found. Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66a8774-df6c-4b73-b617-f60a1abd591c could not be found. Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:50.220793 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66a8774-df6c-4b73-b617-f60a1abd591c could not be found. Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Returning 404 to user: Instance a66a8774-df6c-4b73-b617-f60a1abd591c could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f1ec888-b260-4bdd-8fea-995c13dc3d6e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c" status: 404 len: 111 microversion: 2.1 time: 0.033284 Oct 03 15:37:50.226947 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3799/7424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:50 2022] GET /compute/v2.1/servers/a66a8774-df6c-4b73-b617-f60a1abd591c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:37:50.233258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43fb4ef2-6fe4-4a2e-84f2-851a2af81195 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '.version_select at 0x7fb230118a60>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:50.263219 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43fb4ef2-6fe4-4a2e-84f2-851a2af81195 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-298742237" status: 202 len: 0 microversion: 2.1 time: 0.034028 Oct 03 15:37:50.263825 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3626/7425] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:37:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-298742237 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:37:50.280882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21bbc99e-f036-4f74-ba9c-823c6a57ef1a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: .version_select at 0x7fb22b3f0790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-383618275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCu/SiDruUmPrLcaBMNfbp8b7w6HzBD9sxVwB9n+MEGMsHy0f3DRaRiaIQ+PjtjcLdlxTp+4rAeClW2rro00y/5aWXHPaxZFFTkH+oiLDQ8JYqJK5nObpL3XE+TJRoHm7g=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:50.297710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-21bbc99e-f036-4f74-ba9c-823c6a57ef1a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:37:50.304338 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-21bbc99e-f036-4f74-ba9c-823c6a57ef1a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for user e869c9e024bc452a8bc0081188ee79d9 and project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:37:50.329657 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21bbc99e-f036-4f74-ba9c-823c6a57ef1a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052652 Oct 03 15:37:50.330697 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3800/7426] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:37:50 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:50.388040 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-443172162", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-383618275", "networks": [{"uuid": "360f165f-fe00-4b4c-88e5-a74993ea130b"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:50.443598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] validate_networks() for [('360f165f-fe00-4b4c-88e5-a74993ea130b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:37:50.824093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:37:50.824542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:37:50.825046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:37:50.825454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:37:50.825863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:37:50.835786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:50.836265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:50.836700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:50.837469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:50.837919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:50.838342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:50.860177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:37:50.865726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for user e869c9e024bc452a8bc0081188ee79d9 and project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:37:50.879166 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:37:50.881540 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:37:50.932799 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5fffaa65-45db-4bdb-bf79-38b243409b5b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548734 Oct 03 15:37:50.933498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3627/7427] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:37:50.945337 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2c851e0c-616d-492d-b941-3efd1866245f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:50.946320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2c851e0c-616d-492d-b941-3efd1866245f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:51.015165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2c851e0c-616d-492d-b941-3efd1866245f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:51.027798 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2c851e0c-616d-492d-b941-3efd1866245f tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1261 microversion: 2.1 time: 0.086788 Oct 03 15:37:51.028395 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3801/7428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:50 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:52.052539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:52.053184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:52.059803 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:52.060290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:52.060728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:52.061539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:52.061988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:52.062417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:52.130828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:52.138976 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2b38b1da-561c-4e1f-8135-14038da4cb69 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1313 microversion: 2.1 time: 0.091399 Oct 03 15:37:52.139571 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3628/7429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:52 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1313 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:53.162221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:53.162910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:53.170676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:53.171116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:53.171570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:53.172423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:53.172958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:53.173479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:53.315873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:53.324217 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cf0b9152-3bf0-45a4-9f7b-f7b644fb50da tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1361 microversion: 2.1 time: 0.166139 Oct 03 15:37:53.324955 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3802/7430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:53 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:53.642579 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f25ac745-d491-4ab3-961a-862aac58d55b req-e6b88b5e-65ee-4e70-8af3-1c19115a30e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c7deaf-0b3b-47fb-a886-9498b9b06367", "tag": "56402204-54bf-4072-a099-5cb74f8b08d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:53.652603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f25ac745-d491-4ab3-961a-862aac58d55b req-e6b88b5e-65ee-4e70-8af3-1c19115a30e3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:53.653121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f25ac745-d491-4ab3-961a-862aac58d55b req-e6b88b5e-65ee-4e70-8af3-1c19115a30e3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:53.653556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f25ac745-d491-4ab3-961a-862aac58d55b req-e6b88b5e-65ee-4e70-8af3-1c19115a30e3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:53.664878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f25ac745-d491-4ab3-961a-862aac58d55b req-e6b88b5e-65ee-4e70-8af3-1c19115a30e3 service nova] Creating event network-changed:56402204-54bf-4072-a099-5cb74f8b08d1 for instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 on n-h1-781139-2 Oct 03 15:37:53.670045 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f25ac745-d491-4ab3-961a-862aac58d55b req-e6b88b5e-65ee-4e70-8af3-1c19115a30e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095042 Oct 03 15:37:53.670650 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3629/7431] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:37:54.348193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:54.348839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:54.355868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:54.356357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:54.356803 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:54.357572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:54.358038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:54.358470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:54.498844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:54.510409 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1fad16d5-ad2a-4586-8e80-223305693326 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1361 microversion: 2.1 time: 0.166065 Oct 03 15:37:54.511177 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3803/7432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:54 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:55.537954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:55.538690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:55.545444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:55.545921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:55.546361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:55.547047 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:55.547486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:55.547921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:55.699852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:55.712150 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-14c9be30-bca4-4dbd-a734-fc2dc2cd3c35 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1361 microversion: 2.1 time: 0.179330 Oct 03 15:37:55.713002 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3630/7433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:55 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:56.737773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:56.738356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:56.745875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:56.746384 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:56.746834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:56.747553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:56.748055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:56.748492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:56.884102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:56.892593 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c52bcd2-94d1-41e1-b0bc-247c57f73558 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1361 microversion: 2.1 time: 0.158617 Oct 03 15:37:56.893211 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3804/7434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:56 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:57.920504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:57.921651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:57.932778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:57.933569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:57.934240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:57.935313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:57.936003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:57.936659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:58.073518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:58.082252 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-33aedad0-e47f-451a-b674-86d61d3b3006 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1361 microversion: 2.1 time: 0.169009 Oct 03 15:37:58.083213 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3631/7435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:57 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:59.108801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:37:59.109772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:37:59.120676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:59.121564 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:59.122434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:59.123838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:59.124567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:59.125323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:59.268458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:37:59.281347 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-acef51f1-0cf4-4fd6-9743-8602ed72bcc6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1361 microversion: 2.1 time: 0.178226 Oct 03 15:37:59.282169 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3805/7436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:37:59 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:37:59.665145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d1539511-6222-4e3e-af3f-4b3a5e7a282b req-b20e6749-26c6-47b2-8eca-185f358900f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c7deaf-0b3b-47fb-a886-9498b9b06367", "name": "network-vif-plugged", "status": "completed", "tag": "56402204-54bf-4072-a099-5cb74f8b08d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:37:59.675899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d1539511-6222-4e3e-af3f-4b3a5e7a282b req-b20e6749-26c6-47b2-8eca-185f358900f5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:37:59.676377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d1539511-6222-4e3e-af3f-4b3a5e7a282b req-b20e6749-26c6-47b2-8eca-185f358900f5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:37:59.676802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d1539511-6222-4e3e-af3f-4b3a5e7a282b req-b20e6749-26c6-47b2-8eca-185f358900f5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:37:59.688356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d1539511-6222-4e3e-af3f-4b3a5e7a282b req-b20e6749-26c6-47b2-8eca-185f358900f5 service nova] Creating event network-vif-plugged:56402204-54bf-4072-a099-5cb74f8b08d1 for instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 on n-h1-781139-2 Oct 03 15:37:59.693429 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d1539511-6222-4e3e-af3f-4b3a5e7a282b req-b20e6749-26c6-47b2-8eca-185f358900f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Oct 03 15:37:59.694057 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3632/7437] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:00.306885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:00.307678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:00.317838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:00.318596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:00.319487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:00.320746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:00.321605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:00.322311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:00.462662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:00.470700 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7a10c152-2435-40b4-9427-320172d53594 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1361 microversion: 2.1 time: 0.169178 Oct 03 15:38:00.471280 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3806/7438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:00 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:01.492815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:01.493658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:01.497915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:01.498615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:01.506365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:01.506877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:01.507325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:01.508023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:01.508477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:01.508895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:01.643219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:01.652185 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-443bdbe9-ced2-4b25-8a7c-9d0f83fb4853 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1552 microversion: 2.1 time: 0.161190 Oct 03 15:38:01.652711 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3633/7439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:01 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:01.675748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:01.676496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:01.678573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:01.685183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:01.685818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:01.686276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:01.686977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:01.687448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:01.687891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:01.830918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:01.839869 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cd8bc774-4252-4e0f-9ae2-016b4d2d4cde tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1552 microversion: 2.1 time: 0.168722 Oct 03 15:38:01.840451 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3807/7440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:01 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:03.359238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f069a7d-cec7-48c0-b5c6-72e95b831b93"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:38:03.361704 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:03.370276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:03.370758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:03.371218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:03.371912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:03.372348 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:03.372779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:03.639874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:03.660227 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fc5b43bb-11fa-4586-a499-f386a9652f78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305305 Oct 03 15:38:03.660892 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3634/7441] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:38:03 2022] POST /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:15.545511 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:15.546029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:15.551535 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:38:15.551697 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:38:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments/6f069a7d-cec7-48c0-b5c6-72e95b831b93 (ip 10.222.0.20) !!! Oct 03 15:38:15.553039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:15.553920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=70 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:15.568199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:15.568695 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:15.569181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:15.570106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:15.570553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:15.570987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:15.660237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lazy-loading 'services' on Instance uuid a7c7deaf-0b3b-47fb-a886-9498b9b06367 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:38:15.757209 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af09a097-0586-4a7f-9ae0-693a7564df28 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments/6f069a7d-cec7-48c0-b5c6-72e95b831b93" status: 202 len: 0 microversion: 2.1 time: 0.217862 Oct 03 15:38:15.757824 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3808/7442] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:38:15 2022] DELETE /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments/6f069a7d-cec7-48c0-b5c6-72e95b831b93 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:38:15.767700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:15.770673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:15.773468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:15.774310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:15.781597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:15.782091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:15.782541 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:15.783243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:15.783703 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:15.784129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:15.821338 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e69b5e31-9b89-4b05-85f3-733c840bbd93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058283 Oct 03 15:38:15.821958 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3635/7443] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:15 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:16.836483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:16.838880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:16.845823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:16.846312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:16.846761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:16.847473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:16.847937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:16.848371 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:16.879736 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bf16b585-c913-42f6-a26e-77efa070fc78 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048895 Oct 03 15:38:16.880285 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3809/7444] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:16 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:17.892710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:17.895330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:17.902966 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:17.903464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:17.903899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:17.904614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:17.905139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:17.905569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:17.938350 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-859a5694-7774-4990-9e23-2aa57a374b68 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049666 Oct 03 15:38:17.938935 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3636/7445] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:17 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:18.952032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:18.954315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:18.961469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:18.961981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:18.962435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:18.963148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:18.963622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:18.964061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:18.995681 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aa5d5f60-bc2e-4bed-807f-0dcbb4fc7561 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047898 Oct 03 15:38:18.996484 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3810/7446] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:18 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:20.009222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:20.011660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:20.019051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:20.019712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:20.020289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:20.021057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:20.021516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:20.021943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:20.053004 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e0a9ca3-c6dd-4c8d-8c98-16ee9e425ae3 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048501 Oct 03 15:38:20.053590 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3637/7447] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:20 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:21.066203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:21.068501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:21.075937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:21.076483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:21.076891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:21.077638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:21.078111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:21.078549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:21.109263 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d810c6d1-e6ce-44db-a258-2186ed994fd5 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047193 Oct 03 15:38:21.109826 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3811/7448] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:21 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:38:21.121431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:21.121960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:21.128851 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:21.129808 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:21.130248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:21.130939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:21.131391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:21.131812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:21.218062 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] HTTP exception thrown: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 is not attached to volume 6f069a7d-cec7-48c0-b5c6-72e95b831b93 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Request method failure captured: Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments/6f069a7d-cec7-48c0-b5c6-72e95b831b93 HTTP/1.1 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwGkyYM_Ce6HY4DDBU38sVuHGr_uG2n_96kljkUzb8I2NB66hg0T9m2Xb462kbwgcPT0kc70f94k5UItEygUJvcP8z3yf7h26HMgNLXPDTG_p3swcG49997BjOYEzYRuy_v1pCtLk3aukYnynaHIgxMhzsNn7gOo5hC_nXZxhHtyLOA Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c604bd80b041e985cc12dd4f1d4b60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e869c9e024bc452a8bc0081188ee79d9 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 is not attached to volume 6f069a7d-cec7-48c0-b5c6-72e95b831b93 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': 'a7c7deaf-0b3b-47fb-a886-9498b9b06367', 'id': '6f069a7d-cec7-48c0-b5c6-72e95b831b93'} Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6f069a7d-cec7-48c0-b5c6-72e95b831b93. Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 is not attached to volume 6f069a7d-cec7-48c0-b5c6-72e95b831b93 Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:38:21.219991 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:38:21.224950 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:38:21.224950 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:38:21.224950 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 is not attached to volume 6f069a7d-cec7-48c0-b5c6-72e95b831b93 Oct 03 15:38:21.224950 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:21.224950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Returning 404 to user: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 is not attached to volume 6f069a7d-cec7-48c0-b5c6-72e95b831b93 {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:38:21.224950 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53d89628-dd02-4843-ba05-006dced6111b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments/6f069a7d-cec7-48c0-b5c6-72e95b831b93" status: 404 len: 154 microversion: 2.1 time: 0.104246 Oct 03 15:38:21.224950 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3638/7449] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:38:21 2022] DELETE /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367/os-volume_attachments/6f069a7d-cec7-48c0-b5c6-72e95b831b93 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:38:24.578146 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:24.578772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:24.586687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:24.587314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:24.587837 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:24.588633 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:24.589144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:24.589589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:24.618188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:38:24.700353 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a435c67-9b0e-48f8-bc9a-4128b5551628 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 204 len: 0 microversion: 2.1 time: 0.125751 Oct 03 15:38:24.700981 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3812/7450] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:38:24 2022] DELETE /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:38:24.711267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:24.712050 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:24.720255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:24.720828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:24.721381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:24.722178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:24.722699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:24.723190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:24.857601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:24.866006 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2a83ba34-19fc-4b48-b817-465224767ee1 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1558 microversion: 2.1 time: 0.160406 Oct 03 15:38:24.866579 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3639/7451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:24 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:25.895516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:25.896617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:25.904054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:25.904551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:25.905041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:25.905755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:25.906222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:25.906659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:26.052395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:26.060746 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3e6da63e-64a3-46d4-bca8-3987294a6ba6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1558 microversion: 2.1 time: 0.172469 Oct 03 15:38:26.061361 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3813/7452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:25 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:26.926695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e109aa61-eeee-49dd-b836-7a1465fe3a0e req-29331417-5de0-47e1-a19a-1d9d73d77e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c7deaf-0b3b-47fb-a886-9498b9b06367", "name": "network-vif-deleted", "tag": "56402204-54bf-4072-a099-5cb74f8b08d1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:38:26.939213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e109aa61-eeee-49dd-b836-7a1465fe3a0e req-29331417-5de0-47e1-a19a-1d9d73d77e94 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:26.939789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e109aa61-eeee-49dd-b836-7a1465fe3a0e req-29331417-5de0-47e1-a19a-1d9d73d77e94 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:26.940215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e109aa61-eeee-49dd-b836-7a1465fe3a0e req-29331417-5de0-47e1-a19a-1d9d73d77e94 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:26.955209 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e109aa61-eeee-49dd-b836-7a1465fe3a0e req-29331417-5de0-47e1-a19a-1d9d73d77e94 service nova] Creating event network-vif-deleted:56402204-54bf-4072-a099-5cb74f8b08d1 for instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 on n-h1-781139-2 Oct 03 15:38:26.961393 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e109aa61-eeee-49dd-b836-7a1465fe3a0e req-29331417-5de0-47e1-a19a-1d9d73d77e94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038792 Oct 03 15:38:26.965490 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3640/7453] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:27.084359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:27.084903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:27.092594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:27.093137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:27.093583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:27.094291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:27.094751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:27.095216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:27.403498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:27.403997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:27.404421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:27.404883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lazy-loading 'fault' on Instance uuid a7c7deaf-0b3b-47fb-a886-9498b9b06367 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:38:27.447607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:27.456978 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-388f1966-f79e-44f8-8a88-1cdcb98a8379 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 200 len: 1351 microversion: 2.1 time: 0.376916 Oct 03 15:38:27.458004 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3814/7454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:27 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 1351 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:28.486505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:28.487663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: a7c7deaf-0b3b-47fb-a886-9498b9b06367] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:28.499761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:28.500569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:28.501350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:28.502484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:28.503234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:28.503938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:28.518451 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] HTTP exception thrown: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 could not be found. Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Request method failure captured: Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 HTTP/1.1 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwGkyYM_Ce6HY4DDBU38sVuHGr_uG2n_96kljkUzb8I2NB66hg0T9m2Xb462kbwgcPT0kc70f94k5UItEygUJvcP8z3yf7h26HMgNLXPDTG_p3swcG49997BjOYEzYRuy_v1pCtLk3aukYnynaHIgxMhzsNn7gOo5hC_nXZxhHtyLOA Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c604bd80b041e985cc12dd4f1d4b60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e869c9e024bc452a8bc0081188ee79d9 Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 could not be found. Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'a7c7deaf-0b3b-47fb-a886-9498b9b06367'} Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 could not be found. Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 could not be found. Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:28.520092 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 could not be found. Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Returning 404 to user: Instance a7c7deaf-0b3b-47fb-a886-9498b9b06367 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a6f45a4b-212e-4b64-9029-a5f6bd8c9275 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367" status: 404 len: 111 microversion: 2.1 time: 0.042300 Oct 03 15:38:28.524336 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3641/7455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:28 2022] GET /compute/v2.1/servers/a7c7deaf-0b3b-47fb-a886-9498b9b06367 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:38:28.530584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f494b102-f4b1-4637-8477-da2612929090 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '.version_select at 0x7fb2283601f0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:28.552881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f494b102-f4b1-4637-8477-da2612929090 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-383618275" status: 202 len: 0 microversion: 2.1 time: 0.026131 Oct 03 15:38:28.553466 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3815/7456] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 3 15:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-383618275 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:38:28.571426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e5a7b86c-091a-4b39-83b0-7b1595a11517 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: .version_select at 0x7fb22b4f9310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1774585312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZNkRbOZq5wIRwBIhRXZA/nRkWGGrq9g12tWgI6EKd9WRL1oyMPprfLWHKCT1qzsk9A+kDQ/HhZIvMLbsDE7xxb+g1sVJrbccLF2pD7N6Lu0hTDmBMdpYtLi7QYghX5vg=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:38:28.590585 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e5a7b86c-091a-4b39-83b0-7b1595a11517 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:38:28.595938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-e5a7b86c-091a-4b39-83b0-7b1595a11517 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for user e869c9e024bc452a8bc0081188ee79d9 and project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:38:28.622451 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e5a7b86c-091a-4b39-83b0-7b1595a11517 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054953 Oct 03 15:38:28.623079 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3642/7457] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:38:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:28.677184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-148134506", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1774585312", "networks": [{"uuid": "360f165f-fe00-4b4c-88e5-a74993ea130b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:38:28.735228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] validate_networks() for [('360f165f-fe00-4b4c-88e5-a74993ea130b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:38:29.203817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:38:29.204483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:38:29.205259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:38:29.205925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:38:29.206543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:38:29.220552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:29.221316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:29.222078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:29.223253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:29.223997 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:29.224432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:29.242090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:38:29.247406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Getting quotas for user e869c9e024bc452a8bc0081188ee79d9 and project f3c604bd80b041e985cc12dd4f1d4b60. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:38:29.261283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:38:29.263910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:38:29.314053 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-90546fa9-a59c-43db-aedf-b4bfe164ab53 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640878 Oct 03 15:38:29.314703 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3816/7458] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:38:29.326154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-28c2ccff-4fb4-486e-849c-b1b0a89dceb6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:29.326770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-28c2ccff-4fb4-486e-849c-b1b0a89dceb6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:29.387368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-28c2ccff-4fb4-486e-849c-b1b0a89dceb6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:29.395243 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-28c2ccff-4fb4-486e-849c-b1b0a89dceb6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1262 microversion: 2.1 time: 0.073043 Oct 03 15:38:29.396414 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3643/7459] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:29 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:30.419981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:30.421268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:30.428347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:30.428893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:30.429373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:30.430102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:30.430574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:30.431031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:30.499259 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:30.512291 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d7cf455-996d-46ee-a977-5e2069747d93 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1322 microversion: 2.1 time: 0.096360 Oct 03 15:38:30.513219 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3817/7460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:30 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:31.538538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:31.539169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:31.546414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:31.546895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:31.547336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:31.548038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:31.548494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:31.548919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:31.769835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:31.778826 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a95ef652-1f3f-4eeb-b62f-f5d6d3d82fca tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1362 microversion: 2.1 time: 0.245877 Oct 03 15:38:31.779506 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3644/7461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:31 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:31.918284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-efcf0c41-e462-4d3a-bc56-4624c95acef0 req-38d1583a-2e01-481c-852c-2ee97e99b0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb745e54-d335-4e39-a5b6-fc5ac0cd4c41", "tag": "df474174-c4c3-4979-8648-ef9b638cd9b2"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:38:31.930790 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-efcf0c41-e462-4d3a-bc56-4624c95acef0 req-38d1583a-2e01-481c-852c-2ee97e99b0f1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:31.931356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-efcf0c41-e462-4d3a-bc56-4624c95acef0 req-38d1583a-2e01-481c-852c-2ee97e99b0f1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:31.931800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-efcf0c41-e462-4d3a-bc56-4624c95acef0 req-38d1583a-2e01-481c-852c-2ee97e99b0f1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:31.943222 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-efcf0c41-e462-4d3a-bc56-4624c95acef0 req-38d1583a-2e01-481c-852c-2ee97e99b0f1 service nova] Creating event network-changed:df474174-c4c3-4979-8648-ef9b638cd9b2 for instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 on n-h1-781139-2 Oct 03 15:38:31.948798 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-efcf0c41-e462-4d3a-bc56-4624c95acef0 req-38d1583a-2e01-481c-852c-2ee97e99b0f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034292 Oct 03 15:38:31.949595 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3818/7462] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:32.805355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:32.806212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:32.816231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:32.816954 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:32.817583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:32.818763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:32.819244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:32.819689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:32.955818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:32.964148 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-80519b58-4e2d-4002-801c-9c59054c42a9 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1362 microversion: 2.1 time: 0.164565 Oct 03 15:38:32.964735 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3645/7463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:32 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:33.994186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:33.995218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:34.005961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:34.007294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:34.008389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:34.009040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:34.009573 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:34.010029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:34.495452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:34.503381 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-43321eb7-922d-4ceb-9f9c-c8cdcc7db9ff tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1362 microversion: 2.1 time: 0.517983 Oct 03 15:38:34.504433 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3819/7464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:33 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:35.531643 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:35.532639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:35.542358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:35.542849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:35.543270 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:35.544027 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:35.544484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:35.544915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:35.689631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:35.697635 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-65057c0a-5002-4e1e-acef-d9cc1f7d34b4 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1362 microversion: 2.1 time: 0.173062 Oct 03 15:38:35.698499 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3646/7465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:35 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:36.725774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:36.727027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:36.739694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:36.740531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:36.741345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:36.742296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:36.742769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:36.743190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:36.890864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:36.903061 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-076a7351-7ba7-4e07-bfab-1949a6a89197 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1362 microversion: 2.1 time: 0.183856 Oct 03 15:38:36.903774 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3820/7466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:36 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:37.815473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f9a8e87f-1c2f-40c1-81e9-68b1e3dc10af req-87d37528-8c19-4415-83f3-787097eac134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb745e54-d335-4e39-a5b6-fc5ac0cd4c41", "name": "network-vif-plugged", "status": "completed", "tag": "df474174-c4c3-4979-8648-ef9b638cd9b2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:38:37.826542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f9a8e87f-1c2f-40c1-81e9-68b1e3dc10af req-87d37528-8c19-4415-83f3-787097eac134 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:37.826962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f9a8e87f-1c2f-40c1-81e9-68b1e3dc10af req-87d37528-8c19-4415-83f3-787097eac134 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:37.827393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f9a8e87f-1c2f-40c1-81e9-68b1e3dc10af req-87d37528-8c19-4415-83f3-787097eac134 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:37.839294 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f9a8e87f-1c2f-40c1-81e9-68b1e3dc10af req-87d37528-8c19-4415-83f3-787097eac134 service nova] Creating event network-vif-plugged:df474174-c4c3-4979-8648-ef9b638cd9b2 for instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 on n-h1-781139-2 Oct 03 15:38:37.844552 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f9a8e87f-1c2f-40c1-81e9-68b1e3dc10af req-87d37528-8c19-4415-83f3-787097eac134 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Oct 03 15:38:37.845183 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3647/7467] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:37.926595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:37.927183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:37.935214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:37.935720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:37.936179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:37.936949 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:37.937433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:37.937875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:38.076375 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:38.085495 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9e465ea0-279f-4e11-ab78-019fa8049d48 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1362 microversion: 2.1 time: 0.162744 Oct 03 15:38:38.086032 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3821/7468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:37 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:39.110329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:39.111090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:39.118161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:39.118675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:39.119121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:39.119869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:39.120371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:39.120794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:39.261664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:39.273760 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9d30c568-bfc5-4b43-a156-fabf41d7b5eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1362 microversion: 2.1 time: 0.168528 Oct 03 15:38:39.274481 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3648/7469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:39 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:40.302483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:40.304144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:40.307545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:40.308698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:40.315248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:40.315744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:40.316190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:40.316912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:40.317401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:40.317838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:40.453893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:40.464668 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d26b9219-6f02-43a9-8811-485e5f34eab6 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1554 microversion: 2.1 time: 0.169708 Oct 03 15:38:40.465288 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3822/7470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:40 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:40.487499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:40.488240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:40.490362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:40.497143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:40.497631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:40.498070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:40.498768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:40.499226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:40.499651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:40.638093 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:38:40.649904 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-948fede1-8266-4ca8-bc9f-900b20b1efa8 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1554 microversion: 2.1 time: 0.166102 Oct 03 15:38:40.650718 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3649/7471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:38:40 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:38:42.198598 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65027ce2-f960-45d2-956c-abdaa9d7afb8"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:38:42.202085 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:42.210950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:42.211561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:42.212187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:42.213007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:42.213546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:42.214048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:42.397713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:42.520834 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-65f098c5-8893-49e9-b7ce-cbaf89b0627b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "POST /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327612 Oct 03 15:38:42.521482 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3823/7472] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:38:42 2022] POST /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:53.286860 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:53.287427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:53.290177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:53.290934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=66 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:53.297538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:53.298019 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:53.298447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:53.299127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:53.299570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:53.299986 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:53.388101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lazy-loading 'services' on Instance uuid cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:38:53.465780 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-800f0f6a-5f33-4d75-95f4-3c20fda8032e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments/65027ce2-f960-45d2-956c-abdaa9d7afb8" status: 202 len: 0 microversion: 2.1 time: 0.182940 Oct 03 15:38:53.466414 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3650/7473] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:38:53 2022] DELETE /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments/65027ce2-f960-45d2-956c-abdaa9d7afb8 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:38:53.473262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:53.474114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:38:53.478653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:53.481199 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:53.488941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:53.489493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:53.489947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:53.490645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:53.491184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:53.491663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:53.524742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-cff402f6-eebb-4849-bd95-3d94ff4fac06 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053360 Oct 03 15:38:53.525274 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3824/7474] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:53 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:54.541707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:54.544100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:54.550791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:54.551274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:54.551708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:54.552409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:54.552855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:54.553313 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:54.585232 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a56aae88-1784-4d29-b6f1-6c4bfa1bf895 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049131 Oct 03 15:38:54.586099 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3651/7475] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:54 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:55.598488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:55.600760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:55.613004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:55.613749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:55.614355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:55.615421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:55.616121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:55.617297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:55.650478 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7deb488-fabb-4431-a9c1-b2ed136a24eb tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056046 Oct 03 15:38:55.651158 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3825/7476] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:55 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:56.663529 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:56.665947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:56.673305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:56.673882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:56.674318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:56.675012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:56.675458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:56.675880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:56.706563 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ed1958d1-f641-48c4-997f-d8f309373a95 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047102 Oct 03 15:38:56.707516 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3652/7477] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:56 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:57.720099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:57.722309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:57.729502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:57.729998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:57.730442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:57.731160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:57.732050 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:57.732486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:57.765272 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-970a778b-b1a6-4b7e-a273-82405cdd0c88 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049383 Oct 03 15:38:57.765861 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3826/7478] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:57 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:38:58.782350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:58.785970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:58.798208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:58.799016 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:58.799745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:58.800962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:58.801716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:58.802448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:58.834388 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-82ee97b8-f60c-4053-a99e-44996cb21354 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058814 Oct 03 15:38:58.834959 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3653/7479] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:38:58 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:38:58.848107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:38:58.848684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:38:58.865432 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:58.866130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:58.866769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:58.868149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:38:58.868637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:38:58.869115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:38:58.952913 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] HTTP exception thrown: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 is not attached to volume 65027ce2-f960-45d2-956c-abdaa9d7afb8 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Request method failure captured: Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments/65027ce2-f960-45d2-956c-abdaa9d7afb8 HTTP/1.1 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwGkyYM_Ce6HY4DDBU38sVuHGr_uG2n_96kljkUzb8I2NB66hg0T9m2Xb462kbwgcPT0kc70f94k5UItEygUJvcP8z3yf7h26HMgNLXPDTG_p3swcG49997BjOYEzYRuy_v1pCtLk3aukYnynaHIgxMhzsNn7gOo5hC_nXZxhHtyLOA Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c604bd80b041e985cc12dd4f1d4b60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: e869c9e024bc452a8bc0081188ee79d9 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 is not attached to volume 65027ce2-f960-45d2-956c-abdaa9d7afb8 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': 'cb745e54-d335-4e39-a5b6-fc5ac0cd4c41', 'id': '65027ce2-f960-45d2-956c-abdaa9d7afb8'} Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 65027ce2-f960-45d2-956c-abdaa9d7afb8. Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 is not attached to volume 65027ce2-f960-45d2-956c-abdaa9d7afb8 Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:38:58.954605 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:38:58.962487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:38:58.962487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:38:58.962487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 is not attached to volume 65027ce2-f960-45d2-956c-abdaa9d7afb8 Oct 03 15:38:58.962487 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:38:58.962487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Returning 404 to user: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 is not attached to volume 65027ce2-f960-45d2-956c-abdaa9d7afb8 {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:38:58.962487 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c787a19d-a47b-4ac8-a240-34b5a37e2e8a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments/65027ce2-f960-45d2-956c-abdaa9d7afb8" status: 404 len: 154 microversion: 2.1 time: 0.113541 Oct 03 15:38:58.962487 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3827/7480] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:38:58 2022] DELETE /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41/os-volume_attachments/65027ce2-f960-45d2-956c-abdaa9d7afb8 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:39:02.345600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:02.346535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:02.353802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:02.354294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:02.354733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:02.355458 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:02.355915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:02.356341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:02.384845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:39:02.469691 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e00017b-7462-49a8-9ed6-2543e3ae558b tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 204 len: 0 microversion: 2.1 time: 0.127890 Oct 03 15:39:02.470610 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3654/7481] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:39:02 2022] DELETE /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:39:02.479376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:02.479989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:02.487683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:02.488433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:02.488873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:02.489611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:02.490077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:02.490512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:02.630176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:02.638156 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4a6cfa54-b32e-46dd-bfb2-43a1321a337a tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1560 microversion: 2.1 time: 0.162621 Oct 03 15:39:02.638734 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3828/7482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:02 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:03.666834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:03.667658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:03.676304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:03.676873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:03.677507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:03.678326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:03.678861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:03.679389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:03.823224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:03.831268 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d6112b38-9e15-401a-a552-c07bada1a19d tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1560 microversion: 2.1 time: 0.171418 Oct 03 15:39:03.832215 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3655/7483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:03 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:04.856677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:04.857622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:04.866749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:04.867244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:04.867947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:04.869566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:04.870115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:04.870570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:04.911826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-3271fedb-5b2a-42e8-9c8b-588155ca0913 req-5c180dbf-f68c-4dfd-bcde-707b8d915044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb745e54-d335-4e39-a5b6-fc5ac0cd4c41", "name": "network-vif-deleted", "tag": "df474174-c4c3-4979-8648-ef9b638cd9b2"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:39:04.931503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3271fedb-5b2a-42e8-9c8b-588155ca0913 req-5c180dbf-f68c-4dfd-bcde-707b8d915044 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:04.931983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3271fedb-5b2a-42e8-9c8b-588155ca0913 req-5c180dbf-f68c-4dfd-bcde-707b8d915044 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:04.932434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-3271fedb-5b2a-42e8-9c8b-588155ca0913 req-5c180dbf-f68c-4dfd-bcde-707b8d915044 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:04.942358 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e869c9e024bc452a8bc0081188ee79d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3c604bd80b041e985cc12dd4f1d4b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:04.945741 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-3271fedb-5b2a-42e8-9c8b-588155ca0913 req-5c180dbf-f68c-4dfd-bcde-707b8d915044 service nova] Creating event network-vif-deleted:df474174-c4c3-4979-8648-ef9b638cd9b2 for instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 on n-h1-781139-2 Oct 03 15:39:04.952705 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1a9e0dcb-ffda-42f6-895c-69d8f51c329e tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 200 len: 1518 microversion: 2.1 time: 0.101096 Oct 03 15:39:04.953943 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-3271fedb-5b2a-42e8-9c8b-588155ca0913 req-5c180dbf-f68c-4dfd-bcde-707b8d915044 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043406 Oct 03 15:39:04.955504 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3656/7484] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:39:04.961272 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3829/7485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:04 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 1518 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:05.981961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:05.982880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] [instance: cb745e54-d335-4e39-a5b6-fc5ac0cd4c41] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:05.991053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:05.991654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:05.992228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:05.993125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:05.993684 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:05.994209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:06.008219 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] HTTP exception thrown: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 could not be found. Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Request method failure captured: Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 HTTP/1.1 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwGkyYM_Ce6HY4DDBU38sVuHGr_uG2n_96kljkUzb8I2NB66hg0T9m2Xb462kbwgcPT0kc70f94k5UItEygUJvcP8z3yf7h26HMgNLXPDTG_p3swcG49997BjOYEzYRuy_v1pCtLk3aukYnynaHIgxMhzsNn7gOo5hC_nXZxhHtyLOA Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f3c604bd80b041e985cc12dd4f1d4b60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f3c604bd80b041e985cc12dd4f1d4b60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: f3c604bd80b041e985cc12dd4f1d4b60 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1154375917 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: e869c9e024bc452a8bc0081188ee79d9 Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestEncryptedCinderVolumes-1154375917-project Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 could not be found. Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'cb745e54-d335-4e39-a5b6-fc5ac0cd4c41'} Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 could not be found. Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 could not be found. Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:39:06.009919 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 could not be found. Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Returning 404 to user: Instance cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d6b7277-94a2-4de8-b8c6-f8430cb76e64 tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41" status: 404 len: 111 microversion: 2.1 time: 0.037115 Oct 03 15:39:06.015065 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3657/7486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:05 2022] GET /compute/v2.1/servers/cb745e54-d335-4e39-a5b6-fc5ac0cd4c41 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:39:06.020325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47fdff39-bc88-48f9-ac95-5c90621e00ef tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] Calling method '.version_select at 0x7fb234bbc040>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:06.042938 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47fdff39-bc88-48f9-ac95-5c90621e00ef tempest-TestEncryptedCinderVolumes-1154375917 tempest-TestEncryptedCinderVolumes-1154375917-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1774585312" status: 202 len: 0 microversion: 2.1 time: 0.026370 Oct 03 15:39:06.043543 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3830/7487] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 3 15:39:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1774585312 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 15:39:33.091012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2c5511f5-7ec8-4905-af0c-33f327ebc99e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'create', calling method: .version_select at 0x7fb22b4b5ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1135216115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbZuEKo2GqjOQGIehC9L6nhxa80g5EEpCKmJYTvZQBoVfgEi2P3H6Lp1o0Y3kYqT+cfoBaoKvunMYyuxU1KgfVIElrrNwKNgL0OiH4aP8JADB4rb1dxH2sEmX1lATyjEw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:39:33.097021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:39:33.097688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:39:33.112695 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2c5511f5-7ec8-4905-af0c-33f327ebc99e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for project be83080851a74a4ab5cd4ff8db302083. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:39:33.118321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-2c5511f5-7ec8-4905-af0c-33f327ebc99e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for user 049a5e8d03f84936908ac478fe79fbee and project be83080851a74a4ab5cd4ff8db302083. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:39:33.145070 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2c5511f5-7ec8-4905-af0c-33f327ebc99e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058041 Oct 03 15:39:33.145629 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3658/7488] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:39:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:39:33.198823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:39:33.199861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:39:33.205557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-966604586", "imageRef": "1f90fb18-4437-4dd2-bc55-f82297855849", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1135216115", "networks": [{"uuid": "d2d38483-5859-4de6-8321-b97fcb84a996"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:39:33.264538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] validate_networks() for [('d2d38483-5859-4de6-8321-b97fcb84a996', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:39:33.666526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:39:33.666973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:39:33.667496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:39:33.667920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:39:33.668350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:39:33.677726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:33.678251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:33.678684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:33.679423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:33.679897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:33.680340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:33.698679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for project be83080851a74a4ab5cd4ff8db302083. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:39:33.704411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for user 049a5e8d03f84936908ac478fe79fbee and project be83080851a74a4ab5cd4ff8db302083. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:39:33.718166 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:39:33.720422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1f90fb18-4437-4dd2-bc55-f82297855849',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:39:33.768626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87788742-4ea3-48ec-a400-b3d07de1b1d3 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571763 Oct 03 15:39:33.769352 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3831/7489] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:39:33.780820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-334ea4ac-5084-4d6a-9b4c-80c54a6bd7a7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:33.781460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-334ea4ac-5084-4d6a-9b4c-80c54a6bd7a7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:33.840570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-334ea4ac-5084-4d6a-9b4c-80c54a6bd7a7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:33.849868 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-334ea4ac-5084-4d6a-9b4c-80c54a6bd7a7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1258 microversion: 2.1 time: 0.072745 Oct 03 15:39:33.850805 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3659/7490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:33 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:34.872652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:34.873328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:34.880951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:34.881479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:34.882131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:34.882850 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:34.883336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:34.883777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:34.974981 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:34.983212 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3de934ae-f369-4854-806a-b77028f86776 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1318 microversion: 2.1 time: 0.114962 Oct 03 15:39:34.983811 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3832/7491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:34 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1318 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:36.015253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:36.016440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:36.024509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:36.025469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:36.026214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:36.027284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:36.028010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:36.028792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:36.173355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:36.183594 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ce465bf1-e390-4100-afa1-f6ad015ff2d6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.180636 Oct 03 15:39:36.184189 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3660/7492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:36 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:37.207972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:37.209265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:37.217029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:37.217541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:37.217998 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:37.218739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:37.219209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:37.219658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:37.362827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:37.371007 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0d0314d8-8955-4d0d-9622-9fd1487e55df tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.167302 Oct 03 15:39:37.371619 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3833/7493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:37 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:38.398631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:38.399758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:38.408346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:38.408836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:38.409378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:38.410174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:38.410641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:38.411044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:38.552940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:38.561191 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6f3a731-5247-449b-8000-2b9e2898e224 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.169265 Oct 03 15:39:38.561776 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3661/7494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:38 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:39:39.584797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:39.585451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:39.594781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:39.595263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:39.595749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:39.596486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:39.596954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:39.597423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:39.738892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:39.747639 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b844da2-b282-48ec-8f1e-db3592d22606 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.167429 Oct 03 15:39:39.748234 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3834/7495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:39 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:40.771669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:40.772374 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:40.780469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:40.780943 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:40.781449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:40.782161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:40.782762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:40.783187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:40.918507 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:40.926725 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-192aa411-f5c3-4c16-b732-a8528fea7731 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.159132 Oct 03 15:39:40.942633 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3662/7496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:40 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:41.950513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:41.951156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:41.962719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:41.965165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:41.966621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:41.969071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:41.970408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:41.971140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:42.117752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:42.126707 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-37f11e7f-7fb3-44ba-ae93-bd9ca7552fde tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.180503 Oct 03 15:39:42.137357 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3835/7497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:41 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:43.150160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:43.154513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:43.162022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:43.162471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:43.162910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:43.163629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:43.164099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:43.164542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:43.311742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:43.320174 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ba0c18d3-5c23-43f6-bf53-c1ef95c88c8c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.174158 Oct 03 15:39:43.320828 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3663/7498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:43 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:44.345797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:44.346421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:44.349660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:39:44.350590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:39:44.356856 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:44.357623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:44.358095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:44.359098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:44.359533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:44.360005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:44.555514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:44.564167 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3cd93387-2718-4d15-8b08-de091f9e3666 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.222486 Oct 03 15:39:44.565246 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3836/7499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:44 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:44.579442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c07d680b-923e-4371-8025-1fe9fd7d3c96 req-fd3c28a7-53c3-4b50-b31f-1b6d8f5a2f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae45cafb-2c76-4afa-9402-ddc4492f8b4b", "tag": "298c1f12-72ec-41d6-a636-66e6e4616909"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:39:44.585888 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:39:44.594982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c07d680b-923e-4371-8025-1fe9fd7d3c96 req-fd3c28a7-53c3-4b50-b31f-1b6d8f5a2f0b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:44.595757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c07d680b-923e-4371-8025-1fe9fd7d3c96 req-fd3c28a7-53c3-4b50-b31f-1b6d8f5a2f0b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:44.596290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c07d680b-923e-4371-8025-1fe9fd7d3c96 req-fd3c28a7-53c3-4b50-b31f-1b6d8f5a2f0b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:44.607666 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c07d680b-923e-4371-8025-1fe9fd7d3c96 req-fd3c28a7-53c3-4b50-b31f-1b6d8f5a2f0b service nova] Creating event network-changed:298c1f12-72ec-41d6-a636-66e6e4616909 for instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b on n-h2-781139-2 Oct 03 15:39:44.612820 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c07d680b-923e-4371-8025-1fe9fd7d3c96 req-fd3c28a7-53c3-4b50-b31f-1b6d8f5a2f0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037170 Oct 03 15:39:44.614271 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3664/7500] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:39:45.593538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:45.594419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:45.605862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:45.606537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:45.607140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:45.608257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:45.608677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:45.609318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:45.770894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:45.779240 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b4778600-f9c7-4827-b47f-9727bc80eeef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.193005 Oct 03 15:39:45.779829 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3837/7501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:45 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:46.804042 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:46.804748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:46.811469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:46.811953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:46.812390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:46.813125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:46.813578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:46.813983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:46.944734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:46.954202 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-af7ccb09-8367-484b-854b-027beeab1561 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.155322 Oct 03 15:39:46.954801 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3665/7502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:46 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:47.978864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:47.979512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:47.988830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:47.989495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:47.990122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:47.991044 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:47.991614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:47.992176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:48.125988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:48.133949 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afc5ca83-946b-4520-b16c-306004510349 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.160081 Oct 03 15:39:48.134534 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3838/7503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:47 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:48.871691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d0537aee-1e3f-4376-aed1-719627930f9f req-c808e8dc-7a81-4612-b10a-c6d33cce1511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae45cafb-2c76-4afa-9402-ddc4492f8b4b", "name": "network-vif-plugged", "status": "completed", "tag": "298c1f12-72ec-41d6-a636-66e6e4616909"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:39:48.885525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d0537aee-1e3f-4376-aed1-719627930f9f req-c808e8dc-7a81-4612-b10a-c6d33cce1511 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:48.885996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d0537aee-1e3f-4376-aed1-719627930f9f req-c808e8dc-7a81-4612-b10a-c6d33cce1511 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:48.886402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d0537aee-1e3f-4376-aed1-719627930f9f req-c808e8dc-7a81-4612-b10a-c6d33cce1511 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:48.898215 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d0537aee-1e3f-4376-aed1-719627930f9f req-c808e8dc-7a81-4612-b10a-c6d33cce1511 service nova] Creating event network-vif-plugged:298c1f12-72ec-41d6-a636-66e6e4616909 for instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b on n-h2-781139-2 Oct 03 15:39:48.903440 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d0537aee-1e3f-4376-aed1-719627930f9f req-c808e8dc-7a81-4612-b10a-c6d33cce1511 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035621 Oct 03 15:39:48.904436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3666/7504] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:39:49.161938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:49.162930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:49.171018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:49.171532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:49.171988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:49.172711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:49.173217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:49.173663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:49.323970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:49.332897 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7e09dcb-7cc9-4842-a398-05cee47c3dab tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1358 microversion: 2.1 time: 0.178247 Oct 03 15:39:49.333506 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3839/7505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:49 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:50.369401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:50.370277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:50.377789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.378276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.378710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.379414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.379863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.380289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.523543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:50.531821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ecd7adb1-ded5-4368-943d-191cf5453457 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1547 microversion: 2.1 time: 0.170094 Oct 03 15:39:50.532966 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3667/7506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:50 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:50.554388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:50.555123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:50.562440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.563041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.563551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.564326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.564891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.565415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.702364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:50.710740 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2abd4984-0c52-4ab8-a422-95e19f8442ed tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1547 microversion: 2.1 time: 0.160406 Oct 03 15:39:50.711331 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3840/7507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:50 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:39:50.733010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:50.737777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:50.738626 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Searching by: {'deleted': False, 'project_id': 'be83080851a74a4ab5cd4ff8db302083'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 15:39:50.744233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.744820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.745402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.746126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.746576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.746996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.772266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 15:39:50.800138 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8766d1ca-e584-47a8-a9d9-4a785fe245d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070991 Oct 03 15:39:50.800710 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3668/7508] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 15:39:50 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:39:50.812707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:39:50.813434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:50.819759 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.820360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.820873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.821681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:50.822216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:50.822760 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:50.961877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:39:50.971114 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f6cfc414-5956-45b0-a28b-90952fa3491d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1547 microversion: 2.1 time: 0.162316 Oct 03 15:39:50.971722 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3841/7509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:39:50 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:39:52.737214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6094d7fb-209a-483f-bcbf-b28f9953263f"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:39:52.739566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:39:52.746802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:52.747312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:52.747742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:52.748433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:39:52.748877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:39:52.749330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:39:53.003234 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fe0bce0f-27d3-4f13-a945-81c24d1cb53b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269778 Oct 03 15:39:53.003829 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3669/7510] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:39:52 2022] POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:40:06.137326 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:40:06.137948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:40:06.141554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:40:06.142232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=62 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:40:06.148397 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:06.148889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:06.149359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:06.150076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:06.150527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:06.150956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:06.286899 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:40:06.295595 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ad7cfdb-9c4a-4df7-b14a-36f66c7dbeeb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1593 microversion: 2.1 time: 0.162185 Oct 03 15:40:06.296175 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3842/7511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:40:06 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:40:08.160572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-dfb67618-96fa-4206-9790-b1a8993b59aa req-6497a86f-7f89-4697-bec6-e257f0934a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae45cafb-2c76-4afa-9402-ddc4492f8b4b", "tag": "298c1f12-72ec-41d6-a636-66e6e4616909"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:40:08.171847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:40:08.173186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:40:08.174329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:40:08.181444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dfb67618-96fa-4206-9790-b1a8993b59aa req-6497a86f-7f89-4697-bec6-e257f0934a60 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:08.181953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dfb67618-96fa-4206-9790-b1a8993b59aa req-6497a86f-7f89-4697-bec6-e257f0934a60 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:08.182641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-dfb67618-96fa-4206-9790-b1a8993b59aa req-6497a86f-7f89-4697-bec6-e257f0934a60 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:08.198484 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-dfb67618-96fa-4206-9790-b1a8993b59aa req-6497a86f-7f89-4697-bec6-e257f0934a60 service nova] Creating event network-changed:298c1f12-72ec-41d6-a636-66e6e4616909 for instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b on n-h2-781139-2 Oct 03 15:40:08.205023 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-dfb67618-96fa-4206-9790-b1a8993b59aa req-6497a86f-7f89-4697-bec6-e257f0934a60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048735 Oct 03 15:40:08.206324 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3670/7512] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:40:09.222018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1590686763"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:40:09.222596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:40:09.230193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:09.230693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:09.231140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:09.231863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:09.232309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:09.232819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:09.373225 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Adding security group 09195f6b-5e4f-4d49-9340-52d7cab45e38 to port 298c1f12-72ec-41d6-a636-66e6e4616909 Oct 03 15:40:09.708412 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-14c2d7a2-d74f-40e2-aba7-5ff1f4687ecb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.490439 Oct 03 15:40:09.709298 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3843/7513] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:40:09 2022] POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:40:09.719782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:40:09.721090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:40:09.728706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:09.729207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:09.729627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:09.730340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:09.730780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:09.731198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:09.885709 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:40:09.894210 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-115b771e-4122-4724-a890-bc7990f8bd8b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1758 microversion: 2.1 time: 0.180190 Oct 03 15:40:09.894821 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3671/7514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:40:09 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:40:10.222195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-09648d3e-b225-43cb-95fb-2611263fb5ba req-2a3b2024-bd5b-45b7-ad2b-a69ff75a5a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae45cafb-2c76-4afa-9402-ddc4492f8b4b", "tag": "298c1f12-72ec-41d6-a636-66e6e4616909"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:40:10.233549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-09648d3e-b225-43cb-95fb-2611263fb5ba req-2a3b2024-bd5b-45b7-ad2b-a69ff75a5a20 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:40:10.234018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-09648d3e-b225-43cb-95fb-2611263fb5ba req-2a3b2024-bd5b-45b7-ad2b-a69ff75a5a20 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:40:10.234489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-09648d3e-b225-43cb-95fb-2611263fb5ba req-2a3b2024-bd5b-45b7-ad2b-a69ff75a5a20 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:40:10.247473 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-09648d3e-b225-43cb-95fb-2611263fb5ba req-2a3b2024-bd5b-45b7-ad2b-a69ff75a5a20 service nova] Creating event network-changed:298c1f12-72ec-41d6-a636-66e6e4616909 for instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b on n-h2-781139-2 Oct 03 15:40:10.253125 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-09648d3e-b225-43cb-95fb-2611263fb5ba req-2a3b2024-bd5b-45b7-ad2b-a69ff75a5a20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035005 Oct 03 15:40:10.253732 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3844/7515] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:41:47.628565 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:41:47.629460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:41:47.631542 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 03 15:41:47.636677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:41:47.639852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:41:47.648784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:41:47.649334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:41:47.649770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:41:47.650499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:41:47.650953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:41:47.651379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:41:47.728717 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fc6970f0-d378-4e22-9485-2834ea301a1d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.102955 Oct 03 15:41:47.729396 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3672/7516] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:41:47 2022] POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:41:47.737292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:41:47.738066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:41:47.744451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:41:47.745428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:41:47.754128 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:41:47.754574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:41:47.755257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:41:47.756212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:41:47.756761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:41:47.757346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:41:48.379847 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 15:41:48.380628 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 15:41:48.498727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:41:48.507713 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e3b688c8-9b5a-49d2-800a-01a24b0d1895 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1760 microversion: 2.1 time: 0.773522 Oct 03 15:41:48.508302 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3845/7517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:41:47 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1760 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:41:49.537714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:41:49.538864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:41:49.547442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:41:49.547934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:41:49.548373 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:41:49.549090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:41:49.549535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:41:49.549991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:41:49.784826 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:41:49.794240 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d660ff6-5299-47a9-a7b2-18879ac6701c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1758 microversion: 2.1 time: 0.265347 Oct 03 15:41:49.794876 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3673/7518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:41:49 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1758 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:03.692551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:03.693833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:03.700898 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1590686763"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:03.701480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:03.711243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:03.711743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:03.712197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:03.712907 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:03.713470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:03.713939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:03.717651 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58362. Oct 03 15:43:03.718349 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58360. Oct 03 15:43:03.850621 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Removing security group 09195f6b-5e4f-4d49-9340-52d7cab45e38 from port 298c1f12-72ec-41d6-a636-66e6e4616909 Oct 03 15:43:04.172915 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d7910905-72ce-4ab0-9385-3252cf2e2c5b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/action" status: 202 len: 0 microversion: 2.1 time: 0.485712 Oct 03 15:43:04.177202 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3846/7519] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:43:03 2022] POST /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:43:04.183509 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:04.184546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:04.270850 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c09499b6-a382-455b-9f31-be97f603f1ae req-2af0b6a3-0069-4af7-bf5d-23a476c04df2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae45cafb-2c76-4afa-9402-ddc4492f8b4b", "tag": "298c1f12-72ec-41d6-a636-66e6e4616909"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:04.280556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c09499b6-a382-455b-9f31-be97f603f1ae req-2af0b6a3-0069-4af7-bf5d-23a476c04df2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:04.281092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c09499b6-a382-455b-9f31-be97f603f1ae req-2af0b6a3-0069-4af7-bf5d-23a476c04df2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:04.281524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c09499b6-a382-455b-9f31-be97f603f1ae req-2af0b6a3-0069-4af7-bf5d-23a476c04df2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:04.293566 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c09499b6-a382-455b-9f31-be97f603f1ae req-2af0b6a3-0069-4af7-bf5d-23a476c04df2 service nova] Creating event network-changed:298c1f12-72ec-41d6-a636-66e6e4616909 for instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b on n-h2-781139-2 Oct 03 15:43:04.299112 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c09499b6-a382-455b-9f31-be97f603f1ae req-2af0b6a3-0069-4af7-bf5d-23a476c04df2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121589 Oct 03 15:43:04.300023 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3674/7520] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:05.673153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:05.673694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:05.679887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:05.680388 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:05.680840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:05.681552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:05.682016 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:05.682554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:05.765721 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lazy-loading 'services' on Instance uuid ae45cafb-2c76-4afa-9402-ddc4492f8b4b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:43:05.843767 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [d46eaf79-c2b6-4ea4-b80a-9e5229a489d2] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:43:06.317203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7dc69380-d72b-4191-84b4-e2ec50cdb28a req-35e59fc7-411f-4f98-8afd-529a4b7f2ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae45cafb-2c76-4afa-9402-ddc4492f8b4b", "tag": "298c1f12-72ec-41d6-a636-66e6e4616909"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:06.327389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7dc69380-d72b-4191-84b4-e2ec50cdb28a req-35e59fc7-411f-4f98-8afd-529a4b7f2ba1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:06.328247 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7dc69380-d72b-4191-84b4-e2ec50cdb28a req-35e59fc7-411f-4f98-8afd-529a4b7f2ba1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:06.328693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7dc69380-d72b-4191-84b4-e2ec50cdb28a req-35e59fc7-411f-4f98-8afd-529a4b7f2ba1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:06.340401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7dc69380-d72b-4191-84b4-e2ec50cdb28a req-35e59fc7-411f-4f98-8afd-529a4b7f2ba1 service nova] Creating event network-changed:298c1f12-72ec-41d6-a636-66e6e4616909 for instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b on n-h2-781139-2 Oct 03 15:43:06.345719 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7dc69380-d72b-4191-84b4-e2ec50cdb28a req-35e59fc7-411f-4f98-8afd-529a4b7f2ba1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033635 Oct 03 15:43:06.346626 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3675/7521] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:43:06.852288 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [d46eaf79-c2b6-4ea4-b80a-9e5229a489d2] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58392. Oct 03 15:43:06.856414 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d31fbba9-0b37-47b1-9d14-d5c55116b997 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments/6094d7fb-209a-483f-bcbf-b28f9953263f" status: 202 len: 0 microversion: 2.1 time: 1.188305 Oct 03 15:43:06.858174 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3847/7522] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:43:05 2022] DELETE /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments/6094d7fb-209a-483f-bcbf-b28f9953263f => generated 0 bytes in 1191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:43:06.867731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:06.870795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:06.878217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:06.878702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:06.879138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:06.879935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:06.880388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:06.880841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:06.912157 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7827021a-c519-4bfa-9e5d-adad01a341fe tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Oct 03 15:43:06.912815 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3676/7523] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:43:06 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:07.927130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:07.929561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:07.937607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:07.938111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:07.938568 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:07.939290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:07.939755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:07.940230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:07.971773 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b09629cb-a5d3-45cc-b122-9228e7608e0e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049915 Oct 03 15:43:07.972605 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3848/7524] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:43:07 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:08.984887 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:08.987201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:08.994488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:08.994967 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:08.995368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:08.996299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:08.996727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:08.997220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:09.030677 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a648b591-9ab0-4dab-ba66-bbdb4928a456 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049757 Oct 03 15:43:09.031229 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3677/7525] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:43:08 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:10.042686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:10.044889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:10.052264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:10.052757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:10.053236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:10.053948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:10.054410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:10.054845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:10.085339 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bfe6c427-dc71-4dc0-88e4-efc99c3c1ed6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Oct 03 15:43:10.085909 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3849/7526] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:43:10 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:11.100127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:11.102516 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:11.110286 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:11.110782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:11.111246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:11.111953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:11.112408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:11.112832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:11.143505 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-783c4e1e-bde6-4358-a2f4-1cb8fc701de5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Oct 03 15:43:11.144079 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3678/7527] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:43:11 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:12.160919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:12.164558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:12.173442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:12.173942 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:12.174392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:12.175094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:12.175569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:12.176003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:12.205437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8f0c620f-b709-4256-9e73-27e646903d71 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051363 Oct 03 15:43:12.205987 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3850/7528] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:43:12 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:43:12.217002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:12.217515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:12.224514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:12.225033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:12.225470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:12.226165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:12.226615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:12.227036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:12.310395 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] HTTP exception thrown: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b is not attached to volume 6094d7fb-209a-483f-bcbf-b28f9953263f Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Request method failure captured: Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: request: DELETE /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments/6094d7fb-209a-483f-bcbf-b28f9953263f HTTP/1.1 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwImvuRps8-GcgsPMzY4aPgJXkgiMZOlgXAxLKJb89jz5TRDzrslxTPaYjq3NQ6_jpELX0CA279S14ugmbSOqMuwUbiiooPqBBy2gsZp65iML7i3O8szot2jwc1wNgiEn511KcLDoBtSBxNrw-zoT5gNX1me87OSqwZKpCUN9Az65HE Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be83080851a74a4ab5cd4ff8db302083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 049a5e8d03f84936908ac478fe79fbee Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b is not attached to volume 6094d7fb-209a-483f-bcbf-b28f9953263f Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'server_id': 'ae45cafb-2c76-4afa-9402-ddc4492f8b4b', 'id': '6094d7fb-209a-483f-bcbf-b28f9953263f'} Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6094d7fb-209a-483f-bcbf-b28f9953263f. Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b is not attached to volume 6094d7fb-209a-483f-bcbf-b28f9953263f Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:43:12.312100 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:43:12.316694 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:43:12.316694 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:43:12.316694 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b is not attached to volume 6094d7fb-209a-483f-bcbf-b28f9953263f Oct 03 15:43:12.316694 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:12.316694 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Returning 404 to user: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b is not attached to volume 6094d7fb-209a-483f-bcbf-b28f9953263f {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:43:12.316694 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-54141381-0ca8-4cb0-80ce-98bc1f034eec tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments/6094d7fb-209a-483f-bcbf-b28f9953263f" status: 404 len: 154 microversion: 2.1 time: 0.100750 Oct 03 15:43:12.316694 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3679/7529] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:43:12 2022] DELETE /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b/os-volume_attachments/6094d7fb-209a-483f-bcbf-b28f9953263f => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:43:15.582475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:15.583681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:15.591206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:15.591796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:15.592262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:15.593027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:15.593499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:15.593946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:15.621099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:43:15.704496 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-beeedbdd-eee4-4976-b29e-9f93f2a29879 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 204 len: 0 microversion: 2.1 time: 0.125711 Oct 03 15:43:15.705371 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3851/7530] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:43:15 2022] DELETE /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:43:15.714635 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:15.715612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:15.723422 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:15.723907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:15.724390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:15.725152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:15.725597 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:15.726026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:15.863032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:15.871378 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b1ed6dff-3a0f-40b5-a6e9-65ed9af3b45d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1553 microversion: 2.1 time: 0.160842 Oct 03 15:43:15.871968 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3680/7531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:15 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:16.900552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:16.901796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:16.914394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:16.915238 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:16.916000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:16.917252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:16.918057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:16.919347 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:17.067204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:17.075657 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-52da76ee-6c51-4043-bb35-6533d4455d7d tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1553 microversion: 2.1 time: 0.182394 Oct 03 15:43:17.076241 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3852/7532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:16 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:17.709292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-79accd46-1794-4177-9cbc-471388cbcaa2 req-d19c03c3-14d4-4ac7-8dd0-f9b3ba15d12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae45cafb-2c76-4afa-9402-ddc4492f8b4b", "name": "network-vif-deleted", "tag": "298c1f12-72ec-41d6-a636-66e6e4616909"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:17.722588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79accd46-1794-4177-9cbc-471388cbcaa2 req-d19c03c3-14d4-4ac7-8dd0-f9b3ba15d12d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:17.722982 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79accd46-1794-4177-9cbc-471388cbcaa2 req-d19c03c3-14d4-4ac7-8dd0-f9b3ba15d12d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:17.723408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-79accd46-1794-4177-9cbc-471388cbcaa2 req-d19c03c3-14d4-4ac7-8dd0-f9b3ba15d12d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:17.736087 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-79accd46-1794-4177-9cbc-471388cbcaa2 req-d19c03c3-14d4-4ac7-8dd0-f9b3ba15d12d service nova] Creating event network-vif-deleted:298c1f12-72ec-41d6-a636-66e6e4616909 for instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b on n-h2-781139-2 Oct 03 15:43:17.742171 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-79accd46-1794-4177-9cbc-471388cbcaa2 req-d19c03c3-14d4-4ac7-8dd0-f9b3ba15d12d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036677 Oct 03 15:43:17.742783 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3681/7533] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:18.100771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:18.102344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:18.110609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:18.111490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:18.112174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:18.112889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:18.113445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:18.113891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:18.149379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:18.149880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:18.150329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:18.150809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lazy-loading 'fault' on Instance uuid ae45cafb-2c76-4afa-9402-ddc4492f8b4b {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:43:18.192881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:18.201234 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5a2a8d92-0a7c-4840-8899-e160947fc31f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 200 len: 1348 microversion: 2.1 time: 0.105213 Oct 03 15:43:18.201856 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3853/7534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:18 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:19.226364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:19.227064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: ae45cafb-2c76-4afa-9402-ddc4492f8b4b] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:19.234588 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:19.235062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:19.235495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:19.236177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:19.236624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:19.237082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:19.250467 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] HTTP exception thrown: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b could not be found. Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Request method failure captured: Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b HTTP/1.1 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwImvuRps8-GcgsPMzY4aPgJXkgiMZOlgXAxLKJb89jz5TRDzrslxTPaYjq3NQ6_jpELX0CA279S14ugmbSOqMuwUbiiooPqBBy2gsZp65iML7i3O8szot2jwc1wNgiEn511KcLDoBtSBxNrw-zoT5gNX1me87OSqwZKpCUN9Az65HE Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be83080851a74a4ab5cd4ff8db302083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 049a5e8d03f84936908ac478fe79fbee Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b could not be found. Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': 'ae45cafb-2c76-4afa-9402-ddc4492f8b4b'} Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b could not be found. Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b could not be found. Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:43:19.252080 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b could not be found. Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Returning 404 to user: Instance ae45cafb-2c76-4afa-9402-ddc4492f8b4b could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5836c20f-3bb0-416b-b38f-ca5e0855be27 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b" status: 404 len: 111 microversion: 2.1 time: 0.031535 Oct 03 15:43:19.257425 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3682/7535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:19 2022] GET /compute/v2.1/servers/ae45cafb-2c76-4afa-9402-ddc4492f8b4b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:43:19.262578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-96076ba1-7e35-4dbd-b29c-d8df5642431f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '.version_select at 0x7fb22b5e0dc0>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:19.285488 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-96076ba1-7e35-4dbd-b29c-d8df5642431f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135216115" status: 202 len: 0 microversion: 2.1 time: 0.026745 Oct 03 15:43:19.286009 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3854/7536] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 15:43:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135216115 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:43:28.279659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f2ca81ce-1afd-4a14-a409-fab07549f686 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'create', calling method: .version_select at 0x7fb22b349b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1328690766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiuISLoNiaQG0szflRc6ctVF/G0XFxMbxccql9L3aSuyjeYKrfI7m/pIQxPukiBZAkIoz6UcRHoRy+/KFsMp6NigzTQ37/7gyfLvJiVIL2nAdNPmXeiBWT1hbCKbf4Qow=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:28.285937 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:43:28.286091 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 03 15:43:28.300975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f2ca81ce-1afd-4a14-a409-fab07549f686 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for project be83080851a74a4ab5cd4ff8db302083. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:43:28.306484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f2ca81ce-1afd-4a14-a409-fab07549f686 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for user 049a5e8d03f84936908ac478fe79fbee and project be83080851a74a4ab5cd4ff8db302083. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:43:28.336512 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f2ca81ce-1afd-4a14-a409-fab07549f686 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061028 Oct 03 15:43:28.337143 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3683/7537] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:43:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:28.391149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:28.399216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1959398160", "imageRef": "0d053ad0-cef2-40ad-ac08-86d83537caf6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1328690766", "networks": [{"uuid": "d2d38483-5859-4de6-8321-b97fcb84a996"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:28.456409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] validate_networks() for [('d2d38483-5859-4de6-8321-b97fcb84a996', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:43:29.175767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:43:29.176374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:43:29.177156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:43:29.177772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:43:29.178372 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:43:29.192211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:29.192874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:29.193374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:29.194118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:29.194588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:29.195036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:29.214206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for project be83080851a74a4ab5cd4ff8db302083. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:43:29.219574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Getting quotas for user 049a5e8d03f84936908ac478fe79fbee and project be83080851a74a4ab5cd4ff8db302083. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:43:29.232440 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:43:29.234735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d053ad0-cef2-40ad-ac08-86d83537caf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:43:29.285770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6a2cd1f7-fe62-4ae5-9b5e-27f168f8756a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897078 Oct 03 15:43:29.286458 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3855/7538] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:43:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:43:29.294589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=38 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:29.299469 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d59f726e-41e4-45e0-97f1-68454fe18988 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:29.300081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d59f726e-41e4-45e0-97f1-68454fe18988 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:29.355086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d59f726e-41e4-45e0-97f1-68454fe18988 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:29.362395 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d59f726e-41e4-45e0-97f1-68454fe18988 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1259 microversion: 2.1 time: 0.068521 Oct 03 15:43:29.363166 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3684/7539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:29 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:30.386751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:30.387355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:30.393817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:30.394318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:30.394743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:30.395482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:30.395933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:30.396367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:30.460154 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:30.468436 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-84f59b01-f9f7-49c5-8874-a26fd47704b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1311 microversion: 2.1 time: 0.086653 Oct 03 15:43:30.469058 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3856/7540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:30 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:31.493791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:31.494513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:31.504306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:31.504900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:31.505454 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:31.506244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:31.506785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:31.507273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:31.677456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:31.687020 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8153a90f-7365-4436-90cc-5dc8eed39384 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.198821 Oct 03 15:43:31.688436 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3685/7541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:31 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:32.713418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:32.715134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:32.724557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:32.725657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:32.726336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:32.727261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:32.728100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:32.728815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:32.874353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:32.882465 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-234413f4-1cb5-4262-adf2-7d01846f9b4b tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.173933 Oct 03 15:43:32.883303 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3857/7542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:32 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:33.906336 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:33.907882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:33.917432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:33.917976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:33.918446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:33.919154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:33.919607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:33.920061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:34.079423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:34.089388 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5be23133-fd92-4877-a79c-ce0b8e8c4c1a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.187556 Oct 03 15:43:34.090624 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3686/7543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:33 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:35.115490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:35.116107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:35.121814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:35.124213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:35.124720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:35.125417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:35.126220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:35.126616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:35.127078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:35.273058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:35.281474 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fbdb2cc6-bbd5-4c69-911a-3dbcc1baee92 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.170781 Oct 03 15:43:35.282249 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3858/7544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:35 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:36.306769 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:36.308229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:36.312755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:36.317277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:36.317896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:36.318404 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:36.319176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:36.319687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:36.320140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:36.485004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:36.493202 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b6d00847-db13-40c6-9f24-df293cb5f0ea tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.190393 Oct 03 15:43:36.494019 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3687/7545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:36 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:37.516260 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:37.516887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:37.527069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:37.528003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:37.528678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:37.529468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:37.529950 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:37.530398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:37.678444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:37.687276 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f73b106-ee3b-4407-b055-fdc8aa9ec25e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.175043 Oct 03 15:43:37.687877 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3859/7546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:37 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:38.713973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:38.714690 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:38.723419 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:38.724029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:38.724578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:38.725503 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:38.726075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:38.726613 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:38.857494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:38.866068 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d98213c6-98de-475d-9fff-22aa06e20d1e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.157311 Oct 03 15:43:38.866635 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3688/7547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:38 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:39.892521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:39.893452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:39.897275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:39.898268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:39.906717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:39.907212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:39.907658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:39.908361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:39.908804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:39.909267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:40.044325 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:40.052831 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78a0b2c2-ca90-4860-b50b-45e788b1a5f9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.165902 Oct 03 15:43:40.053469 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3860/7548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:39 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:41.088554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:41.089665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:41.092559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:43:41.102783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:41.103614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:41.104334 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:41.105546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:41.106295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:41.106994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:41.242199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:41.253292 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e527521-8af6-421d-aa5f-ef1a4418225f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.171376 Oct 03 15:43:41.253870 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3689/7549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:41 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:42.276182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:42.276847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:42.284178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:42.284678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:42.285176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:42.285900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:42.286367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:42.286807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:42.427930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:42.438598 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f0aea500-3d54-4278-a34c-f2d7eef34cc9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.166302 Oct 03 15:43:42.439847 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3861/7550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:42 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:42.492676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f561ebe7-149b-4f71-8d68-3d5af1d26e89 req-e9c093ad-5dfe-4d8c-b06b-ab4fc587cdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1748a7ad-daca-4926-a0b2-533477bc2cbf", "tag": "cf5d9cbc-7519-4521-b6e9-7aee4959953c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:42.502674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f561ebe7-149b-4f71-8d68-3d5af1d26e89 req-e9c093ad-5dfe-4d8c-b06b-ab4fc587cdb5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:42.503223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f561ebe7-149b-4f71-8d68-3d5af1d26e89 req-e9c093ad-5dfe-4d8c-b06b-ab4fc587cdb5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:42.503657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f561ebe7-149b-4f71-8d68-3d5af1d26e89 req-e9c093ad-5dfe-4d8c-b06b-ab4fc587cdb5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:42.514871 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f561ebe7-149b-4f71-8d68-3d5af1d26e89 req-e9c093ad-5dfe-4d8c-b06b-ab4fc587cdb5 service nova] Creating event network-changed:cf5d9cbc-7519-4521-b6e9-7aee4959953c for instance 1748a7ad-daca-4926-a0b2-533477bc2cbf on n-h1-781139-2 Oct 03 15:43:42.520345 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f561ebe7-149b-4f71-8d68-3d5af1d26e89 req-e9c093ad-5dfe-4d8c-b06b-ab4fc587cdb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115454 Oct 03 15:43:42.521039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3690/7551] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:43.469075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:43.470288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:43.478824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:43.479365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:43.479824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:43.480571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:43.481055 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:43.481525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:43.617319 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:43.625474 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5311f119-9008-403f-8e9d-06d271ee0b11 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.163221 Oct 03 15:43:43.626130 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3862/7552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:43 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:44.654269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:44.655402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:44.666363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:44.667185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:44.667868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:44.669108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:44.669776 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:44.670658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:44.815838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:44.828519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a729c6a5-b4c8-422a-89f3-22a0e3ec6ef9 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.182390 Oct 03 15:43:44.829347 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3691/7553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:44 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:45.852009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:45.852775 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:45.860147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:45.860688 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:45.861200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:45.861926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:45.862400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:45.862844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:45.999116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:46.008527 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af325f70-e7ce-46a0-87b1-9b19f92e80a6 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.160468 Oct 03 15:43:46.009548 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3863/7554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:45 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:47.032008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:47.033074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:47.040537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:47.041064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:47.041506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:47.042201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:47.042654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:47.043094 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:47.183804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:47.192836 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-69fca30d-fdf4-4062-a307-a8ee13a713e5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.164788 Oct 03 15:43:47.193457 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3692/7555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:47 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:48.220187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:48.221186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:48.229270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:48.229819 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:48.230318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:48.231100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:48.231611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:48.232094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:48.377390 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:48.385658 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72f97d86-4d4f-479b-8ddf-d0a73114cb43 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.172098 Oct 03 15:43:48.386209 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3864/7556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:48 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:48.975973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5f9a1f3e-ba47-4fd0-9aec-f0599541a92c req-50af2cf6-3263-4c8c-9af0-3e3449be33c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1748a7ad-daca-4926-a0b2-533477bc2cbf", "name": "network-vif-plugged", "status": "completed", "tag": "cf5d9cbc-7519-4521-b6e9-7aee4959953c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:48.987191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f9a1f3e-ba47-4fd0-9aec-f0599541a92c req-50af2cf6-3263-4c8c-9af0-3e3449be33c4 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:48.988320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f9a1f3e-ba47-4fd0-9aec-f0599541a92c req-50af2cf6-3263-4c8c-9af0-3e3449be33c4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:48.988765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f9a1f3e-ba47-4fd0-9aec-f0599541a92c req-50af2cf6-3263-4c8c-9af0-3e3449be33c4 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:49.000970 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5f9a1f3e-ba47-4fd0-9aec-f0599541a92c req-50af2cf6-3263-4c8c-9af0-3e3449be33c4 service nova] Creating event network-vif-plugged:cf5d9cbc-7519-4521-b6e9-7aee4959953c for instance 1748a7ad-daca-4926-a0b2-533477bc2cbf on n-h1-781139-2 Oct 03 15:43:49.006911 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5f9a1f3e-ba47-4fd0-9aec-f0599541a92c req-50af2cf6-3263-4c8c-9af0-3e3449be33c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091258 Oct 03 15:43:49.007552 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3693/7557] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:43:49.412720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:49.413398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:49.421935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:49.422534 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:49.423053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:49.423931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:49.424519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:49.425089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:49.569424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:49.578424 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-57f2dada-d339-4190-bd6f-1372c921de6f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1359 microversion: 2.1 time: 0.172175 Oct 03 15:43:49.578978 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3865/7558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:49 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:50.601464 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 03 15:43:50.606268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:50.606987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:50.613652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:50.614137 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:50.614577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:50.615278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:50.615719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:50.616138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:50.755356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:50.763426 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-57b77903-d3dd-484d-8224-e515b43189ad tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1549 microversion: 2.1 time: 0.164774 Oct 03 15:43:50.764060 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3694/7559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:50 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:50.787163 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:50.787916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:50.795301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:50.796008 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:50.796461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:50.797210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:50.797677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:50.798139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:50.936643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:50.945476 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f206db4e-9686-4152-be25-0935d1941ef7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1549 microversion: 2.1 time: 0.162575 Oct 03 15:43:50.946290 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3866/7560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:50 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:50.968105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:50.973238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:50.974024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Searching by: {'deleted': False, 'project_id': 'be83080851a74a4ab5cd4ff8db302083'} {{(pid=128868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 15:43:50.979926 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:50.980400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:50.980831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:50.981575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:50.982025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:50.982436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:51.010434 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.multi_cell_list [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 15:43:51.037985 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ad7cfb2-fa82-4879-923c-a7d07411b30a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073733 Oct 03 15:43:51.038560 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3695/7561] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 3 15:43:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:43:51.057471 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:43:51.058263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:51.066996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:51.067500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:51.067951 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:51.068660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:51.069172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:51.069593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:51.216115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:43:51.224152 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ba91a050-650f-422b-8a19-0848174a8e4c tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1549 microversion: 2.1 time: 0.173098 Oct 03 15:43:51.224740 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3867/7562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:43:51 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:43:52.775698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ace2302-2d6d-493e-809a-823d7e49d52a"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:43:52.778088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:43:52.786470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:52.786951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:52.787390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:52.788084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:43:52.788537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:43:52.788972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:43:52.794047 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58638. Oct 03 15:43:53.068839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-99f0ebc8-715b-4a3c-a4db-285204878de4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297047 Oct 03 15:43:53.069574 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3696/7563] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 3 15:43:52 2022] POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:44:03.879057 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:44:03.879663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:44:03.882159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=19 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:44:03.882973 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=74 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:44:03.889400 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:03.890253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:03.890925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:03.892245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:03.892709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:03.893175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:04.030505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:44:04.039622 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d0e7fc78-e357-44b5-84f1-7ef7c96318a4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1595 microversion: 2.1 time: 0.165546 Oct 03 15:44:04.040352 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3868/7564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:44:03 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1595 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:44:05.693192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:44:05.694031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=19 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:44:05.694899 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:44:05.699353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b134b912-3209-4b43-b3f9-00e4d0533b95 req-bd150dd9-7ce4-47fd-8bc5-7eb86c7ec91b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1748a7ad-daca-4926-a0b2-533477bc2cbf", "tag": "cf5d9cbc-7519-4521-b6e9-7aee4959953c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:44:05.716023 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b134b912-3209-4b43-b3f9-00e4d0533b95 req-bd150dd9-7ce4-47fd-8bc5-7eb86c7ec91b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:05.716506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b134b912-3209-4b43-b3f9-00e4d0533b95 req-bd150dd9-7ce4-47fd-8bc5-7eb86c7ec91b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:05.717011 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b134b912-3209-4b43-b3f9-00e4d0533b95 req-bd150dd9-7ce4-47fd-8bc5-7eb86c7ec91b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:05.729431 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b134b912-3209-4b43-b3f9-00e4d0533b95 req-bd150dd9-7ce4-47fd-8bc5-7eb86c7ec91b service nova] Creating event network-changed:cf5d9cbc-7519-4521-b6e9-7aee4959953c for instance 1748a7ad-daca-4926-a0b2-533477bc2cbf on n-h1-781139-2 Oct 03 15:44:05.734572 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b134b912-3209-4b43-b3f9-00e4d0533b95 req-bd150dd9-7ce4-47fd-8bc5-7eb86c7ec91b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043072 Oct 03 15:44:05.735196 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3697/7565] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:44:06.723507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1542800345"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:44:06.724052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:44:06.731596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:06.732088 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:06.732527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:06.733252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:06.733716 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:06.734156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:06.865219 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.network.security_group_api [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Adding security group db3a88ee-3632-40d7-b265-69a3671ee1b6 to port cf5d9cbc-7519-4521-b6e9-7aee4959953c Oct 03 15:44:07.199226 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b000de78-c5b7-4b66-9a05-ea364318e810 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/action" status: 202 len: 0 microversion: 2.1 time: 0.479712 Oct 03 15:44:07.199983 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3869/7566] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:44:06 2022] POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:44:07.206769 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d4a85f77-e76c-40fd-9f4d-c0059237fcc3] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:44:07.210615 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:44:07.211378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:44:07.218266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:07.218876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:07.219409 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:07.220764 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:07.221440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:07.221746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:07.370478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:44:07.379324 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8fa966b9-2a41-4f93-bb2e-aa0488685864 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1760 microversion: 2.1 time: 0.174426 Oct 03 15:44:07.379938 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3698/7567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:44:07 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:44:07.750588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-577c9430-cde8-4bfd-b2b1-a268835777aa req-61ea390e-bf04-4cd4-9e77-c3a9e8548879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1748a7ad-daca-4926-a0b2-533477bc2cbf", "tag": "cf5d9cbc-7519-4521-b6e9-7aee4959953c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:44:07.760567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-577c9430-cde8-4bfd-b2b1-a268835777aa req-61ea390e-bf04-4cd4-9e77-c3a9e8548879 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:44:07.761094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-577c9430-cde8-4bfd-b2b1-a268835777aa req-61ea390e-bf04-4cd4-9e77-c3a9e8548879 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:44:07.761537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-577c9430-cde8-4bfd-b2b1-a268835777aa req-61ea390e-bf04-4cd4-9e77-c3a9e8548879 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:44:07.773070 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-577c9430-cde8-4bfd-b2b1-a268835777aa req-61ea390e-bf04-4cd4-9e77-c3a9e8548879 service nova] Creating event network-changed:cf5d9cbc-7519-4521-b6e9-7aee4959953c for instance 1748a7ad-daca-4926-a0b2-533477bc2cbf on n-h1-781139-2 Oct 03 15:44:07.779076 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-577c9430-cde8-4bfd-b2b1-a268835777aa req-61ea390e-bf04-4cd4-9e77-c3a9e8548879 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033092 Oct 03 15:44:07.779672 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3870/7568] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:45:05.081747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:45:05.082515 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=8 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:45:05.090077 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] [d4a85f77-e76c-40fd-9f4d-c0059237fcc3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58724. Oct 03 15:45:05.139763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:45:05.142118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:05.148365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:05.148844 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:05.149392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:05.150086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:05.150539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:05.150963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:05.225988 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ee228ef6-2afd-4d33-b5c4-c123ce8fa14a tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/action" status: 202 len: 0 microversion: 2.1 time: 0.150930 Oct 03 15:45:05.226872 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3699/7569] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:45:05 2022] POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:45:05.234509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:45:05.235290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:45:05.240356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:05.241111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:05.249058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:05.249553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:05.250003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:05.250715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:05.251178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:05.251613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:05.416257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:05.425623 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73a3f733-6d58-4f2d-b0c6-8c9eb69b5cba tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1752 microversion: 2.1 time: 0.193047 Oct 03 15:45:05.426210 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3871/7570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:05 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:06.460065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:06.461385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:06.471927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:06.472462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:06.472901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:06.473660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:06.474118 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:06.474544 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:06.631346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:06.643890 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1562b1ca-3c2b-4dd1-8ecc-341ebaf31324 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.192930 Oct 03 15:45:06.644470 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3700/7571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:06 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:07.682211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:07.684398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:07.693549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:07.694117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:07.694569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:07.695283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:07.695750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:07.696184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:07.852914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:07.865819 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4af3ca1-2d68-47b9-8e3f-33291bc78028 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.191240 Oct 03 15:45:07.866580 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3872/7572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:07 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:08.892683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:08.893692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:08.901882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:08.902363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:08.902796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:08.903491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:08.903938 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:08.904406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:09.065200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:09.079307 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b19a1b5e-647f-48b2-80db-bb30f04515bc tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.192707 Oct 03 15:45:09.080255 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3701/7573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:08 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:10.108570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:10.109666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:10.122937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:10.123783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:10.124537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:10.125780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:10.126565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:10.127302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:10.296724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:10.306525 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c0a252d-33cd-40a9-aec9-b723a9ce3edb tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.205356 Oct 03 15:45:10.307122 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3873/7574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:10 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:11.333682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:11.334307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:11.342439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:11.342973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:11.343452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:11.344219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:11.344713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:11.345219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:11.500412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:11.510002 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-932e4832-8c71-453c-91da-1f4184b369ef tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.181760 Oct 03 15:45:11.510560 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3702/7575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:11 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:12.546897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:12.547880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:12.555889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:12.556589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:12.557063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:12.557821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:12.558301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:12.558726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:12.706631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:12.715241 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23f2142a-9956-47b6-90d8-3f2659916e1f tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.175078 Oct 03 15:45:12.715824 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3874/7576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:12 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:13.740652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:13.741338 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:13.749211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:13.749755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:13.750200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:13.750921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:13.751402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:13.751812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:13.923346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:13.931989 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-97da2880-44db-4402-9e21-c5d3ba9df67e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.196858 Oct 03 15:45:13.932730 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3703/7577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:13 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:14.963934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:14.964946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:14.976813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:14.977706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:14.978478 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:14.979691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:14.980521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:14.981256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:15.132186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:15.144693 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-26dc4c83-4acd-447a-bf47-86304c522c4e tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.187219 Oct 03 15:45:15.145558 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3875/7578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:14 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:16.177713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:16.178717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:16.190537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:16.191460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:16.191913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:16.192604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:16.193083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:16.193593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:16.346258 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:16.360807 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8c0cd1de-4320-4631-a4b5-125a0462e087 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1757 microversion: 2.1 time: 0.189613 Oct 03 15:45:16.361584 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3704/7579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:16 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:45:17.389709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:45:17.390691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:45:17.402551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:17.403374 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:17.404124 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:17.405458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:45:17.406248 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:45:17.406966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:45:17.563416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:45:17.572483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abec6458-4773-421a-8501-5b599d74ea19 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1760 microversion: 2.1 time: 0.189374 Oct 03 15:45:17.573096 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3876/7580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:45:17 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1760 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:13.192026 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1542800345"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:13.192978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:13.197730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=12 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:13.198845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:13.204904 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:13.205411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:13.205846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:13.206547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:13.206988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:13.207411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:13.346076 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.network.security_group_api [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Removing security group db3a88ee-3632-40d7-b265-69a3671ee1b6 from port cf5d9cbc-7519-4521-b6e9-7aee4959953c Oct 03 15:46:13.677434 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f9c04555-3a64-484e-9f12-ce3cc79c74d2 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/action" status: 202 len: 0 microversion: 2.1 time: 0.492090 Oct 03 15:46:13.678077 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3705/7581] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:46:13 2022] POST /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:46:13.687188 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-03e446f1-819a-4683-a9b4-3c642e6d7078 req-a546dbff-6464-43da-8c17-4dabc9021753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1748a7ad-daca-4926-a0b2-533477bc2cbf", "tag": "cf5d9cbc-7519-4521-b6e9-7aee4959953c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:13.693033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:13.693739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:13.701409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-03e446f1-819a-4683-a9b4-3c642e6d7078 req-a546dbff-6464-43da-8c17-4dabc9021753 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:13.702412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-03e446f1-819a-4683-a9b4-3c642e6d7078 req-a546dbff-6464-43da-8c17-4dabc9021753 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:13.702555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-03e446f1-819a-4683-a9b4-3c642e6d7078 req-a546dbff-6464-43da-8c17-4dabc9021753 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:13.717305 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-03e446f1-819a-4683-a9b4-3c642e6d7078 req-a546dbff-6464-43da-8c17-4dabc9021753 service nova] Creating event network-changed:cf5d9cbc-7519-4521-b6e9-7aee4959953c for instance 1748a7ad-daca-4926-a0b2-533477bc2cbf on n-h1-781139-2 Oct 03 15:46:13.724010 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-03e446f1-819a-4683-a9b4-3c642e6d7078 req-a546dbff-6464-43da-8c17-4dabc9021753 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040868 Oct 03 15:46:13.725118 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3877/7582] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:14.767814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:14.768384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:14.771213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d87d869f-fca8-4e66-a497-10050072486f req-ae3a8909-5b8c-400e-b8f4-042a56b8ffc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1748a7ad-daca-4926-a0b2-533477bc2cbf", "tag": "cf5d9cbc-7519-4521-b6e9-7aee4959953c"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:14.775234 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:14.775752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:14.776188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:14.777428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:14.777927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:14.778377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:14.782316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d87d869f-fca8-4e66-a497-10050072486f req-ae3a8909-5b8c-400e-b8f4-042a56b8ffc0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:14.782810 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d87d869f-fca8-4e66-a497-10050072486f req-ae3a8909-5b8c-400e-b8f4-042a56b8ffc0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:14.783447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d87d869f-fca8-4e66-a497-10050072486f req-ae3a8909-5b8c-400e-b8f4-042a56b8ffc0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:14.795234 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d87d869f-fca8-4e66-a497-10050072486f req-ae3a8909-5b8c-400e-b8f4-042a56b8ffc0 service nova] Creating event network-changed:cf5d9cbc-7519-4521-b6e9-7aee4959953c for instance 1748a7ad-daca-4926-a0b2-533477bc2cbf on n-h1-781139-2 Oct 03 15:46:14.800901 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d87d869f-fca8-4e66-a497-10050072486f req-ae3a8909-5b8c-400e-b8f4-042a56b8ffc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035359 Oct 03 15:46:14.801634 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3878/7583] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:14.870594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lazy-loading 'services' on Instance uuid 1748a7ad-daca-4926-a0b2-533477bc2cbf {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:46:14.949850 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a457f65-1caf-4afe-a777-055a85cf29f4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments/6ace2302-2d6d-493e-809a-823d7e49d52a" status: 202 len: 0 microversion: 2.1 time: 0.187833 Oct 03 15:46:14.951384 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3706/7584] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:46:14 2022] DELETE /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments/6ace2302-2d6d-493e-809a-823d7e49d52a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:46:14.968584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:14.972771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:14.982194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:14.982707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:14.983157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:14.984501 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:14.985035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:14.985484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:15.039129 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0c50f136-dec2-471e-b0ca-189e0cc476b5 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082863 Oct 03 15:46:15.040145 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3879/7585] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:46:14 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:16.058663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:16.062067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:16.070306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:16.071142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:16.071941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:16.073545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:16.074147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:16.074752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:16.434446 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-afd7181c-3274-4e9d-9d37-0e2af73e5814 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.383288 Oct 03 15:46:16.435267 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3707/7586] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:46:16 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments => generated 197 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:17.447824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:17.450731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:17.458140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:17.458645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:17.459097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:17.459821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:17.460293 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:17.460735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:17.492335 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e541eb47-e9ec-4716-88ec-88729fe6c2d4 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048489 Oct 03 15:46:17.492835 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3880/7587] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:46:17 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:18.505292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:18.507917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:18.515660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:18.516148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:18.516575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:18.517307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:18.517759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:18.518205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:18.550587 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05fd760a-e3cc-495d-8b66-5db16e0867d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049383 Oct 03 15:46:18.551496 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3708/7588] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:46:18 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:19.564294 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:19.566834 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:19.574398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:19.575255 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:19.575711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:19.576435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:19.576912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:19.577408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:19.611181 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b941e071-b433-4c90-96c7-31f27dd5eede tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051171 Oct 03 15:46:19.611761 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3881/7589] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:46:19 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:20.628692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:20.632223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:20.640791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:20.641323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:20.641763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:20.642464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:20.642918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:20.643328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:20.672821 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94157ec2-15ec-4224-89d1-ec269a7396ff tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050876 Oct 03 15:46:20.673419 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3709/7590] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 3 15:46:20 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 15:46:20.687249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:20.687766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:20.696788 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:20.697594 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:20.698265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:20.698977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:20.699444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:20.700243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:20.783796 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] HTTP exception thrown: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf is not attached to volume 6ace2302-2d6d-493e-809a-823d7e49d52a Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Request method failure captured: Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: request: DELETE /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments/6ace2302-2d6d-493e-809a-823d7e49d52a HTTP/1.1 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwImvuRps8-GcgsPMzY4aPgJXkgiMZOlgXAxLKJb89jz5TRDzrslxTPaYjq3NQ6_jpELX0CA279S14ugmbSOqMuwUbiiooPqBBy2gsZp65iML7i3O8szot2jwc1wNgiEn511KcLDoBtSBxNrw-zoT5gNX1me87OSqwZKpCUN9Az65HE Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be83080851a74a4ab5cd4ff8db302083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: 049a5e8d03f84936908ac478fe79fbee Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf is not attached to volume 6ace2302-2d6d-493e-809a-823d7e49d52a Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'server_id': '1748a7ad-daca-4926-a0b2-533477bc2cbf', 'id': '6ace2302-2d6d-493e-809a-823d7e49d52a'} Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6ace2302-2d6d-493e-809a-823d7e49d52a. Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf is not attached to volume 6ace2302-2d6d-493e-809a-823d7e49d52a Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:46:20.785596 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:46:20.790377 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:46:20.790377 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:46:20.790377 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf is not attached to volume 6ace2302-2d6d-493e-809a-823d7e49d52a Oct 03 15:46:20.790377 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:46:20.790377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Returning 404 to user: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf is not attached to volume 6ace2302-2d6d-493e-809a-823d7e49d52a {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:46:20.790377 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4a81f53-81f3-44b5-87f2-250431de9876 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments/6ace2302-2d6d-493e-809a-823d7e49d52a" status: 404 len: 154 microversion: 2.1 time: 0.103969 Oct 03 15:46:20.790377 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3882/7591] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 3 15:46:20 2022] DELETE /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf/os-volume_attachments/6ace2302-2d6d-493e-809a-823d7e49d52a => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:46:24.060770 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:24.061320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:24.070250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:24.070984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:24.071527 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:24.072449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:24.073119 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:24.073854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:24.104045 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:46:24.197116 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-aa5c32aa-d61b-470c-8291-531e6a6d1cfa tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 204 len: 0 microversion: 2.1 time: 0.141076 Oct 03 15:46:24.197765 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3710/7592] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:46:24 2022] DELETE /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:46:24.207553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:24.208194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:24.219378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:24.219876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:24.220331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:24.221160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:24.221630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:24.222072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:24.359131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:24.367117 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-87dfab5c-3fab-42a0-8243-da2ee102e3e8 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1555 microversion: 2.1 time: 0.164412 Oct 03 15:46:24.367727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3883/7593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:24 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:25.394812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:25.395876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:25.405817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:25.406299 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:25.406719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:25.407424 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:25.407877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:25.408298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:25.540883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:25.552670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7ef96484-f066-4197-8129-646aac6931d0 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1555 microversion: 2.1 time: 0.164201 Oct 03 15:46:25.553549 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3711/7594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:25 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:26.577004 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:26.579421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:26.587312 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:26.587817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:26.588273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:26.589221 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:26.589693 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:26.590164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:26.615444 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-5f9d7859-98a7-4fce-a2b2-50b4cb56470b req-d1a3d2ae-c2a2-432c-9b97-4a02b51fb015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1748a7ad-daca-4926-a0b2-533477bc2cbf", "name": "network-vif-deleted", "tag": "cf5d9cbc-7519-4521-b6e9-7aee4959953c"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:26.626347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f9d7859-98a7-4fce-a2b2-50b4cb56470b req-d1a3d2ae-c2a2-432c-9b97-4a02b51fb015 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:26.626819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f9d7859-98a7-4fce-a2b2-50b4cb56470b req-d1a3d2ae-c2a2-432c-9b97-4a02b51fb015 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:26.627428 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-5f9d7859-98a7-4fce-a2b2-50b4cb56470b req-d1a3d2ae-c2a2-432c-9b97-4a02b51fb015 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:26.643399 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-5f9d7859-98a7-4fce-a2b2-50b4cb56470b req-d1a3d2ae-c2a2-432c-9b97-4a02b51fb015 service nova] Creating event network-vif-deleted:cf5d9cbc-7519-4521-b6e9-7aee4959953c for instance 1748a7ad-daca-4926-a0b2-533477bc2cbf on n-h1-781139-2 Oct 03 15:46:26.648299 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-5f9d7859-98a7-4fce-a2b2-50b4cb56470b req-d1a3d2ae-c2a2-432c-9b97-4a02b51fb015 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037640 Oct 03 15:46:26.648889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3712/7595] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:46:26.660521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049a5e8d03f84936908ac478fe79fbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be83080851a74a4ab5cd4ff8db302083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:26.669050 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3b998c5c-e2ef-4b53-bd4e-67d995203658 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 200 len: 1513 microversion: 2.1 time: 0.097202 Oct 03 15:46:26.669671 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3884/7596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:26 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 1513 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:27.699550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:27.701114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] [instance: 1748a7ad-daca-4926-a0b2-533477bc2cbf] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:27.711674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:27.712457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:27.713246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:27.714387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:27.714956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:27.715400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:27.729026 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] HTTP exception thrown: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf could not be found. Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Request method failure captured: Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf HTTP/1.1 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwImvuRps8-GcgsPMzY4aPgJXkgiMZOlgXAxLKJb89jz5TRDzrslxTPaYjq3NQ6_jpELX0CA279S14ugmbSOqMuwUbiiooPqBBy2gsZp65iML7i3O8szot2jwc1wNgiEn511KcLDoBtSBxNrw-zoT5gNX1me87OSqwZKpCUN9Az65HE Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_be83080851a74a4ab5cd4ff8db302083", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/be83080851a74a4ab5cd4ff8db302083"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: be83080851a74a4ab5cd4ff8db302083 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1041148774 Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 049a5e8d03f84936908ac478fe79fbee Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestMinimumBasicScenario-1041148774-project Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf could not be found. Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '1748a7ad-daca-4926-a0b2-533477bc2cbf'} Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf could not be found. Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf could not be found. Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:46:27.730706 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf could not be found. Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Returning 404 to user: Instance 1748a7ad-daca-4926-a0b2-533477bc2cbf could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3fb1677-b6d7-4bb1-a262-3c117cf28e98 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf" status: 404 len: 111 microversion: 2.1 time: 0.041464 Oct 03 15:46:27.735617 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3713/7597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:27 2022] GET /compute/v2.1/servers/1748a7ad-daca-4926-a0b2-533477bc2cbf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 15:46:27.742298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9fe67698-3d2b-4068-a1d1-052a4d0ed7b7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] Calling method '.version_select at 0x7fb22bf3e820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:27.765852 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9fe67698-3d2b-4068-a1d1-052a4d0ed7b7 tempest-TestMinimumBasicScenario-1041148774 tempest-TestMinimumBasicScenario-1041148774-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1328690766" status: 202 len: 0 microversion: 2.1 time: 0.027306 Oct 03 15:46:27.766438 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3885/7598] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 3 15:46:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1328690766 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:46:37.385965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fff9af20-29f6-41da-ad56-498f22811347 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: .version_select at 0x7fb234adae50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-826270824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCN7hO4Q6+dxVbSdXmU7PY2QNrodMcg+kCWv4C1UGetCLYEtukdM/41FdRiNBDj1ij3Da43UrzO5vFkfK5eYmaeGFhIqXA7NQAO5uE0C89vJ9gbPfiKp+hkHowa4MPzpJQ=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:37.408805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-fff9af20-29f6-41da-ad56-498f22811347 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:46:37.414421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-fff9af20-29f6-41da-ad56-498f22811347 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:46:37.428124 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fff9af20-29f6-41da-ad56-498f22811347 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [d72cc83a-6e2e-45aa-bbb9-dc4cf8baa02a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:46:37.721077 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:38.440130 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [None req-fff9af20-29f6-41da-ad56-498f22811347 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [d72cc83a-6e2e-45aa-bbb9-dc4cf8baa02a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58968. Oct 03 15:46:38.465584 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fff9af20-29f6-41da-ad56-498f22811347 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.285152 Oct 03 15:46:38.466163 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3714/7599] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:46:37 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:44.218737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=40 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:44.219566 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:44.224412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1150212113", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "c0e856ef-4be4-4209-b3da-262d4e4372b7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-826270824", "security_groups": [{"name": "tempest-secgroup-smoke-823536891"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:44.334494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] validate_networks() for [('c0e856ef-4be4-4209-b3da-262d4e4372b7', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:46:45.201785 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:46:45.202149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:46:45.203290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:46:45.203817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:46:45.204207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:46:45.216308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:45.217101 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:45.217738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:45.218854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:45.219589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:45.219814 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:45.244727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:46:45.252254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:46:45.266707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:46:45.269422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:46:45.331231 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [57fc77c8-921a-49ea-8a74-425622349fd3] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:46:46.339961 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [57fc77c8-921a-49ea-8a74-425622349fd3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59016. Oct 03 15:46:46.344584 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83589811-f920-4422-8833-480a44c93276 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.127830 Oct 03 15:46:46.345479 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3886/7600] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:46:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:46:46.359217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-925cd308-ac16-428c-ad96-f2b854f64201 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:46.359817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-925cd308-ac16-428c-ad96-f2b854f64201 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:46.362257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:46.423331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-925cd308-ac16-428c-ad96-f2b854f64201 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:46.430550 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-925cd308-ac16-428c-ad96-f2b854f64201 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1266 microversion: 2.1 time: 0.077172 Oct 03 15:46:46.431148 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3715/7601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:46 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:47.455601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:47.456448 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:47.463656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:47.464498 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:47.464985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:47.465923 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:47.466420 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:47.467931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:47.544667 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:47.554169 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-77331857-2a8a-4b38-8928-94523b799271 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1318 microversion: 2.1 time: 0.103323 Oct 03 15:46:47.554842 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3887/7602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:47 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1318 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:48.578265 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:48.578876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:48.586459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:48.586948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:48.587366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:48.588250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:48.588697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:48.589147 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:48.722272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:48.730238 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bb219df7-c2b6-49ff-963b-513d45b7c3c0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1391 microversion: 2.1 time: 0.157030 Oct 03 15:46:48.730837 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3716/7603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:48 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:49.043744 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d0533b02-c785-4a29-a405-0b17f21e6c68 req-68d4ad4b-780b-4ebb-a121-9d54fcec227a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e28481f-8d1d-48c7-81a8-9474a99080ed", "tag": "9cfa8349-5269-4801-bb6c-946abca29ed1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:49.058132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d0533b02-c785-4a29-a405-0b17f21e6c68 req-68d4ad4b-780b-4ebb-a121-9d54fcec227a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:49.058815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d0533b02-c785-4a29-a405-0b17f21e6c68 req-68d4ad4b-780b-4ebb-a121-9d54fcec227a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:49.059283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d0533b02-c785-4a29-a405-0b17f21e6c68 req-68d4ad4b-780b-4ebb-a121-9d54fcec227a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:49.072721 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d0533b02-c785-4a29-a405-0b17f21e6c68 req-68d4ad4b-780b-4ebb-a121-9d54fcec227a service nova] Creating event network-changed:9cfa8349-5269-4801-bb6c-946abca29ed1 for instance 2e28481f-8d1d-48c7-81a8-9474a99080ed on n-h2-781139-2 Oct 03 15:46:49.078502 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d0533b02-c785-4a29-a405-0b17f21e6c68 req-68d4ad4b-780b-4ebb-a121-9d54fcec227a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038854 Oct 03 15:46:49.079121 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3888/7604] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:49.758145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:49.759024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:49.762735 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:46:49.763006 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed (ip 10.222.0.20) !!! Oct 03 15:46:49.772189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:49.772679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:49.773159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:49.773865 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:49.774325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:49.774750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:49.968271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:49.976419 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d03bad7e-70dd-4776-b186-f7fae225f1a2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1391 microversion: 2.1 time: 0.225090 Oct 03 15:46:49.977041 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3717/7605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:49 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:51.001231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:51.002832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:51.012754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:51.013300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:51.013754 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:51.014662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:51.015155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:51.015677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:51.206283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:51.219546 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-abdb0b13-b7d0-4ab9-9beb-9cf6545cf32c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1391 microversion: 2.1 time: 0.222844 Oct 03 15:46:51.220361 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3889/7606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:50 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:52.250196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:52.251747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:52.259062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:52.259552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:52.260054 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:52.260699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:52.261190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:52.261624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:52.400414 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:52.408275 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-edfa2ef0-3220-42b8-a3ff-5ca8196b9106 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1391 microversion: 2.1 time: 0.164879 Oct 03 15:46:52.408868 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3718/7607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:52 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:53.430888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:53.431502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:53.438714 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:53.439275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:53.439749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:53.440442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:53.440911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:53.441402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:53.587365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:53.595583 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e1b0cfe-bda0-4052-8be0-90567a32f366 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1391 microversion: 2.1 time: 0.168736 Oct 03 15:46:53.596179 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3890/7608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:53 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:54.621621 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:54.622224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:54.630488 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:54.631086 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:54.631535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:54.632242 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:54.632699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:54.633171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:54.765914 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:54.774045 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a6d8212-52e1-43df-b833-8b1d84623884 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1391 microversion: 2.1 time: 0.158656 Oct 03 15:46:54.774606 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3719/7609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:54 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:54.997405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1568f3f5-9b3b-4b89-b393-7270c56f2cb6 req-d1ac7144-0f53-4a8f-8dd3-2223ca3ba40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e28481f-8d1d-48c7-81a8-9474a99080ed", "name": "network-vif-plugged", "status": "completed", "tag": "9cfa8349-5269-4801-bb6c-946abca29ed1"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:55.008546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1568f3f5-9b3b-4b89-b393-7270c56f2cb6 req-d1ac7144-0f53-4a8f-8dd3-2223ca3ba40f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:55.009075 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1568f3f5-9b3b-4b89-b393-7270c56f2cb6 req-d1ac7144-0f53-4a8f-8dd3-2223ca3ba40f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:55.009526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1568f3f5-9b3b-4b89-b393-7270c56f2cb6 req-d1ac7144-0f53-4a8f-8dd3-2223ca3ba40f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:55.021885 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1568f3f5-9b3b-4b89-b393-7270c56f2cb6 req-d1ac7144-0f53-4a8f-8dd3-2223ca3ba40f service nova] Creating event network-vif-plugged:9cfa8349-5269-4801-bb6c-946abca29ed1 for instance 2e28481f-8d1d-48c7-81a8-9474a99080ed on n-h2-781139-2 Oct 03 15:46:55.027020 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1568f3f5-9b3b-4b89-b393-7270c56f2cb6 req-d1ac7144-0f53-4a8f-8dd3-2223ca3ba40f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Oct 03 15:46:55.027629 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3891/7610] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:55.799256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:55.799872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:55.807254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:55.807740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:55.808191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:55.809055 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:55.809532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:55.809964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:55.949992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:55.959450 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8b9b40de-f2f1-40dc-bc20-279e0a5df0d7 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1391 microversion: 2.1 time: 0.164611 Oct 03 15:46:55.960020 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3720/7611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:55 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:56.982446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:56.983791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:56.991707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:56.992871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:57.003378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:57.003887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:57.004341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:57.005096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:57.005565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:57.006002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:57.154884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:57.167159 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc359f09-fd3c-42c3-9585-f59e60f0b2d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1563 microversion: 2.1 time: 0.186261 Oct 03 15:46:57.167932 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3892/7612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:56 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:57.191096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:57.191681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:57.193711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:46:57.200388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:57.200877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:57.201357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:57.202053 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:57.202508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:57.202935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:57.338752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:57.347146 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ec8e11e0-463e-44c7-8fca-7fe5deff58f5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1563 microversion: 2.1 time: 0.159953 Oct 03 15:46:57.347666 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3721/7613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:57 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:46:58.999513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-d62f97bc-7fb2-4597-87c4-7e7d40123cef req-477b3855-cb14-4b75-9a26-500e93279859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e28481f-8d1d-48c7-81a8-9474a99080ed", "tag": "9cfa8349-5269-4801-bb6c-946abca29ed1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:46:59.005318 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:46:59.006813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:46:59.018617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d62f97bc-7fb2-4597-87c4-7e7d40123cef req-477b3855-cb14-4b75-9a26-500e93279859 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:59.021558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:59.022080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:59.022557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:59.023275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:46:59.023793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:59.024239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:59.028907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d62f97bc-7fb2-4597-87c4-7e7d40123cef req-477b3855-cb14-4b75-9a26-500e93279859 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:46:59.029377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-d62f97bc-7fb2-4597-87c4-7e7d40123cef req-477b3855-cb14-4b75-9a26-500e93279859 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:46:59.041486 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-d62f97bc-7fb2-4597-87c4-7e7d40123cef req-477b3855-cb14-4b75-9a26-500e93279859 service nova] Creating event network-changed:9cfa8349-5269-4801-bb6c-946abca29ed1 for instance 2e28481f-8d1d-48c7-81a8-9474a99080ed on n-h2-781139-2 Oct 03 15:46:59.047031 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-d62f97bc-7fb2-4597-87c4-7e7d40123cef req-477b3855-cb14-4b75-9a26-500e93279859 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051597 Oct 03 15:46:59.047842 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3722/7614] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:46:59.264431 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:46:59.273717 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f2d2ee0f-5148-46e5-8bf5-62111ee20c61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1563 microversion: 2.1 time: 0.283757 Oct 03 15:46:59.274652 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3893/7615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:46:58 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1563 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:20.594570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:20.598332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:20.601557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=17 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:20.602214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=38 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:20.608963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:20.609554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:20.610012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:20.610705 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:20.611155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:20.611570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:20.666146 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f71c5927-9138-4552-b355-b1405c1bf093 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action" status: 200 len: 24572 microversion: 2.1 time: 0.079005 Oct 03 15:47:20.666817 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3723/7616] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:47:20 2022] POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action => generated 24572 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:47:31.753701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:31.754291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:31.756395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:31.757125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:31.763300 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:31.763799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:31.764278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:31.765024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:31.765495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:31.765933 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:31.838500 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0ca9d40e-7e05-4999-b2df-095f539f5ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action" status: 202 len: 0 microversion: 2.1 time: 0.088883 Oct 03 15:47:31.839184 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3894/7617] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:47:31 2022] POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:47:31.848167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:31.848872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:31.851920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:31.852595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:31.859020 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:31.859514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:31.859965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:31.860658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:31.861135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:31.861696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:32.001346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:32.009751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-879318dd-f2f0-4673-84d7-1899536533b3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1687 microversion: 2.1 time: 0.165761 Oct 03 15:47:32.010469 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3724/7618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:31 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:33.037213 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:33.037939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:33.044895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:33.045434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:33.045897 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:33.046645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:33.047116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:33.047557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:33.191909 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:33.200797 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b5a6317-a225-4883-ae62-7a3098a275a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1667 microversion: 2.1 time: 0.169378 Oct 03 15:47:33.201417 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3895/7619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:33 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:34.312208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:34.314852 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:34.324531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:34.325138 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:34.325650 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:34.326487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:34.326998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:34.327493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:34.381389 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a8d78795-c9e0-4fdc-a014-12883c0ee4f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action" status: 200 len: 32637 microversion: 2.1 time: 0.073631 Oct 03 15:47:34.382039 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3725/7620] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:47:34 2022] POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action => generated 32637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:47:34.394875 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:34.395416 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:34.402467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:34.402974 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:34.403423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:34.404148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:34.404620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:34.405099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:34.477919 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eb64175a-0a63-447d-b7ae-b87274e2f3aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action" status: 202 len: 0 microversion: 2.1 time: 0.086721 Oct 03 15:47:34.478607 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3896/7621] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:47:34 2022] POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:47:34.487568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:34.488277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:34.496396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:34.496940 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:34.497363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:34.498629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:34.499116 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:34.499787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:34.643417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:34.652101 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a801fae4-504b-46de-8855-58fefab44c76 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1674 microversion: 2.1 time: 0.168754 Oct 03 15:47:34.653049 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3726/7622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:34 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:47:35.681694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:35.682290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:35.689206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:35.689707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:35.690157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:35.690866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:35.691332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:35.691770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:35.844627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:35.853358 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-678f89e6-ea8b-418d-9d28-abe8a956e013 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1682 microversion: 2.1 time: 0.178650 Oct 03 15:47:35.853952 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3897/7623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:35 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:35.957255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:35.959457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:35.966318 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:35.966809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:35.967253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:35.967948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:35.968400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:35.968827 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:36.023728 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fba83998-0fd1-463c-8212-c3e44b85d3ef tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action" status: 200 len: 38447 microversion: 2.1 time: 0.070465 Oct 03 15:47:36.024447 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3727/7624] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:47:35 2022] POST /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed/action => generated 38447 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:47:37.031414 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:37.031947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:37.034063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c0769161-1d73-4dcb-b655-eb66c88cb540 req-98b28a02-dfc4-4a45-854f-4d357f24e76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e28481f-8d1d-48c7-81a8-9474a99080ed", "tag": "9cfa8349-5269-4801-bb6c-946abca29ed1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:37.038972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:37.039482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:37.040147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:37.040888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:37.041410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:37.041847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:37.045061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c0769161-1d73-4dcb-b655-eb66c88cb540 req-98b28a02-dfc4-4a45-854f-4d357f24e76d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:37.045535 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c0769161-1d73-4dcb-b655-eb66c88cb540 req-98b28a02-dfc4-4a45-854f-4d357f24e76d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:37.045959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c0769161-1d73-4dcb-b655-eb66c88cb540 req-98b28a02-dfc4-4a45-854f-4d357f24e76d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:37.057241 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c0769161-1d73-4dcb-b655-eb66c88cb540 req-98b28a02-dfc4-4a45-854f-4d357f24e76d service nova] Creating event network-changed:9cfa8349-5269-4801-bb6c-946abca29ed1 for instance 2e28481f-8d1d-48c7-81a8-9474a99080ed on n-h2-781139-2 Oct 03 15:47:37.062105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c0769161-1d73-4dcb-b655-eb66c88cb540 req-98b28a02-dfc4-4a45-854f-4d357f24e76d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032107 Oct 03 15:47:37.062696 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3728/7625] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:47:37.068601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:47:37.164279 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32fd02e7-bde3-4408-9f0d-3a8bad96b256 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 204 len: 0 microversion: 2.1 time: 0.136293 Oct 03 15:47:37.173019 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3898/7626] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:47:37 2022] DELETE /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:47:37.175285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:37.175972 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:37.182912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:37.183831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:37.184494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:37.185462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:37.186145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:37.186793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:37.327365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:37.335872 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d94897ee-da2f-4dcf-8d49-7cfa01740d78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1688 microversion: 2.1 time: 0.165814 Oct 03 15:47:37.336498 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3729/7627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:37 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:38.360793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:38.361545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:38.369045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:38.369558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:38.370012 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:38.370732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:38.371204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:38.371653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:38.528607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:38.537227 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdce1e74-98e8-4b4a-9cbe-c46458903a46 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1688 microversion: 2.1 time: 0.180868 Oct 03 15:47:38.537808 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3899/7628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:38 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:39.124543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-6bcb449c-5b78-4102-9da1-0032ea193cc8 req-58213282-c557-4219-9eb2-51caae195e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e28481f-8d1d-48c7-81a8-9474a99080ed", "name": "network-vif-deleted", "tag": "9cfa8349-5269-4801-bb6c-946abca29ed1"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:39.135892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bcb449c-5b78-4102-9da1-0032ea193cc8 req-58213282-c557-4219-9eb2-51caae195e72 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:39.136377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bcb449c-5b78-4102-9da1-0032ea193cc8 req-58213282-c557-4219-9eb2-51caae195e72 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:39.136816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-6bcb449c-5b78-4102-9da1-0032ea193cc8 req-58213282-c557-4219-9eb2-51caae195e72 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:39.148270 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-6bcb449c-5b78-4102-9da1-0032ea193cc8 req-58213282-c557-4219-9eb2-51caae195e72 service nova] Creating event network-vif-deleted:9cfa8349-5269-4801-bb6c-946abca29ed1 for instance 2e28481f-8d1d-48c7-81a8-9474a99080ed on n-h2-781139-2 Oct 03 15:47:39.153329 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-6bcb449c-5b78-4102-9da1-0032ea193cc8 req-58213282-c557-4219-9eb2-51caae195e72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Oct 03 15:47:39.153942 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3730/7629] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:47:39.561502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:39.562159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:39.569209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:39.569708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:39.570160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:39.570881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:39.571389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:39.571827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:39.605730 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:39.606211 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:39.606676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:39.607126 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lazy-loading 'fault' on Instance uuid 2e28481f-8d1d-48c7-81a8-9474a99080ed {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:47:39.655019 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:39.662342 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4bcbf452-8efd-41c6-804c-73f834c40766 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 200 len: 1356 microversion: 2.1 time: 0.105396 Oct 03 15:47:39.662926 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3900/7630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:39 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:40.692145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:40.693333 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 2e28481f-8d1d-48c7-81a8-9474a99080ed] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:40.702044 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:40.702542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:40.702952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:40.703676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:40.704129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:40.704577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:40.718425 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] HTTP exception thrown: Instance 2e28481f-8d1d-48c7-81a8-9474a99080ed could not be found. Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Request method failure captured: Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed HTTP/1.1 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwPcC34rhG4ymjBIvYFpGalY0FgaLBJaryyoprD84IXJNSLJQa3ziIaaKtxnO5sDwo0zEa5_D-jy71pYjPj945-iOkP1rZ9ygeS2tUbp3CNyNUj5hmskpnhHi3A1nrl5fTtr6e9KF9sHf1bgiHurW7Xz9xieYIaRPglfXR0fl3_l-q4 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/85448b7772694deebf35d6b222d913be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_85448b7772694deebf35d6b222d913be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b66e9adacee94b27b9af39b9467efcb7 Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 2e28481f-8d1d-48c7-81a8-9474a99080ed could not be found. Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '2e28481f-8d1d-48c7-81a8-9474a99080ed'} Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e28481f-8d1d-48c7-81a8-9474a99080ed could not be found. Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e28481f-8d1d-48c7-81a8-9474a99080ed could not be found. Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:47:40.720109 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e28481f-8d1d-48c7-81a8-9474a99080ed could not be found. Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Returning 404 to user: Instance 2e28481f-8d1d-48c7-81a8-9474a99080ed could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d28cd657-8ecc-4641-aaca-89f2b8528c1c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed" status: 404 len: 111 microversion: 2.1 time: 0.037864 Oct 03 15:47:40.725034 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3731/7631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:40 2022] GET /compute/v2.1/servers/2e28481f-8d1d-48c7-81a8-9474a99080ed => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:47:44.434072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83f566d0-7f6b-4d43-9341-70235f222486 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '.version_select at 0x7fb230a20820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:44.464316 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83f566d0-7f6b-4d43-9341-70235f222486 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-826270824" status: 202 len: 0 microversion: 2.1 time: 0.034086 Oct 03 15:47:44.470907 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3901/7632] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 3 15:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-826270824 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:47:44.491783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3c71c3d-0fa4-4911-ba72-970137414b59 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: .version_select at 0x7fb232150b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-751067087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYmLLlfsbEvsl2SQpXCLeTJUAkxZQ/0Fywe1HvHBMiWWSPtQYLESCcfLaZhg8c63QicEHrsAMn1ULmJ8mL2WXNSo90K9la52Z6/LzhK2OvfwuDjrgwhDUOJ0Bgy5FNrvw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:44.509985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f3c71c3d-0fa4-4911-ba72-970137414b59 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:47:44.515524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-f3c71c3d-0fa4-4911-ba72-970137414b59 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:47:44.541250 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3c71c3d-0fa4-4911-ba72-970137414b59 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053367 Oct 03 15:47:44.541865 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3732/7633] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:47:44 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:47:50.014158 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-220040742", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "cda8b392-49e6-4e84-8998-c76c2eea132c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-751067087", "security_groups": [{"name": "tempest-secgroup-smoke-1234431139"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:50.036677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:50.152737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] validate_networks() for [('cda8b392-49e6-4e84-8998-c76c2eea132c', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:47:50.578399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:47:50.583840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:47:50.584357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:47:50.584796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:47:50.585261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:47:50.595553 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:50.596052 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:50.596585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:50.597387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:50.597859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:50.598339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:50.625904 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:47:50.632812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:47:50.651251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:47:50.656232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:47:50.728483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bd45bbf4-87f0-4132-b39c-2766bf89b807 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730343 Oct 03 15:47:50.741246 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-155ba829-a6cb-4330-af64-7d49bb8a7a91 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:50.742504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-155ba829-a6cb-4330-af64-7d49bb8a7a91 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:50.745746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=32 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:47:50.747707 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3902/7634] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:47:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:47:51.152640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-155ba829-a6cb-4330-af64-7d49bb8a7a91 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:51.160462 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-155ba829-a6cb-4330-af64-7d49bb8a7a91 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1265 microversion: 2.1 time: 0.423318 Oct 03 15:47:51.161421 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3733/7635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:50 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1265 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:52.184957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:52.185580 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:52.192483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:52.192982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:52.193433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:52.194542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:52.194990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:52.195664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:52.267762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:52.276499 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c91776b4-5202-4cb0-b6ef-43c8b51fb28e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1323 microversion: 2.1 time: 0.096403 Oct 03 15:47:52.280965 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3903/7636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:52 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:53.301596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:53.302687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:53.310584 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:53.311391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:53.312152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:53.313167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:53.313829 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:53.314288 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:53.525269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:53.536005 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a5ca12d9-2ccb-4eaa-aded-07821d80468f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.238993 Oct 03 15:47:53.536597 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3734/7637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:53 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:53.632117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-db4055ef-4bcd-47d2-9ab8-d57633b67991 req-a0f603c7-23b4-473f-bb76-1011cb5fc894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d4069e-7ed2-435a-85c3-7b660cdabfcc", "tag": "cbff7324-f22b-4e32-b3df-7a0e743f959e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:47:53.651096 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db4055ef-4bcd-47d2-9ab8-d57633b67991 req-a0f603c7-23b4-473f-bb76-1011cb5fc894 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:53.651491 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db4055ef-4bcd-47d2-9ab8-d57633b67991 req-a0f603c7-23b4-473f-bb76-1011cb5fc894 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:53.652192 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-db4055ef-4bcd-47d2-9ab8-d57633b67991 req-a0f603c7-23b4-473f-bb76-1011cb5fc894 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:53.669841 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-db4055ef-4bcd-47d2-9ab8-d57633b67991 req-a0f603c7-23b4-473f-bb76-1011cb5fc894 service nova] Creating event network-changed:cbff7324-f22b-4e32-b3df-7a0e743f959e for instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc on n-h1-781139-2 Oct 03 15:47:53.677988 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-db4055ef-4bcd-47d2-9ab8-d57633b67991 req-a0f603c7-23b4-473f-bb76-1011cb5fc894 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049982 Oct 03 15:47:53.679310 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3904/7638] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:47:54.560134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:54.560729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:54.568305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:54.568832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:54.569312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:54.570024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:54.570491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:54.570921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:54.708771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:54.720833 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4a9b682e-b372-4890-b1de-e75c1be37999 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.164505 Oct 03 15:47:54.721733 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3735/7639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:54 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:55.747589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:55.748305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:55.755836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:55.756373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:55.756828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:55.757608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:55.758084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:55.758654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:55.892267 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:55.901050 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b949b72c-6944-465d-88fd-4125ade539a6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.158303 Oct 03 15:47:55.901644 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3905/7640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:55 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:56.928582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:56.929482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:56.941389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:56.942213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:56.942931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:56.944071 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:56.944853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:56.945604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:57.090559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:57.098957 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2674cc95-1193-479e-84b2-fc29e90397eb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.177127 Oct 03 15:47:57.099552 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3736/7641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:56 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:58.123204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:58.123922 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:58.131377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:58.131958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:58.132484 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:58.133302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:58.133832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:58.134277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:58.288560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:58.296944 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a4d24957-de70-46a1-ad40-674bdb745c5e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.178014 Oct 03 15:47:58.297551 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3906/7642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:58 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:47:59.320800 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:47:59.321496 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:47:59.329303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:59.329789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:59.330245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:59.330929 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:47:59.331381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:47:59.331788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:47:59.467068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:47:59.474870 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e2c7caab-d5b4-47bd-addc-5f466d4cb880 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.158133 Oct 03 15:47:59.475455 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3737/7643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:47:59 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:48:00.125470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3f86e744-3e35-41d6-a2b0-28ed378351b1 req-ac25b2b4-2eda-491f-87f5-3587d4190389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d4069e-7ed2-435a-85c3-7b660cdabfcc", "name": "network-vif-plugged", "status": "completed", "tag": "cbff7324-f22b-4e32-b3df-7a0e743f959e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:48:00.136941 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3f86e744-3e35-41d6-a2b0-28ed378351b1 req-ac25b2b4-2eda-491f-87f5-3587d4190389 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:00.137535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3f86e744-3e35-41d6-a2b0-28ed378351b1 req-ac25b2b4-2eda-491f-87f5-3587d4190389 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:00.138070 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3f86e744-3e35-41d6-a2b0-28ed378351b1 req-ac25b2b4-2eda-491f-87f5-3587d4190389 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:00.150096 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3f86e744-3e35-41d6-a2b0-28ed378351b1 req-ac25b2b4-2eda-491f-87f5-3587d4190389 service nova] Creating event network-vif-plugged:cbff7324-f22b-4e32-b3df-7a0e743f959e for instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc on n-h1-781139-2 Oct 03 15:48:00.155259 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3f86e744-3e35-41d6-a2b0-28ed378351b1 req-ac25b2b4-2eda-491f-87f5-3587d4190389 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033677 Oct 03 15:48:00.155878 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3907/7644] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:48:00.502359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:48:00.503315 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:48:00.514857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:00.515654 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:00.516377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:00.517575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:00.518594 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:00.519351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:00.653572 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:48:00.661955 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-05489a28-09cb-4a59-b62a-002164b9a500 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.166203 Oct 03 15:48:00.662541 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3738/7645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:48:00 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:48:01.682654 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:48:01.683458 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:48:01.688391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:48:01.689132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:48:01.696308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:01.696778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:01.697252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:01.698056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:01.698887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:01.699324 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:01.845614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:48:01.853987 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c12821d7-d2f0-445c-92ea-b9313639e3e3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1391 microversion: 2.1 time: 0.172318 Oct 03 15:48:01.854568 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3908/7646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:48:01 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:48:02.877923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:48:02.878543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:48:02.880459 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:48:02.882021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:48:02.887739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:02.888230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:02.888673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:02.889406 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:02.889856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:02.890281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:03.032421 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:48:03.043352 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-267e7b89-e243-46c6-9152-33193cfac0bc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1562 microversion: 2.1 time: 0.169481 Oct 03 15:48:03.043932 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3739/7647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:48:02 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:48:03.065877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:48:03.066508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:48:03.069306 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:48:03.075270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:03.075777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:03.076296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:03.077039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:03.077514 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:03.077957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:03.220133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:48:03.232531 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2f15b27a-2919-49c3-81a5-f6e95fca1ebc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1562 microversion: 2.1 time: 0.170396 Oct 03 15:48:03.233427 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3909/7648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:48:03 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:48:05.243443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:48:05.244160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:48:05.251788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:05.252410 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:05.252948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:05.253731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:05.254279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:05.254773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:05.308273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-28956058-72b0-45be-92a9-7ce572c1f376 req-df90f809-2d65-4fcc-a921-92fe965259d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d4069e-7ed2-435a-85c3-7b660cdabfcc", "tag": "cbff7324-f22b-4e32-b3df-7a0e743f959e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:48:05.318691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-28956058-72b0-45be-92a9-7ce572c1f376 req-df90f809-2d65-4fcc-a921-92fe965259d5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:05.319193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-28956058-72b0-45be-92a9-7ce572c1f376 req-df90f809-2d65-4fcc-a921-92fe965259d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:05.319615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-28956058-72b0-45be-92a9-7ce572c1f376 req-df90f809-2d65-4fcc-a921-92fe965259d5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:05.332375 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-28956058-72b0-45be-92a9-7ce572c1f376 req-df90f809-2d65-4fcc-a921-92fe965259d5 service nova] Creating event network-changed:cbff7324-f22b-4e32-b3df-7a0e743f959e for instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc on n-h1-781139-2 Oct 03 15:48:05.337974 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-28956058-72b0-45be-92a9-7ce572c1f376 req-df90f809-2d65-4fcc-a921-92fe965259d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101287 Oct 03 15:48:05.339276 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3910/7649] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:48:05.392003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:48:05.400063 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6915fe1a-f3ce-4358-a7e2-123cbee52822 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1562 microversion: 2.1 time: 0.167520 Oct 03 15:48:05.400671 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3740/7650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:48:05 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:48:36.749207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:48:36.751592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:48:36.753844 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:48:36.754513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=38 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:48:36.761687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:36.762173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:36.762620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:36.763369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:48:36.763835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:48:36.764273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:48:36.835867 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-69106ef8-3dba-4595-869f-d382b1a4a2aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc/action" status: 200 len: 24566 microversion: 2.1 time: 0.091677 Oct 03 15:48:36.836542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3911/7651] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:48:36 2022] POST /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc/action => generated 24566 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:49:07.293592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:07.294788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=42 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:07.302494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:49:07.304735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:07.311772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:07.312255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:07.312692 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:07.313427 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:07.313880 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:07.314304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:07.393518 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61a73b26-3449-48b2-9ba3-702705a59970 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc/action" status: 202 len: 0 microversion: 2.1 time: 0.103118 Oct 03 15:49:07.394178 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3741/7652] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:49:07 2022] POST /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:49:07.404839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:07.405590 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:07.408411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:07.409118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:07.416452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:07.416978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:07.417683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:07.418419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:07.418893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:07.419352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:07.563368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:07.571694 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-39a2bda0-07df-476f-9da1-3ba44065068f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1673 microversion: 2.1 time: 0.171435 Oct 03 15:49:07.572845 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3912/7653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:07 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:08.601665 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:08.602365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:08.609196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:08.609680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:08.610114 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:08.610799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:08.611252 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:08.611677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:08.751126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:08.760200 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c95e432-5a97-49c4-aee2-08f09d6e59aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.165899 Oct 03 15:49:08.760953 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3742/7654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:08 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:09.792619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:09.793829 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:09.806925 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:09.807751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:09.808479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:09.809703 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:09.810496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:09.811217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:09.950135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:09.963038 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7ed48c85-3797-4129-a9f8-f72262bc892e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.177556 Oct 03 15:49:09.963842 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3913/7655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:09 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:10.995189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:10.996210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:11.008632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:11.010123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:11.010863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:11.012235 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:11.012992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:11.013748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:11.162965 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:11.175128 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-531df457-54c2-40e0-89fe-6b2d6355fb5d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.186443 Oct 03 15:49:11.175889 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3743/7656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:10 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:12.204342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:12.205424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:12.217387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:12.218170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:12.219005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:12.220173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:12.220988 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:12.221733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:12.369815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:12.377953 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f50c41a3-8e1f-4d55-ba3f-4c6f9a6655b6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.180738 Oct 03 15:49:12.379028 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3914/7657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:12 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:13.407236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:13.408256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:13.420627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:13.421492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:13.422249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:13.423402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:13.424169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:13.424884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:13.575881 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:13.584356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6cdf8920-f52f-43fb-90a0-588d916b582b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.183686 Oct 03 15:49:13.584964 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3744/7658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:13 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:14.611845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:14.612798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:14.621793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:14.622297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:14.622756 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:14.623477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:14.623952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:14.624395 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:14.772825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:14.781235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2921eff5-38c8-4bcd-ab8f-d0401825cb7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.176306 Oct 03 15:49:14.781826 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3915/7659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:14 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:15.810034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:15.811003 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:15.821679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:15.822537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:15.822981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:15.823680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:15.824132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:15.824559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:15.967323 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:15.978341 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f8f19f4-b627-44ac-8b8a-e286743b4aa4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.175338 Oct 03 15:49:15.978955 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3745/7660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:15 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:17.002321 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:17.003117 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:17.010894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:17.011393 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:17.011892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:17.012706 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:17.013230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:17.013675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:17.146694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:17.154787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2b0c180c-200a-4774-95d7-956ea551c51e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.156549 Oct 03 15:49:17.155373 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3916/7661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:16 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:18.189177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:18.190387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:18.203202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:18.204007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:18.204734 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:18.205947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:18.206696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:18.207400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:18.347327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:18.356466 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2d0f7a19-df61-4cc6-9e6c-99e2debc1b09 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1678 microversion: 2.1 time: 0.175394 Oct 03 15:49:18.357071 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3746/7662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:18 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:19.380704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:49:19.381314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:19.389156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:19.389665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:19.390122 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:19.390849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:19.391322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:19.391761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:19.534217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:49:19.542649 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-44a11c5b-7e61-4283-a571-387e40cf9888 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1681 microversion: 2.1 time: 0.165963 Oct 03 15:49:19.543269 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3917/7663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:49:19 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:49:51.807300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:49:51.809629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:49:51.811877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=12 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:51.812719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:51.818281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:51.818778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:51.819229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:51.819939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:49:51.820396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:49:51.820891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:49:51.893383 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-63447ec9-1b57-4505-b4f9-4216328b1a5b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc/action" status: 200 len: 68951 microversion: 2.1 time: 0.090049 Oct 03 15:49:51.894260 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3747/7664] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:49:51 2022] POST /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc/action => generated 68951 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:50:09.162364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:09.162888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:09.165172 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1c34c4c9-bd28-43b5-af61-c8b675d17557 req-d63f3d5f-88a5-4ed0-85ff-7bf4f569f2eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0d4069e-7ed2-435a-85c3-7b660cdabfcc", "tag": "cbff7324-f22b-4e32-b3df-7a0e743f959e"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:50:09.165587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:09.166382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:09.172970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:09.173487 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:09.173625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:09.173935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:09.174283 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:09.175014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:09.175560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:09.176097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:09.181059 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1c34c4c9-bd28-43b5-af61-c8b675d17557 req-d63f3d5f-88a5-4ed0-85ff-7bf4f569f2eb service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:09.181790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1c34c4c9-bd28-43b5-af61-c8b675d17557 req-d63f3d5f-88a5-4ed0-85ff-7bf4f569f2eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:09.182209 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1c34c4c9-bd28-43b5-af61-c8b675d17557 req-d63f3d5f-88a5-4ed0-85ff-7bf4f569f2eb service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:09.194999 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1c34c4c9-bd28-43b5-af61-c8b675d17557 req-d63f3d5f-88a5-4ed0-85ff-7bf4f569f2eb service nova] Creating event network-changed:cbff7324-f22b-4e32-b3df-7a0e743f959e for instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc on n-h1-781139-2 Oct 03 15:50:09.200356 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1c34c4c9-bd28-43b5-af61-c8b675d17557 req-d63f3d5f-88a5-4ed0-85ff-7bf4f569f2eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039491 Oct 03 15:50:09.201557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3748/7665] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:50:09.206948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:50:09.298826 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-23749030-ac16-44c1-b26c-84d8f29c6f4f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 204 len: 0 microversion: 2.1 time: 0.140445 Oct 03 15:50:09.299595 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3918/7666] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:50:09 2022] DELETE /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:09.312863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:09.314110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:09.321238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:09.321736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:09.322182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:09.322900 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:09.323364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:09.323797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:09.464017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:09.472633 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-47563358-4f12-4ad7-b3b4-fc29ea43190c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1687 microversion: 2.1 time: 0.166772 Oct 03 15:50:09.473230 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3749/7667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:09 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:10.501502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:10.502329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:10.511314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:10.511938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:10.512503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:10.513505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:10.514141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:10.514639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:10.660041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:10.668634 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72183ff5-372c-4e93-b4e1-315a62f56097 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1687 microversion: 2.1 time: 0.173350 Oct 03 15:50:10.669309 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3919/7668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:10 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:11.692552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:11.693271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:11.700612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:11.701158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:11.701598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:11.702297 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:11.702752 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:11.703175 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:11.730107 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a42ce9d4-1c60-4d7b-93bf-01b7027e5a9a req-6ae5cd7d-d261-4815-b2f9-0241360db3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0d4069e-7ed2-435a-85c3-7b660cdabfcc", "name": "network-vif-deleted", "tag": "cbff7324-f22b-4e32-b3df-7a0e743f959e"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:50:11.747676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a42ce9d4-1c60-4d7b-93bf-01b7027e5a9a req-6ae5cd7d-d261-4815-b2f9-0241360db3f0 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:11.748277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a42ce9d4-1c60-4d7b-93bf-01b7027e5a9a req-6ae5cd7d-d261-4815-b2f9-0241360db3f0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:11.748729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a42ce9d4-1c60-4d7b-93bf-01b7027e5a9a req-6ae5cd7d-d261-4815-b2f9-0241360db3f0 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:11.764386 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a42ce9d4-1c60-4d7b-93bf-01b7027e5a9a req-6ae5cd7d-d261-4815-b2f9-0241360db3f0 service nova] Creating event network-vif-deleted:cbff7324-f22b-4e32-b3df-7a0e743f959e for instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc on n-h1-781139-2 Oct 03 15:50:11.768708 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:11.770115 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a42ce9d4-1c60-4d7b-93bf-01b7027e5a9a req-6ae5cd7d-d261-4815-b2f9-0241360db3f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043791 Oct 03 15:50:11.771676 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3920/7669] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:50:11.777296 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ae59dad0-d92d-4061-bff1-5cd0039e4104 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 200 len: 1500 microversion: 2.1 time: 0.089189 Oct 03 15:50:11.777876 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3750/7670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:11 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 1500 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:12.802931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:12.803645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: f0d4069e-7ed2-435a-85c3-7b660cdabfcc] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:12.810359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:12.810821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:12.811278 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:12.812011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:12.812475 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:12.812918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:12.826815 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] HTTP exception thrown: Instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc could not be found. Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Request method failure captured: Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc HTTP/1.1 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwPcC34rhG4ymjBIvYFpGalY0FgaLBJaryyoprD84IXJNSLJQa3ziIaaKtxnO5sDwo0zEa5_D-jy71pYjPj945-iOkP1rZ9ygeS2tUbp3CNyNUj5hmskpnhHi3A1nrl5fTtr6e9KF9sHf1bgiHurW7Xz9xieYIaRPglfXR0fl3_l-q4 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/85448b7772694deebf35d6b222d913be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_85448b7772694deebf35d6b222d913be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: b66e9adacee94b27b9af39b9467efcb7 Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc could not be found. Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': 'f0d4069e-7ed2-435a-85c3-7b660cdabfcc'} Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc could not be found. Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc could not be found. Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:50:12.828535 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc could not be found. Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Returning 404 to user: Instance f0d4069e-7ed2-435a-85c3-7b660cdabfcc could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59b3f2e7-9eb2-47ec-a343-ef024c1ca918 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc" status: 404 len: 111 microversion: 2.1 time: 0.032871 Oct 03 15:50:12.833917 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3921/7671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:12 2022] GET /compute/v2.1/servers/f0d4069e-7ed2-435a-85c3-7b660cdabfcc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:50:15.877429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6a98e829-2628-4b85-b423-efa7f8c484e0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '.version_select at 0x7fb22b30f310>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:15.901221 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6a98e829-2628-4b85-b423-efa7f8c484e0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-751067087" status: 202 len: 0 microversion: 2.1 time: 0.029627 Oct 03 15:50:15.901944 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3751/7672] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 3 15:50:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-751067087 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:50:15.933010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-afb8b394-ad2c-4e3c-a066-27d055e0c94b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: .version_select at 0x7fb2321cec10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2142778848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSTg2SPEdKaBQ+EODtKTIxc5W/Z92XqBHmURqnGP9OP0NaWAsAEMSK4USaqCiEXddJDs0Ks78+/WjIX5KqQGMVUtndqB7epFwXrol8AVHrUoap2FEyv9oHPgJzqHd0f7A=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:50:15.954133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-afb8b394-ad2c-4e3c-a066-27d055e0c94b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:50:15.963054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-afb8b394-ad2c-4e3c-a066-27d055e0c94b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:50:15.977042 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-afb8b394-ad2c-4e3c-a066-27d055e0c94b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [872bb6e8-db13-48b6-8058-7944b349ec71] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:50:16.989498 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-afb8b394-ad2c-4e3c-a066-27d055e0c94b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [872bb6e8-db13-48b6-8058-7944b349ec71] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59352. Oct 03 15:50:17.012401 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-afb8b394-ad2c-4e3c-a066-27d055e0c94b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.083399 Oct 03 15:50:17.013133 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3922/7673] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:50:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:50:22.883332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=14 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.891885 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-790938369", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "fb4c8960-abf6-4deb-abfd-d35696ecb10b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2142778848", "security_groups": [{"name": "tempest-secgroup-smoke-9333283"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:50:23.007075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] validate_networks() for [('fb4c8960-abf6-4deb-abfd-d35696ecb10b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:50:23.531074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:50:23.531457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:50:23.532250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:50:23.534380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:50:23.535083 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:50:23.545015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:23.548381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:23.548845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:23.550127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:23.550558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:23.550974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:23.572739 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:50:23.579810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:50:23.596082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:50:23.598649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:50:23.653922 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [0fd0ca82-7e3b-4d62-a84a-caceb941d5d4] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:50:24.662636 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [0fd0ca82-7e3b-4d62-a84a-caceb941d5d4] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59400. Oct 03 15:50:24.666813 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ccf32470-52a5-4bfb-b6f2-3c1921afbef9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.785719 Oct 03 15:50:24.673853 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3752/7674] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:50:22 2022] POST /compute/v2.1/servers => generated 403 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:50:24.677090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:24.681914 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9b20f43-b227-49cf-9c9a-a1c3ca1c1ae1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:24.682560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9b20f43-b227-49cf-9c9a-a1c3ca1c1ae1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:24.749818 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9b20f43-b227-49cf-9c9a-a1c3ca1c1ae1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:24.758418 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9b20f43-b227-49cf-9c9a-a1c3ca1c1ae1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1266 microversion: 2.1 time: 0.083143 Oct 03 15:50:24.759006 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3923/7675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:24 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:25.783823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:25.786375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:25.794855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:25.795762 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:25.796470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:25.797464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:25.798186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:25.798707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:25.907889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:25.923580 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-da2a23c8-fbd7-442f-8569-d3306ce83d2e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1326 microversion: 2.1 time: 0.144509 Oct 03 15:50:25.924301 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3753/7676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:25 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:26.948105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:26.948669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:26.955577 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:26.956094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:26.956903 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:26.957660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:26.958130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:26.958574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:27.104499 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:27.112747 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-aafbafc2-57f2-423d-9c5d-8f001d6a22a4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.169081 Oct 03 15:50:27.113492 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3924/7677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:26 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:27.319186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-aa027aea-6963-41a3-8604-4ca0dcdc084e req-ed932e5b-ef2b-4b23-813a-e13cf11fc57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:50:27.328919 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa027aea-6963-41a3-8604-4ca0dcdc084e req-ed932e5b-ef2b-4b23-813a-e13cf11fc57c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:27.329447 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa027aea-6963-41a3-8604-4ca0dcdc084e req-ed932e5b-ef2b-4b23-813a-e13cf11fc57c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:27.329856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aa027aea-6963-41a3-8604-4ca0dcdc084e req-ed932e5b-ef2b-4b23-813a-e13cf11fc57c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:27.341701 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-aa027aea-6963-41a3-8604-4ca0dcdc084e req-ed932e5b-ef2b-4b23-813a-e13cf11fc57c service nova] Creating event network-changed:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h2-781139-2 Oct 03 15:50:27.346737 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-aa027aea-6963-41a3-8604-4ca0dcdc084e req-ed932e5b-ef2b-4b23-813a-e13cf11fc57c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093363 Oct 03 15:50:27.347360 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3754/7678] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:50:28.140526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:28.141613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:28.153335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:28.154169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:28.154918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:28.156102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:28.156565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:28.157054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:28.292960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:28.301369 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4be74ed-18b6-4b1e-8dc5-434339ee0e84 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.167492 Oct 03 15:50:28.301943 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3925/7679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:28 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:29.330331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:29.331060 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:29.338316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:29.338830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:29.339277 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:29.339985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:29.340479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:29.340893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:29.481676 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:29.490003 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-98404482-5b60-4f41-956e-699ca714d64b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.165132 Oct 03 15:50:29.490590 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3755/7680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:29 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:30.514625 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:30.515674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:30.524110 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:30.524669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:30.525225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:30.526014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:30.526541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:30.527026 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:30.663108 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:30.670985 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1edfba94-64c5-4a1f-8881-3f8dc05f9a50 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.160983 Oct 03 15:50:30.671556 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3926/7681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:30 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:31.698878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:31.699895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:31.708863 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:31.709363 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:31.709796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:31.710486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:31.710933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:31.711351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:31.854614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:31.863251 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-881ecafd-3cd2-4f13-8ad0-ad6f08945fbe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.170993 Oct 03 15:50:31.863913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3756/7682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:31 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:32.887687 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:32.888483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:32.896680 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:32.897244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:32.897719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:32.898476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:32.898962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:32.899418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:33.037080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:33.045775 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b4e50f9-698a-49d3-8480-78a2ccbb824f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.162858 Oct 03 15:50:33.046366 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3927/7683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:32 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:34.072285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:34.072907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:34.075849 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:34.076542 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:34.083632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:34.084134 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:34.084578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:34.085321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:34.085795 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:34.086223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:34.194918 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a823d482-c2b0-4c36-b700-ef8a6713869f req-13bd8ea4-2ffb-470f-8dfc-e9cf98c7dda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "name": "network-vif-plugged", "status": "completed", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:50:34.205207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a823d482-c2b0-4c36-b700-ef8a6713869f req-13bd8ea4-2ffb-470f-8dfc-e9cf98c7dda3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:34.205845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a823d482-c2b0-4c36-b700-ef8a6713869f req-13bd8ea4-2ffb-470f-8dfc-e9cf98c7dda3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:34.207005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a823d482-c2b0-4c36-b700-ef8a6713869f req-13bd8ea4-2ffb-470f-8dfc-e9cf98c7dda3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:34.219430 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a823d482-c2b0-4c36-b700-ef8a6713869f req-13bd8ea4-2ffb-470f-8dfc-e9cf98c7dda3 service nova] Creating event network-vif-plugged:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h2-781139-2 Oct 03 15:50:34.227231 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a823d482-c2b0-4c36-b700-ef8a6713869f req-13bd8ea4-2ffb-470f-8dfc-e9cf98c7dda3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114450 Oct 03 15:50:34.228636 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3928/7684] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:50:34.272560 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:34.281703 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d3b3abe-93ef-4e1a-8a42-afeedf4bd37e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.213382 Oct 03 15:50:34.282632 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3757/7685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:34 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:35.305287 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:35.314675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:35.315860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:35.328427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:35.329361 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:35.330131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:35.331333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:35.332121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:35.335935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:35.482457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:35.490750 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4ce054ac-13c0-49e1-94bc-78e9bce2e20f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1389 microversion: 2.1 time: 0.187417 Oct 03 15:50:35.491297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3929/7686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:35 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1389 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:36.517701 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:36.518731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:36.530706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:36.531523 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:36.532272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:36.533484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:36.534262 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:36.534985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:36.675457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:36.684340 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2f4b55c0-361c-44e6-8923-9c92a38854dd tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1561 microversion: 2.1 time: 0.173378 Oct 03 15:50:36.684946 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3758/7687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:36 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:36.707200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:36.708578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:36.715737 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:36.716241 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:36.716694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:36.717449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:36.717919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:36.718365 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:36.866258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:36.874561 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-3d2685f6-13b2-423d-a650-7168d35c2bad tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1561 microversion: 2.1 time: 0.171414 Oct 03 15:50:36.875180 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3930/7688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:36 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:38.557489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:50:38.558133 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:50:38.561277 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-3f38717b-0332-49a7-b389-066841104a9e req-bb167524-21ca-4780-9440-15939866307a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:50:38.565331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:38.565823 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:38.566266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:38.567278 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:38.567738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:38.568174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:38.575234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3f38717b-0332-49a7-b389-066841104a9e req-bb167524-21ca-4780-9440-15939866307a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:50:38.576058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3f38717b-0332-49a7-b389-066841104a9e req-bb167524-21ca-4780-9440-15939866307a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:50:38.576711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-3f38717b-0332-49a7-b389-066841104a9e req-bb167524-21ca-4780-9440-15939866307a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:50:38.590658 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-3f38717b-0332-49a7-b389-066841104a9e req-bb167524-21ca-4780-9440-15939866307a service nova] Creating event network-changed:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h2-781139-2 Oct 03 15:50:38.597812 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-3f38717b-0332-49a7-b389-066841104a9e req-bb167524-21ca-4780-9440-15939866307a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041402 Oct 03 15:50:38.599362 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3931/7689] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:50:38.794257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:50:38.802930 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5c338e92-6325-4809-ac64-cf33f9f20f13 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1561 microversion: 2.1 time: 0.249755 Oct 03 15:50:38.803519 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3759/7690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:50:38 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1561 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:00.094543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:00.096894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:00.101089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:00.101747 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=40 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:00.105722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:00.106274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:00.106708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:00.107462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:00.107917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:00.108350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:00.165717 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a65ade70-3c9f-4eeb-9ce9-dcdb132fe5c6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action" status: 200 len: 24568 microversion: 2.1 time: 0.075365 Oct 03 15:51:00.166368 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3932/7691] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:51:00 2022] POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:51:06.491161 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:06.495129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:06.499354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:06.500036 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=40 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:06.506638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:06.507191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:06.507636 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:06.508332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:06.508792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:06.509241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:06.552194 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:06.561275 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Old instance type m1.heat2, new instance type m1.heat {{(pid=128868) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 03 15:51:06.568174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:51:06.568602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:51:06.569129 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:51:06.569538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:51:06.569953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:51:06.644654 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e48e4c73-9a5f-42ae-b455-23a71fad3b86 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.160408 Oct 03 15:51:06.645344 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3760/7692] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:51:06 2022] POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:51:06.654270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:06.655121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:06.662631 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:06.663114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:06.663570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:06.664305 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:06.664766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:06.665222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:06.803768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:06.812274 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4aeba37-f28c-440d-a9cc-212bbf682061 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1689 microversion: 2.1 time: 0.162145 Oct 03 15:51:06.812802 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3933/7693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:06 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:07.838357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:07.838990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:07.846326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:07.846828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:07.847276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:07.847985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:07.848445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:07.848873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:08.281834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:08.290056 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d464e14b-c69f-4e5a-b8b0-a68844e593b5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1689 microversion: 2.1 time: 0.457528 Oct 03 15:51:08.290641 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3761/7694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:07 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1689 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:51:09.318910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:09.319971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:09.331129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:09.331639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:09.332102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:09.332833 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:09.333340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:09.333792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:09.476983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:09.489470 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5e294b5c-fdb7-4638-b97a-e738229063e5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.177923 Oct 03 15:51:09.490258 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3934/7695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:09 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:10.517350 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:10.518388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:10.525855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:10.526341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:10.526782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:10.527482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:10.527939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:10.528368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:10.671423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:10.679728 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f63d5afb-0638-4cdb-a832-65533a36cfdf tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.169133 Oct 03 15:51:10.680391 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3762/7696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:10 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:11.708077 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:11.709153 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:11.721332 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:11.721836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:11.722284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:11.723018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:11.723462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:11.723895 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:11.873357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:11.882041 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73905169-6557-4f35-8b01-86956a0f2d01 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.180736 Oct 03 15:51:11.882635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3935/7697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:11 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:12.910046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:12.910838 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:12.920563 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:12.921298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:12.921927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:12.922931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:12.923573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:12.924180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:13.075162 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:13.084824 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-24f9af09-9a47-4fae-9146-03681fc85c9f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.181141 Oct 03 15:51:13.085438 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3763/7698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:12 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:14.122129 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:14.123320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:14.132694 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:14.133234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:14.133704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:14.134406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:14.134863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:14.135315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:14.276656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:14.284945 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9c9edea1-c458-432d-8078-cb3799e09533 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.169644 Oct 03 15:51:14.285530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3936/7699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:14 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:15.318939 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:15.319586 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:15.326979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:15.327478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:15.327927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:15.328629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:15.329127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:15.329562 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:15.472815 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:15.481829 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-76a5d2a4-158e-418c-944d-832812f3fbfa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.170289 Oct 03 15:51:15.482392 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3764/7700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:15 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:16.510769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:16.511873 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:16.522900 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:16.523405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:16.523888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:16.524611 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:16.525113 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:16.525558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:16.671866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:16.681914 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-45ab6f6f-9c31-4766-a7d0-0dbf2c52a49c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.178129 Oct 03 15:51:16.682505 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3937/7701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:16 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:17.705532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:17.706173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:17.714598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:17.715088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:17.715557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:17.716254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:17.716702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:17.717164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:17.861691 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:17.873363 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e82c9490-35bc-4ae4-9fe4-45935a3969e1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.171799 Oct 03 15:51:17.874166 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3765/7702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:17 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:18.901334 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:18.901970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:18.909245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:18.909746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:18.910207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:18.910916 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:18.911382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:18.911821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:19.051728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:19.060532 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17ecd001-b9ba-4255-bf63-edbdacc56ff3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.163947 Oct 03 15:51:19.061146 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3938/7703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:18 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:20.089992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:20.091012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:20.102307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:20.102774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:20.103216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:20.103920 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:20.104375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:20.104801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:20.251163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:20.263221 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-21eef76a-4daf-4cb6-8ef1-7ecbfbaba2d9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1694 microversion: 2.1 time: 0.180044 Oct 03 15:51:20.264022 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3766/7704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:20 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:21.244800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-8da8c4b6-9eed-4af7-9cdb-6202fbb12513 req-4c845d2b-28b8-49b1-9ddb-84aaf9fd09da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "name": "network-vif-unplugged", "status": "completed", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:21.255587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8da8c4b6-9eed-4af7-9cdb-6202fbb12513 req-4c845d2b-28b8-49b1-9ddb-84aaf9fd09da service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:21.256220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8da8c4b6-9eed-4af7-9cdb-6202fbb12513 req-4c845d2b-28b8-49b1-9ddb-84aaf9fd09da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:21.256532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-8da8c4b6-9eed-4af7-9cdb-6202fbb12513 req-4c845d2b-28b8-49b1-9ddb-84aaf9fd09da service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:21.274591 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-8da8c4b6-9eed-4af7-9cdb-6202fbb12513 req-4c845d2b-28b8-49b1-9ddb-84aaf9fd09da service nova] Creating event network-vif-unplugged:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h1-781139-2 Oct 03 15:51:21.281847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [req-8da8c4b6-9eed-4af7-9cdb-6202fbb12513 req-4c845d2b-28b8-49b1-9ddb-84aaf9fd09da service nova] Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128869) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:51:21.289647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:21.290255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:21.297828 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-8da8c4b6-9eed-4af7-9cdb-6202fbb12513 req-4c845d2b-28b8-49b1-9ddb-84aaf9fd09da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057575 Oct 03 15:51:21.298804 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3939/7705] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:51:21.298931 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:21.299368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:21.299798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:21.300493 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:21.301159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:21.301582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:21.443289 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:21.451452 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-776418d3-cedf-4e8e-8e42-5ddd78d4ee25 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1693 microversion: 2.1 time: 0.166306 Oct 03 15:51:21.452108 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3767/7706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:21 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:22.477708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:22.478391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:22.485275 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:22.485765 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:22.486219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:22.486932 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:22.487422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:22.487853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:22.674621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:22.682945 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-847a0a78-ccda-44a9-b7bf-8d80856b0510 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1693 microversion: 2.1 time: 0.210723 Oct 03 15:51:22.683656 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3940/7707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:22 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:23.340095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7e9f0855-f345-4267-b162-5731c834de5a req-2f9c4dbd-e04c-4f61-af00-827ec571918c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:23.350475 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e9f0855-f345-4267-b162-5731c834de5a req-2f9c4dbd-e04c-4f61-af00-827ec571918c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:23.350945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e9f0855-f345-4267-b162-5731c834de5a req-2f9c4dbd-e04c-4f61-af00-827ec571918c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:23.351371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7e9f0855-f345-4267-b162-5731c834de5a req-2f9c4dbd-e04c-4f61-af00-827ec571918c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:23.366461 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7e9f0855-f345-4267-b162-5731c834de5a req-2f9c4dbd-e04c-4f61-af00-827ec571918c service nova] Creating event network-changed:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h1-781139-2 Oct 03 15:51:23.372127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [req-7e9f0855-f345-4267-b162-5731c834de5a req-2f9c4dbd-e04c-4f61-af00-827ec571918c service nova] Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-781139-2', 'n-h1-781139-2'} {{(pid=128868) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 03 15:51:23.383485 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7e9f0855-f345-4267-b162-5731c834de5a req-2f9c4dbd-e04c-4f61-af00-827ec571918c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047700 Oct 03 15:51:23.384081 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3768/7708] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:51:23.707447 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:23.708182 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:23.715827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:23.716340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:23.716779 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:23.717582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:23.718068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:23.718563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:23.853753 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:23.861947 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-edea33b2-af7c-4ef8-8e30-7586cef0ad60 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1691 microversion: 2.1 time: 0.158701 Oct 03 15:51:23.862542 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3941/7709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:23 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:24.892293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:24.893467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:24.902038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:24.902519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:24.902955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:24.903641 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:24.904089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:24.904514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:25.057107 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:25.070050 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6013bde1-e93d-47ab-b0f1-5c9f7d8c13c2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1691 microversion: 2.1 time: 0.185894 Oct 03 15:51:25.070669 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3769/7710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:24 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:26.098452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:26.099536 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:26.107848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.108345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.108796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.109547 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.110017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.110451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.254847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:26.267373 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-46694cfe-587c-4cef-ad3b-65f237cb1c4e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1688 microversion: 2.1 time: 0.175213 Oct 03 15:51:26.268064 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3942/7711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:26 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:26.295245 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:26.295832 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:26.305948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.306436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.306884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.307589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.308051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.308504 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.383519 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2fac494e-781a-4368-b53e-9aba856691bb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action" status: 204 len: 0 microversion: 2.1 time: 0.094933 Oct 03 15:51:26.384142 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3770/7712] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:51:26 2022] POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:26.392627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:26.393281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:26.399685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.400485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.400953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.401858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.402401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.402742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.545160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:26.553556 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e8e6463c-c263-427d-9197-2bc12543ba61 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1688 microversion: 2.1 time: 0.164963 Oct 03 15:51:26.554175 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3943/7713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:26 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:26.578470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:26.579186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:26.585867 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.586355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.586812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.587510 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:26.587962 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:26.588380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:26.810154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:26.818662 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b81cab9b-29ca-4b0e-bbbd-940cce1a9df9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1688 microversion: 2.1 time: 0.245824 Oct 03 15:51:26.819260 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3771/7714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:26 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1688 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:27.843003 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:51:27.843607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:27.850927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:27.851495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:27.851936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:27.852792 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:27.853309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:27.853751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:27.995131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:51:28.003605 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-95148c1b-66a3-49fa-b186-2521517fd2ba tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1680 microversion: 2.1 time: 0.165005 Oct 03 15:51:28.004174 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3944/7715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:51:27 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:29.171180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-7ff7f0c8-af90-4b60-aaf8-972eb5abc2a1 req-ceccaec7-c003-4866-9a6e-9f90d40b70f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "name": "network-vif-plugged", "status": "completed", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:29.184768 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7ff7f0c8-af90-4b60-aaf8-972eb5abc2a1 req-ceccaec7-c003-4866-9a6e-9f90d40b70f2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:29.185667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7ff7f0c8-af90-4b60-aaf8-972eb5abc2a1 req-ceccaec7-c003-4866-9a6e-9f90d40b70f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:29.186108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-7ff7f0c8-af90-4b60-aaf8-972eb5abc2a1 req-ceccaec7-c003-4866-9a6e-9f90d40b70f2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:29.198195 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-7ff7f0c8-af90-4b60-aaf8-972eb5abc2a1 req-ceccaec7-c003-4866-9a6e-9f90d40b70f2 service nova] Creating event network-vif-plugged:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h1-781139-2 Oct 03 15:51:29.204175 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-7ff7f0c8-af90-4b60-aaf8-972eb5abc2a1 req-ceccaec7-c003-4866-9a6e-9f90d40b70f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036227 Oct 03 15:51:29.204735 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3772/7716] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:51:58.286879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=26 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.287560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=74 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.384917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:51:58.387348 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:51:58.393655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:58.394159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:58.394615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:58.395335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:51:58.395800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:51:58.396266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:51:58.466185 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-62f58e94-5e8a-43e2-890d-05f3d43d4c30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action" status: 200 len: 24573 microversion: 2.1 time: 0.184589 Oct 03 15:51:58.466817 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3945/7717] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:51:58 2022] POST /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9/action => generated 24573 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:15.750085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:15.751203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-9dd50870-8cde-437a-a647-7731ef4314ba req-e1928add-39b4-46d0-bf66-db18f6184308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:15.751868 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:15.754570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=30 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.755187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.757678 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.758409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.762802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:15.764200 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:15.764675 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:15.765446 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:15.765578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9dd50870-8cde-437a-a647-7731ef4314ba req-e1928add-39b4-46d0-bf66-db18f6184308 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:15.766043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9dd50870-8cde-437a-a647-7731ef4314ba req-e1928add-39b4-46d0-bf66-db18f6184308 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:15.766485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:15.766603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-9dd50870-8cde-437a-a647-7731ef4314ba req-e1928add-39b4-46d0-bf66-db18f6184308 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:15.767237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:15.779874 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-9dd50870-8cde-437a-a647-7731ef4314ba req-e1928add-39b4-46d0-bf66-db18f6184308 service nova] Creating event network-changed:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h1-781139-2 Oct 03 15:52:15.785425 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-9dd50870-8cde-437a-a647-7731ef4314ba req-e1928add-39b4-46d0-bf66-db18f6184308 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Oct 03 15:52:15.786057 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3946/7718] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:15.795743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:52:15.882581 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-32356075-14d5-4829-a2ce-9d3836324a18 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 204 len: 0 microversion: 2.1 time: 0.136027 Oct 03 15:52:15.884072 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3773/7719] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:52:15 2022] DELETE /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:52:15.894169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:15.894896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:15.901778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:15.902284 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:15.902740 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:15.903470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:15.904194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:15.904657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:16.128636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:16.137321 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-683e4a98-cea2-4bb8-b657-8bcbf829bc27 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1686 microversion: 2.1 time: 0.248852 Oct 03 15:52:16.138104 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3947/7720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:15 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1686 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:17.161524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:17.162353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:17.169848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:17.170342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:17.170781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:17.171489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:17.171932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:17.172359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:17.358592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:17.366612 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00666ea4-5450-41fa-8377-bfe9f829e424 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1686 microversion: 2.1 time: 0.209529 Oct 03 15:52:17.367314 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3774/7721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:17 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1686 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:17.938526 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-4597fff5-a32d-4f17-9093-7d278cf5ab95 req-a8e6a0e4-d0d1-4ee3-9120-c6d776173351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f6a208-85f1-4403-bf44-561cecbb2ff9", "name": "network-vif-deleted", "tag": "3c418e13-afd7-495d-9fd6-874c1c709ac6"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:17.950696 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4597fff5-a32d-4f17-9093-7d278cf5ab95 req-a8e6a0e4-d0d1-4ee3-9120-c6d776173351 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:17.951196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4597fff5-a32d-4f17-9093-7d278cf5ab95 req-a8e6a0e4-d0d1-4ee3-9120-c6d776173351 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:17.951628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-4597fff5-a32d-4f17-9093-7d278cf5ab95 req-a8e6a0e4-d0d1-4ee3-9120-c6d776173351 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:17.964752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-4597fff5-a32d-4f17-9093-7d278cf5ab95 req-a8e6a0e4-d0d1-4ee3-9120-c6d776173351 service nova] Creating event network-vif-deleted:3c418e13-afd7-495d-9fd6-874c1c709ac6 for instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 on n-h1-781139-2 Oct 03 15:52:17.970483 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-4597fff5-a32d-4f17-9093-7d278cf5ab95 req-a8e6a0e4-d0d1-4ee3-9120-c6d776173351 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035648 Oct 03 15:52:17.971164 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3948/7722] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:18.390955 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:18.391638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:18.398957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:18.399524 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:18.400033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:18.400842 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:18.401331 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:18.401757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:18.438505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:18.438985 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:18.439415 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:18.439872 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lazy-loading 'fault' on Instance uuid 93f6a208-85f1-4403-bf44-561cecbb2ff9 {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:52:18.489555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:18.498366 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1152a751-6216-4738-811f-9da8d6c3d75e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 200 len: 1356 microversion: 2.1 time: 0.111451 Oct 03 15:52:18.498936 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3775/7723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:18 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:19.527838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:19.528556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 93f6a208-85f1-4403-bf44-561cecbb2ff9] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:19.536433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:19.536954 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:19.537417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:19.538130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:19.538601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:19.539041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:19.553457 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] HTTP exception thrown: Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 could not be found. Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Request method failure captured: Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 HTTP/1.1 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwPcC34rhG4ymjBIvYFpGalY0FgaLBJaryyoprD84IXJNSLJQa3ziIaaKtxnO5sDwo0zEa5_D-jy71pYjPj945-iOkP1rZ9ygeS2tUbp3CNyNUj5hmskpnhHi3A1nrl5fTtr6e9KF9sHf1bgiHurW7Xz9xieYIaRPglfXR0fl3_l-q4 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/85448b7772694deebf35d6b222d913be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_85448b7772694deebf35d6b222d913be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: b66e9adacee94b27b9af39b9467efcb7 Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 could not be found. Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '93f6a208-85f1-4403-bf44-561cecbb2ff9'} Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 could not be found. Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 could not be found. Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:52:19.555116 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 could not be found. Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Returning 404 to user: Instance 93f6a208-85f1-4403-bf44-561cecbb2ff9 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1494fdc9-6a97-42f4-9452-6b2686b24a87 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9" status: 404 len: 111 microversion: 2.1 time: 0.035048 Oct 03 15:52:19.560752 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3949/7724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:19 2022] GET /compute/v2.1/servers/93f6a208-85f1-4403-bf44-561cecbb2ff9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:52:23.062518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-89e73161-e3dd-4378-bc57-d21a56467869 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '.version_select at 0x7fb2302d50d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:23.090435 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-89e73161-e3dd-4378-bc57-d21a56467869 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2142778848" status: 202 len: 0 microversion: 2.1 time: 0.032203 Oct 03 15:52:23.091537 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3776/7725] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Oct 3 15:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2142778848 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:52:23.115995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-32a374e8-6e0e-4df6-9dd6-d60c4377d598 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: .version_select at 0x7fb230de4310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-12047537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGh03aE7l6KOmcM1NjSzcBa6V7s4BOnwQJ2sLJxy7gfZqH/ksB2Ky8k97wB0SKAgPsF7lsPpEkqrtp2uHxAkP2uGWT+ry76b4oedR8l72smdRMrae5NV+rplc9OkLpp4Q=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:23.135345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-32a374e8-6e0e-4df6-9dd6-d60c4377d598 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:52:23.140881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-32a374e8-6e0e-4df6-9dd6-d60c4377d598 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:52:23.168216 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-32a374e8-6e0e-4df6-9dd6-d60c4377d598 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055555 Oct 03 15:52:23.168872 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3950/7726] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:52:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:52:28.795577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-557113792", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "197ce038-4a58-4736-b7e9-a3d993a209cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-12047537", "security_groups": [{"name": "tempest-secgroup-smoke-2017744952"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:28.818064 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:28.921170 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] validate_networks() for [('197ce038-4a58-4736-b7e9-a3d993a209cd', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:52:29.326445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:52:29.326901 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:52:29.327378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:52:29.327788 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:52:29.328198 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:52:29.337959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:29.338557 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:29.339095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:29.340738 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:29.341375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:29.341820 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:29.360490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:52:29.366080 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:52:29.379998 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:52:29.382391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:52:29.431372 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-78429251-f4e3-4866-ad34-31adc089ac78 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639916 Oct 03 15:52:29.431953 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3777/7727] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:52:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:52:29.444609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06ef5505-46b8-41b5-84d7-d5da8faeb5fe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:29.445403 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-06ef5505-46b8-41b5-84d7-d5da8faeb5fe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:29.514136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-06ef5505-46b8-41b5-84d7-d5da8faeb5fe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:29.521963 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06ef5505-46b8-41b5-84d7-d5da8faeb5fe tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1264 microversion: 2.1 time: 0.082274 Oct 03 15:52:29.522536 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3951/7728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:29 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1264 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:30.547341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:30.548656 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:30.555501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:30.556312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:30.557135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:30.558021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:30.558677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:30.559710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:30.646190 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:30.656800 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f3776a98-b8fb-4078-ae92-85dec227b260 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1324 microversion: 2.1 time: 0.115047 Oct 03 15:52:30.658016 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3778/7729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:30 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1324 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:31.682143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:31.683402 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:31.686828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:31.697987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:31.698502 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:31.698965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:31.700071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:31.700545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:31.703049 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:31.873652 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:31.883331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-13b3923e-1208-43f8-a8bf-e48350c63d5a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1390 microversion: 2.1 time: 0.205583 Oct 03 15:52:31.899816 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3952/7730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:31 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1390 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:32.101915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-9c17e26b-337f-4322-a353-52b808156078 req-4ee03ba6-d5d1-4e47-ac33-d34abd23898a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ecee5-54c5-4684-ad4a-de35a02fd435", "tag": "6f50443e-7775-46ff-ae5a-a170c6f9d7d8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:32.113357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9c17e26b-337f-4322-a353-52b808156078 req-4ee03ba6-d5d1-4e47-ac33-d34abd23898a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:32.113991 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9c17e26b-337f-4322-a353-52b808156078 req-4ee03ba6-d5d1-4e47-ac33-d34abd23898a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:32.114426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9c17e26b-337f-4322-a353-52b808156078 req-4ee03ba6-d5d1-4e47-ac33-d34abd23898a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:32.126189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-9c17e26b-337f-4322-a353-52b808156078 req-4ee03ba6-d5d1-4e47-ac33-d34abd23898a service nova] Creating event network-changed:6f50443e-7775-46ff-ae5a-a170c6f9d7d8 for instance 117ecee5-54c5-4684-ad4a-de35a02fd435 on n-h2-781139-2 Oct 03 15:52:32.131214 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-9c17e26b-337f-4322-a353-52b808156078 req-4ee03ba6-d5d1-4e47-ac33-d34abd23898a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033536 Oct 03 15:52:32.131831 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3779/7731] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:32.915010 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:32.916013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:32.924261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:32.924770 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:32.925257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:32.925976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:32.926455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:32.926869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:33.069289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:33.081170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-49a09768-5a91-47cd-8e25-c57388fb6818 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1390 microversion: 2.1 time: 0.172479 Oct 03 15:52:33.082067 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3953/7732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:32 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:34.107291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:34.107843 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:34.114784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:34.115273 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:34.115720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:34.116512 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:34.116958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:34.117430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:34.258057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:34.266258 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7a0758f9-1e81-4b95-8925-7a3e1559112c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1390 microversion: 2.1 time: 0.164742 Oct 03 15:52:34.266857 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3780/7733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:34 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:35.290519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:35.291234 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:35.297920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:35.298421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:35.298872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:35.299585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:35.300073 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:35.300509 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:35.436634 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:35.444570 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-33df14fd-d8b9-4acb-a5f3-1327b89e1855 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1390 microversion: 2.1 time: 0.158402 Oct 03 15:52:35.445159 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3954/7734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:35 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:36.472558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:36.473537 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:36.484307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:36.484791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:36.485255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:36.485959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:36.486408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:36.486828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:36.631282 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:36.639401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f6fa7f91-2c67-46ad-92bf-2e683b063984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1390 microversion: 2.1 time: 0.173810 Oct 03 15:52:36.640225 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3781/7735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:36 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:37.666879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:37.667927 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:37.679964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:37.680794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:37.681592 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:37.682773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:37.683556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:37.684283 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:37.841661 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:37.852475 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dbedc2a2-5485-4d9a-9aa2-55dc00e80857 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1390 microversion: 2.1 time: 0.192001 Oct 03 15:52:37.853297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3955/7736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:37 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1390 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:38.757889 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-173874fb-feb6-4485-a436-e0aaa4f35254 req-b7adf877-e23e-4f17-99af-a7e82534f249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117ecee5-54c5-4684-ad4a-de35a02fd435", "name": "network-vif-plugged", "status": "completed", "tag": "6f50443e-7775-46ff-ae5a-a170c6f9d7d8"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:38.771191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-173874fb-feb6-4485-a436-e0aaa4f35254 req-b7adf877-e23e-4f17-99af-a7e82534f249 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:38.771681 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-173874fb-feb6-4485-a436-e0aaa4f35254 req-b7adf877-e23e-4f17-99af-a7e82534f249 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:38.772081 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-173874fb-feb6-4485-a436-e0aaa4f35254 req-b7adf877-e23e-4f17-99af-a7e82534f249 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:38.783460 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-173874fb-feb6-4485-a436-e0aaa4f35254 req-b7adf877-e23e-4f17-99af-a7e82534f249 service nova] Creating event network-vif-plugged:6f50443e-7775-46ff-ae5a-a170c6f9d7d8 for instance 117ecee5-54c5-4684-ad4a-de35a02fd435 on n-h2-781139-2 Oct 03 15:52:38.788669 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-173874fb-feb6-4485-a436-e0aaa4f35254 req-b7adf877-e23e-4f17-99af-a7e82534f249 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034714 Oct 03 15:52:38.789491 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3782/7737] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:38.876288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:38.877130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:38.884194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:38.884778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:38.885351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:38.886135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:38.886692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:38.887228 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:39.025209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:39.033574 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d9b47f1c-588e-4ce4-8ed7-97a10370778c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1390 microversion: 2.1 time: 0.161458 Oct 03 15:52:39.034207 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3956/7738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:38 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:40.063401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:40.064759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:40.067913 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:40.069292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:40.079210 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:40.079688 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:40.080123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:40.080814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:40.081293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:40.081720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:40.237778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:40.245966 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-552b0c0f-faca-4e62-9ecc-56d3e85d3f11 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1563 microversion: 2.1 time: 0.190210 Oct 03 15:52:40.246531 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3783/7739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:40 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1563 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:40.272550 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:40.273214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:40.275195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:40.282196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:40.282698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:40.283151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:40.283872 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:40.284345 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:40.284787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:40.428465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:40.438899 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f210f88-44bf-473c-81c1-835ec0ce3907 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1563 microversion: 2.1 time: 0.170309 Oct 03 15:52:40.439473 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3957/7740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:40 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:52:42.364522 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:52:42.365325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:52:42.366901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6be8fa8d-1fa3-46e0-88ec-a037001cbd40 req-9bda5ae9-0862-4be3-a6dd-6abd3c1b3b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ecee5-54c5-4684-ad4a-de35a02fd435", "tag": "6f50443e-7775-46ff-ae5a-a170c6f9d7d8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:52:42.372712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:42.373269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:42.373715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:42.374417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:42.374923 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:42.375583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:42.379115 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6be8fa8d-1fa3-46e0-88ec-a037001cbd40 req-9bda5ae9-0862-4be3-a6dd-6abd3c1b3b33 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:52:42.379805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6be8fa8d-1fa3-46e0-88ec-a037001cbd40 req-9bda5ae9-0862-4be3-a6dd-6abd3c1b3b33 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:52:42.380453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6be8fa8d-1fa3-46e0-88ec-a037001cbd40 req-9bda5ae9-0862-4be3-a6dd-6abd3c1b3b33 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:52:42.392684 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6be8fa8d-1fa3-46e0-88ec-a037001cbd40 req-9bda5ae9-0862-4be3-a6dd-6abd3c1b3b33 service nova] Creating event network-changed:6f50443e-7775-46ff-ae5a-a170c6f9d7d8 for instance 117ecee5-54c5-4684-ad4a-de35a02fd435 on n-h2-781139-2 Oct 03 15:52:42.397884 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6be8fa8d-1fa3-46e0-88ec-a037001cbd40 req-9bda5ae9-0862-4be3-a6dd-6abd3c1b3b33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034974 Oct 03 15:52:42.398472 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3958/7741] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:52:42.599786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:52:42.609071 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1b074744-1fb4-4804-8ed5-334a20bea450 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1563 microversion: 2.1 time: 0.248910 Oct 03 15:52:42.609994 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3784/7742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:52:42 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:03.925545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:03.926254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=38 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:03.930492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:53:03.932853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:03.940845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:03.941367 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:03.941824 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:03.942539 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:03.943011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:03.943561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:04.010856 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-29250412-2aa9-460b-a628-ea3271b54302 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action" status: 200 len: 24568 microversion: 2.1 time: 0.086828 Oct 03 15:53:04.011774 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3959/7743] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:53:03 2022] POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action => generated 24568 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:53:15.082298 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ec9151c-6a55-4cd9-a5c7-5f294061487a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:53:15.085388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:15.086061 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=36 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:15.093095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ec9151c-6a55-4cd9-a5c7-5f294061487a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:15.093592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ec9151c-6a55-4cd9-a5c7-5f294061487a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:15.094068 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2ec9151c-6a55-4cd9-a5c7-5f294061487a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:15.119002 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ec9151c-6a55-4cd9-a5c7-5f294061487a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Going to try to stop instance {{(pid=128868) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 15:53:15.164002 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ec9151c-6a55-4cd9-a5c7-5f294061487a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action" status: 202 len: 0 microversion: 2.1 time: 0.086217 Oct 03 15:53:15.164640 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3785/7744] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:53:15 2022] POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:53:15.175102 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:15.175936 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:15.179100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:15.179862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:15.186841 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:15.187353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:15.187876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:15.189186 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:15.189672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:15.190125 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:15.331642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:15.339961 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b041131d-0d3e-4bb7-ad46-afdc96057c2d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.170278 Oct 03 15:53:15.340548 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3960/7745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:15 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:16.371726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:16.372893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:16.381062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:16.381552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:16.381992 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:16.382693 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:16.383152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:16.383577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:16.531005 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:16.539414 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-85f0f63f-161a-44fb-91a6-9456ef2a9984 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.176401 Oct 03 15:53:16.540223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3786/7746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:16 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:17.570279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:17.571410 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:17.582656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:17.583165 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:17.583619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:17.584340 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:17.584815 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:17.585289 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:17.738736 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:17.746970 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6e30cf3-75f0-4ea1-9e5e-336ea481f010 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.183333 Oct 03 15:53:17.747579 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3961/7747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:17 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:18.775187 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:18.776244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:18.788445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:18.789327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:18.790066 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:18.791222 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:18.791983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:18.792735 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:18.926321 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:18.934778 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b759cea5-8f6c-419c-9045-124215a920aa tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.166329 Oct 03 15:53:18.935358 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3787/7748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:18 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:19.962787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:19.963662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:19.973295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:19.973827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:19.974282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:19.975000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:19.975831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:19.976266 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:20.114462 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:20.122756 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-17a6f6f0-4ac5-44c1-9513-5ecc145adf34 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.166704 Oct 03 15:53:20.123339 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3962/7749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:19 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:21.151168 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:21.152183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:21.163729 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:21.164519 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:21.165346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:21.166489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:21.167255 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:21.167948 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:21.319303 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:21.327186 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87053434-d885-48af-8939-aa6192ee5cd6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.182708 Oct 03 15:53:21.327775 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3788/7750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:21 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:22.352546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:22.353222 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:22.360868 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:22.361405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:22.361861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:22.362588 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:22.363066 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:22.363507 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:22.499290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:22.511659 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-177b03f8-2c93-4eec-8e7f-acb9af63bd03 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.163384 Oct 03 15:53:22.512457 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3963/7751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:22 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:23.541204 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:23.542176 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:23.551604 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:23.552088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:23.552528 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:23.553254 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:23.553707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:23.554131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:23.690474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:23.698483 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e357513d-2e26-4538-8261-e6c0af0aa44e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.163915 Oct 03 15:53:23.699067 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3789/7752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:23 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:24.722990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:24.723698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:24.735007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:24.736060 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:24.736562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:24.737369 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:24.737879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:24.738286 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:24.895570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:24.908614 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-017c220a-89e3-42ec-8463-b9c67c624540 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.188825 Oct 03 15:53:24.909522 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3964/7753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:24 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:25.942457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:25.943221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:25.952477 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:25.953183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:25.953771 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:25.954787 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:25.955525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:25.956073 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:26.104121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:26.116339 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c83dae3c-7c9d-4ba2-9c87-c44f69cccd35 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.180141 Oct 03 15:53:26.117204 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3790/7754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:25 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:27.145807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:27.147005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:27.158766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:27.159587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:27.160336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:27.161567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:27.162691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:27.163438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:27.310198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:27.318731 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b84e519f-a92c-4c32-9b04-6d10db6fa675 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.179682 Oct 03 15:53:27.319313 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3965/7755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:27 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:28.346267 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:28.346877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:28.354638 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:28.355131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:28.355577 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:28.356274 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:28.356723 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:28.357188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:28.499484 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:28.511876 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-acea0814-25f4-43a5-9a60-d1d5434abd30 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.171938 Oct 03 15:53:28.512808 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3791/7756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:28 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:29.542647 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:29.543704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:29.553176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:29.553686 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:29.554147 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:29.554880 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:29.555359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:29.555811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:29.701262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:29.713741 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f923b36-68d3-433d-88bd-9c99ffbe4cbc tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1692 microversion: 2.1 time: 0.177573 Oct 03 15:53:29.714530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3966/7757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:29 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:30.744452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:30.745520 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:30.757731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:30.758532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:30.759256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:30.760391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:30.761199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:30.761907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:30.898397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:30.910174 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-65375cd5-0d50-4fe7-9ff9-557bb57fca3a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1669 microversion: 2.1 time: 0.172035 Oct 03 15:53:30.910960 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3792/7758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:30 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:32.018433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:53:32.022290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:32.034013 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:32.034513 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:32.034962 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:32.035707 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:32.036171 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:32.036606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:32.092874 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a5ae25d7-faed-4956-88f7-6a927bdebeeb tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action" status: 200 len: 38352 microversion: 2.1 time: 0.081049 Oct 03 15:53:32.093567 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3967/7759] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:53:32 2022] POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action => generated 38352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:53:32.106576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4fd4380f-b370-4149-bf53-c687735994c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:53:32.114148 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd4380f-b370-4149-bf53-c687735994c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:32.114631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd4380f-b370-4149-bf53-c687735994c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:32.115067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4fd4380f-b370-4149-bf53-c687735994c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:32.137602 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4fd4380f-b370-4149-bf53-c687735994c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Going to try to start instance {{(pid=128868) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 15:53:32.188495 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4fd4380f-b370-4149-bf53-c687735994c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action" status: 202 len: 0 microversion: 2.1 time: 0.085684 Oct 03 15:53:32.189148 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3793/7760] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:53:32 2022] POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:53:32.199225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:32.199989 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:32.208858 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:32.209394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:32.209843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:32.210768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:32.211232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:32.211676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:32.358343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:32.366616 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4dc772bd-7030-40f6-95b9-483cb79838d0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1678 microversion: 2.1 time: 0.171755 Oct 03 15:53:32.367209 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3968/7761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:32 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:33.397473 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:53:33.398627 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:33.409164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:33.409687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:33.410125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:33.410828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:33.411284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:33.411711 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:33.552951 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:53:33.561180 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9353945c-cf05-4609-a6e4-87cedee9da90 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1682 microversion: 2.1 time: 0.172555 Oct 03 15:53:33.561743 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3794/7762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:53:33 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:53:57.784727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:53:57.787451 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:53:57.791015 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 15:53:57.791237 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action (ip 10.222.0.20) !!! Oct 03 15:53:57.792569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=18 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:57.793561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=52 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:57.802438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:57.802947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:57.803399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:57.804134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:53:57.804589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:53:57.805072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:53:57.864836 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d6a80b4d-064c-4b14-9491-422438e91c15 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action" status: 200 len: 62918 microversion: 2.1 time: 0.084666 Oct 03 15:53:57.866002 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3969/7763] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:53:57 2022] POST /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435/action => generated 62918 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:54:05.538893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:05.539476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:05.541924 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=20 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:05.547100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:05.555183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:05.556506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:05.557237 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:05.557988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:05.558545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:05.559102 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:05.588757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:54:05.601430 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-7e4fbcab-a9b0-465b-9d1b-303b63d180b2 req-5c5f3846-a072-4e22-9592-18ecb4d87e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "117ecee5-54c5-4684-ad4a-de35a02fd435", "tag": "6f50443e-7775-46ff-ae5a-a170c6f9d7d8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:54:05.615011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7e4fbcab-a9b0-465b-9d1b-303b63d180b2 req-5c5f3846-a072-4e22-9592-18ecb4d87e98 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:05.615496 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7e4fbcab-a9b0-465b-9d1b-303b63d180b2 req-5c5f3846-a072-4e22-9592-18ecb4d87e98 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:05.616082 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-7e4fbcab-a9b0-465b-9d1b-303b63d180b2 req-5c5f3846-a072-4e22-9592-18ecb4d87e98 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:05.629038 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-7e4fbcab-a9b0-465b-9d1b-303b63d180b2 req-5c5f3846-a072-4e22-9592-18ecb4d87e98 service nova] Creating event network-changed:6f50443e-7775-46ff-ae5a-a170c6f9d7d8 for instance 117ecee5-54c5-4684-ad4a-de35a02fd435 on n-h2-781139-2 Oct 03 15:54:05.635305 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-7e4fbcab-a9b0-465b-9d1b-303b63d180b2 req-5c5f3846-a072-4e22-9592-18ecb4d87e98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098225 Oct 03 15:54:05.636530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3970/7764] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:54:05.680878 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8ab8aebd-3ee8-4cd0-b84a-89c4fbd6a14a tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 204 len: 0 microversion: 2.1 time: 0.146072 Oct 03 15:54:05.693024 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3795/7765] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:54:05 2022] DELETE /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:54:05.694051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:05.694972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:05.702503 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:05.703151 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:05.703711 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:05.704604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:05.705236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:05.706717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:05.852442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:05.861675 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7103fc4b-2790-4567-b7cc-5606da585945 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1688 microversion: 2.1 time: 0.173891 Oct 03 15:54:05.862889 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3971/7766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:05 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:06.886934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:06.887639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:06.894970 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:06.895470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:06.895906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:06.896612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:06.897088 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:06.897525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:07.079224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:07.087774 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-014a0800-5771-488b-856d-b495998182c4 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 200 len: 1688 microversion: 2.1 time: 0.205207 Oct 03 15:54:07.088367 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3796/7767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:06 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:54:07.652902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2d00c08e-a9da-4897-b86a-59a1bd246b91 req-9f4399a3-0403-4f15-8564-4b68ee0eed18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "117ecee5-54c5-4684-ad4a-de35a02fd435", "name": "network-vif-deleted", "tag": "6f50443e-7775-46ff-ae5a-a170c6f9d7d8"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:54:07.667268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d00c08e-a9da-4897-b86a-59a1bd246b91 req-9f4399a3-0403-4f15-8564-4b68ee0eed18 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:07.667763 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d00c08e-a9da-4897-b86a-59a1bd246b91 req-9f4399a3-0403-4f15-8564-4b68ee0eed18 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:07.668209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d00c08e-a9da-4897-b86a-59a1bd246b91 req-9f4399a3-0403-4f15-8564-4b68ee0eed18 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:07.680279 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2d00c08e-a9da-4897-b86a-59a1bd246b91 req-9f4399a3-0403-4f15-8564-4b68ee0eed18 service nova] Creating event network-vif-deleted:6f50443e-7775-46ff-ae5a-a170c6f9d7d8 for instance 117ecee5-54c5-4684-ad4a-de35a02fd435 on n-h2-781139-2 Oct 03 15:54:07.685850 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2d00c08e-a9da-4897-b86a-59a1bd246b91 req-9f4399a3-0403-4f15-8564-4b68ee0eed18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037073 Oct 03 15:54:07.686478 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3972/7768] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:54:08.113145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:08.114637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 117ecee5-54c5-4684-ad4a-de35a02fd435] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:08.122825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:08.123312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:08.123780 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:08.124478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:08.124956 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:08.125379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:08.141849 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] HTTP exception thrown: Instance 117ecee5-54c5-4684-ad4a-de35a02fd435 could not be found. Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Request method failure captured: Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 HTTP/1.1 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwPcC34rhG4ymjBIvYFpGalY0FgaLBJaryyoprD84IXJNSLJQa3ziIaaKtxnO5sDwo0zEa5_D-jy71pYjPj945-iOkP1rZ9ygeS2tUbp3CNyNUj5hmskpnhHi3A1nrl5fTtr6e9KF9sHf1bgiHurW7Xz9xieYIaRPglfXR0fl3_l-q4 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/85448b7772694deebf35d6b222d913be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_85448b7772694deebf35d6b222d913be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b66e9adacee94b27b9af39b9467efcb7 Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 117ecee5-54c5-4684-ad4a-de35a02fd435 could not be found. Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '117ecee5-54c5-4684-ad4a-de35a02fd435'} Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 117ecee5-54c5-4684-ad4a-de35a02fd435 could not be found. Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 117ecee5-54c5-4684-ad4a-de35a02fd435 could not be found. Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:54:08.143474 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 117ecee5-54c5-4684-ad4a-de35a02fd435 could not be found. Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Returning 404 to user: Instance 117ecee5-54c5-4684-ad4a-de35a02fd435 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d68aed50-5639-4ef8-ad35-c22b79a6ab45 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435" status: 404 len: 111 microversion: 2.1 time: 0.036480 Oct 03 15:54:08.148550 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3797/7769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:08 2022] GET /compute/v2.1/servers/117ecee5-54c5-4684-ad4a-de35a02fd435 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:54:11.178567 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-47434cee-27eb-4e9e-aa91-bd407da7d58f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '.version_select at 0x7fb234be9f70>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:11.202785 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-47434cee-27eb-4e9e-aa91-bd407da7d58f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-12047537" status: 202 len: 0 microversion: 2.1 time: 0.029813 Oct 03 15:54:11.203727 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3973/7770] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 3 15:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-12047537 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:54:11.236525 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-71217f8a-5f70-408b-a923-817bb42116e6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: .version_select at 0x7fb234addc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1864806840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/VTeUPBbzJ6fiBtnaZFGyxbaikRXwo9kcaNBI2klXUDLtxqbUMBQm0LgxI6Gjw/V7ed8hh3xhx25DUi0XdsoVadK6oiF8Au1VP1bCOO/GQ4x22LBYQJ5ZW24ucBgQ1xw=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:54:11.253995 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-71217f8a-5f70-408b-a923-817bb42116e6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:54:11.260269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-71217f8a-5f70-408b-a923-817bb42116e6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:54:11.284334 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-71217f8a-5f70-408b-a923-817bb42116e6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051893 Oct 03 15:54:11.284909 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3798/7771] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:54:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:54:17.143926 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2084292154", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "networks": [{"uuid": "0a3e1d2d-a229-4e00-9000-cd82865fcae7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1864806840", "security_groups": [{"name": "tempest-secgroup-smoke-1877543963"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:54:17.263626 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] validate_networks() for [('0a3e1d2d-a229-4e00-9000-cd82865fcae7', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:54:17.673206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=14 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:17.763429 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:54:17.763864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:54:17.764357 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:54:17.764781 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:54:17.765237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:54:17.780585 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:17.785700 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:17.786329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:17.787264 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:17.787883 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:17.788422 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:17.822089 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:54:17.829227 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Getting quotas for user b66e9adacee94b27b9af39b9467efcb7 and project 85448b7772694deebf35d6b222d913be. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:54:17.853705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:54:17.856608 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:54:17.922729 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c4ba69f0-9aea-4d40-8a1e-c97c1c778a23 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783686 Oct 03 15:54:17.923605 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3974/7772] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:54:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:54:17.937673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-39618771-d3f2-454f-ab21-b5deb4f8e64d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:17.938319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-39618771-d3f2-454f-ab21-b5deb4f8e64d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:18.038452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-39618771-d3f2-454f-ab21-b5deb4f8e64d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:18.050888 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-39618771-d3f2-454f-ab21-b5deb4f8e64d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1267 microversion: 2.1 time: 0.116581 Oct 03 15:54:18.051543 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3799/7773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:17 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:19.075516 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:19.076373 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:19.084495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:19.084835 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:19.085548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:19.086518 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:19.087191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:19.087870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:19.193939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:19.202333 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-bdb2079a-0ca1-4afa-88b3-798835a019d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1327 microversion: 2.1 time: 0.131955 Oct 03 15:54:19.203184 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3975/7774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:19 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:20.226792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:20.228184 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:20.235385 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:20.238853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:20.239569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:20.240158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:20.241221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:20.241784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:20.242300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:20.470319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:20.478802 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6f3ae965-9f5a-43cd-bca5-0d581ef9d571 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1393 microversion: 2.1 time: 0.256444 Oct 03 15:54:20.479608 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3800/7775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:20 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1393 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:54:20.801545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-0a09160e-c1e8-4d41-882a-334c35c7a4a1 req-9bc202fe-ce05-48b0-adb3-78bb72f1e10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3221ab03-4ad3-4f32-963b-f778608013be", "tag": "61a755c7-b01b-413a-9a41-4320f2cf2efa"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:54:20.815381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0a09160e-c1e8-4d41-882a-334c35c7a4a1 req-9bc202fe-ce05-48b0-adb3-78bb72f1e10c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:20.815893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0a09160e-c1e8-4d41-882a-334c35c7a4a1 req-9bc202fe-ce05-48b0-adb3-78bb72f1e10c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:20.816315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-0a09160e-c1e8-4d41-882a-334c35c7a4a1 req-9bc202fe-ce05-48b0-adb3-78bb72f1e10c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:20.828145 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-0a09160e-c1e8-4d41-882a-334c35c7a4a1 req-9bc202fe-ce05-48b0-adb3-78bb72f1e10c service nova] Creating event network-changed:61a755c7-b01b-413a-9a41-4320f2cf2efa for instance 3221ab03-4ad3-4f32-963b-f778608013be on n-h1-781139-2 Oct 03 15:54:20.835271 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-0a09160e-c1e8-4d41-882a-334c35c7a4a1 req-9bc202fe-ce05-48b0-adb3-78bb72f1e10c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039326 Oct 03 15:54:20.836128 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3976/7776] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:54:21.507229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:21.508076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:21.520189 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:21.521104 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:21.521556 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:21.522330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:21.522793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:21.523225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:21.668570 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:21.676770 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bce34a6b-9bf0-457c-9f9c-826c570062a5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1393 microversion: 2.1 time: 0.176346 Oct 03 15:54:21.677845 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3801/7777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:21 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:22.706493 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:22.708465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:22.721659 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:22.722574 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:22.723551 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:22.725218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:22.725809 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:22.726270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:22.867643 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:22.875928 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-747d5dc0-6f6b-4d9b-9c0b-593912d0d615 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1393 microversion: 2.1 time: 0.177281 Oct 03 15:54:22.876519 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3977/7778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:22 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:23.902182 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:23.902809 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:23.910392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:23.910937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:23.911460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:23.912241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:23.912727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:23.913341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:24.053367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:24.061441 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c44db139-1e6f-4599-a0fc-fa058b3f36c8 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1393 microversion: 2.1 time: 0.164741 Oct 03 15:54:24.062034 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3802/7779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:23 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:25.087413 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:25.088001 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:25.095571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:25.096074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:25.096554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:25.097316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:25.097793 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:25.098244 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:25.249274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:25.258010 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1e1b9a40-28cf-4e65-b751-593b9fc7401f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1393 microversion: 2.1 time: 0.176146 Oct 03 15:54:25.258661 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3978/7780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:25 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:26.277402 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-19e785cc-b929-4244-b0f1-4b8c22c5e689 req-abc36434-d9ce-4237-80c5-4eb4b4424e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3221ab03-4ad3-4f32-963b-f778608013be", "name": "network-vif-plugged", "status": "completed", "tag": "61a755c7-b01b-413a-9a41-4320f2cf2efa"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:54:26.281442 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:26.282169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:26.290546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-19e785cc-b929-4244-b0f1-4b8c22c5e689 req-abc36434-d9ce-4237-80c5-4eb4b4424e4b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:26.291035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-19e785cc-b929-4244-b0f1-4b8c22c5e689 req-abc36434-d9ce-4237-80c5-4eb4b4424e4b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:26.291689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:26.291837 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-19e785cc-b929-4244-b0f1-4b8c22c5e689 req-abc36434-d9ce-4237-80c5-4eb4b4424e4b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:26.292201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:26.292657 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:26.293851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:26.294722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:26.295209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:26.306625 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-19e785cc-b929-4244-b0f1-4b8c22c5e689 req-abc36434-d9ce-4237-80c5-4eb4b4424e4b service nova] Creating event network-vif-plugged:61a755c7-b01b-413a-9a41-4320f2cf2efa for instance 3221ab03-4ad3-4f32-963b-f778608013be on n-h1-781139-2 Oct 03 15:54:26.313960 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-19e785cc-b929-4244-b0f1-4b8c22c5e689 req-abc36434-d9ce-4237-80c5-4eb4b4424e4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041751 Oct 03 15:54:26.315058 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3803/7781] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:54:26.442453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:26.454102 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-21361f49-763b-43b2-83e9-bd173686f4ac tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1393 microversion: 2.1 time: 0.176744 Oct 03 15:54:26.454699 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3979/7782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:26 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:27.483513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:27.484225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:27.493226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:27.493714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:27.494154 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:27.494859 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:27.495314 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:27.495743 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:27.645906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:27.653365 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0069ddda-0607-467d-93d2-6328099884b9 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1393 microversion: 2.1 time: 0.178394 Oct 03 15:54:27.653967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3804/7783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:27 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:28.681741 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:28.682584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:28.687344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:28.688463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:28.689823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:28.698612 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:28.699542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:28.699542 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:28.700297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:28.700823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:28.701229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:28.840479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:28.852829 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db9c885d-28db-4ba7-a70a-0aa37990c6d3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1564 microversion: 2.1 time: 0.177927 Oct 03 15:54:28.853649 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3980/7784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:28 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:28.876110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:28.876728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:28.878894 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:28.886322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:28.886812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:28.887292 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:28.888029 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:28.888480 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:28.888876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:29.024359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:29.032812 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-556f3832-0f11-4fdb-a05c-fe737d5263af tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1564 microversion: 2.1 time: 0.160760 Oct 03 15:54:29.033438 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3805/7785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:28 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:54:30.985563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:54:30.986828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:54:30.987657 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ebe5f5fe-72b6-492c-928d-2ab901dbb982 req-d95b7a1a-02df-4775-b538-428e51584bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3221ab03-4ad3-4f32-963b-f778608013be", "tag": "61a755c7-b01b-413a-9a41-4320f2cf2efa"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:54:30.996578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:30.997476 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:30.998135 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:30.999069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:30.999215 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebe5f5fe-72b6-492c-928d-2ab901dbb982 req-d95b7a1a-02df-4775-b538-428e51584bfa service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:54:30.999710 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebe5f5fe-72b6-492c-928d-2ab901dbb982 req-d95b7a1a-02df-4775-b538-428e51584bfa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:30.999823 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:54:31.000149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebe5f5fe-72b6-492c-928d-2ab901dbb982 req-d95b7a1a-02df-4775-b538-428e51584bfa service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:31.000545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:54:31.014664 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ebe5f5fe-72b6-492c-928d-2ab901dbb982 req-d95b7a1a-02df-4775-b538-428e51584bfa service nova] Creating event network-changed:61a755c7-b01b-413a-9a41-4320f2cf2efa for instance 3221ab03-4ad3-4f32-963b-f778608013be on n-h1-781139-2 Oct 03 15:54:31.019902 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ebe5f5fe-72b6-492c-928d-2ab901dbb982 req-d95b7a1a-02df-4775-b538-428e51584bfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036050 Oct 03 15:54:31.021698 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3806/7786] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:54:31.148957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:54:31.157787 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a74a9795-6a1c-47c5-9333-7493c43983d2 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1564 microversion: 2.1 time: 0.176661 Oct 03 15:54:31.158704 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3981/7787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:54:30 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:03.551489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:03.552689 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=34 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:03.559143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:55:03.561521 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:03.569317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:03.569742 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:03.570179 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:03.570953 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:03.571548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:03.571987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:03.646583 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4c6bbf7a-3756-4676-b350-60fed3eec2d5 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action" status: 200 len: 24569 microversion: 2.1 time: 0.098711 Oct 03 15:55:03.647234 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3807/7788] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:55:03 2022] POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action => generated 24569 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:55:34.059762 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:34.061249 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=40 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:34.068664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:55:34.069638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:34.080621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:34.081477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:34.082231 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:34.083398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:34.084273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:34.084708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:34.110738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lazy-loading 'flavor' on Instance uuid 3221ab03-4ad3-4f32-963b-f778608013be {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:55:34.183849 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6f1f1013-f112-4deb-9d27-7b7893b6857f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action" status: 202 len: 0 microversion: 2.1 time: 0.127348 Oct 03 15:55:34.184707 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3982/7789] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:55:34 2022] POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:55:34.194135 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:34.195142 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:34.197461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=4 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:34.198121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:34.204452 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:34.204950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:34.205388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:34.206132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:34.206558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:34.206987 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:34.346717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:34.355048 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dfbee258-c071-4a5d-a990-f3b9bffdc53c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1690 microversion: 2.1 time: 0.165779 Oct 03 15:55:34.355891 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3808/7790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:34 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:35.382980 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:35.384056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:35.394015 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:35.394725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:35.395291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:35.396172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:35.396750 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:35.397356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:35.537816 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:35.546331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-588c2688-b042-4ac1-8a57-c5b60c6107f6 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1690 microversion: 2.1 time: 0.168943 Oct 03 15:55:35.547000 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3983/7791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:35 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:36.575958 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:36.576974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:36.588612 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:36.589494 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:36.590226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:36.591437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:36.592197 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:36.592909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:36.734988 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:36.743430 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-669ed5b8-8427-4c33-9474-42d01cd112b1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1673 microversion: 2.1 time: 0.174513 Oct 03 15:55:36.744140 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3809/7792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:36 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:37.849806 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:55:37.853438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:37.866718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:37.867541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:37.868290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:37.869722 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:37.870216 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:37.870699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:37.932770 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5566051f-6763-459b-9f71-0ceff954483c tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action" status: 200 len: 36738 microversion: 2.1 time: 0.089057 Oct 03 15:55:37.933700 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3984/7793] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:55:37 2022] POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action => generated 36738 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 15:55:37.950896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:55:37.951610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:37.961622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:37.962305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:37.963034 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:37.963945 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:37.964400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:37.964821 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:38.037181 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-678d8fbf-6bb3-478f-9201-1c85b8031b98 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action" status: 202 len: 0 microversion: 2.1 time: 0.092313 Oct 03 15:55:38.037832 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3810/7794] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:55:37 2022] POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:55:38.046830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:38.047660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:38.055079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:38.055674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:38.056196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:38.057063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:38.057602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:38.058099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:38.200179 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:38.208650 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4628429b-1ef3-43ed-bcf1-c0e95e26ff7f tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1679 microversion: 2.1 time: 0.165947 Oct 03 15:55:38.209208 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3985/7795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:38 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:39.240916 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:39.242072 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:39.253619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:39.254423 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:39.255156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:39.256309 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:39.257145 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:39.257801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:39.411960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:39.420424 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7d5cbef1-b1a5-40e7-b799-48249211f16d tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1679 microversion: 2.1 time: 0.188639 Oct 03 15:55:39.421048 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3811/7796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:39 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:40.448640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:40.449939 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:40.461565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:40.462376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:40.463134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:40.464310 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:40.465100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:40.465538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:40.595477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:40.603423 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-60c93186-c4c6-4f28-83cd-9d17b5ee982e tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1682 microversion: 2.1 time: 0.161567 Oct 03 15:55:40.604013 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3986/7797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:40 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:40.702456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:55:40.704673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:40.711748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:40.712230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:40.712660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:40.713377 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:40.713824 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:40.714240 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:40.784019 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2c371bc-8275-48fd-b43a-11e798344cf3 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action" status: 200 len: 36738 microversion: 2.1 time: 0.085423 Oct 03 15:55:40.784854 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3812/7798] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:55:40 2022] POST /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be/action => generated 36738 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 15:55:42.125131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:42.125691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:42.133515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:42.134239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:42.134685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:42.135604 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:42.136078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:42.136768 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:42.164729 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 15:55:42.190092 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-8f6cb736-159c-4f33-9e01-7452146fdd82 req-fbc2022c-5a0e-4518-b76a-b6b9815a4fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3221ab03-4ad3-4f32-963b-f778608013be", "tag": "61a755c7-b01b-413a-9a41-4320f2cf2efa"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:55:42.206214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f6cb736-159c-4f33-9e01-7452146fdd82 req-fbc2022c-5a0e-4518-b76a-b6b9815a4fef service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:42.207021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f6cb736-159c-4f33-9e01-7452146fdd82 req-fbc2022c-5a0e-4518-b76a-b6b9815a4fef service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:42.207755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-8f6cb736-159c-4f33-9e01-7452146fdd82 req-fbc2022c-5a0e-4518-b76a-b6b9815a4fef service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:42.223924 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-8f6cb736-159c-4f33-9e01-7452146fdd82 req-fbc2022c-5a0e-4518-b76a-b6b9815a4fef service nova] Creating event network-changed:61a755c7-b01b-413a-9a41-4320f2cf2efa for instance 3221ab03-4ad3-4f32-963b-f778608013be on n-h1-781139-2 Oct 03 15:55:42.229021 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-8f6cb736-159c-4f33-9e01-7452146fdd82 req-fbc2022c-5a0e-4518-b76a-b6b9815a4fef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106192 Oct 03 15:55:42.229650 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3813/7799] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:55:42.255766 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9ca41427-8a51-4236-ba74-2e5940371328 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 204 len: 0 microversion: 2.1 time: 0.135436 Oct 03 15:55:42.256424 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3987/7800] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 15:55:42 2022] DELETE /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 15:55:42.265984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:42.266857 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:42.284139 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:42.285067 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:42.285779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:42.286745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:42.287291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:42.287989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:42.424202 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:42.432332 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-382c1cee-92a1-4c49-bd5c-1841e896b480 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1688 microversion: 2.1 time: 0.171223 Oct 03 15:55:42.432946 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3814/7801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:42 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:43.463254 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:43.464308 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:43.472253 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:43.472758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:43.473256 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:43.473978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:43.474450 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:43.474879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:43.628869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:43.637941 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-83792cc3-ad60-4bf2-beae-eb821282a9c1 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1688 microversion: 2.1 time: 0.181944 Oct 03 15:55:43.638714 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3988/7802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:43 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:44.545600 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-f34c2b47-d3dd-4bdf-89c1-ea1eb4b5029f req-9652ab2e-30f2-4de5-bb06-a9d0c31509fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3221ab03-4ad3-4f32-963b-f778608013be", "name": "network-vif-deleted", "tag": "61a755c7-b01b-413a-9a41-4320f2cf2efa"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:55:44.557015 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f34c2b47-d3dd-4bdf-89c1-ea1eb4b5029f req-9652ab2e-30f2-4de5-bb06-a9d0c31509fc service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:44.557491 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f34c2b47-d3dd-4bdf-89c1-ea1eb4b5029f req-9652ab2e-30f2-4de5-bb06-a9d0c31509fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:44.557918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-f34c2b47-d3dd-4bdf-89c1-ea1eb4b5029f req-9652ab2e-30f2-4de5-bb06-a9d0c31509fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:44.569680 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-f34c2b47-d3dd-4bdf-89c1-ea1eb4b5029f req-9652ab2e-30f2-4de5-bb06-a9d0c31509fc service nova] Creating event network-vif-deleted:61a755c7-b01b-413a-9a41-4320f2cf2efa for instance 3221ab03-4ad3-4f32-963b-f778608013be on n-h1-781139-2 Oct 03 15:55:44.575647 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-f34c2b47-d3dd-4bdf-89c1-ea1eb4b5029f req-9652ab2e-30f2-4de5-bb06-a9d0c31509fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034238 Oct 03 15:55:44.576416 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3815/7803] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:55:44.663533 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:44.664201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:44.672280 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:44.672780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:44.673262 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:44.673986 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:44.674453 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:44.674892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:44.707919 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:44.708457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:44.709069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:44.709554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lazy-loading 'fault' on Instance uuid 3221ab03-4ad3-4f32-963b-f778608013be {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:55:44.754733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66e9adacee94b27b9af39b9467efcb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85448b7772694deebf35d6b222d913be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:55:44.763052 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-7e868b56-83d2-4f7b-80a0-46e2e5c0a16b tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 200 len: 1357 microversion: 2.1 time: 0.103824 Oct 03 15:55:44.763639 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3989/7804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:44 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:55:45.793312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:45.794169 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] [instance: 3221ab03-4ad3-4f32-963b-f778608013be] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:55:45.801113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:45.801599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:45.802038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:45.802741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:55:45.803195 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:55:45.803623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:55:45.817363 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] HTTP exception thrown: Instance 3221ab03-4ad3-4f32-963b-f778608013be could not be found. Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Request method failure captured: Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be HTTP/1.1 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwPcC34rhG4ymjBIvYFpGalY0FgaLBJaryyoprD84IXJNSLJQa3ziIaaKtxnO5sDwo0zEa5_D-jy71pYjPj945-iOkP1rZ9ygeS2tUbp3CNyNUj5hmskpnhHi3A1nrl5fTtr6e9KF9sHf1bgiHurW7Xz9xieYIaRPglfXR0fl3_l-q4 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/85448b7772694deebf35d6b222d913be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_85448b7772694deebf35d6b222d913be", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85448b7772694deebf35d6b222d913be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: 85448b7772694deebf35d6b222d913be Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-512017565 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: b66e9adacee94b27b9af39b9467efcb7 Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestNetworkAdvancedServerOps-512017565-project Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 3221ab03-4ad3-4f32-963b-f778608013be could not be found. Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '3221ab03-4ad3-4f32-963b-f778608013be'} Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3221ab03-4ad3-4f32-963b-f778608013be could not be found. Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3221ab03-4ad3-4f32-963b-f778608013be could not be found. Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:55:45.819006 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3221ab03-4ad3-4f32-963b-f778608013be could not be found. Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Returning 404 to user: Instance 3221ab03-4ad3-4f32-963b-f778608013be could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2431d0dc-130a-4c49-8f9f-c290f5ceedd0 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be" status: 404 len: 111 microversion: 2.1 time: 0.035985 Oct 03 15:55:45.824379 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3816/7805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:55:45 2022] GET /compute/v2.1/servers/3221ab03-4ad3-4f32-963b-f778608013be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 15:55:49.151910 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc75b4b1-397d-4497-b4b5-96851b404032 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] Calling method '.version_select at 0x7fb22b6b0550>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:55:49.186834 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc75b4b1-397d-4497-b4b5-96851b404032 tempest-TestNetworkAdvancedServerOps-512017565 tempest-TestNetworkAdvancedServerOps-512017565-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1864806840" status: 202 len: 0 microversion: 2.1 time: 0.039875 Oct 03 15:55:49.187613 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3990/7806] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Oct 3 15:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1864806840 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:56:00.237583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=18 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:56:00.239294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:56:00.468091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-612fef6b-efaa-4afe-8368-b9a7a029a85f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'create', calling method: .version_select at 0x7fb2302a2a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-538496197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKoyEb8nk3hL1jzS9A+O0OATItT/XBTYbnSy4KyAzPTdM6kuWGlaYiwgubmPlrOIbYJ2SUznz9a8o5RxXrdqPWdWQaoPzttXvYH1pkWDnaTYPL5h7IXRGgi9kOOELbe3g=="}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:56:00.485191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-612fef6b-efaa-4afe-8368-b9a7a029a85f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:56:00.491532 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-612fef6b-efaa-4afe-8368-b9a7a029a85f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for user f95d4b82656d4825a820d5fa0f52daa4 and project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'key_pairs'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:56:00.519225 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-612fef6b-efaa-4afe-8368-b9a7a029a85f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.288116 Oct 03 15:56:00.520024 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3817/7807] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 15:56:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:56:01.529861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:56:01.530715 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:56:01.535323 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1118544879", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-538496197", "security_groups": [{"name": "tempest-secgroup-smoke-316899887"}], "networks": [{"uuid": "fba22801-e812-45cf-a585-5733f79db98b"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:56:01.650497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] validate_networks() for [('fba22801-e812-45cf-a585-5733f79db98b', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 15:56:02.055767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 15:56:02.056201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 15:56:02.056689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 15:56:02.057268 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 15:56:02.057734 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 15:56:02.067861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:02.068636 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:02.069140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:02.069885 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:02.070351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:02.070787 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:02.089732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 15:56:02.095494 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for user f95d4b82656d4825a820d5fa0f52daa4 and project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 15:56:02.108958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 15:56:02.111960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 15:56:02.169234 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-27affe82-39fc-40e7-86ce-6feedd8e362d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.640331 Oct 03 15:56:02.170692 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3991/7808] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 15:56:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 15:56:02.182798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2ad7dddd-ac0a-49de-b24a-2dc01ed854dc tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:02.183418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2ad7dddd-ac0a-49de-b24a-2dc01ed854dc tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:02.243644 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2ad7dddd-ac0a-49de-b24a-2dc01ed854dc tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:02.252435 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2ad7dddd-ac0a-49de-b24a-2dc01ed854dc tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1246 microversion: 2.1 time: 0.074304 Oct 03 15:56:02.253568 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3818/7809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:02 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:03.276961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:03.277619 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:03.285263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:03.285755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:03.286470 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:03.287178 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:03.287653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:03.288121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:03.414782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:03.428529 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0f4841f5-6223-418f-b602-8d4684dc4397 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1306 microversion: 2.1 time: 0.153577 Oct 03 15:56:03.432465 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3992/7810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:03 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:04.457140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:04.458403 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:04.470123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:04.470632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:04.471078 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:04.472007 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:04.472464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:04.472893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:04.635866 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:04.644588 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-00aa5ee4-1e8a-4d61-8452-130fb42557a7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1371 microversion: 2.1 time: 0.193154 Oct 03 15:56:04.645146 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3819/7811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:04 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:04.953506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cd5f07b4-274b-4577-acd0-6749bbbd530b req-4859f8bc-bd5b-4a9e-b99e-5375af051d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:56:04.967438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cd5f07b4-274b-4577-acd0-6749bbbd530b req-4859f8bc-bd5b-4a9e-b99e-5375af051d6e service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:04.968356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cd5f07b4-274b-4577-acd0-6749bbbd530b req-4859f8bc-bd5b-4a9e-b99e-5375af051d6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:04.968805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cd5f07b4-274b-4577-acd0-6749bbbd530b req-4859f8bc-bd5b-4a9e-b99e-5375af051d6e service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:04.983356 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cd5f07b4-274b-4577-acd0-6749bbbd530b req-4859f8bc-bd5b-4a9e-b99e-5375af051d6e service nova] Creating event network-changed:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h1-781139-2 Oct 03 15:56:04.989213 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cd5f07b4-274b-4577-acd0-6749bbbd530b req-4859f8bc-bd5b-4a9e-b99e-5375af051d6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039510 Oct 03 15:56:04.989815 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3993/7812] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:56:05.670268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:05.670847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:05.678057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:05.678687 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:05.679149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:05.679882 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:05.680359 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:05.680804 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:05.829181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:05.838401 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cd31d6e5-e42f-4772-9378-d63eb9a2a1b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1371 microversion: 2.1 time: 0.172513 Oct 03 15:56:05.839277 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3820/7813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:05 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:06.867847 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:06.869038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:06.881270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:06.882051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:06.882791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:06.884009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:06.884791 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:06.885578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:07.036136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:07.044589 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9b82e1d-dfa0-40c7-b39e-3256854d0537 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1371 microversion: 2.1 time: 0.184587 Oct 03 15:56:07.045261 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3994/7814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:06 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:08.071978 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:08.073012 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:08.084731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:08.085601 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:08.086335 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:08.087492 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:08.088261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:08.088990 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:08.225508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:08.235727 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-61d3cf8a-c6c6-48c2-bbc1-4c62617931ed tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1371 microversion: 2.1 time: 0.170479 Oct 03 15:56:08.236294 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3821/7815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:08 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:09.266972 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:09.267584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:09.274929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:09.275433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:09.275887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:09.276603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:09.277105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:09.277548 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:09.421947 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:09.433568 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-816208aa-1c13-45ce-bd9c-6869e5ad21a9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1371 microversion: 2.1 time: 0.170491 Oct 03 15:56:09.434289 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3995/7816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:09 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:10.461792 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:10.462907 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:10.472361 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:10.472855 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:10.473341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:10.474057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:10.474505 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:10.474935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:10.612196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:10.620980 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-576b9810-0e8c-4812-b941-8fa134fce38f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1371 microversion: 2.1 time: 0.166232 Oct 03 15:56:10.621570 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3822/7817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:10 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:10.866164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-a4b6f24c-2b63-4af1-af81-3196338f94c6 req-287e1342-9971-45ca-ab24-2d01943d69a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "name": "network-vif-plugged", "status": "completed", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:56:10.876993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4b6f24c-2b63-4af1-af81-3196338f94c6 req-287e1342-9971-45ca-ab24-2d01943d69a1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:10.877495 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4b6f24c-2b63-4af1-af81-3196338f94c6 req-287e1342-9971-45ca-ab24-2d01943d69a1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:10.877948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-a4b6f24c-2b63-4af1-af81-3196338f94c6 req-287e1342-9971-45ca-ab24-2d01943d69a1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:10.889898 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-a4b6f24c-2b63-4af1-af81-3196338f94c6 req-287e1342-9971-45ca-ab24-2d01943d69a1 service nova] Creating event network-vif-plugged:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h1-781139-2 Oct 03 15:56:10.894973 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-a4b6f24c-2b63-4af1-af81-3196338f94c6 req-287e1342-9971-45ca-ab24-2d01943d69a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094733 Oct 03 15:56:10.895562 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3996/7818] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:56:11.649076 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:11.650070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:11.659707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:11.660191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:11.660622 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:11.661356 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:11.661806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:11.662230 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:11.800531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:11.808496 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ac9e2cb5-5874-49f4-93c9-e419329b0dcb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1371 microversion: 2.1 time: 0.165923 Oct 03 15:56:11.809096 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3823/7819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:11 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:12.831479 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:56:12.832292 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=6 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:56:12.836460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:12.837206 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:12.844559 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:12.845024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:12.845480 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:12.846196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:12.846739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:12.847150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:12.987940 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:12.996267 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b34904c4-eaaa-402b-8c79-3088e9af12a4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1555 microversion: 2.1 time: 0.166710 Oct 03 15:56:12.996894 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3997/7820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:12 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:13.019623 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:56:13.020239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:56:13.022243 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=6 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:56:13.028329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:13.028817 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:13.029279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:13.029971 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:13.030426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:13.030856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:13.171910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:56:13.180444 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dcebb662-c4ed-4f9e-b40e-26bb7e88804c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1555 microversion: 2.1 time: 0.164943 Oct 03 15:56:13.181077 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3824/7821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:56:13 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:56:15.229045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-6104013b-15bb-474b-8d15-8c67947dbebe req-3ae461a1-40b9-46dc-a868-776cb8c927e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:56:15.240668 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6104013b-15bb-474b-8d15-8c67947dbebe req-3ae461a1-40b9-46dc-a868-776cb8c927e9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:56:15.241314 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6104013b-15bb-474b-8d15-8c67947dbebe req-3ae461a1-40b9-46dc-a868-776cb8c927e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:56:15.241767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-6104013b-15bb-474b-8d15-8c67947dbebe req-3ae461a1-40b9-46dc-a868-776cb8c927e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:56:15.255523 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-6104013b-15bb-474b-8d15-8c67947dbebe req-3ae461a1-40b9-46dc-a868-776cb8c927e9 service nova] Creating event network-changed:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h1-781139-2 Oct 03 15:56:15.261071 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-6104013b-15bb-474b-8d15-8c67947dbebe req-3ae461a1-40b9-46dc-a868-776cb8c927e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035963 Oct 03 15:56:15.261898 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3998/7822] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:58:41.397488 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 15:58:41.399062 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d4a85f77-e76c-40fd-9f4d-c0059237fcc3] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 15:58:41.399871 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:41.400698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=36 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:41.402075 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 15:58:41.402232 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f/action (ip 10.222.0.20) !!! Oct 03 15:58:41.404331 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 15:58:41.404458 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f/action (ip 10.222.0.20) !!! Oct 03 15:58:41.406040 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 15:58:41.406152 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 15:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f/action (ip 10.222.0.20) !!! Oct 03 15:58:41.412435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:58:41.412994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:41.426401 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:41.426878 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:41.427306 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:41.428025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:41.428472 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:41.428910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:41.457846 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.objects.instance [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lazy-loading 'flavor' on Instance uuid 1186930d-9899-4ce4-bbaa-8915145ebc9f {{(pid=128868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 15:58:41.858097 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5a25aab4-c31a-4bff-a399-9a41abe50791 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f/action" status: 202 len: 0 microversion: 2.1 time: 0.463463 Oct 03 15:58:41.858753 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3825/7823] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:58:41 2022] POST /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:58:41.866519 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:58:41.867476 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:58:41.868100 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:41.869059 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=32 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:58:41.870367 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 15:58:41.870512 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 15:58:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f (ip 10.222.0.20) !!! Oct 03 15:58:41.885720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:41.886446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:41.894446 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:41.894943 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:41.895415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:41.896106 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:41.896570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:41.897032 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:42.091660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:42.104590 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f2e33f8-7b40-425c-a3cf-565efdfa23df tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.240052 Oct 03 15:58:42.105451 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 3999/7824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:41 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:58:43.139312 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:43.140100 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:43.151772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:43.152317 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:43.152812 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:43.153617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:43.154125 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:43.154599 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:43.159052 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] [d4a85f77-e76c-40fd-9f4d-c0059237fcc3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60212. Oct 03 15:58:43.159807 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60210. Oct 03 15:58:43.304550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:43.312537 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0ecf48dd-d4f5-4fcb-bb28-7b33b30a1daa tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.181659 Oct 03 15:58:43.313152 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3826/7825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:43 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:44.339958 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:44.340745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:44.353339 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:44.354111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:44.354660 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:44.355543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:44.356131 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:44.356702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:44.361680 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60222. Oct 03 15:58:44.362580 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60220. Oct 03 15:58:44.497328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:44.506047 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f93b7f79-9688-42e9-bfac-6c5aad062395 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.172498 Oct 03 15:58:44.506639 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4000/7826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:44 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:45.534101 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:45.535110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:45.545121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:45.545608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:45.546049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:45.546753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:45.547211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:45.547639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:45.691937 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:45.704627 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-87ef1cd0-9599-4423-99d4-3ec1a2366961 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.177035 Oct 03 15:58:45.705553 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3827/7827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:45 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:46.735751 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:46.736745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:46.747237 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:46.748099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:46.748549 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:46.749295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:46.749758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:46.750195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:46.888783 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:46.901167 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-16f1d99c-605a-41a8-a57c-d51baf430c2b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.171721 Oct 03 15:58:46.902753 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4001/7828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:46 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:47.934084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:47.935341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:47.945869 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:47.946547 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:47.947140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:47.948366 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:47.948733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:47.949295 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:48.094057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:48.102030 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-903010e2-b7b8-445c-95eb-a45047fee2c1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.174025 Oct 03 15:58:48.102621 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3828/7829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:47 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:49.136200 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:49.137137 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:49.145627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:49.146210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:49.146733 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:49.147560 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:49.148118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:49.148630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:49.301048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:49.309632 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-20870abc-8d11-48e7-a529-07ff2bfb687f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.179873 Oct 03 15:58:49.310429 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4002/7830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:49 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:50.341416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:50.342025 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:50.349751 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:50.350251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:50.351390 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:50.352132 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:50.352596 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:50.353095 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:50.489049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:50.497100 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-08bafba2-e75d-4253-804b-fe6f87b82268 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.161865 Oct 03 15:58:50.497674 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3829/7831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:50 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:51.526438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:51.527537 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:51.539717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:51.540556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:51.541368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:51.542552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:51.543541 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:51.544011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:51.689813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:51.702105 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b87c8a7a-ad91-4c11-8351-67d193c6a985 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.183021 Oct 03 15:58:51.703054 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4003/7832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:51 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:52.727329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:52.727950 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:52.734961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:52.735432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:52.735873 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:52.736573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:52.737051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:52.737478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:52.894099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:52.902624 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-34c6f405-f622-47be-aa21-f7c900f7a6f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.179646 Oct 03 15:58:52.903218 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3830/7833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:52 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:53.929382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:53.930007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:53.938915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:53.939449 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:53.939902 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:53.940606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:53.941098 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:53.941532 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:54.082801 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:54.091004 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9c255c7-5502-49e8-9ae1-bf80f724420b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1701 microversion: 2.1 time: 0.168227 Oct 03 15:58:54.091554 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4004/7834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:53 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1701 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:55.120835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:55.121441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:55.129495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:55.129975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:55.130407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:55.131096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:55.131549 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:55.131968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:55.266649 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:55.275090 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4bd26620-46f3-47de-8203-c24d53e59c7d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1701 microversion: 2.1 time: 0.158247 Oct 03 15:58:55.275675 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3831/7835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:55 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:55.815327 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-14caf698-1fc0-4c6c-8069-52c76bce59a1 req-bd30582e-bd66-4fa0-af8f-1f9fdac7c83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "name": "network-vif-plugged", "status": "completed", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:58:55.826079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-14caf698-1fc0-4c6c-8069-52c76bce59a1 req-bd30582e-bd66-4fa0-af8f-1f9fdac7c83b service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:55.827269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-14caf698-1fc0-4c6c-8069-52c76bce59a1 req-bd30582e-bd66-4fa0-af8f-1f9fdac7c83b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:55.827727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-14caf698-1fc0-4c6c-8069-52c76bce59a1 req-bd30582e-bd66-4fa0-af8f-1f9fdac7c83b service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:55.840893 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-14caf698-1fc0-4c6c-8069-52c76bce59a1 req-bd30582e-bd66-4fa0-af8f-1f9fdac7c83b service nova] Creating event network-vif-plugged:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h1-781139-2 Oct 03 15:58:55.847099 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-14caf698-1fc0-4c6c-8069-52c76bce59a1 req-bd30582e-bd66-4fa0-af8f-1f9fdac7c83b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035691 Oct 03 15:58:55.847914 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4005/7836] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:58:56.303049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:56.304014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:56.313994 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:56.314481 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:56.314917 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:56.315879 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:56.316328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:56.316747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:56.448677 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:56.456959 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f734c693-90bc-452e-b413-e4e00386d7fb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1701 microversion: 2.1 time: 0.160558 Oct 03 15:58:56.457553 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3832/7837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:56 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:57.485114 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:57.485828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:57.492672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:57.493197 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:57.493646 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:57.494356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:57.494821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:57.495258 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:57.635874 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:57.644374 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-00b83f25-56d2-4298-af60-1b29e47d8ad9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1701 microversion: 2.1 time: 0.166706 Oct 03 15:58:57.645017 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4006/7838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:57 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1701 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:58.672004 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:58.672578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:58.679555 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:58.680039 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:58.680479 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:58.681164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:58.681819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:58.682238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:58.824546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:58:58.834185 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0cd1c3be-6bed-47bf-8207-8f91a3c3d07c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.166258 Oct 03 15:58:58.834782 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3833/7839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:58 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:58:59.860957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:58:59.868081 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:58:59.872679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:59.873752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:59.874836 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:58:59.875901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:58:59.876417 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:58:59.877168 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:00.121346 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:00.131235 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-28a14c17-d384-4e85-90ba-2539e88d64d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.275007 Oct 03 15:59:00.145731 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4007/7840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:58:59 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:01.158310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:01.158952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:01.166836 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:01.167384 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:01.167822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:01.168554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:01.169052 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:01.169487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:01.308448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:01.316807 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c3d5706c-3784-42a5-9d2a-d489317b962a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.162603 Oct 03 15:59:01.317632 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3834/7841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:01 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:02.340349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:02.341627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:02.351043 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:02.352007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:02.352881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:02.354593 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:02.355139 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:02.355789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:02.530796 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:02.539696 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9e9ff3f-12c6-4c69-bbbf-5d7043758593 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.203414 Oct 03 15:59:02.540758 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4008/7842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:02 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:03.564113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:03.564717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:03.572063 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:03.572545 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:03.573217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:03.573918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:03.574364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:03.574810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:03.737884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:03.751863 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-70124224-a50d-4f1c-a65e-6996baf3df51 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.191679 Oct 03 15:59:03.752509 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3835/7843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:03 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 15:59:04.776748 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:04.777876 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:04.787225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:04.788320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:04.789279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:04.791011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:04.791557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:04.792189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:04.945074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:04.955223 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5d71697e-67ee-48e0-9b66-a78bef42b1b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.182968 Oct 03 15:59:04.956104 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4009/7844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:04 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:05.979224 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:05.979935 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:05.988498 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:05.989325 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:05.990388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:05.991719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:05.992383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:05.992874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:06.168417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:06.180329 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-686762c7-3f44-46cc-b98b-ddffb6e68549 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.205044 Oct 03 15:59:06.187553 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3836/7845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:05 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:07.204257 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:07.204982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:07.212155 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:07.212628 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:07.213148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:07.213870 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:07.214336 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:07.214970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:07.351083 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:07.359405 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e5935668-0593-4719-bd4d-06654fd9ee10 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1696 microversion: 2.1 time: 0.159543 Oct 03 15:59:07.359993 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4010/7846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:07 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:08.385785 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:08.386455 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:08.396463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:08.397173 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:08.397733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:08.398717 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:08.399223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:08.399802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:08.539399 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:08.547839 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-53681b2b-a243-404d-9412-cc0eb7d17f7c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1678 microversion: 2.1 time: 0.168101 Oct 03 15:59:08.548448 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3837/7847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:08 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:09.576169 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:09.577214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:09.589298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:09.590120 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:09.591038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:09.592214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:09.592983 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:09.593930 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:09.730627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:09.738976 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f744990f-c616-46b6-9675-1e5c83040829 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1678 microversion: 2.1 time: 0.169439 Oct 03 15:59:09.739530 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4011/7848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:09 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:10.764035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:10.764674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:10.772280 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:10.772759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:10.773218 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:10.773909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:10.774371 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:10.774791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:10.917918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:10.926670 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3cf75dc9-ddb9-4edb-99a0-7a52cb1398bd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1621 microversion: 2.1 time: 0.166977 Oct 03 15:59:10.927269 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3838/7849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:10 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1621 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:10.959622 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:10.960232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:10.969225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:10.969679 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:10.970143 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:10.971000 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:10.971624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:10.972209 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:11.017952 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128869) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 15:59:11.100476 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [57fc77c8-921a-49ea-8a74-425622349fd3] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 15:59:11.903167 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1f9ee7ff-e5cb-4f60-9846-b49fa5934abf req-1f726f4b-23e0-4289-a9a7-afcf72af06f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "name": "network-vif-unplugged", "status": "completed", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:11.910090 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=29 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:11.916683 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1f9ee7ff-e5cb-4f60-9846-b49fa5934abf req-1f726f4b-23e0-4289-a9a7-afcf72af06f1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:11.917199 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1f9ee7ff-e5cb-4f60-9846-b49fa5934abf req-1f726f4b-23e0-4289-a9a7-afcf72af06f1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:11.917639 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1f9ee7ff-e5cb-4f60-9846-b49fa5934abf req-1f726f4b-23e0-4289-a9a7-afcf72af06f1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:11.921614 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:11.931156 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.server_external_events [req-1f9ee7ff-e5cb-4f60-9846-b49fa5934abf req-1f726f4b-23e0-4289-a9a7-afcf72af06f1 service nova] Unable to find a host for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f. Dropping event network-vif-unplugged {{(pid=128868) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 15:59:11.931990 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1f9ee7ff-e5cb-4f60-9846-b49fa5934abf req-1f726f4b-23e0-4289-a9a7-afcf72af06f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032839 Oct 03 15:59:11.932596 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3839/7850] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 15:59:12.111006 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [57fc77c8-921a-49ea-8a74-425622349fd3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60328. Oct 03 15:59:12.117113 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5688d4c3-3fe1-434c-a25e-91141250435d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f/action" status: 202 len: 0 microversion: 2.1 time: 1.161267 Oct 03 15:59:12.118068 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4012/7851] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 15:59:10 2022] POST /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f/action => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 15:59:12.130030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:12.130624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:12.137696 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:12.138188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:12.138653 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:12.139360 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:12.139810 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:12.140264 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:12.274964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:12.283263 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-872c364b-c1b1-4022-bd09-3a889dd8a605 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1629 microversion: 2.1 time: 0.157877 Oct 03 15:59:12.283868 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3840/7852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:12 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1629 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:13.312726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:13.313812 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:13.316882 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:13.323297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:13.324007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:13.324457 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:13.325201 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:13.325664 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:13.326095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:13.329181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:59:13.478620 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:13.486819 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-dc3f9752-1a93-4167-9061-cab59f5e54c5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.182263 Oct 03 15:59:13.487402 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4013/7853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:13 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:14.388598 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-fb987e47-65bf-42ed-8e8b-ce06ed69ae5f req-b8a5c900-7d14-43f1-b622-cae5b6e9f7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:14.398456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fb987e47-65bf-42ed-8e8b-ce06ed69ae5f req-b8a5c900-7d14-43f1-b622-cae5b6e9f7e9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:14.398830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fb987e47-65bf-42ed-8e8b-ce06ed69ae5f req-b8a5c900-7d14-43f1-b622-cae5b6e9f7e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:14.399269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-fb987e47-65bf-42ed-8e8b-ce06ed69ae5f req-b8a5c900-7d14-43f1-b622-cae5b6e9f7e9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:14.410414 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-fb987e47-65bf-42ed-8e8b-ce06ed69ae5f req-b8a5c900-7d14-43f1-b622-cae5b6e9f7e9 service nova] Creating event network-changed:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h2-781139-2 Oct 03 15:59:14.415551 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-fb987e47-65bf-42ed-8e8b-ce06ed69ae5f req-b8a5c900-7d14-43f1-b622-cae5b6e9f7e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089368 Oct 03 15:59:14.416327 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3841/7854] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 15:59:14.511991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:14.512623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:14.519247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:14.519745 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:14.520193 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:14.520906 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:14.521404 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:14.521828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:14.722229 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:14.730544 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4950a7e-b49f-4ebe-a10e-77c72efee111 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.223303 Oct 03 15:59:14.731136 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4014/7855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:14 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:15.756375 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:15.757822 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:15.764634 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:15.765341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:15.765786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:15.766499 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:15.766980 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:15.767372 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:15.926662 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:15.935306 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-43210ec0-b4ab-4141-82dd-8d74283314b1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.184519 Oct 03 15:59:15.935869 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3842/7856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:15 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:16.960299 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:16.961724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:16.969123 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:16.969635 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:16.970731 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:16.971519 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:16.971996 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:16.972629 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:17.122704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:17.131994 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2302c63a-595c-49a8-83ff-b81e23ae008d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.175583 Oct 03 15:59:17.132653 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4015/7857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:16 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:18.156345 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:18.157467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:18.165049 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:18.165575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:18.166014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:18.166730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:18.167188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:18.167624 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:18.315343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:18.323684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4f62782e-e4db-4897-8cb5-57c66efd3fe8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.171608 Oct 03 15:59:18.324311 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3843/7858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:18 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:19.347434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:19.348342 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:19.355632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:19.356134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:19.356591 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:19.357355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:19.357828 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:19.358282 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:19.508176 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:19.516730 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e0ff8443-b3f4-4aa5-9dfc-9263500a4265 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.173265 Oct 03 15:59:19.517711 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4016/7859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:19 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:20.541311 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:20.542127 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:20.551017 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:20.551631 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:20.552178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:20.552883 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:20.553367 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:20.553793 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:20.700712 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:20.709784 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6e5ce024-2f96-4ab2-86c9-1f1a4410619a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.172376 Oct 03 15:59:20.710476 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3844/7860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:20 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:21.734035 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:21.734929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:21.742621 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:21.743145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:21.743670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:21.744554 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:21.745161 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:21.745639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:21.886443 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:21.894642 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-932c69e6-9f98-4be4-8849-21bf3125f859 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.164514 Oct 03 15:59:21.911284 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4017/7861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:21 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:22.921443 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:22.922024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:22.929930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:22.930417 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:22.930858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:22.931554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:22.932009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:22.932431 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:23.067352 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:23.075732 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d4016f9f-e1f7-42b3-b012-037e5dc9b71c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.160624 Oct 03 15:59:23.076337 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3845/7862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:22 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:24.103558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:24.104579 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:24.116543 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:24.117427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:24.118195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:24.119370 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:24.120160 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:24.120871 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:24.281709 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:24.294029 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-06717280-0048-4f82-8aed-f49472b5ed59 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.196906 Oct 03 15:59:24.294760 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4018/7863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:24 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:25.322616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:25.323625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:25.335581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:25.336389 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:25.337160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:25.338290 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:25.339033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:25.339732 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:25.485008 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:25.493959 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6c8f6bac-b161-4e9c-a7bd-a25395042214 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.177972 Oct 03 15:59:25.494557 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3846/7864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:25 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:26.519105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:26.519698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:26.527272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:26.527773 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:26.528217 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:26.528956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:26.529423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:26.529860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:26.671094 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:26.679321 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-09c8a4c5-c806-4782-bc97-5c0f9c9358b2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.164564 Oct 03 15:59:26.679904 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4019/7865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:26 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:27.705777 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:27.706467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:27.715772 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:27.716291 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:27.716773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:27.717736 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:27.718192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:27.718619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:27.889160 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:27.902480 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-8d4d8f05-529f-429a-9152-333cab073d43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.201610 Oct 03 15:59:27.903790 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3847/7866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:27 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:28.919355 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-1be85c63-5207-4e2a-a700-5c22fb140c86 req-5e1c11cf-7e86-40fd-a939-e7f3bf62a5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "name": "network-vif-plugged", "status": "completed", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 15:59:28.926895 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:28.927408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:28.930843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1be85c63-5207-4e2a-a700-5c22fb140c86 req-5e1c11cf-7e86-40fd-a939-e7f3bf62a5ff service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:28.932007 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1be85c63-5207-4e2a-a700-5c22fb140c86 req-5e1c11cf-7e86-40fd-a939-e7f3bf62a5ff service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:28.932512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-1be85c63-5207-4e2a-a700-5c22fb140c86 req-5e1c11cf-7e86-40fd-a939-e7f3bf62a5ff service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:28.934652 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:28.935287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:28.935724 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:28.936964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:28.936964 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:28.937518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:28.944999 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-1be85c63-5207-4e2a-a700-5c22fb140c86 req-5e1c11cf-7e86-40fd-a939-e7f3bf62a5ff service nova] Creating event network-vif-plugged:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h2-781139-2 Oct 03 15:59:28.950362 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-1be85c63-5207-4e2a-a700-5c22fb140c86 req-5e1c11cf-7e86-40fd-a939-e7f3bf62a5ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034837 Oct 03 15:59:28.951405 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4020/7867] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 15:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 15:59:29.086319 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:29.094292 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6eacc9db-c66a-4dec-95d8-257dfbcc4a3c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.171675 Oct 03 15:59:29.094894 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3848/7868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:28 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:30.118490 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:30.119205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:30.126732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:30.127251 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:30.127937 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:30.128869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:30.129389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:30.129826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:30.274555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:30.282966 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fd0bf151-b5fc-42f0-9815-a4bb14b2c79f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1687 microversion: 2.1 time: 0.168705 Oct 03 15:59:30.283615 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4021/7869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:30 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 15:59:31.310432 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 15:59:31.311442 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 15:59:31.320302 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:31.320791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:31.321260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:31.321947 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 15:59:31.322416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 15:59:31.322853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 15:59:31.461253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 15:59:31.469464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2e683935-c6c0-45ac-8e3c-7cae913c240a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1674 microversion: 2.1 time: 0.165627 Oct 03 15:59:31.470060 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3849/7870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 15:59:31 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:43.204230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=17 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:43.205034 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=49 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:43.207574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=21 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:43.208393 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=57 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:43.211297 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:43.211826 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:43.213961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-70109dd2-db7d-4f44-a909-273b487ace5e req-41d4219b-3384-4e0b-a3c0-e816a2d889c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:43.219905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.220133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.220512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.221250 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.222047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.222180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.225546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-70109dd2-db7d-4f44-a909-273b487ace5e req-41d4219b-3384-4e0b-a3c0-e816a2d889c2 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.226021 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-70109dd2-db7d-4f44-a909-273b487ace5e req-41d4219b-3384-4e0b-a3c0-e816a2d889c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.227463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-70109dd2-db7d-4f44-a909-273b487ace5e req-41d4219b-3384-4e0b-a3c0-e816a2d889c2 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.241684 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-70109dd2-db7d-4f44-a909-273b487ace5e req-41d4219b-3384-4e0b-a3c0-e816a2d889c2 service nova] Creating event network-changed:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h2-781139-2 Oct 03 16:00:43.247031 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-70109dd2-db7d-4f44-a909-273b487ace5e req-41d4219b-3384-4e0b-a3c0-e816a2d889c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042203 Oct 03 16:00:43.247876 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3850/7871] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:43.250071 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:00:43.346415 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-600aed95-2aa7-4dc2-8fb2-b384c68210bb tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 204 len: 0 microversion: 2.1 time: 0.143892 Oct 03 16:00:43.347324 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4022/7872] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 16:00:43 2022] DELETE /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:00:43.356534 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:43.357272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:43.364441 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.365084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.366193 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.366349 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:43.366805 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:43.367467 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:43.507765 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:43.516281 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f34a6ffb-57bf-4ab9-860e-ab9ebd27376f tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.164242 Oct 03 16:00:43.516913 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3851/7873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:43 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:00:44.542769 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:44.543455 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:44.550061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:44.550569 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:44.551018 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:44.551732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:44.552196 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:44.552630 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:44.783092 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:00:44.791720 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2d608362-c95c-429b-8075-25a71dad9c3b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 200 len: 1680 microversion: 2.1 time: 0.253371 Oct 03 16:00:44.792402 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4023/7874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:44 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:00:45.163862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-e553eca1-3474-4c13-8581-1e044f4ba694 req-ccf39f42-2f62-4f67-a00d-ea29dc1717a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1186930d-9899-4ce4-bbaa-8915145ebc9f", "name": "network-vif-deleted", "tag": "a18c9b56-f72b-479d-852f-77796a90ed46"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:45.173915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e553eca1-3474-4c13-8581-1e044f4ba694 req-ccf39f42-2f62-4f67-a00d-ea29dc1717a3 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:45.174392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e553eca1-3474-4c13-8581-1e044f4ba694 req-ccf39f42-2f62-4f67-a00d-ea29dc1717a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:45.174830 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-e553eca1-3474-4c13-8581-1e044f4ba694 req-ccf39f42-2f62-4f67-a00d-ea29dc1717a3 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:45.186634 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-e553eca1-3474-4c13-8581-1e044f4ba694 req-ccf39f42-2f62-4f67-a00d-ea29dc1717a3 service nova] Creating event network-vif-deleted:a18c9b56-f72b-479d-852f-77796a90ed46 for instance 1186930d-9899-4ce4-bbaa-8915145ebc9f on n-h2-781139-2 Oct 03 16:00:45.191698 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-e553eca1-3474-4c13-8581-1e044f4ba694 req-ccf39f42-2f62-4f67-a00d-ea29dc1717a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089183 Oct 03 16:00:45.192394 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3852/7875] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:00:45.816245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:45.816971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 1186930d-9899-4ce4-bbaa-8915145ebc9f] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:00:45.825233 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:45.825780 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:45.826295 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:45.827090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:00:45.827609 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:00:45.828099 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:00:45.843571 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] HTTP exception thrown: Instance 1186930d-9899-4ce4-bbaa-8915145ebc9f could not be found. Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Request method failure captured: Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f HTTP/1.1 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwYLN-ifDEDYKjanxGOL-72seVhS92R44JQmnik2hsFnzd42TZYizB6e1PqOJXTilSIGfhjHqdjtydHh5UG31cOqwkpSn3IHuZrverF08x8AWRuKjPWho4one_8a28FWW2-Fctd_yOc0UfEM0adZcx_zukr4oZ8wSPv_LXrFL3Ol6pg Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 96f9c57611f2496f8b3c857ceeddb568 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestShelveInstance-920636672 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/96f9c57611f2496f8b3c857ceeddb568"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_96f9c57611f2496f8b3c857ceeddb568", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/96f9c57611f2496f8b3c857ceeddb568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/96f9c57611f2496f8b3c857ceeddb568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestShelveInstance-920636672 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 96f9c57611f2496f8b3c857ceeddb568 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestShelveInstance-920636672 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestShelveInstance-920636672-project Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f95d4b82656d4825a820d5fa0f52daa4 Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestShelveInstance-920636672-project Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 1186930d-9899-4ce4-bbaa-8915145ebc9f could not be found. Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '1186930d-9899-4ce4-bbaa-8915145ebc9f'} Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1186930d-9899-4ce4-bbaa-8915145ebc9f could not be found. Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1186930d-9899-4ce4-bbaa-8915145ebc9f could not be found. Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:00:45.845311 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1186930d-9899-4ce4-bbaa-8915145ebc9f could not be found. Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Returning 404 to user: Instance 1186930d-9899-4ce4-bbaa-8915145ebc9f could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1f029902-32f9-4e47-ac84-39acc34fd3b8 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f" status: 404 len: 111 microversion: 2.1 time: 0.035031 Oct 03 16:00:45.850946 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4024/7876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:00:45 2022] GET /compute/v2.1/servers/1186930d-9899-4ce4-bbaa-8915145ebc9f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:00:46.026996 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bbde70af-278d-4182-9787-8d70a9bf8a88 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '.version_select at 0x7fb234b37040>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:00:46.055212 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bbde70af-278d-4182-9787-8d70a9bf8a88 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-538496197" status: 202 len: 0 microversion: 2.1 time: 0.032760 Oct 03 16:00:46.055812 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3853/7877] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 3 16:00:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-538496197 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:00:46.080408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b263547c-0149-466d-ad40-dabac00ccfa9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'create', calling method: .version_select at 0x7fb230d4fc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1572149208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDCBxhQFmL4IYHFcqHP5l+ZKmLwTfeHYRDQVU4Hv4S4OTNyOsgqcMYYNz5QQq2II/k1JWmId615BFg5R+J3FOSqvxq0fvJytqCae6nfpdEjFTX/JeBcWwTHEAef5joMwg=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:00:46.095676 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b263547c-0149-466d-ad40-dabac00ccfa9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:00:46.100811 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-b263547c-0149-466d-ad40-dabac00ccfa9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for user f95d4b82656d4825a820d5fa0f52daa4 and project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:00:46.131070 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b263547c-0149-466d-ad40-dabac00ccfa9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054759 Oct 03 16:00:46.131686 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4025/7878] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 16:00:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:02.509973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:02.510818 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:02.515508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1705753155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1572149208", "security_groups": [{"name": "tempest-secgroup-smoke-1400696200"}], "networks": [{"uuid": "fba22801-e812-45cf-a585-5733f79db98b"}], "block_device_mapping_v2": [{"uuid": "a7299797-fd3a-4f8b-b405-7470b912ab42", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:02.640568 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] validate_networks() for [('fba22801-e812-45cf-a585-5733f79db98b', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:01:03.092825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:01:03.093619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:01:03.094416 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:01:03.095113 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:01:03.095802 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:01:03.109221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.109707 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.110144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.110862 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:03.111329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:03.111754 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:03.129715 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:01:03.135381 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Getting quotas for user f95d4b82656d4825a820d5fa0f52daa4 and project 96f9c57611f2496f8b3c857ceeddb568. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:01:03.194975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:01:03.197272 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7299797-fd3a-4f8b-b405-7470b912ab42',volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:01:03.340313 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b679bf84-5a16-48a5-b5af-3817ebe39b43 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.832360 Oct 03 16:01:03.341691 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3854/7879] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 16:01:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:01:03.350869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:03.352021 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:03.353014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:03.357412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a7cf3146-45a1-4505-a0e3-ac6099ba2141 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:03.358079 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a7cf3146-45a1-4505-a0e3-ac6099ba2141 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:03.421718 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a7cf3146-45a1-4505-a0e3-ac6099ba2141 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:03.429037 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a7cf3146-45a1-4505-a0e3-ac6099ba2141 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1089 microversion: 2.1 time: 0.080072 Oct 03 16:01:03.429609 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4026/7880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:03 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:04.452014 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-27f28bfb-7895-4a9d-aba3-130e367596e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:04.452628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-27f28bfb-7895-4a9d-aba3-130e367596e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:04.511075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-27f28bfb-7895-4a9d-aba3-130e367596e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:04.518442 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-27f28bfb-7895-4a9d-aba3-130e367596e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1089 microversion: 2.1 time: 0.070446 Oct 03 16:01:04.519192 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3855/7881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:04 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:05.541587 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-fc8c594c-fde0-454d-8aae-3ace93bdb964 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:05.542219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-fc8c594c-fde0-454d-8aae-3ace93bdb964 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:05.596207 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-fc8c594c-fde0-454d-8aae-3ace93bdb964 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:05.603343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-fc8c594c-fde0-454d-8aae-3ace93bdb964 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1089 microversion: 2.1 time: 0.065742 Oct 03 16:01:05.603884 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4027/7882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:05 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:06.630531 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ddc737c5-db91-43f2-8834-ad1e16dfed7b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:06.631508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ddc737c5-db91-43f2-8834-ad1e16dfed7b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:06.689685 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ddc737c5-db91-43f2-8834-ad1e16dfed7b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:06.696770 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ddc737c5-db91-43f2-8834-ad1e16dfed7b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1089 microversion: 2.1 time: 0.073401 Oct 03 16:01:06.697388 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3856/7883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:06 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:07.721975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:07.722761 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:07.732411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:07.733140 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:07.733702 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:07.734582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:07.735173 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:07.735725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:07.799964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:07.808237 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a1431c1b-0829-4439-8f7e-5c7ad98180d2 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1139 microversion: 2.1 time: 0.091673 Oct 03 16:01:07.808836 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4028/7884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:07 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:08.831219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:08.831960 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:08.839378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:08.839941 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:08.840457 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:08.841251 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:08.841799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:08.842294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:08.909903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:08.919154 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-55039397-55a6-42f4-8cfa-a0a8f3303010 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1205 microversion: 2.1 time: 0.092020 Oct 03 16:01:08.919749 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3857/7885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:08 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1205 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:09.943752 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:09.944525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:09.952038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:09.952677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:09.953054 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:09.953774 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:09.954401 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:09.954845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:10.101884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-66f2f14e-ff6f-46b4-a7f2-a85c02ab4c43 req-827d50eb-d3e6-49bb-98ad-de7789cd3f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:10.118238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-66f2f14e-ff6f-46b4-a7f2-a85c02ab4c43 req-827d50eb-d3e6-49bb-98ad-de7789cd3f7f service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:10.118713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-66f2f14e-ff6f-46b4-a7f2-a85c02ab4c43 req-827d50eb-d3e6-49bb-98ad-de7789cd3f7f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:10.119910 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-66f2f14e-ff6f-46b4-a7f2-a85c02ab4c43 req-827d50eb-d3e6-49bb-98ad-de7789cd3f7f service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:10.136069 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-66f2f14e-ff6f-46b4-a7f2-a85c02ab4c43 req-827d50eb-d3e6-49bb-98ad-de7789cd3f7f service nova] Creating event network-changed:b026d35c-ecc2-4fe7-8fbb-b52141528951 for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 on n-h1-781139-2 Oct 03 16:01:10.142644 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-66f2f14e-ff6f-46b4-a7f2-a85c02ab4c43 req-827d50eb-d3e6-49bb-98ad-de7789cd3f7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045577 Oct 03 16:01:10.143890 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3858/7886] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:10.165405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:10.174672 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d701c9b1-9c0a-45e4-bd0c-235f69162783 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1273 microversion: 2.1 time: 0.234901 Oct 03 16:01:10.175669 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4029/7887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:09 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:11.202526 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:11.203225 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:11.210834 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:11.211320 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:11.211753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:11.212451 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:11.212906 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:11.213351 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:11.359582 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:11.367773 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5d3ba104-c8c8-4b68-a31b-83c7e5873cd9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1273 microversion: 2.1 time: 0.169946 Oct 03 16:01:11.368356 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3859/7888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:11 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:12.392242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:12.392859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:12.400080 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.400552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.401056 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.401767 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:12.402230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:12.402666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:12.542953 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:12.551898 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-656b244a-d93a-4051-bdf1-4540fed85b72 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1273 microversion: 2.1 time: 0.163988 Oct 03 16:01:12.552635 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4030/7889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:12 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:13.575571 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:13.576158 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:13.579326 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:13.585605 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.586192 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.586506 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:13.587211 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:13.587659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:13.588084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:13.741969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:13.750066 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e7c08cbb-2833-4bc9-9cbc-e39f798776c4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1273 microversion: 2.1 time: 0.178771 Oct 03 16:01:13.750891 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3860/7890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:13 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:14.774674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:14.775236 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:14.782444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.782990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.783689 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.784521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:14.785048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:14.785545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:14.931808 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:14.939914 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6dd34758-8160-45cd-b22a-87c4c56876db tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.170110 Oct 03 16:01:14.940501 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4031/7891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:14 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:15.965430 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:15.966196 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:15.974659 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:15.975155 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:15.975595 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:15.976300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:15.976759 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:15.977231 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:16.129043 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:16.137574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-0522afe3-1860-4f77-b30c-1ab145c86fef tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.177291 Oct 03 16:01:16.138185 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3861/7892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:15 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:17.163672 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:17.164463 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:17.166985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=4 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:17.175350 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.175854 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.176315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.177061 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:17.177529 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:17.177970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:17.324681 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:17.332800 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-af72bc24-5aed-4569-855c-af13acfc6799 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.174555 Oct 03 16:01:17.333419 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4032/7893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:17 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:18.356236 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:18.356828 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:18.358763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:18.365552 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.366038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.366463 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.367152 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:18.367607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:18.368031 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:18.514219 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:18.522682 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-6ddb2a17-0220-4a0a-a76b-16ebc7e4a7d6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.170470 Oct 03 16:01:18.523262 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3862/7894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:18 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:19.549130 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:19.550848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:19.561728 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:19.562500 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:19.563212 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:19.564309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:19.565175 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:19.566150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:19.717029 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:19.725461 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8dea5894-32cc-4aeb-ba3d-8da5add68875 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.182503 Oct 03 16:01:19.726049 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4033/7895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:19 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:20.750757 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:20.751698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:20.762550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.763241 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.763892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.764874 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:20.765578 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:20.766181 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:20.916337 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:20.924308 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d1b05b5f-e6d9-469d-8ed3-fc3dbfbfc968 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.179407 Oct 03 16:01:20.924899 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3863/7896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:20 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:21.947466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:21.948159 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:21.955640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.956144 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.956603 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:21.957344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:21.957813 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:21.958245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:22.099581 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:22.111763 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-655d4777-4710-413d-8ba7-c1ac1b312f0d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.168342 Oct 03 16:01:22.112600 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4034/7897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:21 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:23.137342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:23.137957 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:23.145412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:23.145912 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:23.146327 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.147046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:23.147482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:23.148006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:23.287174 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:23.295996 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-3497310d-a578-45a1-8bac-04a5eb50e28a tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.162736 Oct 03 16:01:23.296587 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3864/7898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:23 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:24.324595 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:24.325698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:24.336853 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.337391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.337849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.338570 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.339039 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.339506 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.482242 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:24.490238 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4f792006-ebc1-4881-9076-45ba01385840 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.173350 Oct 03 16:01:24.490836 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4035/7899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:24 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:24.618730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-51fa9d3c-cf1d-43ba-8065-725afa6821a4 req-dc599089-72c0-4cee-852d-d78786500432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "name": "network-vif-plugged", "status": "completed", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:24.629009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-51fa9d3c-cf1d-43ba-8065-725afa6821a4 req-dc599089-72c0-4cee-852d-d78786500432 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:24.629476 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-51fa9d3c-cf1d-43ba-8065-725afa6821a4 req-dc599089-72c0-4cee-852d-d78786500432 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:24.630328 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-51fa9d3c-cf1d-43ba-8065-725afa6821a4 req-dc599089-72c0-4cee-852d-d78786500432 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:24.642440 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-51fa9d3c-cf1d-43ba-8065-725afa6821a4 req-dc599089-72c0-4cee-852d-d78786500432 service nova] Creating event network-vif-plugged:b026d35c-ecc2-4fe7-8fbb-b52141528951 for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 on n-h1-781139-2 Oct 03 16:01:24.647460 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-51fa9d3c-cf1d-43ba-8065-725afa6821a4 req-dc599089-72c0-4cee-852d-d78786500432 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088631 Oct 03 16:01:24.648120 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3865/7900] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:01:25.517069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:25.517960 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:25.528987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:25.529705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:25.530406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:25.531546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:25.532272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:25.532879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:25.674477 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:25.686957 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6284e184-7b51-49af-a2a5-23d366fe003b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1261 microversion: 2.1 time: 0.175804 Oct 03 16:01:25.687827 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4036/7901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:25 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:26.715791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:26.716651 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:26.724607 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.725260 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.725794 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:26.726647 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.727212 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.727763 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:26.864608 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:26.873368 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c2cd55c5-a887-4428-9390-ee97c5a796e9 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1446 microversion: 2.1 time: 0.163901 Oct 03 16:01:26.873918 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3866/7902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:26 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:26.896024 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:01:26.896656 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:01:26.903805 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.904291 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.904743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:26.905520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:26.905991 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:26.906435 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:27.048181 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:01:27.056743 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-939553fa-c8f9-427b-ac90-aaf1f3800d44 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1446 microversion: 2.1 time: 0.164685 Oct 03 16:01:27.057374 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4037/7903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:01:26 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:01:29.093891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-ebac581d-96b8-49c4-bf0f-cf1ff0cd99cf req-91513ee6-ed27-42f9-b193-be0ddcc569f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:01:29.105099 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebac581d-96b8-49c4-bf0f-cf1ff0cd99cf req-91513ee6-ed27-42f9-b193-be0ddcc569f8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:01:29.105583 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebac581d-96b8-49c4-bf0f-cf1ff0cd99cf req-91513ee6-ed27-42f9-b193-be0ddcc569f8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:01:29.106013 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-ebac581d-96b8-49c4-bf0f-cf1ff0cd99cf req-91513ee6-ed27-42f9-b193-be0ddcc569f8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:01:29.118375 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-ebac581d-96b8-49c4-bf0f-cf1ff0cd99cf req-91513ee6-ed27-42f9-b193-be0ddcc569f8 service nova] Creating event network-changed:b026d35c-ecc2-4fe7-8fbb-b52141528951 for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 on n-h1-781139-2 Oct 03 16:01:29.124254 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-ebac581d-96b8-49c4-bf0f-cf1ff0cd99cf req-91513ee6-ed27-42f9-b193-be0ddcc569f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034590 Oct 03 16:01:29.125251 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3867/7904] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:24.257118 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=28 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:24.257892 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=60 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:24.259197 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 16:03:24.259381 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 16:03:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5/action (ip 10.222.0.20) !!! Oct 03 16:03:24.260466 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 16:03:24.260608 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 16:03:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5/action (ip 10.222.0.20) !!! Oct 03 16:03:24.265344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:24.265821 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:24.279246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:24.279743 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:24.280190 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:24.280896 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:24.281383 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:24.281827 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:24.305333 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lazy-loading 'flavor' on Instance uuid 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:03:24.391686 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-01798bb2-f28b-456f-a004-de5891d18f83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5/action" status: 202 len: 0 microversion: 2.1 time: 0.137881 Oct 03 16:03:24.392405 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4038/7905] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 16:03:24 2022] POST /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:03:24.399575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:24.400745 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=56 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:24.406789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:24.407513 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:24.414896 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:24.415378 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:24.415813 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:24.416501 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:24.416963 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:24.417386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:24.559300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:24.567751 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-4524c4ca-0f08-41fb-ac72-589677dfedbe tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.170630 Oct 03 16:03:24.568546 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3868/7906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:24 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:25.598642 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:25.599764 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:25.607062 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:25.607556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:25.608005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:25.608720 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:25.609232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:25.609675 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:25.757225 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:25.765702 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-9b052728-0085-4130-af9f-d8ee70201eee tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.176543 Oct 03 16:03:25.766297 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4039/7907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:25 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:26.792758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:26.793761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:26.805180 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:26.805660 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:26.806096 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:26.806784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:26.807248 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:26.807667 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:26.951984 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:26.960640 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-be07052f-232e-403b-a995-50a392d8b442 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.174686 Oct 03 16:03:26.961255 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3869/7908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:26 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:27.988116 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:27.989203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:28.000990 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:28.001843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:28.002601 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:28.003804 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:28.004562 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:28.005328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:28.140658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:28.149073 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6b4d339c-38b3-4e99-bbaf-4b49e76d2087 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.167704 Oct 03 16:03:28.149659 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4040/7909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:27 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:29.184285 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:29.184989 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:29.193500 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:29.194065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:29.194575 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:29.195380 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:29.195918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:29.196426 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:29.331714 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:29.339659 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-56740673-7ae1-4c56-8e3e-2661f8aa775b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.160108 Oct 03 16:03:29.340249 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3870/7910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:29 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:30.366929 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:30.367617 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:30.374971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.375466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.375915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.376627 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:30.377121 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:30.377555 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:30.541406 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:30.552060 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b179969f-e97a-4e6b-a984-a3c75c8da01c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.191489 Oct 03 16:03:30.552673 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4041/7911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:30 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:31.577616 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:31.578435 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:31.588386 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:31.589074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:31.589663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:31.590589 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:31.591213 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:31.591779 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:31.737397 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:31.745466 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1e1ceb71-529c-4074-81f5-22b2d0a0b8f4 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.173238 Oct 03 16:03:31.745998 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3871/7912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:31 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:32.770245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:32.770881 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:32.778194 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:32.778698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:32.779150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:32.779859 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:32.780349 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:32.780795 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:32.934389 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:32.944034 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e9f64665-f275-4eb9-8872-ca955c829da1 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.177731 Oct 03 16:03:32.945044 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4042/7913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:32 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:33.972304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:33.973342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:33.985006 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.985811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.986554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:33.987679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:33.988433 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:33.989186 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:34.130973 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:34.139825 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-94ebab02-f53d-4694-9460-eecdf1cdde38 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.174055 Oct 03 16:03:34.140435 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3872/7914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:33 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:35.163979 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:35.164563 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:35.172145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.172653 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.173150 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.173887 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:35.174356 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:35.174800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:35.400296 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:35.409134 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-74bf867e-14e6-4668-a2ab-d8abb8262bd3 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.249255 Oct 03 16:03:35.409724 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4043/7915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:35 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:36.437028 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:36.438075 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:36.449482 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:36.449976 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:36.450418 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:36.451121 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:36.451580 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:36.452018 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:36.593126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:36.601595 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1c3fd0ed-769b-47c1-b2bc-66a41d55dfa5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.171346 Oct 03 16:03:36.602191 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3873/7916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:36 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:37.625218 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:37.625905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:37.633409 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:37.633915 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:37.634732 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:37.635483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:37.636038 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:37.636483 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:37.772589 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:37.781975 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a6e12a11-01c5-4ea5-8174-5917286cf702 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.160777 Oct 03 16:03:37.782690 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4044/7917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:37 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:38.806185 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:38.807120 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:38.814835 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.815354 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.815798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.816514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:38.817010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:38.817449 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:38.963655 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:38.972134 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-de77ff01-2c58-4dc9-939d-2daaf8f7825d tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.169970 Oct 03 16:03:38.972973 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3874/7918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:38 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:39.999053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:39.999727 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:40.007934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.008489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.008994 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.010557 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.011316 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.011624 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.159360 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:40.170463 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-2a5fdd29-0597-415f-a924-8aa31762f7ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1512 microversion: 2.1 time: 0.176854 Oct 03 16:03:40.171049 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4045/7919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:39 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:40.203487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:40.204089 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:40.211379 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.211864 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.212296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.213022 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.213478 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.213927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.263807 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128868) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 16:03:40.335617 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7fec5ee2-98db-46ae-bfda-7a6c74604d33 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "POST /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5/action" status: 202 len: 0 microversion: 2.1 time: 0.136316 Oct 03 16:03:40.336358 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3875/7920] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 16:03:40 2022] POST /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:03:40.344669 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:40.345466 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:40.351572 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.352076 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.352525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.353273 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:40.353735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:40.354170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:40.489263 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:40.497758 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2fcc029-fad4-4785-951a-b7c328e432bf tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1520 microversion: 2.1 time: 0.156836 Oct 03 16:03:40.498236 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4046/7921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:40 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:41.258164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-aec23768-8cc1-4639-a872-98fcb2afc1a7 req-2aac1f37-a064-497d-a7ad-e2bfa56ae6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "name": "network-vif-unplugged", "status": "completed", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:41.270341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aec23768-8cc1-4639-a872-98fcb2afc1a7 req-2aac1f37-a064-497d-a7ad-e2bfa56ae6fc service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:41.270819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aec23768-8cc1-4639-a872-98fcb2afc1a7 req-2aac1f37-a064-497d-a7ad-e2bfa56ae6fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:41.271257 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-aec23768-8cc1-4639-a872-98fcb2afc1a7 req-2aac1f37-a064-497d-a7ad-e2bfa56ae6fc service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:41.282332 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.compute.server_external_events [req-aec23768-8cc1-4639-a872-98fcb2afc1a7 req-2aac1f37-a064-497d-a7ad-e2bfa56ae6fc service nova] Unable to find a host for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5. Dropping event network-vif-unplugged {{(pid=128868) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 16:03:41.283229 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-aec23768-8cc1-4639-a872-98fcb2afc1a7 req-2aac1f37-a064-497d-a7ad-e2bfa56ae6fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029962 Oct 03 16:03:41.283832 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3876/7922] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 16:03:41.526053 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:41.527252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:41.538613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:41.539426 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:41.540185 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:41.541408 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:41.542239 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:41.543002 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:41.685149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:41.693342 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5decd8d8-97f4-415f-a695-fd1e57533c22 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1520 microversion: 2.1 time: 0.174064 Oct 03 16:03:41.694017 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4047/7923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:41 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:42.717603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:42.718221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:42.725436 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.725915 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.726355 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.727058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:42.727490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:42.727909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:42.969886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:42.977882 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-e6c83125-cc0f-400d-b10a-81776eff6126 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1522 microversion: 2.1 time: 0.264432 Oct 03 16:03:42.978521 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3877/7924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:42 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:44.002068 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:44.002701 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:44.010540 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.011276 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.011583 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.012683 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:44.013281 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:44.013638 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:44.225616 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:44.233946 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ad4668a1-00ac-47e0-aabb-24bb7cd0fac5 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1522 microversion: 2.1 time: 0.236020 Oct 03 16:03:44.234532 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4048/7925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:43 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:45.257797 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:45.258358 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:45.265369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.265854 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.266294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.267033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:45.267485 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:45.267911 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:45.404471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:45.412574 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-846d5143-a66e-416e-ab44-1ad14295f9b7 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1522 microversion: 2.1 time: 0.159080 Oct 03 16:03:45.413215 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3878/7926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:45 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:46.436891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:46.437525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:46.444460 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.444957 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.445438 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.446180 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:46.446655 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:46.447097 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:46.586878 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:46.595089 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-41175aca-6936-4e73-bb95-efc8b71f9e14 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1522 microversion: 2.1 time: 0.162709 Oct 03 16:03:46.595688 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4049/7927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:46 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:47.619051 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:47.619679 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:47.627903 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.628396 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.628845 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.629574 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:47.630033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:47.630462 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:47.914151 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:47.922601 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-b451a473-515b-4b38-b391-1700e497e711 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.307790 Oct 03 16:03:47.923207 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3879/7928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:47 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:48.143755 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-e87b80d0-d7c3-40b7-85b7-60f7dfc51fc1 req-1543ed4a-9f55-4e2d-9760-ea728f4504d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:48.155889 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e87b80d0-d7c3-40b7-85b7-60f7dfc51fc1 req-1543ed4a-9f55-4e2d-9760-ea728f4504d7 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.156489 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e87b80d0-d7c3-40b7-85b7-60f7dfc51fc1 req-1543ed4a-9f55-4e2d-9760-ea728f4504d7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.156970 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-e87b80d0-d7c3-40b7-85b7-60f7dfc51fc1 req-1543ed4a-9f55-4e2d-9760-ea728f4504d7 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.168840 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-e87b80d0-d7c3-40b7-85b7-60f7dfc51fc1 req-1543ed4a-9f55-4e2d-9760-ea728f4504d7 service nova] Creating event network-changed:b026d35c-ecc2-4fe7-8fbb-b52141528951 for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 on n-h2-781139-2 Oct 03 16:03:48.174331 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-e87b80d0-d7c3-40b7-85b7-60f7dfc51fc1 req-1543ed4a-9f55-4e2d-9760-ea728f4504d7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034654 Oct 03 16:03:48.174942 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4050/7929] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:48.950713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:48.951609 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:48.963470 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.964340 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.965610 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:48.966329 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:48.966798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:48.967228 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:49.142203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:49.151089 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-fea8f174-657d-45b5-8246-d5fb00204c17 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.207395 Oct 03 16:03:49.151930 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3880/7930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:48 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:50.176434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:50.177220 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:50.185084 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:50.185578 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:50.186051 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:50.186777 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:50.187344 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:50.187798 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:50.331385 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:50.342892 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-0b579637-a0a0-405e-a98f-6ba0707acc21 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.170857 Oct 03 16:03:50.343900 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4051/7931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:50 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:51.371229 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:51.372425 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:51.384250 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.385536 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.386263 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.387244 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:51.387700 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:51.388108 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:51.544322 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:51.552360 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-26305591-53af-4a3e-b9d7-1275e2d4ed9b tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.187870 Oct 03 16:03:51.552959 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3881/7932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:51 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:52.576040 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:52.576674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:52.584090 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:52.584584 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:52.585063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:52.585766 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:52.586232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:52.586663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:52.733965 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:52.742342 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9092558-84ed-4f8d-8cb9-2a63055ed5af tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.170457 Oct 03 16:03:52.742967 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4052/7933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:52 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:53.770343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:53.771365 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:53.783058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.783861 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.784593 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.785786 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:53.786539 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:53.787249 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:53.924664 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:53.933257 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-72783c49-ee76-4dee-a4f2-ec7b2dd9d691 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.169797 Oct 03 16:03:53.933815 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3882/7934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:53 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:54.961014 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:54.962072 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:54.966698 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=31 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:54.975452 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.976274 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.977078 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.978270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:54.979045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:54.979778 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:54.983615 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:55.122368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:55.139411 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-db217949-11a0-4667-b8f6-da6be7822502 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.184944 Oct 03 16:03:55.140072 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4053/7935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:54 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:56.163959 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:56.164587 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:56.168400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:56.172269 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.172767 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.173226 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:56.173934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:56.174387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:56.174816 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:56.178159 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:56.313456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:56.321428 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-293a1120-83dc-40e7-b20f-668c98cb5f64 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.161343 Oct 03 16:03:56.322008 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3883/7936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:56 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:57.344461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:57.345189 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:57.352961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.353505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.353977 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.354717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:57.355205 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:57.355662 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:57.507967 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:57.516672 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-5c490f6f-74a1-4534-8039-ebe0c4c891fd tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.176419 Oct 03 16:03:57.517275 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4054/7937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:57 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:58.240341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "name": "network-vif-plugged", "status": "completed", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:03:58.252755 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.253294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.253796 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.265998 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] Creating event network-vif-plugged:b026d35c-ecc2-4fe7-8fbb-b52141528951 for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 on n-h2-781139-2 Oct 03 16:03:58.270439 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] [cf0ddb23-f2f1-4681-a290-62a464caed80] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 16:03:58.540298 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:58.540901 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:58.549473 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.549964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.550418 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.551138 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:58.551606 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:58.552031 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:58.689639 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:58.702239 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-d2d55a7f-dee1-49a6-8a8b-82065c917cd6 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.165651 Oct 03 16:03:58.703059 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4055/7938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:58 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:03:59.278490 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] [cf0ddb23-f2f1-4681-a290-62a464caed80] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60852. Oct 03 16:03:59.282494 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-18a8ed94-db98-4439-8058-d17d16ba5d8a req-e0aeef52-9a74-46aa-982d-4b87312f6c2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.046642 Oct 03 16:03:59.283154 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3884/7939] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:03:59.728433 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:03:59.729214 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:03:59.738378 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:59.738877 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:59.739320 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.740027 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:03:59.740492 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:03:59.740948 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:03:59.898869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:03:59.912742 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-6525330e-8d84-4874-bf91-1c031a3e0648 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1578 microversion: 2.1 time: 0.189296 Oct 03 16:03:59.913744 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4056/7940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:03:59 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:04:00.941617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:04:00.942558 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:04:00.952637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.953464 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.954115 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:00.955105 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:04:00.955581 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:04:00.956009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:04:01.095149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:04:01.103375 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d7fb8073-8d0b-447f-aeed-e1d189893856 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1565 microversion: 2.1 time: 0.170388 Oct 03 16:04:01.103958 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3885/7941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:04:00 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:17.534362 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=7 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:17.535170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=23 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:17.539082 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=5 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:17.539909 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=13 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:17.541817 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 16:05:17.542575 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 16:05:17.542948 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 16:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 (ip 10.222.0.20) !!! Oct 03 16:05:17.544902 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 16:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 03 16:05:17.559783 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-43ec4b92-81d6-43fd-92f8-1ff327628b9a req-eff262da-06c2-4dcb-8ddc-7ebf829e009d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:17.561863 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:17.562392 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:17.569725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.570204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.570670 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.571201 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-43ec4b92-81d6-43fd-92f8-1ff327628b9a req-eff262da-06c2-4dcb-8ddc-7ebf829e009d service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.571382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.571720 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-43ec4b92-81d6-43fd-92f8-1ff327628b9a req-eff262da-06c2-4dcb-8ddc-7ebf829e009d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.572149 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-43ec4b92-81d6-43fd-92f8-1ff327628b9a req-eff262da-06c2-4dcb-8ddc-7ebf829e009d service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.572302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.572610 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.586418 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-43ec4b92-81d6-43fd-92f8-1ff327628b9a req-eff262da-06c2-4dcb-8ddc-7ebf829e009d service nova] Creating event network-changed:b026d35c-ecc2-4fe7-8fbb-b52141528951 for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 on n-h2-781139-2 Oct 03 16:05:17.592269 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-43ec4b92-81d6-43fd-92f8-1ff327628b9a req-eff262da-06c2-4dcb-8ddc-7ebf829e009d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055388 Oct 03 16:05:17.593165 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3886/7942] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:17.600839 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:05:17.693471 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4081264-e9a3-4af9-afc6-15fc1a8a5b95 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 204 len: 0 microversion: 2.1 time: 0.160836 Oct 03 16:05:17.697296 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4057/7943] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 16:05:17 2022] DELETE /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:05:17.703761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:17.704576 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:17.715009 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.715853 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.716511 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.717468 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:17.718144 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:17.718799 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:17.888347 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:17.897673 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-941baf1a-74bd-4253-86e3-e05750eaa025 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.198235 Oct 03 16:05:17.898606 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3887/7944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:17 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:18.922742 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:18.923444 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:18.934285 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.934911 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.935525 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:18.936739 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:18.937520 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:18.938167 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:19.084105 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:19.105659 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-641c25a5-b462-479a-ace4-e7cac787fe6c tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1571 microversion: 2.1 time: 0.187344 Oct 03 16:05:19.106282 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4058/7945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:18 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1571 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:19.725892 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-0f2c7277-b29e-4f5b-8c91-1de065fe57ea req-fd0506ee-3146-4268-b84d-53341505f0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4467e7-ba5c-472d-927f-1dbfc89ff4e5", "name": "network-vif-deleted", "tag": "b026d35c-ecc2-4fe7-8fbb-b52141528951"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:19.736310 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0f2c7277-b29e-4f5b-8c91-1de065fe57ea req-fd0506ee-3146-4268-b84d-53341505f0e1 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:19.736791 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0f2c7277-b29e-4f5b-8c91-1de065fe57ea req-fd0506ee-3146-4268-b84d-53341505f0e1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:19.737387 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-0f2c7277-b29e-4f5b-8c91-1de065fe57ea req-fd0506ee-3146-4268-b84d-53341505f0e1 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:19.749189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-0f2c7277-b29e-4f5b-8c91-1de065fe57ea req-fd0506ee-3146-4268-b84d-53341505f0e1 service nova] Creating event network-vif-deleted:b026d35c-ecc2-4fe7-8fbb-b52141528951 for instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 on n-h2-781139-2 Oct 03 16:05:19.754189 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-0f2c7277-b29e-4f5b-8c91-1de065fe57ea req-fd0506ee-3146-4268-b84d-53341505f0e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085905 Oct 03 16:05:19.755197 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3888/7946] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:20.131599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:20.132232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:20.140133 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.140640 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.141170 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.141891 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:20.142364 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:20.142782 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:20.206482 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:20.214965 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-73e9abe1-3172-4f8c-91a4-4422b71d54ea tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1220 microversion: 2.1 time: 0.087374 Oct 03 16:05:20.215624 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4059/7947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:20 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:21.239569 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:21.240343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:21.248858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.249592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.250271 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.251382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:21.252065 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:21.252773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:21.328460 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:21.336743 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-29d4743e-ac9b-4e21-964e-8551b64b6487 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1220 microversion: 2.1 time: 0.102383 Oct 03 16:05:21.337620 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3889/7948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:21 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:22.359848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:22.360424 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:22.367894 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.368394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.368956 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.369861 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:22.370335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:22.370772 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:22.435838 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:22.444340 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-72dd9ccd-91b0-4ec2-9fac-e98bcae0fd86 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1220 microversion: 2.1 time: 0.088662 Oct 03 16:05:22.444962 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4060/7949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:22 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:23.468178 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:23.468790 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:23.476330 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:23.476819 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:23.477284 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:23.478239 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:23.478884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:23.479439 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:23.544357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95d4b82656d4825a820d5fa0f52daa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f9c57611f2496f8b3c857ceeddb568', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:23.552552 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-848da874-7464-4bf2-b745-0d5d77196b83 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 200 len: 1220 microversion: 2.1 time: 0.088425 Oct 03 16:05:23.553259 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3890/7950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:23 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:24.576093 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:24.576726 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] [instance: 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:24.584582 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:24.585141 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:24.585599 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:24.586359 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:24.586825 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:24.587302 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:24.602765 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.wsgi [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] HTTP exception thrown: Instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 could not be found. Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Request method failure captured: Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: request: GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 HTTP/1.1 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: Accept: application/json Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: Accept-Encoding: identity Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: Connection: close Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: Content-Length: 0 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: Content-Type: application/json Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: Host: 10.222.0.20 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: Openstack-System-Scope: None Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: User-Agent: python-urllib3/1.26.12 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Auth-Token: gAAAAABjOwYLN-ifDEDYKjanxGOL-72seVhS92R44JQmnik2hsFnzd42TZYizB6e1PqOJXTilSIGfhjHqdjtydHh5UG31cOqwkpSn3IHuZrverF08x8AWRuKjPWho4one_8a28FWW2-Fctd_yOc0UfEM0adZcx_zukr4oZ8wSPv_LXrFL3Ol6pg Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Id: None Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Domain-Name: None Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Identity-Status: Confirmed Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Is-Admin-Project: True Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Id: default Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Domain-Name: Default Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Id: 96f9c57611f2496f8b3c857ceeddb568 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Project-Name: tempest-TestShelveInstance-920636672 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Role: member,reader Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Roles: member,reader Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/96f9c57611f2496f8b3c857ceeddb568"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_96f9c57611f2496f8b3c857ceeddb568", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/96f9c57611f2496f8b3c857ceeddb568"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/96f9c57611f2496f8b3c857ceeddb568"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant: tempest-TestShelveInstance-920636672 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Id: 96f9c57611f2496f8b3c857ceeddb568 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-Tenant-Name: tempest-TestShelveInstance-920636672 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-User: tempest-TestShelveInstance-920636672-project Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Id: default Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-User-Domain-Name: Default Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-User-Id: f95d4b82656d4825a820d5fa0f52daa4 Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: X-User-Name: tempest-TestShelveInstance-920636672-project Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: method: > Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: exception: Instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 could not be found. Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: action_args: {'id': '2c4467e7-ba5c-472d-927f-1dbfc89ff4e5'} Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 could not be found. Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 could not be found. Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:05:24.604497 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 could not be found. Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: ERROR nova.api.openstack.wsgi Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Returning 404 to user: Instance 2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 could not be found. {{(pid=128869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-54ac3aee-7d96-4626-8c3b-f6c2e0b8ce31 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5" status: 404 len: 111 microversion: 2.1 time: 0.034097 Oct 03 16:05:24.609645 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4061/7951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:24 2022] GET /compute/v2.1/servers/2c4467e7-ba5c-472d-927f-1dbfc89ff4e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:05:24.780085 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-dd7a4c7a-8692-485b-b248-b6b41187f782 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] Calling method '.version_select at 0x7fb2313910d0>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:24.813276 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-dd7a4c7a-8692-485b-b248-b6b41187f782 tempest-TestShelveInstance-920636672 tempest-TestShelveInstance-920636672-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1572149208" status: 202 len: 0 microversion: 2.1 time: 0.037199 Oct 03 16:05:24.815643 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3891/7952] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 3 16:05:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1572149208 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 16:05:42.444069 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:42.445427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:42.655328 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-38feab0d-fc6c-41fb-9a2b-1e7115270d6a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Action: 'create', calling method: .version_select at 0x7fb22b8a0700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-2024640210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq+HEKCnee2rKiQo0Jwk2OsLf2fbe1X6MSVS+KKuzyV+StBK4MzM7Duckbjan7IyvR9bm5K12rz7TfjgoMRS3H2oOCj9zKSOncBE6NTVln46CClgaXaZyFVE43+Zk4/w=="}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:42.672343 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-38feab0d-fc6c-41fb-9a2b-1e7115270d6a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Getting quotas for project c80c06c290ec4236843e59bc9129c52e. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:05:42.678091 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-38feab0d-fc6c-41fb-9a2b-1e7115270d6a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Getting quotas for user 75fa8cbee0114281a5f6476905078614 and project c80c06c290ec4236843e59bc9129c52e. Resources: {'key_pairs'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:05:42.722294 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-38feab0d-fc6c-41fb-9a2b-1e7115270d6a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.284515 Oct 03 16:05:42.723771 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4062/7953] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 3 16:05:42 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:43.762276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=22 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:43.764057 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:43.767961 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-676334632", "imageRef": "b9a0038d-acfa-4c25-a7f1-6598cf246eca", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2024640210", "security_groups": [{"name": "tempest-secgroup-smoke-275735257"}], "networks": [{"uuid": "849fef2b-cf90-4b8f-9933-6fc084350f2e"}]}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:43.878343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.network.neutron [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] validate_networks() for [('849fef2b-cf90-4b8f-9933-6fc084350f2e', None, None, None, None, None)] {{(pid=128868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:05:44.271341 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Flavor limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:05:44.271773 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Image limits 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:05:44.272256 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Flavor pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:05:44.272669 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Image pref 0:0:0 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:05:44.273126 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.virt.hardware [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:05:44.282697 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:44.283110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:44.283548 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:44.284276 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:44.284746 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:44.285362 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:44.303740 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Getting quotas for project c80c06c290ec4236843e59bc9129c52e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:05:44.309391 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.quota [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Getting quotas for user 75fa8cbee0114281a5f6476905078614 and project c80c06c290ec4236843e59bc9129c52e. Resources: {'ram', 'instances', 'cores'} {{(pid=128868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:05:44.322686 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Going to run 1 instances... {{(pid=128868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:05:44.325097 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9a0038d-acfa-4c25-a7f1-6598cf246eca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:05:44.372269 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [0fd0ca82-7e3b-4d62-a84a-caceb941d5d4] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 16:05:45.380374 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [0fd0ca82-7e3b-4d62-a84a-caceb941d5d4] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 32818. Oct 03 16:05:45.384977 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-5f880773-3251-4001-afa4-528c2f415b08 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.624589 Oct 03 16:05:45.385744 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3892/7954] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 16:05:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:05:45.399571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78d3b1fc-e297-4d85-8f0b-3cde88fbae6c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:45.400531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78d3b1fc-e297-4d85-8f0b-3cde88fbae6c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:45.457382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78d3b1fc-e297-4d85-8f0b-3cde88fbae6c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:45.464881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78d3b1fc-e297-4d85-8f0b-3cde88fbae6c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1248 microversion: 2.1 time: 0.070960 Oct 03 16:05:45.465758 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4063/7955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:45 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:46.488706 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-2dc7e813-5168-47ed-82f3-aeb63347b6f9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:46.489346 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-2dc7e813-5168-47ed-82f3-aeb63347b6f9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:46.549037 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-2dc7e813-5168-47ed-82f3-aeb63347b6f9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:46.560575 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-2dc7e813-5168-47ed-82f3-aeb63347b6f9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1248 microversion: 2.1 time: 0.076408 Oct 03 16:05:46.561423 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3893/7956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:46 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:47.583987 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b9e908a3-ccb6-48e2-81b6-c7ce9d9f770d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:47.584645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b9e908a3-ccb6-48e2-81b6-c7ce9d9f770d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:47.644842 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b9e908a3-ccb6-48e2-81b6-c7ce9d9f770d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:47.652111 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b9e908a3-ccb6-48e2-81b6-c7ce9d9f770d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1248 microversion: 2.1 time: 0.072104 Oct 03 16:05:47.652828 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4064/7957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:47 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1248 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:48.680128 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-746acf36-bd18-4f48-8a4f-ea0866f873bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:48.681324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-746acf36-bd18-4f48-8a4f-ea0866f873bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:48.739304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-746acf36-bd18-4f48-8a4f-ea0866f873bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:48.746492 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-746acf36-bd18-4f48-8a4f-ea0866f873bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1248 microversion: 2.1 time: 0.073627 Oct 03 16:05:48.747167 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3894/7958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:48 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:49.774152 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:49.775045 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:49.786674 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:49.787497 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:49.788247 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:49.789558 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:49.790335 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:49.791063 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:49.855794 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:49.864051 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1d659d2d-6a4e-4969-994a-2ae4e09597ce tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1252 microversion: 2.1 time: 0.096656 Oct 03 16:05:49.864637 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4065/7959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:49 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1252 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:50.889592 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:50.890324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:50.899411 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.899981 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.900486 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.901429 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:50.901930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:50.902489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:50.978747 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:50.987336 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-669bc5fd-70d5-476c-83a0-7c9785e132dc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1306 microversion: 2.1 time: 0.103393 Oct 03 16:05:50.987933 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3895/7960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:50 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:52.010985 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:52.011399 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:52.018893 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:52.019398 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:52.019852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:52.020571 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:52.021087 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:52.021531 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:52.062489 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-1844a46a-5c18-48e2-ab6b-67c79f70eede req-5683319c-2793-43be-868f-c7e3abf984a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ad5dde-0550-4389-871f-4973275ccd06", "tag": "d7a1ff90-8859-4571-9838-61ff739eadd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:52.072848 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1844a46a-5c18-48e2-ab6b-67c79f70eede req-5683319c-2793-43be-868f-c7e3abf984a9 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:52.073296 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1844a46a-5c18-48e2-ab6b-67c79f70eede req-5683319c-2793-43be-868f-c7e3abf984a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:52.073730 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-1844a46a-5c18-48e2-ab6b-67c79f70eede req-5683319c-2793-43be-868f-c7e3abf984a9 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:52.085487 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-1844a46a-5c18-48e2-ab6b-67c79f70eede req-5683319c-2793-43be-868f-c7e3abf984a9 service nova] Creating event network-changed:d7a1ff90-8859-4571-9838-61ff739eadd7 for instance 00ad5dde-0550-4389-871f-4973275ccd06 on n-h1-781139-2 Oct 03 16:05:52.093605 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-1844a46a-5c18-48e2-ab6b-67c79f70eede req-5683319c-2793-43be-868f-c7e3abf984a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034827 Oct 03 16:05:52.094676 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3896/7961] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:52.651095 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:52.659343 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-12586193-a814-4788-baae-e07c28358b00 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1373 microversion: 2.1 time: 0.652739 Oct 03 16:05:52.659941 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4066/7962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:52 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1373 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:53.684413 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:53.685070 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:53.691886 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:53.692369 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:53.692801 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:53.693518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:53.693969 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:53.694388 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:53.844214 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:53.852280 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-59975ba1-65c8-4e01-b316-a5c7594ba599 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1373 microversion: 2.1 time: 0.173169 Oct 03 16:05:53.852891 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3897/7963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:53 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:54.880329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:54.881381 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:54.892036 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:54.892556 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:54.893011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:54.893719 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:54.894183 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:54.894614 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:55.047382 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:55.055646 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4c44f05e-45ad-454b-a283-a335625ae791 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1373 microversion: 2.1 time: 0.182032 Oct 03 16:05:55.056208 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4067/7964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:54 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:56.082921 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:56.083927 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:56.087109 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:56.095858 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:56.096343 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:56.096781 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:56.097530 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:56.097983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:56.098412 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:56.254150 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:56.267642 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-7e5283fb-9deb-4c28-aa5e-10b1525b1b5b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1373 microversion: 2.1 time: 0.191252 Oct 03 16:05:56.268270 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3898/7965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:56 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:57.295789 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:57.296387 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:57.303864 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:57.304351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:57.304800 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:57.305545 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:57.306009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:57.306445 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:57.446376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:57.458983 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-4eeb4572-9008-4eda-990e-6f98988658f6 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1373 microversion: 2.1 time: 0.170045 Oct 03 16:05:57.459828 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4068/7966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:57 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:57.975877 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-b22312e0-6cd0-4647-909d-353e78956c37 req-01123615-52b8-47db-a703-b2b8bf4a04a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ad5dde-0550-4389-871f-4973275ccd06", "name": "network-vif-plugged", "status": "completed", "tag": "d7a1ff90-8859-4571-9838-61ff739eadd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:05:57.988407 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b22312e0-6cd0-4647-909d-353e78956c37 req-01123615-52b8-47db-a703-b2b8bf4a04a5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:57.988891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b22312e0-6cd0-4647-909d-353e78956c37 req-01123615-52b8-47db-a703-b2b8bf4a04a5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:57.989353 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-b22312e0-6cd0-4647-909d-353e78956c37 req-01123615-52b8-47db-a703-b2b8bf4a04a5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:58.002139 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-b22312e0-6cd0-4647-909d-353e78956c37 req-01123615-52b8-47db-a703-b2b8bf4a04a5 service nova] Creating event network-vif-plugged:d7a1ff90-8859-4571-9838-61ff739eadd7 for instance 00ad5dde-0550-4389-871f-4973275ccd06 on n-h1-781139-2 Oct 03 16:05:58.007554 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-b22312e0-6cd0-4647-909d-353e78956c37 req-01123615-52b8-47db-a703-b2b8bf4a04a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035885 Oct 03 16:05:58.008494 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3899/7967] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:05:58.487005 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:58.487704 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:58.490252 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:58.499243 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:58.499917 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:58.500527 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:58.501521 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:58.502156 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:58.502749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:58.654048 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:58.664109 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-66ce4254-fe72-4e5a-ac10-acd31cd35f22 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1373 microversion: 2.1 time: 0.184199 Oct 03 16:05:58.664703 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4069/7968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:58 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:59.687111 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=10 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:59.692357 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:59.693091 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:59.699905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:59.700383 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:59.700847 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:59.701658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:59.702207 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:59.702726 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:59.839307 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:05:59.847412 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-1d67418c-8e7f-44e7-831b-3372a10f766e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1558 microversion: 2.1 time: 0.162061 Oct 03 16:05:59.847967 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3900/7969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:59 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:05:59.869708 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:05:59.870341 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:05:59.877749 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:59.878271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:59.878717 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:05:59.879415 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:05:59.879884 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:05:59.880351 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:00.015132 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:06:00.023212 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-1854b2a7-fd9f-4563-8929-8d371c08b91e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1558 microversion: 2.1 time: 0.157395 Oct 03 16:06:00.023802 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4070/7970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:05:59 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:06:01.778559 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-bcc5d3b0-f7e7-46e0-b133-4457c5ac4799 req-631663a7-eda6-4c1b-a35f-f5a1d3ffff73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ad5dde-0550-4389-871f-4973275ccd06", "tag": "d7a1ff90-8859-4571-9838-61ff739eadd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:06:01.790268 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bcc5d3b0-f7e7-46e0-b133-4457c5ac4799 req-631663a7-eda6-4c1b-a35f-f5a1d3ffff73 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:06:01.790750 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bcc5d3b0-f7e7-46e0-b133-4457c5ac4799 req-631663a7-eda6-4c1b-a35f-f5a1d3ffff73 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:06:01.791177 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-bcc5d3b0-f7e7-46e0-b133-4457c5ac4799 req-631663a7-eda6-4c1b-a35f-f5a1d3ffff73 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:06:01.803844 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-bcc5d3b0-f7e7-46e0-b133-4457c5ac4799 req-631663a7-eda6-4c1b-a35f-f5a1d3ffff73 service nova] Creating event network-changed:d7a1ff90-8859-4571-9838-61ff739eadd7 for instance 00ad5dde-0550-4389-871f-4973275ccd06 on n-h1-781139-2 Oct 03 16:06:01.809433 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-bcc5d3b0-f7e7-46e0-b133-4457c5ac4799 req-631663a7-eda6-4c1b-a35f-f5a1d3ffff73 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034672 Oct 03 16:06:01.810063 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3901/7971] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:29.660274 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 16:08:29.661304 n-d-781139-2 devstack@n-api.service[128869]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 03 16:08:29.661879 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:29.662651 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=36 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:29.663605 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 16:08:29.664041 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 16:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06/action (ip 10.222.0.20) !!! Oct 03 16:08:29.666210 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 16:08:29.666391 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 16:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06/action (ip 10.222.0.20) !!! Oct 03 16:08:29.667457 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 16:08:29.667666 n-d-781139-2 devstack@n-api.service[128869]: Mon Oct 3 16:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06/action (ip 10.222.0.20) !!! Oct 03 16:08:29.673975 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-608315693"}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:29.676468 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:29.695269 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:29.695771 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:29.696219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:29.696964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:29.697412 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:29.697845 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:29.910654 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae4b5620-437c-4bff-ad0f-7542e68e059c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "POST /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06/action" status: 202 len: 0 microversion: 2.1 time: 0.253572 Oct 03 16:08:29.911201 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4071/7972] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 16:08:29 2022] POST /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 16:08:36.780071 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d4a85f77-e76c-40fd-9f4d-c0059237fcc3] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 16:08:36.780892 n-d-781139-2 devstack@n-api.service[128868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 16:08:36.781554 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:36.782279 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=32 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:36.783593 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 16:08:36.783815 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 16:08:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 03 16:08:36.852342 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-9cc183fc-32ec-4d69-9b7d-647fd45c8113 req-50c43263-5cf1-4ce7-924d-45102b4f9363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ad5dde-0550-4389-871f-4973275ccd06", "name": "network-vif-plugged", "status": "completed", "tag": "d7a1ff90-8859-4571-9838-61ff739eadd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:36.863490 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9cc183fc-32ec-4d69-9b7d-647fd45c8113 req-50c43263-5cf1-4ce7-924d-45102b4f9363 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:36.864010 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9cc183fc-32ec-4d69-9b7d-647fd45c8113 req-50c43263-5cf1-4ce7-924d-45102b4f9363 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:36.864445 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-9cc183fc-32ec-4d69-9b7d-647fd45c8113 req-50c43263-5cf1-4ce7-924d-45102b4f9363 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:36.875431 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-9cc183fc-32ec-4d69-9b7d-647fd45c8113 req-50c43263-5cf1-4ce7-924d-45102b4f9363 service nova] Creating event network-vif-plugged:d7a1ff90-8859-4571-9838-61ff739eadd7 for instance 00ad5dde-0550-4389-871f-4973275ccd06 on n-h1-781139-2 Oct 03 16:08:36.880764 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-9cc183fc-32ec-4d69-9b7d-647fd45c8113 req-50c43263-5cf1-4ce7-924d-45102b4f9363 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102557 Oct 03 16:08:36.881487 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3902/7973] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:49.652665 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:49.653723 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:49.660538 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1866017627", "imageRef": "9f57ef39-21b0-419d-8045-67134ddcff5d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-2024640210", "security_groups": [{"name": "tempest-secgroup-smoke-275735257"}], "networks": [{"uuid": "849fef2b-cf90-4b8f-9933-6fc084350f2e"}]}} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:49.683642 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [647aabcd-8789-4fa0-8b90-8cdb1db1e27c] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33082. Oct 03 16:08:49.685758 n-d-781139-2 devstack@n-api.service[128869]: INFO oslo.messaging._drivers.impl_rabbit [-] [fa37c600-d2a7-4fd7-b5ad-f5220cf51f9e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33084. Oct 03 16:08:49.914230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.network.neutron [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] validate_networks() for [('849fef2b-cf90-4b8f-9933-6fc084350f2e', None, None, None, None, None)] {{(pid=128869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 16:08:50.692485 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Flavor limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 16:08:50.693172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Image limits 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 16:08:50.693817 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Flavor pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 16:08:50.694405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Image pref 0:0:0 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 16:08:50.694840 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.virt.hardware [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 16:08:50.704224 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:50.704724 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:50.705191 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:50.705982 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:50.706394 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:50.706831 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:50.725245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Getting quotas for project c80c06c290ec4236843e59bc9129c52e. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 16:08:50.730607 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.quota [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Getting quotas for user 75fa8cbee0114281a5f6476905078614 and project c80c06c290ec4236843e59bc9129c52e. Resources: {'ram', 'instances', 'cores'} {{(pid=128869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 16:08:50.743699 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Going to run 1 instances... {{(pid=128869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 16:08:50.746270 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9f57ef39-21b0-419d-8045-67134ddcff5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 16:08:50.796869 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-e4ee0a78-b68a-4690-b7b8-818f6394104d tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.147349 Oct 03 16:08:50.797750 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4072/7974] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 3 16:08:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 16:08:50.807364 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:50.808217 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:08:50.813084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d784a4b2-a6b8-4b6a-87eb-bcb76d16f35f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:50.816719 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d784a4b2-a6b8-4b6a-87eb-bcb76d16f35f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:50.836523 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] [d4a85f77-e76c-40fd-9f4d-c0059237fcc3] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33100. Oct 03 16:08:50.838896 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] [ec801f00-20de-4b58-8eb2-6ee050f4dfbf] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 33102. Oct 03 16:08:50.964171 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-d784a4b2-a6b8-4b6a-87eb-bcb76d16f35f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:50.971995 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d784a4b2-a6b8-4b6a-87eb-bcb76d16f35f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1249 microversion: 2.1 time: 0.166827 Oct 03 16:08:50.972562 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3903/7975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:50 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1249 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:51.994677 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-78d0fd27-3576-4f6d-bdee-2907ae2cca9b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:51.995271 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-78d0fd27-3576-4f6d-bdee-2907ae2cca9b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:52.051172 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-78d0fd27-3576-4f6d-bdee-2907ae2cca9b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:52.059437 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-78d0fd27-3576-4f6d-bdee-2907ae2cca9b tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1249 microversion: 2.1 time: 0.068764 Oct 03 16:08:52.060028 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4073/7976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:51 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:52.782682 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-97901c8f-961c-424d-a792-1cedbe43aec5 req-1513a8f8-72c8-4889-9d0a-875a5e663387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ad5dde-0550-4389-871f-4973275ccd06", "name": "network-vif-unplugged", "status": "completed", "tag": "d7a1ff90-8859-4571-9838-61ff739eadd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:08:52.794461 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-97901c8f-961c-424d-a792-1cedbe43aec5 req-1513a8f8-72c8-4889-9d0a-875a5e663387 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:52.794891 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-97901c8f-961c-424d-a792-1cedbe43aec5 req-1513a8f8-72c8-4889-9d0a-875a5e663387 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:52.795316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-97901c8f-961c-424d-a792-1cedbe43aec5 req-1513a8f8-72c8-4889-9d0a-875a5e663387 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:52.812724 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-97901c8f-961c-424d-a792-1cedbe43aec5 req-1513a8f8-72c8-4889-9d0a-875a5e663387 service nova] Creating event network-vif-unplugged:d7a1ff90-8859-4571-9838-61ff739eadd7 for instance 00ad5dde-0550-4389-871f-4973275ccd06 on n-h1-781139-2 Oct 03 16:08:52.818656 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-97901c8f-961c-424d-a792-1cedbe43aec5 req-1513a8f8-72c8-4889-9d0a-875a5e663387 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039670 Oct 03 16:08:52.819362 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3904/7977] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:08:53.082964 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:53.084195 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:53.091776 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:53.092523 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:53.093011 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:53.093735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:53.094198 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:53.094663 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:53.180912 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:53.188903 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-a305a66d-84a5-43bf-b8f9-316a9851fe99 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1309 microversion: 2.1 time: 0.110200 Oct 03 16:08:53.189521 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4074/7978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:53 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:54.213905 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:54.214508 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:54.221266 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:54.221778 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:54.222221 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:54.223368 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:54.223841 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:54.224287 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:54.371839 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:54.380341 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9af5b04a-5531-4a2b-a12b-7505def81070 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.171893 Oct 03 16:08:54.381036 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3905/7979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:54 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:55.404888 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:55.405650 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:55.413454 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:55.413971 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:55.414421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:55.415134 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:55.415905 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:55.416352 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:55.572993 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:55.582520 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b5696d55-07e9-4075-b5ed-dba09c39e99e tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.182408 Oct 03 16:08:55.583111 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4075/7980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:55 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:56.606437 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:56.607074 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:56.614782 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:56.615305 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:56.615825 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:56.616546 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:56.617032 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:56.617456 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:56.765573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:56.774134 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-ef38a088-457f-4c2c-93ac-736d31466ae2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.171662 Oct 03 16:08:56.781002 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3906/7981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:56 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:57.797411 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:57.798149 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:57.805966 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:57.806469 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:57.806934 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:57.807666 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:57.808136 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:57.808613 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:57.971427 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:57.981267 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c8584411-54b7-4069-ab91-29fbeb20d01f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.187893 Oct 03 16:08:57.985244 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4076/7982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:57 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:08:59.004543 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:08:59.006143 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:08:59.015304 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:59.015876 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:59.016392 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:59.017566 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:08:59.018084 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:08:59.018573 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:08:59.164400 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:08:59.173105 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-db6bbebf-f9ee-4727-8f6c-63d8dcb7af03 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.172713 Oct 03 16:08:59.173924 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3907/7983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:08:58 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:00.196363 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:00.197279 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:00.204705 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:00.205210 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:00.205658 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:00.206391 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:00.206866 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:00.207301 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:00.355461 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:00.364746 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-209a4587-742f-45da-b7e7-304fddf32778 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.172500 Oct 03 16:09:00.365579 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4077/7984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:00 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:01.389106 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:01.389784 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:01.393123 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell0:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:01.398993 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:01.399495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:01.399933 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:01.400756 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:01.401261 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:01.401674 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:01.540733 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:01.548641 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-f5d96f77-9df3-4250-aed7-bfbcfc8e931c tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.163546 Oct 03 16:09:01.549258 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3908/7985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:01 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:01.910272 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=2 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:01.915425 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-b3a4dd2d-0562-4930-a0dc-49c3ae89dc28 req-dcc5fe6f-2a0d-4738-a2b8-a8acb09a89e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d30614-959f-4199-a552-15df900f1e05", "tag": "21884182-126a-4a23-94b7-011638a5aec4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:01.925843 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3a4dd2d-0562-4930-a0dc-49c3ae89dc28 req-dcc5fe6f-2a0d-4738-a2b8-a8acb09a89e8 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:01.926331 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3a4dd2d-0562-4930-a0dc-49c3ae89dc28 req-dcc5fe6f-2a0d-4738-a2b8-a8acb09a89e8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:01.926797 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-b3a4dd2d-0562-4930-a0dc-49c3ae89dc28 req-dcc5fe6f-2a0d-4738-a2b8-a8acb09a89e8 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:01.938817 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-b3a4dd2d-0562-4930-a0dc-49c3ae89dc28 req-dcc5fe6f-2a0d-4738-a2b8-a8acb09a89e8 service nova] Creating event network-changed:21884182-126a-4a23-94b7-011638a5aec4 for instance 67d30614-959f-4199-a552-15df900f1e05 on n-h2-781139-2 Oct 03 16:09:01.944332 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-b3a4dd2d-0562-4930-a0dc-49c3ae89dc28 req-dcc5fe6f-2a0d-4738-a2b8-a8acb09a89e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034281 Oct 03 16:09:01.944894 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4078/7986] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:02.574518 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:02.575324 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:02.584316 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:02.585153 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:02.585713 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:02.586567 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:02.587163 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:02.587698 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:02.732798 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:02.741571 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-88e73242-52e2-4266-b35a-476dc9947c95 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.172064 Oct 03 16:09:02.742161 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3909/7987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:02 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:03.762017 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell0:SELECT=8 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:03.767758 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:03.768486 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:03.775692 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:03.776184 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:03.776637 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:03.777377 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:03.777849 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:03.778290 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:03.918735 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:03.926741 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-220c6cac-f2f9-44b1-b01b-c341e79c8856 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.165753 Oct 03 16:09:03.927336 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4079/7988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:03 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:04.952440 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:04.953233 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:04.962640 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:04.963253 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:04.963811 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:04.964680 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:04.965294 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:04.965831 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:05.106748 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:05.117857 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-bdc3baba-ddd9-4875-b5de-eb59ac93ebf8 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.170689 Oct 03 16:09:05.118385 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3910/7989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:04 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:05.760157 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-d77ab0b1-ac42-4b27-aee3-95a8c5bd3183 req-7b00d5cd-9022-4410-b00b-9755469010ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d30614-959f-4199-a552-15df900f1e05", "name": "network-vif-plugged", "status": "completed", "tag": "21884182-126a-4a23-94b7-011638a5aec4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:05.772074 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d77ab0b1-ac42-4b27-aee3-95a8c5bd3183 req-7b00d5cd-9022-4410-b00b-9755469010ff service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:05.772623 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d77ab0b1-ac42-4b27-aee3-95a8c5bd3183 req-7b00d5cd-9022-4410-b00b-9755469010ff service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:05.773164 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-d77ab0b1-ac42-4b27-aee3-95a8c5bd3183 req-7b00d5cd-9022-4410-b00b-9755469010ff service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:05.785848 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-d77ab0b1-ac42-4b27-aee3-95a8c5bd3183 req-7b00d5cd-9022-4410-b00b-9755469010ff service nova] Creating event network-vif-plugged:21884182-126a-4a23-94b7-011638a5aec4 for instance 67d30614-959f-4199-a552-15df900f1e05 on n-h2-781139-2 Oct 03 16:09:05.791293 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-d77ab0b1-ac42-4b27-aee3-95a8c5bd3183 req-7b00d5cd-9022-4410-b00b-9755469010ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036543 Oct 03 16:09:05.791901 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4080/7990] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:09:06.145930 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:06.146934 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:06.154131 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:06.154619 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:06.155058 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:06.155758 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:06.156216 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:06.156637 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:06.295774 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:06.306530 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-60f01162-bcc4-4cd6-80ec-2f36361c7434 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1374 microversion: 2.1 time: 0.167389 Oct 03 16:09:06.307420 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3911/7991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:06 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:07.334830 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:07.335546 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:07.343368 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:07.343862 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:07.344315 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:07.345041 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:07.345512 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:07.345944 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:07.492033 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:07.504170 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-ae1532a5-dcb6-41dd-bd72-5655e0d75774 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1560 microversion: 2.1 time: 0.173499 Oct 03 16:09:07.504974 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4081/7992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:07 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:07.533382 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:09:07.533974 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:09:07.541300 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:07.541789 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:07.542232 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:07.542932 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:07.543487 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:07.543918 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:07.688893 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:09:07.698592 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-c9c4d4f9-b11c-4c6c-8c2c-b879fd14511a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1560 microversion: 2.1 time: 0.169206 Oct 03 16:09:07.699191 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3912/7993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:09:07 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:09:09.735405 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-5ecc0f1e-4cad-489f-aeb1-03cf73ecaddd req-b3173fa9-3bfb-4800-9ffe-9c541b13b201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d30614-959f-4199-a552-15df900f1e05", "tag": "21884182-126a-4a23-94b7-011638a5aec4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:09:09.745488 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5ecc0f1e-4cad-489f-aeb1-03cf73ecaddd req-b3173fa9-3bfb-4800-9ffe-9c541b13b201 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:09:09.745978 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5ecc0f1e-4cad-489f-aeb1-03cf73ecaddd req-b3173fa9-3bfb-4800-9ffe-9c541b13b201 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:09:09.746419 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-5ecc0f1e-4cad-489f-aeb1-03cf73ecaddd req-b3173fa9-3bfb-4800-9ffe-9c541b13b201 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:09:09.758626 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-5ecc0f1e-4cad-489f-aeb1-03cf73ecaddd req-b3173fa9-3bfb-4800-9ffe-9c541b13b201 service nova] Creating event network-changed:21884182-126a-4a23-94b7-011638a5aec4 for instance 67d30614-959f-4199-a552-15df900f1e05 on n-h2-781139-2 Oct 03 16:09:09.764090 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-5ecc0f1e-4cad-489f-aeb1-03cf73ecaddd req-b3173fa9-3bfb-4800-9ffe-9c541b13b201 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093165 Oct 03 16:09:09.764700 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4082/7994] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:36.835281 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=22 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:36.836741 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=50 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:36.838491 n-d-781139-2 devstack@n-api.service[128868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 16:10:36.838975 n-d-781139-2 devstack@n-api.service[128868]: Mon Oct 3 16:10:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05/action (ip 10.222.0.20) !!! Oct 03 16:10:36.845775 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2047465437"}} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:36.848191 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:36.856517 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:36.857030 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:36.857471 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:36.858165 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:36.858617 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:36.859046 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:37.086430 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-46c70047-662d-40e2-b08a-b21dfa93ae82 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "POST /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05/action" status: 202 len: 0 microversion: 2.1 time: 0.254444 Oct 03 16:10:37.087318 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3913/7995] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 3 16:10:36 2022] POST /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 03 16:10:42.283710 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:42.284645 n-d-781139-2 devstack@n-api.service[128869]: DEBUG dbcounter [-] [128869] Writing DB stats nova_cell1:SELECT=44 {{(pid=128869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:42.296428 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-cd8bf05d-c6a2-43d4-a934-dc318e006031 req-46f00bd7-1c03-407f-a216-096873abc8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d30614-959f-4199-a552-15df900f1e05", "name": "network-vif-plugged", "status": "completed", "tag": "21884182-126a-4a23-94b7-011638a5aec4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:42.311931 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cd8bf05d-c6a2-43d4-a934-dc318e006031 req-46f00bd7-1c03-407f-a216-096873abc8c5 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:42.313058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cd8bf05d-c6a2-43d4-a934-dc318e006031 req-46f00bd7-1c03-407f-a216-096873abc8c5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:42.313058 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-cd8bf05d-c6a2-43d4-a934-dc318e006031 req-46f00bd7-1c03-407f-a216-096873abc8c5 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:42.349191 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-cd8bf05d-c6a2-43d4-a934-dc318e006031 req-46f00bd7-1c03-407f-a216-096873abc8c5 service nova] Creating event network-vif-plugged:21884182-126a-4a23-94b7-011638a5aec4 for instance 67d30614-959f-4199-a552-15df900f1e05 on n-h2-781139-2 Oct 03 16:10:42.360403 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-cd8bf05d-c6a2-43d4-a934-dc318e006031 req-46f00bd7-1c03-407f-a216-096873abc8c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079603 Oct 03 16:10:42.361254 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4083/7996] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:51.209663 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_api:SELECT=2 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:51.210673 n-d-781139-2 devstack@n-api.service[128868]: DEBUG dbcounter [-] [128868] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:51.215533 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:51.216550 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:51.223727 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:51.224293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:51.225164 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:51.225952 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:51.227110 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:51.227603 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:51.258975 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Going to try to terminate instance {{(pid=128868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:10:51.276465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [req-2d74fa44-de16-42b6-93e5-69c901c926cd req-3513446a-5383-4dc1-ae5a-d8dc767f5aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d30614-959f-4199-a552-15df900f1e05", "tag": "21884182-126a-4a23-94b7-011638a5aec4"}]} {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:51.288508 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d74fa44-de16-42b6-93e5-69c901c926cd req-3513446a-5383-4dc1-ae5a-d8dc767f5aea service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:51.289353 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d74fa44-de16-42b6-93e5-69c901c926cd req-3513446a-5383-4dc1-ae5a-d8dc767f5aea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:51.290142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [req-2d74fa44-de16-42b6-93e5-69c901c926cd req-3513446a-5383-4dc1-ae5a-d8dc767f5aea service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:51.303082 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.compute.server_external_events [req-2d74fa44-de16-42b6-93e5-69c901c926cd req-3513446a-5383-4dc1-ae5a-d8dc767f5aea service nova] Creating event network-changed:21884182-126a-4a23-94b7-011638a5aec4 for instance 67d30614-959f-4199-a552-15df900f1e05 on n-h2-781139-2 Oct 03 16:10:51.308881 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [req-2d74fa44-de16-42b6-93e5-69c901c926cd req-3513446a-5383-4dc1-ae5a-d8dc767f5aea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099540 Oct 03 16:10:51.309626 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4084/7997] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:51.356460 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-d066d794-3b62-45f3-8faf-bb7d88b3f65a tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "DELETE /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 204 len: 0 microversion: 2.1 time: 0.149410 Oct 03 16:10:51.358250 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3914/7998] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 16:10:51 2022] DELETE /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:10:51.367890 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:51.368757 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:51.376203 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:51.376832 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:51.377423 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:51.378219 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:51.378848 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:51.379376 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:51.521204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:10:51.529576 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-eedc5cf0-deb3-4142-860b-c0586ca09b42 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1683 microversion: 2.1 time: 0.166857 Oct 03 16:10:51.530132 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4085/7999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:51 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 16:10:52.294661 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-c1df30fb-5436-4a83-9b0d-303a8dbb2c84 req-ea365f39-bc0b-44ab-9957-6deff707ec90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d30614-959f-4199-a552-15df900f1e05", "name": "network-vif-unplugged", "status": "completed", "tag": "21884182-126a-4a23-94b7-011638a5aec4"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:52.306628 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c1df30fb-5436-4a83-9b0d-303a8dbb2c84 req-ea365f39-bc0b-44ab-9957-6deff707ec90 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:52.307033 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c1df30fb-5436-4a83-9b0d-303a8dbb2c84 req-ea365f39-bc0b-44ab-9957-6deff707ec90 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:52.307658 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-c1df30fb-5436-4a83-9b0d-303a8dbb2c84 req-ea365f39-bc0b-44ab-9957-6deff707ec90 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:52.319496 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-c1df30fb-5436-4a83-9b0d-303a8dbb2c84 req-ea365f39-bc0b-44ab-9957-6deff707ec90 service nova] Creating event network-vif-unplugged:21884182-126a-4a23-94b7-011638a5aec4 for instance 67d30614-959f-4199-a552-15df900f1e05 on n-h2-781139-2 Oct 03 16:10:52.324525 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-c1df30fb-5436-4a83-9b0d-303a8dbb2c84 req-ea365f39-bc0b-44ab-9957-6deff707ec90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034028 Oct 03 16:10:52.325195 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3915/8000] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:52.554602 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:52.555329 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:52.562746 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:52.563246 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:52.563690 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:52.564421 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:52.564869 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:52.565322 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:52.730309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:10:52.744550 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-59276ba6-03eb-4088-96f7-1e1b5b745a46 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1683 microversion: 2.1 time: 0.194006 Oct 03 16:10:52.745283 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4086/8001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:52 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:53.327024 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-128a71a4-5bc8-48bd-b56b-355b55e87234 req-57c55aed-3fe7-4f44-adce-0e331b346dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d30614-959f-4199-a552-15df900f1e05", "name": "network-vif-deleted", "tag": "21884182-126a-4a23-94b7-011638a5aec4"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:53.339220 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-128a71a4-5bc8-48bd-b56b-355b55e87234 req-57c55aed-3fe7-4f44-adce-0e331b346dad service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:53.339699 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-128a71a4-5bc8-48bd-b56b-355b55e87234 req-57c55aed-3fe7-4f44-adce-0e331b346dad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:53.340122 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-128a71a4-5bc8-48bd-b56b-355b55e87234 req-57c55aed-3fe7-4f44-adce-0e331b346dad service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:53.352945 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-128a71a4-5bc8-48bd-b56b-355b55e87234 req-57c55aed-3fe7-4f44-adce-0e331b346dad service nova] Creating event network-vif-deleted:21884182-126a-4a23-94b7-011638a5aec4 for instance 67d30614-959f-4199-a552-15df900f1e05 on n-h2-781139-2 Oct 03 16:10:53.358853 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-128a71a4-5bc8-48bd-b56b-355b55e87234 req-57c55aed-3fe7-4f44-adce-0e331b346dad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037715 Oct 03 16:10:53.359455 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3916/8002] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:53.768204 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:53.768995 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:53.776515 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:53.777047 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:53.777505 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:53.778223 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:53.778691 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:53.779142 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:53.811799 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:53.812288 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:53.812738 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:53.813245 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lazy-loading 'fault' on Instance uuid 67d30614-959f-4199-a552-15df900f1e05 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:10:53.855009 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:10:53.862216 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-b2741de8-9da8-4d53-8b89-3edaac1ad8a9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 200 len: 1339 microversion: 2.1 time: 0.098394 Oct 03 16:10:53.862797 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4087/8003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:53 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:54.892038 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:54.893205 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 67d30614-959f-4199-a552-15df900f1e05] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:54.901140 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:54.901625 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:54.902062 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:54.902753 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:54.903208 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:54.903629 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:54.917258 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] HTTP exception thrown: Instance 67d30614-959f-4199-a552-15df900f1e05 could not be found. Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Request method failure captured: Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 HTTP/1.1 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwhRLQTDW-8dVsVZWjn0OhrjPEWgDxEctuCtXK3FY0PUPOfJPc6OUOoFGd8ahBJNdtfZ4imjGHDciUA-ibBWQRfegymXF54Qqn3y-6Eh0TA1IKV8TPh3_YVBAR2pdhxj1Oe2OmYn5Qr6RnpDkTgY8zASGdRAFMHmtMYdxpLIxoTmNYU Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c80c06c290ec4236843e59bc9129c52e Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestSnapshotPattern-1116052200 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c80c06c290ec4236843e59bc9129c52e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c80c06c290ec4236843e59bc9129c52e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c80c06c290ec4236843e59bc9129c52e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c80c06c290ec4236843e59bc9129c52e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestSnapshotPattern-1116052200 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c80c06c290ec4236843e59bc9129c52e Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestSnapshotPattern-1116052200 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestSnapshotPattern-1116052200-project Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 75fa8cbee0114281a5f6476905078614 Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestSnapshotPattern-1116052200-project Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 67d30614-959f-4199-a552-15df900f1e05 could not be found. Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '67d30614-959f-4199-a552-15df900f1e05'} Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d30614-959f-4199-a552-15df900f1e05 could not be found. Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d30614-959f-4199-a552-15df900f1e05 could not be found. Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:10:54.918884 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d30614-959f-4199-a552-15df900f1e05 could not be found. Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Returning 404 to user: Instance 67d30614-959f-4199-a552-15df900f1e05 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-9e28a544-0bba-4bc6-897b-a857566fc517 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05" status: 404 len: 111 microversion: 2.1 time: 0.036972 Oct 03 16:10:54.924448 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3917/8004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:54 2022] GET /compute/v2.1/servers/67d30614-959f-4199-a552-15df900f1e05 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:10:56.335467 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:56.336111 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:56.338183 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-127166e9-fc3e-4690-8f91-c35405c97c0e req-5f62f127-8704-4ceb-be58-8561e42feb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ad5dde-0550-4389-871f-4973275ccd06", "tag": "d7a1ff90-8859-4571-9838-61ff739eadd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:56.343935 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:56.344561 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:56.345145 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:56.345976 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:56.346552 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:56.347230 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:56.351983 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-127166e9-fc3e-4690-8f91-c35405c97c0e req-5f62f127-8704-4ceb-be58-8561e42feb32 service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:56.352731 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-127166e9-fc3e-4690-8f91-c35405c97c0e req-5f62f127-8704-4ceb-be58-8561e42feb32 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:56.353188 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-127166e9-fc3e-4690-8f91-c35405c97c0e req-5f62f127-8704-4ceb-be58-8561e42feb32 service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:56.364318 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-127166e9-fc3e-4690-8f91-c35405c97c0e req-5f62f127-8704-4ceb-be58-8561e42feb32 service nova] Creating event network-changed:d7a1ff90-8859-4571-9838-61ff739eadd7 for instance 00ad5dde-0550-4389-871f-4973275ccd06 on n-h1-781139-2 Oct 03 16:10:56.369790 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-127166e9-fc3e-4690-8f91-c35405c97c0e req-5f62f127-8704-4ceb-be58-8561e42feb32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035499 Oct 03 16:10:56.370739 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3918/8005] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:56.375852 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Going to try to terminate instance {{(pid=128869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 16:10:56.462812 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-f51b8057-190d-4ca8-b52c-fe7ce88f70c2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "DELETE /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 204 len: 0 microversion: 2.1 time: 0.131069 Oct 03 16:10:56.464529 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4088/8006] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 3 16:10:56 2022] DELETE /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 16:10:56.472632 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:56.473408 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:56.479814 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:56.481146 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:56.481806 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:56.482514 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:56.482968 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:56.483394 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:56.633744 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.policy [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:10:56.642464 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-a769c094-3570-44dc-b8d7-bee2b2345fb9 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1682 microversion: 2.1 time: 0.174067 Oct 03 16:10:56.643127 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3919/8007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:56 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:57.667565 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:57.668174 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:57.675685 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:57.676265 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:57.676807 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:57.677713 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:57.678187 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:57.678632 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:57.828261 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:10:57.836829 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c3d98cfe-501a-4c82-a72f-965702ce05bc tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1682 microversion: 2.1 time: 0.173836 Oct 03 16:10:57.837436 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4089/8008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:57 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:58.382761 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [req-93a40537-b265-4754-bdc8-b0a615ab6a7c req-be9c6f39-3021-44fb-a72b-46ad27312e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ad5dde-0550-4389-871f-4973275ccd06", "name": "network-vif-deleted", "tag": "d7a1ff90-8859-4571-9838-61ff739eadd7"}]} {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 16:10:58.393293 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-93a40537-b265-4754-bdc8-b0a615ab6a7c req-be9c6f39-3021-44fb-a72b-46ad27312e2c service nova] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:58.393856 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-93a40537-b265-4754-bdc8-b0a615ab6a7c req-be9c6f39-3021-44fb-a72b-46ad27312e2c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:58.394716 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [req-93a40537-b265-4754-bdc8-b0a615ab6a7c req-be9c6f39-3021-44fb-a72b-46ad27312e2c service nova] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:58.406057 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.compute.server_external_events [req-93a40537-b265-4754-bdc8-b0a615ab6a7c req-be9c6f39-3021-44fb-a72b-46ad27312e2c service nova] Creating event network-vif-deleted:d7a1ff90-8859-4571-9838-61ff739eadd7 for instance 00ad5dde-0550-4389-871f-4973275ccd06 on n-h1-781139-2 Oct 03 16:10:58.410829 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [req-93a40537-b265-4754-bdc8-b0a615ab6a7c req-be9c6f39-3021-44fb-a72b-46ad27312e2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031810 Oct 03 16:10:58.411437 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3920/8009] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 3 16:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 16:10:58.860860 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:58.861465 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.compute.api [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:10:58.868851 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:58.869379 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:58.869938 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:58.870961 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:58.871434 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:58.871920 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:58.908725 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:10:58.909232 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:10:58.909684 n-d-781139-2 devstack@n-api.service[128869]: DEBUG oslo_concurrency.lockutils [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:10:58.910148 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.objects.instance [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lazy-loading 'fault' on Instance uuid 00ad5dde-0550-4389-871f-4973275ccd06 {{(pid=128869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 16:10:58.957304 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.policy [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75fa8cbee0114281a5f6476905078614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80c06c290ec4236843e59bc9129c52e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 16:10:58.966962 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-8a55b4c6-34b3-4e07-8a07-fc3b32eebf3f tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 200 len: 1338 microversion: 2.1 time: 0.109726 Oct 03 16:10:58.967612 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4090/8010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:58 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 16:10:59.994928 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '>' {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:10:59.996203 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.compute.api [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] [instance: 00ad5dde-0550-4389-871f-4973275ccd06] Fetching instance by UUID {{(pid=128868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 16:11:00.003702 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:11:00.004238 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:11:00.004728 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:11:00.005538 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Acquiring lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 16:11:00.006035 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 16:11:00.006495 n-d-781139-2 devstack@n-api.service[128868]: DEBUG oslo_concurrency.lockutils [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Lock "54ca0d6f-7d1c-418e-8501-0d401bcb0ee5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 16:11:00.023259 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.wsgi [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] HTTP exception thrown: Instance 00ad5dde-0550-4389-871f-4973275ccd06 could not be found. Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Request method failure captured: Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: request: GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 HTTP/1.1 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: Accept: application/json Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: Accept-Encoding: identity Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: Connection: close Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: Content-Length: 0 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: Content-Type: application/json Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: Host: 10.222.0.20 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: Openstack-System-Scope: None Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: User-Agent: python-urllib3/1.26.12 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Auth-Token: gAAAAABjOwhRLQTDW-8dVsVZWjn0OhrjPEWgDxEctuCtXK3FY0PUPOfJPc6OUOoFGd8ahBJNdtfZ4imjGHDciUA-ibBWQRfegymXF54Qqn3y-6Eh0TA1IKV8TPh3_YVBAR2pdhxj1Oe2OmYn5Qr6RnpDkTgY8zASGdRAFMHmtMYdxpLIxoTmNYU Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Id: None Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Domain-Name: None Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Identity-Status: Confirmed Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Is-Admin-Project: True Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Id: default Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Domain-Name: Default Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Id: c80c06c290ec4236843e59bc9129c52e Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Project-Name: tempest-TestSnapshotPattern-1116052200 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Role: member,reader Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Roles: member,reader Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c80c06c290ec4236843e59bc9129c52e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c80c06c290ec4236843e59bc9129c52e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c80c06c290ec4236843e59bc9129c52e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c80c06c290ec4236843e59bc9129c52e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant: tempest-TestSnapshotPattern-1116052200 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Id: c80c06c290ec4236843e59bc9129c52e Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-Tenant-Name: tempest-TestSnapshotPattern-1116052200 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-User: tempest-TestSnapshotPattern-1116052200-project Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Id: default Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-User-Domain-Name: Default Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-User-Id: 75fa8cbee0114281a5f6476905078614 Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: X-User-Name: tempest-TestSnapshotPattern-1116052200-project Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: method: > Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: exception: Instance 00ad5dde-0550-4389-871f-4973275ccd06 could not be found. Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: action_args: {'id': '00ad5dde-0550-4389-871f-4973275ccd06'} Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: {{(pid=128868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ad5dde-0550-4389-871f-4973275ccd06 could not be found. Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ad5dde-0550-4389-871f-4973275ccd06 could not be found. Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 16:11:00.024979 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ad5dde-0550-4389-871f-4973275ccd06 could not be found. Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: ERROR nova.api.openstack.wsgi Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: DEBUG nova.api.openstack.wsgi [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Returning 404 to user: Instance 00ad5dde-0550-4389-871f-4973275ccd06 could not be found. {{(pid=128868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: INFO nova.api.openstack.requestlog [None req-cc866672-b58b-4d70-b0da-de2f8ad261fe tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06" status: 404 len: 111 microversion: 2.1 time: 0.037743 Oct 03 16:11:00.030223 n-d-781139-2 devstack@n-api.service[128868]: [pid: 128868|app: 0|req: 3921/8011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 3 16:10:59 2022] GET /compute/v2.1/servers/00ad5dde-0550-4389-871f-4973275ccd06 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 16:11:00.187309 n-d-781139-2 devstack@n-api.service[128869]: DEBUG nova.api.openstack.wsgi [None req-c5cb6fc5-400f-46aa-83d3-3f1a3db81be2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] Calling method '.version_select at 0x7fb22be67820>' {{(pid=128869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 16:11:00.216396 n-d-781139-2 devstack@n-api.service[128869]: INFO nova.api.openstack.requestlog [None req-c5cb6fc5-400f-46aa-83d3-3f1a3db81be2 tempest-TestSnapshotPattern-1116052200 tempest-TestSnapshotPattern-1116052200-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2024640210" status: 202 len: 0 microversion: 2.1 time: 0.033015 Oct 03 16:11:00.221393 n-d-781139-2 devstack@n-api.service[128869]: [pid: 128869|app: 0|req: 4091/8012] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 3 16:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-2024640210 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)